[BktBallRef]

By rule, you were correct.

But since there was confusion, I would not have started the count.

I don't normally start the count until a player for the throwing team has the ball, unless I think they are intentionally delaying the throw-in.