Whack him. I don't do verbal counts on this, regardless. I might make my visual count a little exaggerated, but it's not going to be audible.
The T becomes easy and simple when he adds "what's your problem." I would have answered him differently after the game, though. That comment might lead to other problems if your assigner isn't so understanding. Then again, it's wreck league; thus making the T easier and the comment more acceptable.
Well done.
Oh, and yes, I agree with JR that jeffpea's advice is, well, not optimal.