While on the clock, I've had a few occasions where I've gone based on the hand because the whistle cannot be heard. Of course, for this to work, you need a timer who is paying attention (

) and knows that a violation/foul is about to occur or has occurred, and realizes the clock hasn't stopped yet.
Most of the time, though, I go off of the whistle.