I confess to doing the same thing, though I didn't get the same reaction you did. I'm sure someone noticed though.
I'm currently battling the habit of raising my hand in anticipation of an infraction, like the opposite of an inadvertant whistle. That surely raises eyebrows every now and then, but have not yet been called out on it. I'm sure some coach wants to tell me to "go ahead and get some air in that whistle. You wanted to, why didn't you?"