I actually think that it is funny. If I was the official I would probably be a little annoyed if you were staring me down. But at that time I would probably go talk to my partner to let him/her know what is going on so that we don't have a problem later.
P.S. It being a "jerk move"...don't most officials already think coaches are jerks? You were just fulfilling your role
j/k