[just another ref]

Back in November(?) I posted a thread on a situation where I gave the warning and then called the T in a boys varsity game with 1 second left. The coaches of the offended team went nuts. The next time I talked to the assignment secretary he told me not to "make any more of those two-bit
calls." He also told me several times that "technically, you were right," but went on to explain that "you have to give them a little something," or something like that. When I posted the question here, I believe that everyone who answered said that they would have called it the same way. I am still annoyed and confused by this issue. What about it? Does anyone else consider this a "two-bit" call?
When the defender is over the line up to his armpits do you simply ignore it or repeatedly warn and tell him to back up or what?