Did you discuss the exchange with your partner at halftime? If so, what did he say? I know if I'm the R or the more experienced official, I would definitely talk with my partner about this. Now if he wasn't receptive, then the time tested method of get in, get done, get out always works.