Did you discuss the exchange with your partner at halftime? If so, what did he say? I know if I'm the R or the more experienced official, I would definitely talk with my partner about this. Now if he wasn't receptive, then the time tested method of get in, get done, get out always works.

Everyone who went before you.