What's to worry about? It's an easy T. The player is accusing your partner of a racial bias and implying that you will have his back, also based on race.
It's no different than dropping the N-word on somebody while he's out there, but it's okay if only you could hear it, and it won't show up on tape.
Not to mention that your other 4 foul calls on this player will also be on tape, and how do you defend a ticky-tac call on him when you've let the same thing go on other players when/if your assignor asks?
He called my partner a racist, so I fouled him out. Yep, that's a much better solution.