Good thing I wasn't working the game. I would have walked up to the stands and asked (just as he did) "Now who thinks other than the coach that he should be tossed from the game?"
If they agree you follow up with "Well at least we agree on something" and toss him. If not "Well you're not going to agree with anything I do" and toss him as well. Showmanship is not always for the coach.
Although 90% of the time I would dump quick and fast from right field.