In my state this is not one of the 6 things a coach or player could do to get ejected. Ejection requires filling out forms and notifying the state and often results in fines and in some cases coaches losing their jobs.

Restriction to the dugout is required for lesser offenses and do not require forms and fines. It's almost like a technical foul in basketball, because if he does it again from the bench he is ejected, and there are forms to fill, etc. I would certainly restrict the coach if I was either the PU or the BU in this situation. If I was PU I expect I would beat my partner to it since I am closer.

In anything other than HS ball I would eject for comments made to fans like this guy did and if he is the only coach then the game is over and I don't feel like I am cheating the players at all. He did by his behaviour.