My thoughts on this are:
1) If you are calling a solid game, and your calls are obvious to anyone, no need to worry about gripes.
2) Game management. Calmly talk to coach(es) regardless of their demeanor. Be able to explain and defend your call with rule book (if necessary).
3) Stay consistent throughout. Calls in the first quarter should be calls in the fourth.
4) If the first three fail, whack away!!