I'm a pointer as well - always to the right, and I turn my head when I do it unless it is a dropped third strike. Then I am pointing while tracking the ball, and following with a safe sign to indicate the dropped ball (or out if the situation dictates).
And this may seem petty, maybe because I keep hearing in my head my mother nagging "never point at someone," but I always try to make sure my "point" is about halfway between the 1st base coach and the home dugout - so my mother would be happy that I'm not pointing directly at someone!