GEH be damned...
The only time I'm touching the bat is in this situation. A slight kick will usually get it out of the way, and no one's the wiser. Besides, everyone else is usually watching the ball, not me.
Now if I slip and fall on my butt... (no, that hasn't happened yet.)