[5 sport ref]

IMHO you made the right call. I tend to err on the side of safety and any movement to avoid getting hit is trying to get out of the way. In many games the pitchers overmatch the batters and the batters my have slower reactions.

I think you made the right call.