Strange Balk Call

[Jason Blakely]

Hello,

Runner on second, pitcher in the stretch. F4 feints to second as if a pick-off is on, but drops back to position when R2 shortens his lead. The pitcher, seeing F4's break for second, jump turns to pick - but half way in his jump realizes F4 has returned to position. The pitcher, already committed to throwing, manages to throw to F4 at his normal position 15-20 feet away from second base, so as not to throw it to centerfield.

Umpire calls a balk because the pitcher did not pick off to a base. Is this right?

Thanks,
Jason