Inadvertent Whistle?

[Endzone]

Fourth and four on K's 45 yard line. The ends for K are tight and properly numbered in a three point stance. The punter gives a "hard" count and the two ends simultaneously back off the line with their hands up in front of them as if blocking.

Referee and linejudge throw flags and blow the play dead. "False start by the kicking team." K's coach says they've done nothing wrong. They were only in the process of shifting. The white hat agreed and waived off the flags.

I contend that it was obvious the play was designed to draw the defense off sides and the kicking team should have been penalized. Your thoughts, please.