Taking Signs

[LDUB]

I know that the rule book says that the pitcher must take his signs while on the rubber. Ok, so pitcher takes his sign off the rubber, then he steps on and goes straight to the set position. Then if he pitches, the it is a balk, so I would call time at the end of playing action and enforce it, assuming the pitch was a strike and no one advanced?