This has always bugged me

[bob jenkins]

Although the words say "the pitching regulations begin when the pitcher intentionally contacts the rubber with the pivot foot", they really mean "the pitching regulations begin after the pitcher has gotten "comfortable" on the rubber."

So, if there was some delay between getting on the rubber and removing the ball, call it. If it was all part of the motion to look in for the sign, then let it go.