I view the one minute rule as a tool to stop unnecessary delay, not a precise time limit as in the time for a basketball team to bring the ball into the front court. Personally, if I notice lolly-gagging, I'll start the mental count. Sure, your games may finish a bit sooner than mine, but if I wanted to speed things up, I could always just call more time outs.
Most pitchers here only take 3 pitches after the first inning. The summer leagues have conditioned them, I think (it is a league rule there: 5 first inning, 3 thereafter.)