substitution violation - not leaving huddle immediately

[don't move]

I would like to get a feel for how close everyone is calling illegal substitution for not leaving huddle immediately. I was a spectator at a HS game last Saturday and that foul was called three time. I wouldn't have called any. How do you define immediately? I try to use discression - advantage, disadvantage - the spirit of the rule.
Comments?