I don't care about this that much, sometimes the inbounder makes the pass and just stands there waiting to see if their super-secret inbound play worked. Unless he ends up staying OOB and running around to gain an advantage then I leave it alone. They usually come back in pretty quick when they realize it doesn't help their team playing 5 on 4.