They should really change the rule to when the ball becomes live (preferable), or perhaps if there is a turnover. Imagine an offensive foul during a throw-in when no time runs off the clock. Coach now wants his big guy in for offense/defense, but no subs are allowed.