As the umpire, I would be inclined to wait for the end of rally, check with the scorer, and then inform the up referee of the violation. S/he can then call the violation and make the incorrect server signal and award the point/loss of rally.
The playing captain may request verification of the proper server for the opposing team during any dead ball (Rule 6-2-2). Proper procedure would be to wait for the end of rally/dead ball and then have the floor captain request a check for the correct server on the opposing team.
As you note, once the improper server is detected all points previously scored by that server are cancelled and a point/loss of rally is awarded to the opposing team. The only proviso is that that must occur before the opposing team serves - once they serve, the points stand and are non-correctable.
-Homer-
|