I've also started using "replaces" instead of "for" since this discussion. But the larger problem, I find, is making sure I have the scorekeeper's attention. Inevitably the friend I asked to leave the score table 2 minutes ago comes back during play. If for this reason alone, it's MUCH more useful to be back at the table rather than out on the sideline.
As for the friend, it's a shame there are always so many witnesses.