Actually, it did happen to one of my partners last year. During play, he caught my eye and pointed to the men's room. I nodded that I understood and he just ran off the court. I moved into one-person position until he came back.
Of course, he told me before the game he wasn't feeling well. I just made sure we didn't share whistles.