I would have not stopped the game to get my rulebook. If you do that once, it will be expected the next time. You needed to have a "private" conversation with your partner and "convince" him of what the rule was. If that did not work, we would have just done what he suggested and moved on. Then I would not have called anymore double fouls the rest of the game.
Peace