I think you did the right thing. Obviously, this guy's mind wasn't going to be changed and he was probably just looking for you to admit it was a weak call.
Better to keep walking than give him some ammunition against you the next time you work one of their games.