Also, by stating your partner "jumped all over you" for not making the call, I assume he wasn't very constructive in his criticism. I would be tempted to ask him, when the last perfect game was he worked!?!
And if he thought it REALLY needed to be called, then he should have called himself, even if it was out his primary.