As long as you did your best...that's what counts.
You do bring up an interesting point, though.
Some people perceive this type of banter as good-natured ribbing...like on the golf course when you're playing partner hits it out-of-bounds and you say "Why'd you hit it over there?" (malicious would be: "You f***ing idiot!"
Oh, well. To each his own.