If someone has not called you "the worst official I have ever seen," then you have not officiated long enough or you are not doing your job. It comes with the territory.
I had a football game a few weeks ago and after the game a fan came up to us and said, "that was the worst football game I have ever seen officiated and you are the worst officials I have ever seen." This guy's tone was so blah and monotone that it was funny. My crew joked that later and said he did not sound mad enough and could have put more feeling into his words. We were thinking that we should have told him, "You do not sound mad enough, you need to sound more upset. That was the lamest approach we have ever had, go back to the drawing board." Well that is what we wanted to say. I wanted to laugh in the man's face.
You gotta love this thing we call officiating.
Peace