Maybe I am just missing some point, but I don't understand why the officials woulnd't stay around long enough to make sure everything is ok after the game. I have made some major blown calls, but never felt any kind of fear from officials, the fans, or any of the players, even if there were problems from the game.
OK, I'm just going to ignore relating this to swimming because they are not even close!
I would submit to you that if you were officiating soccer overseas (read: Europe, South America, etc. where they are NUTS about soccer) you would be running off the field!
I echo the sentiments of the other folks that replied -- you are closer to the fans, etc. and there is more potential for problems. Unless the score is within 2-3 points, there is no reason to stick around or check anything -- i.e. if it is a 10-20 point game or more there will be not disputes over the winner, so get the heck outta dodge.