If I was the official you spoke with originally, I wouldn't have minded if you approached me prior to the start of the second half, explained what happened and then asked me to approach the other official to tell him he misheard you.
If, as you say, he had an accent, perhaps he just thought you said "b***s***" instead of "push off". To someone for whom English might be a second language who was standing some distance away, it might have sounded like that.
An alternative would have been to contact the immigration and naturalization service after the game to have them check on the guy's legal status.
Also, if the guy called me a liar, I would have smacked him upside the head with a frying pan.