It's not a correctable error, but the calling official could have had you change it at any time if he had definite knowledge that a screw-up had been made. If everyone else at the table backed you up, maybe his memory could have been "jogged." If not, let it go.
Once you become a referee and work a lot of games, you'll understand why we're a loyal group and we "have each other's back." Calling a referee an idiot is way, way, way, way out of line. Very poor judgment on your part. Besides, if his association thought he was as bad as you do, he wouldn't get varsity games.
Z