You've officially caught the refereeing bug! Good for you!
Caring about the avocation, wanting to get better and striving to improve your game will take you far. Keep reading the books and learning. Never become "that guy."
Also remember where you came from, so as you gain more experience you can give back, coach, and mentor the younger officials coming up.
PS - Don't LISTEN to the fans. Sheesh!
That may be the "second rule" of officiating!