I can only suggest that you do what is right for you. I was in similar position and decided that I was going to keep Sundays free to spend with my family. That immediately kicked out the church leagues I was doing. Then I would just let the guys who helped me along the way know I was unavailable unless they were really in a bind. Then if they did call back I would tell them that I would try to get someone for them. There are usually plenty of younger officials who want to work. Ask the secretary of your board for a list of the new applicants or the newest members of your board, call them up and give them those games. No feelings hurt and less wear and tear on your legs.

Hope this helped.

have fun - - Suppref