AD's generally have to be at most home basketball games, and seeing that many leagues schedule all of their games on the same nights each week, it's tough to get games in your area.
That said, it's a great area to get into (if you can give up the reffing.)
I know a lot of refs, though, who are intramural directors at various colleges and universities. Rec sports departments are generally very flexible about hours and scheduling.