This is a very tough question.  Personally, I don't want to retire when my abilities have declined.  If I can no longer keep up with the players and do my job as I have in my prime (still there I think 

  ) then it may be time to go out to pasture.  Even if you leave the field there are other ways you can stay involved in officiating.  Training, clock opertator, etc.