Ref from the scorers table?

[A Man for All Seasons]

I attended my sons recreation basketball game and was stunned to see only one ref had showed up and so the one person keeping the scorebook and the Clock was also calling fouls, called 4 fouls the whole game. Including a foul that decided the game in double overtime. Has anyone ever seen this before and is there a rule for or against this?