Giving Penalty Signals mechanic

[tskill]

I do quite a bit of lower level JV NFHS games where we normally have a 3 man crew and typically these games are played on fields that are of course not the varsity field and usually don't have a press box or even stands for the spectators.

My question is with the Referee giving the signals for a penalty. Since there is no press box, what do other people do? Do you still face the home team and give the signal and thats it? I've seen many white hats that give the signals to the home side then turn around and give it again to the visitor side.

Any suggestions?