2 outs - team leaves playing area

[NY Softball]

I had a Varsity HS game in NYS this week as PU. The second baseman caught a fly ball to make the second out of the game. After the catch the entire defensive team left the field and met their coaches who had come out behind the fence and near the first baseline. I signal two outs to the BU and he replies confirming two outs. A batter is standing near the batter's box ready to bat and no baserunners were on. I called dead ball and told the defensive team that there is only two outs. Luckily there were no runners on as this could have been a chaotic situation. After I got home, I searched the rule book (ASA) and couldn't find anything that addressed how to administer this situation. Anyone know of a ruling to control this type of situation?