You should watch the scoreboard the entire game.
How else are you going to make sure that the foul totals stay even and that the home team always has more points?
You also have to be aware of what the score is and how much time is left, so that you know when that pivotal call the vociferous coach's team really needs arises.