[BillyMac]

We used to work on the refresher exam as individuals in an open book format. The exam would then be submitted to our rating committee who would correct the exam, with each member getting rating points based on how many questions each member got right on the refresher exam. Our rating system (peer ratings, refresher exam, meeting attendance, availability) produces a ranking, and the number, level, and quality of your assigned games is based on this ranking, so it's a big deal.

The problem was that there were too many master answer sheets available from many sources, within our local board, from other boards in the state, and from other states. These master answer sheets somehow made their way into the hands of a large portion of our membership. If you "knew a guy" then you able to get your hands on these master answer sheets. If you weren't "connected" then you were on your own. Those with the master answer sheets always got full credit, and the full number of rating points for their answers. Those without access to these master answer sheets almost always got far fewer answers correct, and thus, a lower number of rating points.

How did our rating committee fix this? They gave up. Now we still work on the exam as individuals with an open book format. Then we bring our test and answers to one of several officially sanctioned "study groups". Your "ticket" into one of these "study groups" is a completed exam, with no regard for the number of correct, or incorrect, answers. The group leader, usually a veteran official, has the master answer sheet. At these sessions we take turns reading the questions, giving our answers, discussing our answers, and correcting our incorrect answers. Attendance is taken at these "study groups".

If you attend one of these officially sanctioned "study groups", then you get full credit for the refresher exam portion of your rating for the season. If you don't attend, you get no credit. If you have an emergency (family, work, illness, etc) and can't attend, then you have the option of handing in an exam that will be corrected and counted the "old fashioned" way, but at this point almost everybody on our local board has the correct answers so it's all academic at this point.