Board Ratings And Rankings

[All_Heart]

Originally posted by ChuckElias
Bill, I'm Board 31, just north of you in Springfield. We don't have a ratings system anymore, so I can't really give you any input into that. The college ratings (for ECAC) give the coaches some input; but also include the open book test, peer ratings, attendance at the rules clinic and the assignor's rating.

My question is: why are JV officials rating Varsity officials? I don't think I'd be real comfortable with a 2nd year official rating me.

Great point Chuck. I wouldn't want to be evaluated by JV officials either. I know that when I was a JV official I was not in the position to tell the Varsity officials how they did. (Even though I thought I was )

[Edited by All_Heart on Mar 20th, 2006 at 10:31 AM]

[Kostja]

Hi,

We have a somewhat similiar problem. We are presently working on a new system for coaching and evaluating referees in our local organisation. I have to say coaching our referees and improve their performances is of higher priority than generate a ranking. Yet, we would like to have something like a grade for their overall performance and how well they performed in certain categories, for example communication, fouls, violations (travel, 3 seconds, and so on ...).

In the past we had a standard form for the evaluators, where they could grade the ref in different categories. There was also a place to back up those grades with more details. The problem was, referees don't get better if you just tell them that they had a bad game, but don't give more details. On the other hand, if evaluators give more details (text), it is almost impossible to rank the referees by the different feedbacks we get from different evaluators. What do you do to ensure that your evaluators are on the same page (look for the same things) and that one evaluator/coach doesn't say one thing, and one week later another evaluator/coach says something completely opposite. How do you make sure you can compare reports from different evaluators? How can we train the evaluators/coaches to give proper ratings? This season the worst grade was b/c on an a-b-c-d scale, which means we have very good referees or something's wrong with the evaluations!!! We don't have enough evaluations to calculate an average for every referee, some of them get only one or two evaluations per season.

Any input on this is much appreciated.

Kostja