The Official Forum  

Go Back   The Official Forum > Basketball

Reply
 
LinkBack Thread Tools Rate Thread Display Modes
  #1 (permalink)  
Old Thu Oct 19, 2017, 09:22am
Official Forum Member
 
Join Date: Dec 2015
Posts: 536
Frustrated about ratings system and postseason assignment

I went to a clinic last night that was hosted by our state's officiating coordinators, assigners, etc. I got a lot of good stuff out of it, so I'm glad that I went but I was extremely frustrated with their decision to let coach/AD ratings factor "heavily" into their decision of how far officials go. They talked about how that is one of the biggest parts of how far you go in the post season. Literally the next point they made was don't be afraid to whack a coach (when discussing new warning situations). The officials' coordinator went on to say something to the tune of "I saw way too many instances where the coach went too far and should have just gotten a T." As a guy that's trying to work my way up, I don't feel like I have the rapport or reputation to speak up yet but I really wanted to ask them how in the world we are supposed to be able to have a spine with coaches when THEY are the ones who factor heavily into postseason decisions.

This seems idiotic to me. Either you want us to give them a long leash and they decide how far I go in the post season, or you take coach/AD ratings out of it and we are able to take care of business when we need to. ONE coach last year of the 30 games I worked turned in an eval and he gave me zeros on EVERY. SINGLE. THING. Including "wore proper uniform," "showed up at the game," and stupid things like that. I whacked him early in the game for jumping on the court and screaming at me. Then he wanted to talk about it, and I told him he had lost his right to ask me about that when he treated me like one of his players. So that one guy factored pretty heavily into my post season because most coaches don't go fill one out if you're good, and that annoys the crap out of me. Every time an official evaluator came out to watch me, I scored above 4.3 (out of 5), and not many partners I worked with last year had higher averages than me. It pisses me off that the guys that know what to look for are saying I do a good job and one derelict coach can ruin it for me.

I'll just keep working on improving my communication and try to ignore the fact that these two ideas don't seem to be able to coincide harmoniously. The reality of the situation is if I want to move on farther this year, I'm going to have to give a lot more leash and let coaches get away with a lot more than I do.
Reply With Quote
  #2 (permalink)  
Old Thu Oct 19, 2017, 09:24am
Rich's Avatar
Get away from me, Steve.
 
Join Date: Aug 2000
Posts: 15,767
Is working an extra postseason game or two worth overlooking unsportsmanlike conduct for 50-60 other games?

The answer for me has always been.....no, it's not.


Sent from my iPhone using Tapatalk Pro
Reply With Quote
  #3 (permalink)  
Old Thu Oct 19, 2017, 09:28am
Official Forum Member
 
Join Date: Aug 1999
Posts: 18,016
If a coach deserves a T give it to him / her. That coach *might* give you a poorer rating, or s/he *might* realize that s/he deserved it. The other coach will *likely* rate you higher for taking care of business.
Reply With Quote
  #4 (permalink)  
Old Thu Oct 19, 2017, 10:01am
High Five Master
 
Join Date: Mar 2015
Location: Southwest Missouri
Posts: 669
This is the rating sx Missouri has always used since I’ve been an official. It’s F’ng ludicrous the coaches have ANY say, let alone the only say. Our ratings are 100% coach based.

That being said, we have parameters for postseason but they are rarely followed. Ratings index, career length, number of varsity contests in that reg season etc. all of them get ignored during postseason. Sometimes bc of shortage of officials, but mostly due to politics.

I would rather have a mix of coach, peer, assignor, evaluator, assn and written test scores be the basis for a rating.


Sent from my iPhone using Tapatalk
Reply With Quote
  #5 (permalink)  
Old Thu Oct 19, 2017, 10:10am
Official Forum Member
 
Join Date: Dec 2003
Location: Dallas, TX
Posts: 1,847
Quote:
Originally Posted by UNIgiantslayers View Post
I don't feel like I have the rapport or reputation to speak up yet but I really wanted to ask them how in the world we are supposed to be able to have a spine with coaches when THEY are the ones who factor heavily into postseason decisions.
Until you're able to do that, you're going to just have to be content to live within the confines of the mental boundaries you've created for yourself. I've been a member of several associations around the country, and there are none that make everyone happy when it comes to post-season assignments. When coaches have a say in who works their post season games, of course it causes a conflict of interest. But everyone is in the same pool - all you can control is what you can control. Observe the people who you respect and seem to have the respect of the "top" coaches and work far into the post season. See how they manage the game and the coaches and learn from them. Maybe request one of them as a mentor. If you really want to get to that level and these are the cards you've been dealt, you can get there by working on those game management skills just like you would any other part of your game.
Reply With Quote
  #6 (permalink)  
Old Thu Oct 19, 2017, 10:19am
Do not give a damn!!
 
Join Date: Jun 2000
Location: On the border
Posts: 30,463
Actually, if you enforce obvious rules, most coaches will respect you more than those that just turn a blind eye. For example, the coach that is always in the coaching box tends to like officials that will enforce the box when coaches are all over the court. Usually, they know these rules are not the ones you as the officials have made up. You just have to be right and you do not have to use the penalty to enforce those kinds of rules.

Bottom line, coaches will always have some say. They may not be the final say, but they have a say and should in many cases. The good coaches know who the good officials are. I would not worry about it any more than I worry about what a coach thinks of the job I do. I do what I feel is right and move on.

Peace
__________________
Let us get into "Good Trouble."
-----------------------------------------------------------
Charles Michael “Mick” Chambers (1947-2010)
Reply With Quote
  #7 (permalink)  
Old Thu Oct 19, 2017, 10:22am
Official Forum Member
 
Join Date: Dec 2015
Posts: 536
Quote:
Originally Posted by Smitty View Post
Until you're able to do that, you're going to just have to be content to live within the confines of the mental boundaries you've created for yourself. I've been a member of several associations around the country, and there are none that make everyone happy when it comes to post-season assignments. When coaches have a say in who works their post season games, of course it causes a conflict of interest. But everyone is in the same pool - all you can control is what you can control. Observe the people who you respect and seem to have the respect of the "top" coaches and work far into the post season. See how they manage the game and the coaches and learn from them. Maybe request one of them as a mentor. If you really want to get to that level and these are the cards you've been dealt, you can get there by working on those game management skills just like you would any other part of your game.
Agreed on all counts. As I said, I'll just do what I need to in order to try to keep getting better games and more post season assignments. It's just frustrating to see these things happen and not be able to speak up or do anything about it. Thanks for letting me vent and to those that have/will share their experience with this and how they deal with it.
Reply With Quote
  #8 (permalink)  
Old Thu Oct 19, 2017, 10:29am
Official Forum Member
 
Join Date: Nov 2014
Posts: 1,966
Quote:
Originally Posted by JRutledge View Post
Actually, if you enforce obvious rules, most coaches will respect you more than those that just turn a blind eye. For example, the coach that is always in the coaching box tends to like officials that will enforce the box when coaches are all over the court. Usually, they know these rules are not the ones you as the officials have made up. You just have to be right and you do not have to use the penalty to enforce those kinds of rules.

Bottom line, coaches will always have some say. They may not be the final say, but they have a say and should in many cases. The good coaches know who the good officials are. I would not worry about it any more than I worry about what a coach thinks of the job I do. I do what I feel is right and move on.

Peace
I don't think it's unreasonable that coaches get some say in who they feel the "best" officials are. After all, they are the ones that have a stake in the game. Sometimes I don't think we as officials give them enough credit to be as fair as they can in their evaluations (I'd rather have coach ratings than peer ratings which is what we have in SC). What there needs to be is a "check and balance" to throw out the "extreme" ratings on the high and low end of the spectrum.

But a 100% coach-driven rating system? That might be more ludicrous than the system we have where I live.
Reply With Quote
  #9 (permalink)  
Old Thu Oct 19, 2017, 10:56am
Do not give a damn!!
 
Join Date: Jun 2000
Location: On the border
Posts: 30,463
Quote:
Originally Posted by SC Official View Post
I don't think it's unreasonable that coaches get some say in who they feel the "best" officials are. After all, they are the ones that have a stake in the game. Sometimes I don't think we as officials give them enough credit to be as fair as they can in their evaluations (I'd rather have coach ratings than peer ratings which is what we have in SC). What there needs to be is a "check and balance" to throw out the "extreme" ratings on the high and low end of the spectrum.

But a 100% coach-driven rating system? That might be more ludicrous than the system we have where I live.
Whatever that supervisor told the officials, it is probably a line that is used to make a point. I doubt the coaches actually pick the officials that deeply. I bet the officials are ranked and that is used by the supervisor as needed. I think sometimes we get caught up in certain things when those things are not as deep or as important as stated.

All systems have flaws. People always complain in our system and coaches ratings are a small part of what we do or how we are considered for postseason games. And one person does all the assigning and he or she can make all kinds of decisions and do based off of things that clearly have nothing to do with ratings.

Peace
__________________
Let us get into "Good Trouble."
-----------------------------------------------------------
Charles Michael “Mick” Chambers (1947-2010)
Reply With Quote
  #10 (permalink)  
Old Thu Oct 19, 2017, 12:31pm
Official Forum Member
 
Join Date: Dec 2014
Posts: 1,742
This is a very good discussion. FWIW, I hate coach rating systems, but sometimes that's the only way to get a good evaluation sample size if there just aren't enough professional evaluators on the state staff. I would argue that coaches should be expected to submit evaluations for 'x'% of their games. That way, the coaches who don't meet that minimum would have their evaluations removed. And/or....you could exclude coach evaluations whose season averages are > one standard deviation above or below the mean. That way, the guys who always put "5" and the guys who always put "0" are not factored.

I kind of like the approach Rich took. If you stop caring about post-season assignments, you have the freedom to call your regular season games without looking over your shoulder so much. That's very liberating. Worked for me last year as a new guy in a new state when I knew I wasn't going to even sniff the post-season. When I saw a few of my buddies drive 150 miles to work a 1/16 first round blowout with a final score of 76-13 and a paycheck of about $15 more than a regular season game, I realized the Friday night conference rivalry nutcutter I had back in January was a heck of a lot more exciting to officiate.
Reply With Quote
  #11 (permalink)  
Old Thu Oct 19, 2017, 12:48pm
Official Forum Member
 
Join Date: Nov 2014
Posts: 1,966
It is true that no rating system is perfect. In an ideal world there would be no rating systems and it would be all evaluation-based, but the nature of high school basketball is that there are too many officials, too many schools, and not enough money to send an observer to every game. So in order for there to be at least some attempt at objectivity, that's where rating systems come in.

You could live in South Carolina, where your on-court ability means (literally) nothing for advancement.

25% statewide exam score (closed book, everyone takes in Columbia)
25% peer ratings
25% experience points (5% per year until maxed out after 5 years)
20% administrative (combination of meeting attendance, clinic participation, camp once every three years)
5% cooperation (lose points for turnbacks, etc.)

Most officials, in my experience, don't take the peer ratings seriously (we rate 1-10 in six different categories) and will give every partner a 9 or 10. Most officials receive all the other 50 points. What that leads to is the fact that the statewide exam is basically what determines your position in the rankings. An exam, not your on-court ability, determines where you're ranked as an official.

All varsity games, regular season and postseason, statewide are assigned centrally using the ranking list computed by this formula. There are officials at the top who have no business calling a varsity game and officials in the middle of the pack who are good enough to work state finals. Typically that's because the former group consists of good test-takers and officials whose only redeeming quality is knowing the rules really well.

All this to say, trust me when I say that every system has its flaws.
Reply With Quote
  #12 (permalink)  
Old Thu Oct 19, 2017, 04:52pm
Official Forum Member
 
Join Date: Aug 2008
Posts: 2,280
Quote:
Originally Posted by BlueDevilRef View Post
This is the rating sx Missouri has always used since I’ve been an official. It’s F’ng ludicrous the coaches have ANY say, let alone the only say. Our ratings are 100% coach based.

That being said, we have parameters for postseason but they are rarely followed. Ratings index, career length, number of varsity contests in that reg season etc. all of them get ignored during postseason. Sometimes bc of shortage of officials, but mostly due to politics.

I would rather have a mix of coach, peer, assignor, evaluator, assn and written test scores be the basis for a rating.


Sent from my iPhone using Tapatalk
At least in Missouri the coaches have to rate you, which balances things out at least some of the time. The way the OP described it, their coaches only put in a rating if they are upset with the job you did.
Reply With Quote
  #13 (permalink)  
Old Thu Oct 19, 2017, 07:00pm
Official Forum Member
 
Join Date: Dec 2015
Posts: 536
Quote:
Originally Posted by zm1283 View Post
At least in Missouri the coaches have to rate you, which balances things out at least some of the time. The way the OP described it, their coaches only put in a rating if they are upset with the job you did.
That's been my experience. I've gotten two evaluations in the past two seasons. Not two per season. Two total. Both of them did the same thing and gave me every negative rating they possibly could including some of the crazy ones that are obviously not true. That's my problem with it. Require them to rate us like we are required to do sportsmanship ratings (that don't even get used), or don't take them into consideration.
Reply With Quote
  #14 (permalink)  
Old Thu Oct 19, 2017, 07:49pm
Official Forum Member
 
Join Date: Aug 1999
Location: In the offseason.
Posts: 12,260
Quote:
Originally Posted by SC Official View Post

You could live in South Carolina, where your on-court ability means (literally) nothing for advancement.

25% statewide exam score (closed book, everyone takes in Columbia)
25% peer ratings
25% experience points (5% per year until maxed out after 5 years)
20% administrative (combination of meeting attendance, clinic participation, camp once every three years)
5% cooperation (lose points for turnbacks, etc.)

Most officials, in my experience, don't take the peer ratings seriously (we rate 1-10 in six different categories) and will give every partner a 9 or 10. Most officials receive all the other 50 points. What that leads to is the fact that the statewide exam is basically what determines your position in the rankings. An exam, not your on-court ability, determines where you're ranked as an official.
...

All this to say, trust me when I say that every system has its flaws.
Then that is the problem. The officials have it within their power to do the right thing but are not doing it. Can't blame the system when the system isn't used.

Are those ratings sufficiently anonymous so that an official could give an honest rating without fear of retaliation? It would have to be such that the scores would only become available to the officials after a large number were collected and the system closes.
__________________
Owner/Developer of RefTown.com
Commissioner, Portland Basketball Officials Association

Last edited by Camron Rust; Thu Oct 19, 2017 at 07:52pm.
Reply With Quote
  #15 (permalink)  
Old Fri Oct 20, 2017, 05:37am
Esteemed Forum Member
 
Join Date: Aug 2005
Location: Connecticut
Posts: 22,934
My Little Corner Of Connecticut ...

Regular season game (and league or conference postseason games) assignments are based on ratings by a trained observation team supplemented by peer ratings. Each official is rating either varsity or subvarsity and the number of regular season game assignments is based on the discretion of the assignment commissioner, who does a great job.

State tournament games are solely based on coaches votes. The more votes an officials gets, the further that official goes into the tournament. Connecticut has been doing it this way for tournament games for at least forty years, and believe it or not, coaches usually do a pretty good job of selecting the best officials. Every year I look at the tournament list of the thirty-plus officials selected from my local board for the state tournament and only have to scratch my head for one or two of the selected officials, and they're usually gone by the end of the first round.
__________________
"For God so loved the world, that he gave his only begotten Son, that whosoever believeth in him should not perish, but have everlasting life." (John 3:16)

“I was in prison and you came to visit me.” (Matthew 25:36)

Last edited by BillyMac; Fri Oct 20, 2017 at 05:53pm.
Reply With Quote
Reply

Bookmarks

Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is On
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Frustrated BatteryPowered Basketball 34 Mon Oct 05, 2015 11:10am
Ratings system Terrapins Fan Basketball 2 Sat Mar 16, 2013 02:37pm
State Association Ratings System Scratch85 Basketball 1 Mon Oct 08, 2012 05:13pm
Referee descriptors for ratings system.. zebraman Basketball 8 Mon Apr 11, 2005 04:25pm
Many Frustrated Questions! JimNayzium Football 16 Sun Nov 11, 2001 10:54pm


All times are GMT -5. The time now is 03:39am.



Search Engine Friendly URLs by vBSEO 3.3.0 RC1