[MD Longhorn]

If, as T said, we are BUILDING a system of evaluation for umpires, NO, I would not want to take coaches' opinions or input into account. I understand the political necessity of ASKING for their opinion (and I like Rut's thought of rating instead of evaluating... although I think ranking might be better)... but often an umpire that is well liked is not a good umpire. I can't tell you how many times I've walked onto a high school field with Country Bob, who said hey howdy hello to most coaches (by name) and the occasional fan, had a boisterous plate conference, and then tries to award 1 plus 1, or doesn't call obstruction "because they don't like it when you do".

If I am BUILDING a system, I'd begin with the premise that we have enough umpires and evaluators that we can pay them to watch other umpires. I'd have partners anonymously evaluating partners, and ensure that everyone was seen and rated enough that a bad game isn't the end for someone, and the tendencies of the reviewer get averaged out over time.