The Official Forum

The Official Forum (https://forum.officiating.com/)
-   Softball (https://forum.officiating.com/softball/)
-   -   Cool Opportunity (https://forum.officiating.com/softball/59950-cool-opportunity.html)

argodad Wed Dec 01, 2010 05:20pm

Cool Opportunity
 
I've been asked to serve on Florida's NFHS exam-writing committee for this year. As part of the process, I get to submit ten multiple choice questions to the question pool. :cool:

Shoot me your ideas, please! (Even you, HugotoFirst, and any other FL folks.)

youngump Wed Dec 01, 2010 05:55pm

Quote:

Originally Posted by argodad (Post 704369)
I've been asked to serve on Florida's NFHS exam-writing committee for this year. As part of the process, I get to submit ten multiple choice questions to the question pool. :cool:

Shoot me your ideas, please! (Even you, HugotoFirst, and any other FL folks.)

This isn't really an answer to your question but more of a gripe. As someone who generally thinks that Umpire tests aren't very well structured, I'm not sure I'll be much help. But instead of the cryptic parsing challenges, I'd like to see multiple choice questions like these.
For all ten the choices are
a) Foul b) Do over c) Fair d) dead ball strike
1. The ball is lined off the bat into third base and then bounces into the dugout
2. The batter swings and is hit in the hand with the ball
3. The batter tries to dodge an errant pitch and the ball glances off the bat coming to rest on the plate
4. The batter swings and hits the ball into the foul pole
5. The batter swings and hits the ball; it comes to rest on the foul line
6. The batter swings and hits the ball, it hits between home first and the pitching plate then bounds between first and second and is first touched by a fielder in foul territory.

It'd be an easy test for anybody who knew the rules and a tough one for anybody who didn't. I'd make it no book and expect high scores.
________
DaemonBabes

RadioBlue Thu Dec 02, 2010 09:55am

Quote:

Originally Posted by youngump (Post 704399)
This isn't really an answer to your question but more of a gripe. As someone who generally thinks that Umpire tests aren't very well structured, I'm not sure I'll be much help. But instead of the cryptic parsing challenges, I'd like to see multiple choice questions like these.
For all ten the choices are
a) Foul b) Do over c) Fair d) dead ball strike
1. The ball is lined off the bat into third base and then bounces into the dugout
2. The batter swings and is hit in the hand with the ball
3. The batter tries to dodge an errant pitch and the ball glances off the bat coming to rest on the plate
4. The batter swings and hits the ball into the foul pole
5. The batter swings and hits the ball; it comes to rest on the foul line
6. The batter swings and hits the ball, it hits between home first and the pitching plate then bounds between first and second and is first touched by a fielder in foul territory.

It'd be an easy test for anybody who knew the rules and a tough one for anybody who didn't. I'd make it no book and expect high scores.

I like those questions a lot. I might like to see a couple of them read more clearly, but the premise is solid, IMO. You could easily add:
7. The batter swings and hits the ball and subsequently drops the bat while running to first. With the bat in fair territory and not moving, the batted ball hits the bat.

8. The batter swings and hits the ball and subsequently drops the bat while running to first. With the bat in foul territory and not moving, the batted ball comes to rest against the bat.

How about this:

For each of the following, the choices are:

A) Dead ball-foul B) Live ball-strike C) Live ball-batter out D) Dead ball-strike

1. On a 2-2 count, the batter swings and the ball goes sharply and directly from the bat to the catcher's glove where it is caught by the catcher.

2. On a 2-0 count, the batter swings and the ball goes sharply and directly from the bat to the catcher's glove where it is caught by the catcher.

3. On a 1-2 count, the batter swings and the ball goes sharply and directly to the catcher's mask where it falls to the catcher's glove and is caught by the catcher.

4. On a 1-0 count, the batter swings and makes contact with the pitch. The batted ball rises no higher than the batter's head and then falls where it is then caught by the catcher.

Inthegame Thu Dec 02, 2010 04:33pm

Ok here goes -

a) dead ball, batter is out; b) dead ball, runner is out; c) just a ball d) dead ball on-deck batter is out

Runner on 2nd base
Pitcher pitches the ball - it hits her leg and rolls between 1st & home plate into foul territory
On deck batter picks up the ball and flips it to the umpire:eek:

argodad Sat Dec 04, 2010 10:09am

Thanks for those ideas. You may, no, you will see some of them in my list of ten. Any others?

HugoTafurst Sat Dec 04, 2010 06:38pm

:eek:
Quote:

Originally Posted by Inthegame (Post 704806)
Ok here goes -

a) dead ball, batter is out; b) dead ball, runner is out; c) just a ball d) dead ball on-deck batter is out

Runner on 2nd base
Pitcher pitches the ball - it hits her leg and rolls between 1st & home plate into foul territory
On deck batter picks up the ball and flips it to the umpire:eek:

:eek:Sounds like you qualify as a FHSAA question writer!
  • C implies that the ball is live in which case none of the answers are correct. - As soon as On-deck batter touches the ball, it is dead.
  • Nowhere did it state that there was a possible play on the runner, so B would not be correct either

See rule 8-6-13

HugoTafurst Sat Dec 04, 2010 06:46pm

Quote:

Originally Posted by argodad (Post 704369)
I've been asked to serve on Florida's NFHS exam-writing committee for this year. As part of the process, I get to submit ten multiple choice questions to the question pool. :cool:

Shoot me your ideas, please! (Even you, HugotoFirst, and any other FL folks.)


Argo,
I'm not sure I have any incitful questions to add....But I sure would love to be on the committee that edits the actual wording.
I don't have the numbers, but it seems like every year, there are a few thrown out because they ended up being ambiguous...

argodad Sun Dec 05, 2010 09:52am

Quote:

Originally Posted by HugoTafurst (Post 705262)
Argo,
I'm not sure I have any incitful questions to add....But I sure would love to be on the committee that edits the actual wording.
I don't have the numbers, but it seems like every year, there are a few thrown out because they ended up being ambiguous...

Hugo,
I hope I can help that situation this year. We were each given part of the question data base with instructions to mark them with a #1 (good question), #2 (needs re-writing), or #3 (throw it out). In my section, I'm proposing about 1/3 of the questions be re-written -- and I've provided "cleaner and clearer" language.
I'll post again after the meeting Tuesday with my observations.

CecilOne Sun Dec 05, 2010 10:58am

Quote:

Originally Posted by argodad (Post 705356)
Hugo,
I hope I can help that situation this year. We were each given part of the question data base with instructions to mark them with a #1 (good question), #2 (needs re-writing), or #3 (throw it out). In my section, I'm proposing about 1/3 of the questions be re-written -- and I've provided "cleaner and clearer" language.
I'll post again after the meeting Tuesday with my observations.

The main problem with the real NFHS test is questions with no correct answer or more than one correct answer.

argodad Sun Dec 05, 2010 11:19am

Quote:

Originally Posted by CecilOne (Post 705381)
The main problem with the real NFHS test is questions with no correct answer or more than one correct answer.

That's part of the reason FHSAA writes their own exam.

HugoTafurst Sun Dec 05, 2010 11:49am

Quote:

Originally Posted by argodad (Post 705356)
Hugo,
I hope I can help that situation this year. We were each given part of the question data base with instructions to mark them with a #1 (good question), #2 (needs re-writing), or #3 (throw it out). In my section, I'm proposing about 1/3 of the questions be re-written -- and I've provided "cleaner and clearer" language.
I'll post again after the meeting Tuesday with my observations.

Great!

Rich Ives Sun Dec 05, 2010 01:06pm

Quote:

Originally Posted by RadioBlue (Post 704602)
I like those questions a lot. I might like to see a couple of them read more clearly, but the premise is solid, IMO. You could easily add:
7. The batter swings and hits the ball and subsequently drops the bat while running to first. With the bat in fair territory and not moving, the batted ball hits the bat.

8. The batter swings and hits the ball and subsequently drops the bat while running to first. With the bat in foul territory and not moving, the batted ball comes to rest against the bat.

How about this:

For each of the following, the choices are:

A) Dead ball-foul B) Live ball-strike C) Live ball-batter out D) Dead ball-strike.



1. On a 2-2 count, the batter swings and the ball goes sharply and directly from the bat to the catcher's glove where it is caught by the catcher.

2. On a 2-0 count, the batter swings and the ball goes sharply and directly from the bat to the catcher's glove where it is caught by the catcher.

3. On a 1-2 count, the batter swings and the ball goes sharply and directly to the catcher's mask where it falls to the catcher's glove and is caught by the catcher.

4. On a 1-0 count, the batter swings and makes contact with the pitch. The batted ball rises no higher than the batter's head and then falls where it is then caught by the catcher.

Q1: Given the count, both b and c are correct. b is correct in that it's a strike. c is correct because the batter is out as it's strike 3.

Test writing isn't as easy as it would seem.

greymule Mon Dec 06, 2010 09:32am

"The batter swings and hits the ball . . ."

How about just the batter hits the ball?

"The batter swings and hits the ball into the foul pole"

How about the batter hits a fly ball that strikes the foul pole?

RadioBlue Mon Dec 06, 2010 09:42am

Quote:

Originally Posted by Rich Ives (Post 705426)
Q1: Given the count, both b and c are correct. b is correct in that it's a strike. c is correct because the batter is out as it's strike 3.

Test writing isn't as easy as it would seem.

Nice catch. Exactly correct.

CecilOne Mon Dec 06, 2010 10:08am

Quote:

Originally Posted by Rich Ives (Post 705426)
Q1: Given the count, both b and c are correct. b is correct in that it's a strike. c is correct because the batter is out as it's strike 3.

Test writing isn't as easy as it would seem.

That's an example of what I meant by 2 correct answers, test-taker must guess. :rolleyes:

argodad Sat Dec 11, 2010 11:37am

Five of us met at FHSAA headquarters on Tuesday. In 6.5 hours we reviewed the 2011 test question bank for Florida's HS umpires. We did our best to make sure the writing was clear and correct, corrected typos, updated rule references, and shared a couple of war stories. (You can't have 75+ years of softball experience locked in a room without spinning a few yarns.)

We also got to submit a total for 40 new multiple choice questions. Admittedly, some of those will challenge umpires.

So, including the 100 questions in the 2011 NFHS Part 1 (which we did not touch), there are >500 questions in Florida's question bank. When officials log in to take their exam, the computer will randomly select 50 questions for them. No two umpires get the same exam.

It is still possible to take a hard-copy written exam, but it costs extra, and most of would have to travel a long way to take it.

That's the way Florida tests, for better or worse.

HugoTafurst Sat Dec 11, 2010 05:35pm

Quote:

Originally Posted by argodad (Post 706877)
Five of us met at FHSAA headquarters on Tuesday. In 6.5 hours we reviewed the 2011 test question bank for Florida's HS umpires. We did our best to make sure the writing was clear and correct, corrected typos, updated rule references, and shared a couple of war stories. (You can't have 75+ years of softball experience locked in a room without spinning a few yarns.)

We also got to submit a total for 40 new multiple choice questions. Admittedly, some of those will challenge umpires.

So, including the 100 questions in the 2011 NFHS Part 1 (which we did not touch), there are >500 questions in Florida's question bank. When officials log in to take their exam, the computer will randomly select 50 questions for them. No two umpires get the same exam.

It is still possible to take a hard-copy written exam, but it costs extra, and most of would have to travel a long way to take it.

That's the way Florida tests, for better or worse.

So now I will know who to blame!!:D;):D

scottk_61 Mon Dec 13, 2010 01:49am

just curious, who else in working on the test with you?

argodad Sat Dec 18, 2010 10:13am

Quote:

Originally Posted by scottk_61 (Post 707169)
just curious, who else in working on the test with you?

There were five of us total, from different associations covering most of FL. I prefer not to post names. All of us met the pre-requisites (>10 years experience, >95 average on last three exams, FHSAA Rank 1).

IRISHMAFIA Sat Dec 18, 2010 03:47pm

Quote:

Originally Posted by argodad (Post 708327)
There were five of us total, from different associations covering most of FL. I prefer not to post names. All of us met the pre-requisites (>10 years experience, >95 average on last three exams, FHSAA Rank 1).

WAIT A MINUTE!!! If you five understood the previous tests well enough to score a 95, are you sure you are the right people to "redo" the tests?;)

HugoTafurst Sat Dec 18, 2010 04:05pm

Quote:

Originally Posted by IRISHMAFIA (Post 708401)
WAIT A MINUTE!!! If you five understood the previous tests well enough to score a 95, are you sure you are the right people to "redo" the tests?;)

Not really, what happens in FL is that after the tests are over, they discover the confusing questions and throw them out.
;-)

scottk_61 Sat Dec 18, 2010 07:11pm

Quote:

Originally Posted by HugoTafurst (Post 708410)
Not really, what happens in FL is that after the tests are over, they discover the confusing questions and throw them out.
;-)

Oh how true that is.
I have seen some simple questions tossed in the past because two answers might have been close. Not correct mind you but close.

I miss Cecelia and the way she ran things, don't you?

argodad Sun Dec 19, 2010 09:07am

Quote:

Originally Posted by scottk_61 (Post 708432)
I miss Cecelia and the way she ran things, don't you?

Not a bit. Let's just say that I think things are run much more professionally now.

IRISHMAFIA Sun Dec 19, 2010 07:49pm

Quote:

Originally Posted by HugoTafurst (Post 708410)
Not really, what happens in FL is that after the tests are over, they discover the confusing questions and throw them out.
;-)

So, after the name, date and association, how many were left? :rolleyes:

HugoTafurst Sun Dec 19, 2010 08:45pm

Quote:

Originally Posted by IRISHMAFIA (Post 708646)
So, after the name, date and association, how many were left? :rolleyes:

You a funny guy!

:D;):D


FWIW: I just calculated my 10 yr average: 95.1

the year before last, I got 100%.
Funny thing was, I had forgotten about the deadline and someone reminded me that I had to take it that night.... I was 100% inebriated at the time I took it!! :o

Makes me think that it is all the second guessing and overthinking that tends to make us miss some...
:rolleyes:

argodad Fri Jan 07, 2011 11:53am

Quote:

Originally Posted by scottk_61 (Post 707169)
just curious, who else in working on the test with you?

Scott, See your PM. I finally answered.

HugoTafurst Wed Feb 16, 2011 04:49pm

I haven't taken it yet, but I'm hearing from several people in my association that grades are averaging lower than previous years.
I haven't verified it yet, just repeating gossip.

argodad Thu Feb 17, 2011 09:34am

Quote:

Originally Posted by HugoTafurst (Post 730931)
I haven't taken it yet, but I'm hearing from several people in my association that grades are averaging lower than previous years.
I haven't verified it yet, just repeating gossip.

I took it. Still problems in transferring the committee's notated hard-copy questions into the data base. I had one question with two identical (correct) answers. Of course, the computer only thinks one of them is correct.

I did get three of my own multiple choice questions. Hope I got them right! ;)

HugoTafurst Mon Feb 21, 2011 04:04pm

OK, I took mine (almost forgot to deadline)
Can't really say if it was better or worse than before.

Not sure which 2 I got wrong, but a few had me scrathing my head and thinking. :rolleyes::):confused:

HugoTafurst Thu Mar 10, 2011 05:07pm

Final results for 2011??
 
So Argodad...
Is there a final tally as to how many questions were thrown out?
Do you know how this compares to last year?

From a sampling of 14 people in our organization, I can see that at least 4 questions were tossed.....


Got any inside scoop?

argodad Fri Mar 11, 2011 05:07pm

Quote:

Originally Posted by HugoTafurst (Post 738829)
So Argodad...
Is there a final tally as to how many questions were thrown out?
Do you know how this compares to last year?

From a sampling of 14 people in our organization, I can see that at least 4 questions were tossed.....


Got any inside scoop?

Answered in your new thread. I don't have any feedback from FHSAA.


All times are GMT -5. The time now is 09:21pm.



Search Engine Friendly URLs by vBSEO 3.3.0 RC1