I would have said, "Interesting, care to tell me why?"
Then I'd say, "Care to tell me how you'd know that since you were watching YOUR primary, and not mine?"
Then I'd get the rule book and officials manual out of my bag and give it to him with, "Perhaps these will help."