For what it's worth, perhaps I didn't phrase the initial question correctly. Let's leave me out of it. How about this: Say you see contact on the shooting arm that meets your definition of a foul, and you blow the whistle. On a different play, you see the same contact on the off arm, do you call it? It's clear to me that some see it differently simply because it's not the shooting arm.
@canuckrefguy - I learned to play in NC, where a lot of the bball is finesse oriented. I now live in Canada, home of hockey players who play basketball. It's a rougher game all around. Handchecking and hard fouls are not only common, they're practically encouraged.