[OHBBREF]

M&M
I think what you're saying is correct - too many people mistake first foul for first contact.
You ahve to make the contact be foul, if not you are doing a disservice to the team with the ball. They are trying to move the ball quickly to avoid being fouled and keep the clock running. If you just blow the whistle on some little contact you are penalizing them for doing the right thing just as you are giving an advantage to the team fouling if you do not make them foul.
No body said let them kill each other but make them foul the palyer and if they do it too hard call it the way it needs to be called. call what you have been calling all game - just be quick about it!