To me, if the contact makes the shot
significantly more difficult, it's a foul whether the ball goes in or not. Frankly, I often don't know whether the shot falls or not (I pregame this with my partners) because after the whistle I'm watching the players. What constitutes "significant" is going to change with the level of play, and is for me to judge.