I think that something to consider here as well is the difference between the contact being the cause vs it merely having contributed to the violation. A player who is clearly off-balance that falls with a slight bump may not earn the foul, while a player who is clearly balanced and is displaced into a violation would earn the foul. In between is where you need to judge!
I can tell you that there is frequently contact that contributes to a violation but is not called. Most posts I am reading seem to indicate that without seeing the play, poeple can call this a foul. I don't think it is that straightforward.
But if you saw a foul, then you can clearly back the call and feel comfortable that you did the right thing
