Throwing a punch is connsidered fighting, whether the punch lands or not. He should have been tossed.
Also, you are not allowed to "throw some shoulders." You could, and probably should, have been called for a player control foul. Perhaps the official ignored the contact since both of you may have fouled. But then, look at the result!
On a rebound, most officials ignore contact from behind if the player with better position is able to rebound the ball without being displaced or losing the ball. Remember that not all contact is illegal.
|