The key is intent, not offense or defense. Any player can be called for the violation if, in the referee's opinion, there was an intent to stop or move the ball with any part of the leg.
As for JR's comment about never listening to the players - you might want to listen sometimes. After all, they have a tendency to same some amusing things sometimes...