Chuck I believe that you maybe wrong about this under NCAA Men's rules, I do not know about Federation. Rule 4 Sec 33 (Guarding) Article 6(b) pg 73 states there are 4 criteria to establish LGP on the ballhandler. Criteria (B) states the defenders torso must "face" the ball handler.
Here is a link to the rule book if someone wants to look at it.
http://www.ncaa.org/library/rules/20...ball_rules.pdf
Defending someone without the ball is different. That is how I read this. Though I have been wrong before.