Imagine that his arms were extended straight out, like a 60 second timeout signal. Would that be a foul if the same thing happened? I would think so. If his arms are in the poisition you originally described, you just have to judge whether he was within his vertical plane or not and if there is a disadvantage.
Simple, eh?