Inadvertent Whistle - what's the POI?

[so cal lurker]

Well, if the player knocked the ball out of the thrower's hands, the thrower didn't have the ball in his hands when the whistle blew. So isn't the question really whether POI based on the moment the whistle blew (loose ball, AP) or upon what caused the whistle (ball still in hands at moment of erroneously perceived violation, still A's ball)?