Officiate from the floor up. When the ball comes to a player in your primary start with the feet and recognize the pivot foot.
It takes time, but it is possible to locate the ball, find the pivot foot and referee the defense all at the same time.
The only thing you can control is you; you are the common denominator. What makes you strong with a strong partner? Take whatever you think that is with you to EVERY game.
Work your primary, keep your focus, and above all be a GREAT partner. Keep on top of game situations, and focus on YOUR game, not your weaker partner.