The sides, bottom, and top of the backboard are inbounds. Thus the padding is too. The backside is OOB, as is all the support bracing.
As for face-guarding -- it is a T on an opponent without the ball but legal against an opponent who has the ball. Poking an eye out is never legal.