I was a catcher when I played baseball, so wearing the "tools of ignorance" felt completely natural to me.
Give yourself a few games but it will seem right to you, especially as your chest protector molds itself to your body. Make sure you adjust your protector so it is snug near your neck. The mask should be worn as loosely as possible so that it will still stay on your head but will come off easily if hit by a foul ball.
Start by wearing your gear while surfing the web or watching TV and practice taking the mask off with your left hand.
You will come around.