[MajorDave]

like body language. Hands on hips symbolizes an "air of authority" that some people resent. If you do that. The other may be your age. I gather from your address info that you are in college at Elon College or some other institution in Elon, NC. Younger folks always attract ire from someone for having and using their authority over those older than them. I would guess it was some coach or parent that made comments to you about your "arrogance".
Lastly, your stature (or in my case, lack thereof) may be a factor. If you are shorter than say 5'11/6' then some combined with your age and your body language may tend to put some people off that you think "you are bigger than the game".

I would also guess that you are very formal in how you speak to coaches and others. That again puts some people off.

I was a 19 year old Second Lieutenant in the Army once. (many moons ago)
I am short, 5'9" and have a southern/country accent. I met many people early in my military and law careers that thought because of my age, lack of stature and "countrified" accent that I was stupid and arrogant. I think most who know me now have changed their opinions. I really did not care then or now but I think it is important how you are perceived as effective communication is a real focus of mine.

I don't know you or anything about you except your posts so I could be very wrong and way off base here. But, since you asked I offered my two cents. YMMV.

D.C. Teater