Is it worth it being with him, and potentially being uncomfortable in a crowd situation while you are together with him? Really, in my personal opinion, this will get better with time. I know how you feel, because I felt the exact same way about one of my girlfriends, I LOVED the alone time with her, but the social aspects like taking her out to the movies, parties, and whatnot was just plain awkward.
In time however, one gets used to their partner and they're able to build a relationship that is not based on the outside perseptions of others, and eventually what other people think about how you two look together fails to be of consequence anymore.
In all reality, most people simply don't care. Unless you're around friends, no random person is going to think "oh god, weird couple!" and if they do it hardly matters, because you don't even know the people.
If you're with your friends ask them what they think of you and your boyfriend being together, because it seems you are actually unsure of what people think of you two, it could provide better input, and help you along.
Ultimately it is your choice on whether or not you should end it with him soley based on public apperances.
Best of luck.
Post edited at 11:50 pm on Mar. 27, 2007 by Rastafarian
-------
Danse Macabre.