Mostly because you are generalizing.
You're aware of metrosexual men (men who dress in a stereotypically homosexual fashion while actually being straight) who are gay, thus proving that my categorical statement is actually a hasty generalization?