Why do people act like femininity is something to be ashamed of?

I'm a feminine guy and I'm always having people say "you look like a girl" in a condescending way. I just think, "yeah, no **** Sherlock." I'm wondering why people seem to think this is an insult. Do they dislike women or are they just stupid?