why is "pretty boy" an insult?

what i wanna know is why "pretty boy" is considered an insult and why do so many men take offence to it? if i was a boy and someone called me "pretty boy", insult or not, I'd be so flattered... like awh, you think im pretty??? tell me that im the prettiest boy that you have ever seen!!