I'm trying to understand the question. Do you, yourself, feel like your "real" gender doesn't match your physical body. Like a man in a woman's body, basically? Or, were you abused by men and are wondering if maybe that happened because you're gay? Or that they, somehow, picked up some kind of female vibe from you somehow?
It's a complicated subject! There do seem to be a wide range of ways people experience their sexuality. And, personally, I think what ever someone "feels" as far as what works for them and what they're content with, that should be ok. I've heard of situations where, for example, a person may have been born female, but felt that wasn't the right gender, had sex change surgery done, and yet they were attracted to men. Which means they're a trans-sexual homosexual, I guess? I find it confusing (and imagine they would too!) but it is what it is, IMO.
But, I think it's not uncommon for boys who were abused by men to have that raise questions about their sexuality. I think this is a separate issue. Men who sexually abuse boys are working off their own attractions, preferences, and issues and I don't think that says anything about the victim, other than that they were in the wrong place at the wrong time.
What ever your own situation, I can see where this would be hard to talk about. In a perfect world, you'd get nothing but support and sincere attempts to understand. We don't live in a perfect world, but I think this is a fairly safe place to explore the topic.