Putting aside what sex raped what sex, the fear of how people respond to a victims report is the underlying issue. While women do experience poor reactions when they report they are more likely to be believed. A large portion of the time wemon are not belived or get blamed, but I think statisticts show that a man is even less likley to be belived.
I think the op's struggle is that he has been revived vert poorly, even by members here. While the majority of the members here know that it is possible for a female to rape a male and that it is just as traumatising, the OP has been on the reciving end of ignorance too, and i can't imagine how that affected him. I am sure it create a lot of confusion for him.