I sympathize. Because I was raised by a Latin American father, I ended up with what's been often referred to, in literature and commonly, as the "piercing Latin gaze". It's labeled as such for a reason--it's uncharacteristic of Americans...and most other cultures.
Fun thing was...nobody bothered to mention it to me...that I was being raised in a Latin American household. My father learned English first...long story...and my mother spent almost half her life in Latin America...but the second half...so no accent there, either. But everything else couldn't be more different, from eye-contact to body language, to facial expression, to vocal intonation.
So what I ended up with was not only having no idea why everyone else-supposedly "my people", as far as I knew--attacking me...for what reason I didn't understand...because I didn't have any explanation as to why I was different, to give to them...because no one had ever given me one, after all. I had no idea why everyone else in the world was completely different from my Father and Mother and Myself...completely alien to me.
So it usually progressed like this, on 9/10 instances of eye-contact with Americans....their catching my eye...noticing the quality of eye-contact was "aberrant"...almost "stalking" over, like the proverbial predator...sidling up until they were directly in my face...and asking confrontationally/threateningly "Is there something wrong with you?"..actually, more often it was a threatening accusation...'There's something wrong with you, often in a low growl, even.
Because, after all, I didn't/don't look Latin, at all. And I happened to attend schools where no other Latin American's were part of the student body, even as a poin of reference--for either myself, or for the others. Sometimes it was, I was soon to figure out--only a matter of attempting to first get me talking, in order to "suss me out"...but guess what? As soon as I did begin talking...I spoke with an American accent...but Latin style/intonation!....cinching it!...I'd failed the test conclusively, then!... And the reaction was one similar to the reaction of the aliens in the Body Snatchers...the old 70's movie...literally raising a public alarm to the effect of "We've got one here! There's somethin' wrong with this guy!"
Oh...did I mention that I grew up in Texas...widely known as the most open-minded and least confrontational of regional cultures? And one with a notorious interest in and appreciation of Latin Culture? (Sarcasm, for anyone who didn't get it).
So the problem of eye-contact features as especially prominent in my own story. Interestingly, Latin culture, being highly, almost painfully polite, and gentle, prides itself on "looking within" another, as a way of reaching out, and showing one's nobility in his/her sensitivity of spirit and in appreciation for the other.
American culture? Especially as defined by the standards of American Manhood?...Not so much! (Understatement)
So fix an American male, Texan, even better, with the look that I learned from my father was an appropriate one with which to greet another male? This "piercing" "looking within" quality of eye-contact? Well, that's considered a boundary-crossing provocation in the context of a competitive mode male interaction...you're picking a fight, in other words, and deserve what you get (Either that, or it's assumed that you're gay, and coming on to them...another particularly popular way to be seen in small town Texas!).
So it's kind of amusing, if you look at it that way...I was constantly going through life being attacked, having no idea why...and thinking that THEY had started it....When they, at least from their cultural viewpoint/frame of reference...had every legitimate right to claim that I was the one started it".
And the question becomes...How do you change your natural eye-contact? Really? Not without it then seeming obviously unnatural.
And what's more fundamental to another's sense of "whether someone is 'lO.K.' or not, than whether their eye-contact is "right"?
I've finally realized that it's like putting the gears of two different machines together, which weren't made to fit...the teeth will always catch, and grind. You can go through, and try to find exactly where, on each tooth, on each gear, and file and bend away forever, trying to get them to fit...but what's the point? They weren't made to fit. So I'm off to Latin America...approx 30 years too late. I lived there for a short time (never should have left)...and without exception, everyone I met immediately remarked "You're not American, you're Latin...or your father's Latin"....seems Latin Americans might hate Americans, on average...but they hate me less than Americans do, at least. It'll be nice to be able to walk down the street again, without the expectation that any given interaction is going to result in a fight or accusation of "not being allright". Maybe I'll finally be able to begin to learn what it feels like...to feel "all right".
So this can make you pretty resilient, as a way of growing up, actually. That's the bright side. And a pretty apt pupil of human nature, and the human condition, down to a level of minutiae others would never imagine...not having had a motivation to try to evaluate it and analyze it, in attempts to "figure out what was going on" in a completely and inexplicably alien world...where you couldn't get a sense of what made anyone else tick, what wavelength they were on...but only having every reason to expect that they would attack you immediately, literally on eye-contact, if given any opportunity whatsoever.
The eyes are perhaps the only remaining "magical" part of the human body. They are the windows to the soul. We can not have been able to make sense of what another has said, until we lock eyes with them, then suddenly have a complete and thorough grasp on exactly what they mean. We fall in love when "eyes meet across a crowded room". I'm convinced, as I mentioned, that due to the fact that humans are sight hunters, we're "built around" our sense of sight, as central to our experience of the world--we're especially attuned to reading the messages in another's eyes, even down to the level of their "soul and spirit". There are even relatively huge portions of the human brain devoted solely to interpreting eye-movements and reflected meaning. I even think there's something there, some reason that eye-contact seems so much more important to many women, than men...who, after all, are the potential prey, in a world where 50% of the population are stronger and sexually aggressive? Makes being able to read a person's soul in their eyes pretty important to basic safety.
What other way would it be likely for a sight hunter who happens to have predatory motivations, to spot likely prey, the vulnerability of a soul sensitized by trauma--than by reading that vulnerability in the eyes, the vulnerability of a soul who's experience has taught him/her to see the world as a dangerous place which their coping skills do not suffice to measure up against?
I've always been immediately accepted by Latin Americans as indisputably Latin American---how? On sight. As they put it, regularly..."I can see your heart". This is a primary trait in Latin Americans, men particularly. In an American male...well, it doesn't make you popular...not in a good way. You can bear your heart in a cooperative culture. It's considered fundamental. In a competitive culture? Just wait for the fun to ensue!