Why are you even together?
Since you say your schedules do not match at all and your communication does not work, the way he tries to meet you frightens you, you are not happy in that relationship to the point of already calling him Just another asshole (and not sure about you, but if I find myself thinking of someone as an asshole, I do not find myself wanting to be in a close relationship with them, not even should that be temporary assesment), and you feel he is interfering with your work life too?
Sounds to me that being numb and emotions is not the biggest issue there may be, on any side.
Since you say your schedules do not match at all and your communication does not work, the way he tries to meet you frightens you, you are not happy in that relationship to the point of already calling him Just another asshole (and not sure about you, but if I find myself thinking of someone as an asshole, I do not find myself wanting to be in a close relationship with them, not even should that be temporary assesment), and you feel he is interfering with your work life too?
Sounds to me that being numb and emotions is not the biggest issue there may be, on any side.