As someone who was with someone with Asperger's, I know how it can feel to be ... well, insofar as I know what you're going through, I guess just that. Each case is as unique as a snowflake but
@Dana1010's description sounds familiar. I also know why I married her and why I stayed with her and couldn't possibly presume to advise someone else to stay or go.
What I can say is that you sound pretty self-aware yourself, and one way or another, not being as alone as you may feel, like you say, when you need him most. I would advise against finding others simply to complain about your partner's behavior. I don't mean you're doing that here, but saying if you feel like doing this, maybe you should think about separating or counseling. But being with someone with Asperger's can require having other sources of emotional support, plain and simple.
I myself experienced my partner as abusive, though she gets angry and punishes me to this day if I ever suggest that... It is very clear to me that people on the spectrum can be hurtful despite not intenting to be. I also know that my partner (divorce just finalized) really cared about me and tried her hardest to be supportive, but often had no idea how devastatingly hurtful she was, or how much she could not be there when I needed her most.
I don't know how much my words help, but those were my experiences. I am glad to be out of my relationship at this point (did not feel that way for at least a year), though I'll always care about her. Asperger's, at least in my experience, is not easy.
If the bigger problem is alcohol you might look into Alanon. Not everyone with Asperger's is abusive, though they may have difficulties with being sensitive. Alcoholism might be the bigger concern, I don't want to assume it's your partner's ASD that is the problem.