That is terrible. When you call your family, just for a chat or whatever then they make you feel really bad. It is just awful, especially if they know you are ill.
Best is for your husband to distance himself, especially when feeling down. My family do exactly the same to me. I will maybe call my mother for a chat, be in a great mood, then come off the phone in a complete state. It sometimes takes my husband hours to calm me down. I don't know why some families do this. It is toxic to say the least. My family can be ok, as long as they get what they want, but if you have an opinion of your own, out comes emotional blackmail and abuse until you bow down to their will.
Especially when you are unable to deal with this, it is best to keep them at arms length. Your husband has to think of his health, if his family are like emotional vampires then it is best to stay away for awhile. Problem is you keep going back. No matter how tempting it is, no matter how good you feel, don't call them. It is really hard.
I wish you both luck. Toxic families can be so destructive.