You have to get out, you have to let your "Baby" grow up, lol, and you cannot feel guilty about it. What is he doing for himself? only he can make the changes, you can only support. Life as you describe it will wear thin, and you will end up resenting him instead of loving him. That is not healthy for either of you. And I can only imagine the bills are piling up. My Ma used to say "love flies out the window when the bills come in the door."
Is he getting any counselling? Are you? Sounds like you may need counselling apart, and some together. You going out with friends, or having a job is not a rejection of him, but something you have to do for yourself. You may not end up going out as much as you did while he was away. That is a given. But you still need a support system for yourself. You are both perhaps co-dependent, and you may be enabling. Get some help for yourself, encourage him to do the same.