I worked with animals for over 10 years, and over that time I got to know a lot of people too. You strike me a compassionate person, because you wanted a new cat friend for you baby after his buddy took off. So I don't think that you're done with him, I think you're just over his behavior towards the little ones and that's what is frustrating you. But the good news is that you can fix this!
Put the kittens in their own room - food, water, litter, toys, beds - and keep them there. For two weeks. Absolutely go to visit them and play with them often during the day. The important thing here is to NOT let the adult cat near them. This may sound a bit nutty, but rub towels on the kittens and then place them throughout the house where you adult cat likes to sleep, eat, or play or basically do anything pleasurable to him. Also rub towels on your adult cat and put them in the kittens' room around their toys or food. What you're doing here with all this towel-rubbing is giving the adult & the kittens a chance to 'get to know' each other without having to be face to face. What you're hoping for is for the adult cat to associate the kittens' smell with things he likes to do, like eat or play. Same with the babies.
After two weeks you put your adult cat in his own room and you let the kittens have free-run of the house instead. Continue not letting the kittens near the adult cat, and continue the towel rubbing thing. Since the adult cat was with your family first & he is likely used to having free-run of the house, you probably won't want to keep him in there for two weeks. Maybe try a few days.
Then let them meet! Cats (and dogs) feed off our body language, so it's important that you're as relaxed as you introduce them. Your adult might bop the kittens on the nose - that's okay and it is normal. It is like him saying 'I am the boss!' and most kittens will get the idea, some quicker than others. Sure they may irritate him because they're so young and will likely rather play while he'd rather nap, but hopefully they'll have each other to entertain for the most part. I'd give them all treats just for meeting, and more treats when they're interacting in a friendly manner.
I would not rehome the adult cat; I personally don't think it is fair to him. Cats are adaptable creatures but they need time. He might be feeling a loss for his friend that ran away, and to be separated from his humans at a time like this could result in further loss for him.