It's just not that easy finding another therapist also, a lot of people say, yes find another therapist. But the truth is, I have had to find another therapist too many times. It's not easy, especially when these therapists are hard to reach, and thinking about insurance plans, which ones are in your network, do they even take your insurance, etc.. it's a big mess.
I think it's just better to tell your therapist the cold hard truth of how you feel about him. And then he can assess the situation. If he thinks that you and him should stop practice, well then he has to refer you to another therapist, this can be easier than finding another therapist.
Personally, I don't think there is any therapist out there that does not take things personally in their profession. They're human just like the rest of us, and they do make mistakes, but it's up to them to treat you with dignity and respect as their patient.