I only abuse him because he upsets me
You need to take responsibility for your own actions. You cannot blame him for your bad behavior. Why can't you walk away until you calm down? This will not change and the relationship will not improve until you stop trying to make YOUR actions HIS fault.