Fire started, don't worry! But yes, now you've explained more I've changed my mind. No you are not irrational, but yes there is a reason to worry. If the police are such idiots (and I would not recommend telling your doctor either) the next best thing I can think of is to talk to someone at a domestic violence shelter. Because that's what this is, however long it's been since you lived with him. :( I don't know what they can do, but they hear about all kinds of situations and will probably take you seriously.
edited to add: I like Lizio's idea too.