I think it is good to talk these things through--the deciding what you can handle and what you can't, and telling him what you need even if those things seem a bit odd even to yourself. I am doing the same thing, and it is scary, to tell a man you really like that he just did something that freaks you out even though no normal person would mind it. It is VULNERABLE.
My most recent example was: we went out on a date. The restaurant had paper tablecloths, and I had pens in my purse, so we were doodling and passing notes to each other through dinner and it was all sweet and lovely. He drew a heart on the paper, with our names in it. Adorable, right? But he didn't use the nickname I use. He wrote my given name. The name that, whenever I hear it, it reminds me of my husband, who insisted I go by my given name and not the nickname I have loved since I was a child. Even though this wonderful and gentle and very loving man had drawn this adorable picture and basically put "love" on the table, I couldn't handle it because all I could see was my ex husband telling me I couldn't be me anymore--I had to be what he said. It took me all through dinner and halfway through a walk through town to tell this guy it was something that mattered to me, mainly because I felt like an ass for minding when really he was just being loving.
And since he is a wonderful person, he said, Oh, OK, I had no idea and I will never call you that again. Of course. Because he is NOT my ex husband. I am NOT in that relationship anymore. I am out. I am safe. Life is better.
But being that vulnerable with him, and realizing each time something comes up that he sees that vulnerability and respects it and cares for me is just amazing. Amazing and challenging and a huge relief.