Do you think the name Rory is hard to say/pronounce?

Well I'm a teen girl and my name is Rory. I've met a lot of people who think my name is Lori or Tori and can't really pronounce Rory. For my family, Rory has always been easy to say, probably because they've been saying it for years. I usually have to clarify for other people that my name isn't Lori/Tori/Cory/etc. Why is Rory so hard to say for some people? Is it because there are two R's? Is it hard for you to say? I notice that it's sometimes even a little hard for me to say and it comes out sounding like something else ending in ORY/ORI. Thanks.