Anyone else scared sometimes to carry a luxury bag?

I live in a small town in Ohio. I'm sometimes scared to carry my LV tote, although the area I live in is pretty 'safe', but it's just remote. I fear that if I WERE robbed, there's no one around to help me lol

Then again, people get their bags snatched on a busy NYC street.

I know it's really unlikely to get robbed in the daytime, but I'm an anxious person what can I say. Does this little fear ever stop you from buying a bag or using one you already have? How do you get over it?