Does not being local hurt you?

My parents loved the idea of living in a small town with less than 10k people. But it sucked moving back home after college. No local jobs and I don’t want to live here anyway so I’ve been applying only for city jobs. But I’ve heard that not being local to the area hurts you a lot