They would be attacked also if they travel trough the wilderness. At least one random encounter is certain. Greysky city was dangerous, but it was only specially dangerous for Haley, for reasons Haley didn't share with Celia. "This is a dangerous place because it's full of evil people" is a very different deal than "This place is dangerous because it's full of evil people who want to kill me specifically".