It really doesn't limit the jedi greatly. Just means they cant go openly waving around a lightsaber for people to see. The Empire knows there are jedi they missed in the purge thus why they created the Inquisitors to go hunt down rumors of them and turn or kill them. Most surviving jedi are not very powerful and many would have been padawans whose masters took one in order for them to escape. Do they play a big role in the galaxy, nope. Most are struggling to learn the force by themselves while keeping a low profile. I doubt Vader publicized that Luke was a force user. Even if rumors of the Rebels having a jedi knight got out, it would likely take a long time before a low profile padawan would even hear about it. The Rebels too would have wanted to keep the fact they had a jedi in their ranks to a low murmur. It took two years for word of the Endor incident to reach Coruscant(a great deal due to a media blackout on it) so information travels very slow from the rim to the core and even longer from one end of the rim to the other.

It could be the source of a few adventures. There were many types of jedi and not all of them specialized in being combat leaders or knights. In the books there are several mentions of jedi who specialized in agriculture and simply assisted worlds that needed their help and many of them were on far flung worlds doing that job when the Purge occurred. There was a novel I read where a master sacrificed himself along with some commandoes to let his padawan and some useless farmer jedi escape from Vader.