The way I would handle this is to have there be NO Commoners. Not everyone is a PC class, but everyone is at least an Expert or Warrior, or possibly even an Adept or Magewright. A high number of Adepts and Magewrights also contributes to their society being magical and exotic.