Their god. Thats who judges a paladin, not authority, not kings nor emperors. They do their gods will. Many a good paladin lost his powers follow his superior who had strayed from the path.