As I said, the Empire did not "let" them, they were forced to do so because of Ulfric. The failure was not agreeing to the Concordant, the failure was some internal members (Ulfric) were apparently idiots who failed to realize what the point of agreeing to it in the first place was, and failed to act accordingly.