It doesn't remove it, but replaces it with a constant ability for not wearing armor. And if you've taken those perks already, it wouldn't be cheating to add them with the console.