Given that pretty much every set of light armor except for leather and scaled leave you shirtless, and most heavy armor below full plate leaves you sleeveless, warmth is clearly not a concern.
Granted, plate armor in a swamp or mountain is possibly not the greatest idea, but animal hide armor in a swamp is even worse!