The "even if you would not normally be" doesn't mean you avoid exhaustion, it just means you become fatigued. So if you started fatigued, you would be both fatigued and exhausted. (Unless there's a rule somewhere that says you can't ever be both.)