It doesn't get any better from here on... although from what I recall I would have thought you'd still be at the age where that sort of thing can be shrugged off fairly easily.
I do wish I'd got into a proper fitness regimen a few years ago rather than having to try to start from scratch now. Like so many people, I took my fitness and metabolism rather for granted (especially during the period of manual labour where I was getting a decent workout just doing my job) and only started to pay attention to it when it started to decline - by which point it was already so much harder to do anything about than it would have been if I'd started sooner.