If I was DMing, I'd let the players ignore that if they didn't want to deal with the hassle. If they were fine with changing that kind of stuff, there are rules in the Draconomicon for that.
Either way, I think it's fine to just judge each age on its own merits without worrying about the possibility of PC dragons getting extra complications as they aged.