Yannow, I've always wondered about Dr. Whooves and the bevy of background ponies with hourglass symbols. Secret Society of Hipsters?
The serious answer is that I think of them as the Time Patrol, the equivalent of the Weather Patrol. They keep time moving in the right direction, and fight the odd Dalek.