These guys look like they should have d6 HD. That's still like "generally fit," like a rogue, whereas d8 is usually reserved for gishes and such. To counterbalance that, consider making their spellcasting keyed off of charisma?

Also, you were right about the table. My mistake.