A noticeable (but not major) part of a caster's power comes from items. A true mage slayer, fluff-wise, wouldn't care about ruining some potentially useful magic items. Especially when he's got his own.
It's a lot closer to a fair fight if the caster has no magic items than it is if he does.