I would say that the people you're seeing don't understand the problem at all, then. It's not that casters have Save or Dies that are the issue--mundanes can kill plenty of things in a single round, too, and more reliably--it's that casters have the flexibility to solve any problem you throw at them quickly, while mundanes can take hours or months to perform the same task, if they ever can.