If you have a way to keep them at bay, yes. Because you need that precious second to cast Quen, sadly. And the lack of vigor regeneration hurts.