If V can cast spells with no somatic component as a lizard, then I think he could do the same while carrying a weapon. However, back when he was a lizard he only knew 3 spells he could cast like that (Feather Fall, Hold Portal and Suggestion), which would limit him somewhat!