We always played that physical actions could be used as needed to achieve a spell effect. This speed up play and encouraged creative use of magic. One could create a sword of fire and swing it at someone, ect.