Toryg had some martial training, but even his allies admit that he was childish. Ulfric was a veteran of many battles, and...well...did you ever see the duel between Paris and Menelaus in Troy? Yeah. That's how fights between little princelings and experienced soldiers actually go.