A dwarf feel kinship with the plane of Earth by culture. Water covers Earth, and with erosion carves it. So dwarves don't swim is closer to the thuth.

In humans lower lung capacity will affect swimming. Less air inside less buoyancy in the water.