"Holding" isn't well-defined in game (outside of certain bags and spells). If you view it more like "wielding," like I do, then Tvtyrant's interpretation is correct. If you take the strict view of holding as literally carrying an object, then natural attacks and unarmed strikes don't count for the purposes of Haste.