The collapse is mainly downwards. But room doesn't end in a drop, as much as in a wall of rubble. You scaled the other side of it to get to the top of the tower.