If we go into the towers, then it becomes very difficult for all of us to act against it. Those in a tower it doesn't pursue are useless unless they go to windows or the roof. People at windows and the roof are open to attack, so are not in materially better position than someone outside.
I'd rather face it in the open, not on the bridge where it has the potential to blow/knock us off. We can then react to its actions on a round by round basis, and all of us have a chance to do something.
I suspect that Rita and perhaps Aria also have a way to materially affect the dragon at a distance. Mead might get lucky with a glitterdust, but will otherwise not be a great deal of help.