That is only how it works if you take away their agency.

If you take away their agency than the only way they can have agency is by disrupting the game.

If the only way they have agency is by disrupting he game than you are justified in taking away their agency.

Congratulations Darth Ultron, you are your own echo chamber.