But I doubt they'll give up on it easily. In fact, I suspect it will be destroyed, resulting in a final battle at the last gate (filled with toughest monsters) where everything will be at stake.
And I doubt they would pass accidentially: the gate is located in desert on another continent. Someone coming within 1 kilometer will be looking for the gate.