Of course it's an assumption - as I was not a member of the PHB design team, I can only assume what they meant by "invisible." But being an assumption doesn't make it wrong.
If invisible in D&D truly meant "unable to be detected visually" then no DC of Spot check would work - they would automatically fail (just like Listen checks automatically fail in magical silence.) Since they don't, there is clearly something there to be detected.