It's not a great leap. Remember after Kiley left Gary she went to see her boss or an actual psychiatrist? After her session finished, she walked past Matt in the waiting room. It's not like she objects to the idea of casual sex and after the Didi Nightmare, a quiet, reserved girl would probably be a welcome relief.