Not necessarily. I used to sleep with my girlfriend before we got married . . . but that is what we did, SLEEP. I don't see anything immoral about that. Do you know for sure they are having sex? Or are they just sleeping?
Don't give the impression of impropriety. Be beyond reproach.