The above point, considering the fact that Michael is living with a woman with whom he has had two children and has essentially in that regard moved on, is precisely what makes him so suspicious.
It is clear Michael hasn't gotten rid of all the evidence. He can't move on until he has done so.
Good point! Until Terri is gone, the evidence is still there!