We do have crust going back 3.7 billion years which contains evidence of the atmosphere and climate. It would not have been a pleasant place for any but the primitive life form that have left their fossils and other evidence.
Just single cell life up until roughly a billion years ago. Only advanced civilizations that could have sprung up would have been a couple million years ago. Coincidently about the time the Quaternary began.