Because history is not entirely unrecorded. Forensic evidence is more reliable than eyewitness evidence in many cases. It is certainly more reliable if there is a conflict between the two.
If the mere interpretation of forensic evidence is what constitutes science, then why is it "unscientific" to interpret biological entities that function as machines to be the product of intelligent design?