We know that the Sun hugely determines Earth's climate. Thanks to record taking of sunspots after Galileo invented the modern refracting telescope at the beginning of the 17th Century, we know that between 1645 and 1715, there was essentially NO sunspots seen on the Sun, and that perfectly coincided with the famous Maunder Minimum that resulted in winters so cold that the Thames and Seine Rivers in Europe easily froze over during the winter.
Prior to modern means of measuring solar output nobody would be able to know if it really changed, absent something like being able to probe the equivalent of meteorological artifacts on other planets. I wonder if lurking somewhere on, say, Saturn is evidence like this. That might show that oh, Saturn was having a (relative) ice age while Earth was having one too. That would point a finger right at Old Sol.