“that’s speculation”
The favorite excuse of criminals when confronted by their accusers.
It's also an accurate description of people who make statements that can't be backed up with facts.