Speculation is the fun part of philosopizing, partying, and doping off. Some of these notions occasionally make it into the realm of science, by becoming experimentally accessible. We spend our hard earned loot on science, and more than that, scientists, referees, technical editors and academics commit energy, time, and careers to it, so we don't take noodling around with ideas seriously until they reach a stage of particularity such that they can be taken apart piecemeal in the journals.
I see; you're excluding everything a scientist does except their published work from the realm of science. That is far too limited a view IMO.