As an example, who knows what the Super Collider would have discovered. But the luddites saw fit to destroy it. Many of the "disappointing results" are from funding cuts and cancellations. I am paid by the Gov and I wonder if each year my projects will be re-funded.
When younger I had the fortune to work at a research company (in a lowly technician position), and also to meet an academic physicist who had an improvemnt for optical telescopes.
At the company an idea or discovery was greeted with "so-and-so will want this, it'll put 'em two years ahead of the competition". Basic research arose out of the need for the clients to keep ahead in the market.
The academic, however, spent years getting his idea funded because of poitics- basically because funding would go to another department.
I got out just in time: '95 Navy Dept.