Yes, counter-productive government red tape is the only remaining real problem.
As for the costs, a solution is at hand: replace expensive, bespoke reactors with mass-produced modular reactors. Use the economies-of-scale inherent to mass production to make the cost/unit of power drop. Build modular plants, so that only relatively small up-front capital investments are required. That would greatly reduce financial risk, and further reduce overall costs.
I remember reading about modular reactors years ago and I think Bill Gates invested in them. What happened?