"There’s no place to refuel and no structure to hold up the craft."
They brought the take-off fuel with them, and the "structure" for launch as well. The part that landed was left behind. Only the launch pod took off from the moon.
It rejoined the orbiter, and all three astronauts returned to Earth.
The feat could easily be replicated today, for about a thousand times what it cost us then.
Or we could use what we've learned in the meantime, and do it in an even more efficient manner, along with a number of other things we should be doing in space, and should have been doing for some time.
Just exactly what do you think they used for rocket fuel back then?