The Bible also says that Moses went up onto the mountain again to get new tablets in Exodus 34.
Those Tablets were indeed in the Ark of the Covenant when the Temple was dedicated, as recorded in 1 Kings 8.
This is what he's been waiting for; all along...