It’s also possible that once the place was built and they no longer needed it to transport a lot of stone the importance of the port diminished over time.
Maybe it wasn’t a river bank. Could it be a canal bank and they constructed the canal to transport the stone? Then they filled in the canal after its job was done?
Interesting speculations.