Sand and counterweights............
Good guess, but to load them on and off the boats too? Assuming they used boats, but the rock quarry was several miles down river.