You have to take into account atmospheric refraction as well as simple geometry. Refraction allows you to see things that should have “sunk” below the horizon at further distances.
100 miles is sufficient to cancel out any interplay of light rays.
People who live on the sea coast always see the mast of the ship before they see the ship.