A classic case of adverse possession.
My best bud, a surveyor, had land in the Southern Tier in NYS. The neighbor said the drive was his property and blocked it with rocks.
It was finally resolved in my friend's favor...likely because as a surveyor, he was more aware of what his rights were and where his boundaries began and ended.