The only reason they built a wall to keep them out is because at the time there wasn’t anything up there that made it worth conquering and subjugating.
Scots scared the Romans, that is a fact.