Why don’t they just leave!
They do not want to be outside the walls - they want to be inside, messing with the Church's business.
The Church is their last enemy (and really, has always been their only enemy) and they want to bring it down.
bttt
oy.