Being anti-slavery sounds like a conservative value to me. Either way I expect that the descendants of the free staters coming from MA,CT, etc are a small number of the current residents.
You are probably right, but those people control politics and the courts in big chunks of this state.