Sorry but purges of people who soil the cloth must be complete and without nuance.
Church discipline, one of the marks of a true church.
18 This [f]charge I commit to you, son Timothy, according to the prophecies previously made concerning you, that by them you may wage the good warfare, 19 having faith and a good conscience, which some having rejected, concerning the faith have suffered shipwreck, 20 of whom are Hymenaeus and Alexander, whom I delivered to Satan that they may learn not to blaspheme. 1 Timothy 1
Dont sin by forsaking the assembly just because there is no discipline in the church. Either promote that it find a church that does. They exist.