The church may not pay taxes, but neither do other tax-exempt organizations which are allowed to use the library. However, the members of the those organizations pay taxes to support the library.
That said, I think you have put your finger on the solution: Pull the public funding from the libraries. Perhaps the members of the church could start a campaign to do just that.
I like the sound of that, pull their public funding.