Who will cash your check to provide the cash to spend? Banks will charge to cash your check unless you have an account.
Just open a basic checking account and use it to pay utility bills and such.
Banks are a free enterprise. They are market based. No body
is forcing you to patronize them. I hope you are not for
government control or takeover of banks.