“he/she/it is able to go across the street to another bakery”
You can also just go open a new email account with one of the thousands of email services, though.
It gets more complicated when there is collusion between these companies and, for example, every major online payment processor refuses to work with you.