We don’t have free speech in any meaningful sense in that case. Almost all our life takes place within private contracts or can affect those private contracts.
Maybe we should stop pretending we have free speech.
Sounds like what you desire is freedom from the repercussions of exercising free speech. That sort of freedom exists only with regard to speaking your mind about your government.
You have the freedom to say whatever you like to anyone, at any time. You just have to be willing to accept the consequences for what you say.