I would like to point out that it is a mighty fragile "freedom" that can be toppled by people who don't want to shop at a gouger anymore
Fragile, yes, but I think that's true of freedom in general. That's why historically freedom has been a very rare thing that often is toppled by tyrants, stupidity and intolerance.
Economic freedom is not the only thing that a successful society needs. We need to fight evil. We need good men who are willing to commit charity for the common good. Western Civilization was saved by acts of charity -- the men who gave their lives in WWII.
I respectfully disagree. I don't think a wind of public opinion against shopping at gougers will topple any freedom worth anything. The only "freedom" it might topple would be some abstruse mental concept.