Since "whim" is a synonym for "personal freedom", I can fully understand what you're saying.
Freedom built on a foundation of shifting sands doesn't last long.
As you can see on this thread, Libertarian zealots have little difficulty rationalizing the reinstitution of chattel slavery based upon their whims.