Sorry for your confusion. There is no arbitrary decision making elite required. Initiating force is wrong. That's the deal.
Really? Then how do we know what "liberty" means? Should you have the "liberty" to own a Huey Gunship? Maybe you're half-crazy, but you can still function in a "libertarian" society and thus are judged "rational" enough to buy your very own fully armed attack helicopter.
Maybe I'm a different type of "libertarian" that thinks that this is crazy. Let's say that my version of "liberty"--liberty from fear of crazy people with military ordinance--wins out. You have to hand over your 'copter. You don't want to. Looks like we're going to have to "initiate force" against you.
Who decides between our two (or many) competing worldviews of what constitutes "liberty"? If I asked 50 people to write out what they thought "liberty" meant, I'd get 50 different answers.