I think that is a very poor analogy. Despite what the smoke-nazis aver, there is no evidence that second hand smoke is anything other than a nuisance to people. That being the case, can you outlaw body odor, or offensive looking people?
You are correct that there is no inherent "right" to smoke in public. However, nothing I have read gives the government the power to restrict it.
There is no evidence that playing loud music all night long is anything other than a nuisance, either.
But if I tried it tonight, the sheriff's deputy would be at my door right enough.
What most people fail to get in this argument is that we restrict and prohibit all SORTS of things just because they are "nuisances." You can't "read" anywhere that the government (that is, "the people") have the right to restrict them either, but we do it all the time.
Define "public". Private businesses have property rights. He is incorrect, as usual.