Precisely. But not how others live. You contradict yourself with your own post.
It's no contradiction at all. How others live can and does affect my quality of life. People living in community have the right to ensure that the bad actions of a few do not degrade conditions for everybody else. Thus, a community may pass laws against people having sex in public, or public intoxication, or playing ultra-loud car stereos in residential areas.