It's not a question of smokers' rights, it IS a question of property owners rights.
I don't believe that I, as a smoker, can smoke whenever, wherever, for any reason I want.
I do believe that as long as smoking tobacco is legal it should be left to the property owner as whether to allow smoking or not.