Would you like to put that to the test? Ask each and every one of your kids (not the baby, of course) if they like it when you smoke. If they say they don't like it, would you stop? If they asked you to stop, would you?
P.S. They DO smell of smoke. You just can't smell it because YOU smell of smoke, too.