Having a child in a car is dangerous too. How many kids are killed in car crashes every year? Should we ban that too?
Would you argue that we should UNBAN drunk driving? Because it's not always dangerous and as long as no one gets hurt, it's a victimless crime, right?