A 32% increase in risk may not be much in terms of actual risk. I got a mammogram just last week at my local hospital. There was a 3 fold poster urging women to assess their risk, using the various factors to compile a score. Smoking was not mentioned at all, obesity was.
Therefore, I must conclude that smoking is certainly a lesser risk (for breast cancer) than obesity and smoking doesn't make much difference in comparison to non-lifestyle factors like age of beginning and cessation of menses and breast cancer in family members.
Then you'd be wrong. I have no idea why the plastic poster in your doctor's office didn't list smoking as a risk factor, but the American Cancer Society, the American Breast Cancer Foundation and the National Institutes of Health all list smoking as one of the leading risk factors for breast cancer.
Ignore them at your peril.