I agree with the 165 grain bullet, my favorite for .30-06 and .308. I also use them with my .300 Winchester Mag. Better sectional density than the 150 and flatter trajectory than the 180.
I think you and I are the only ones who prefer the 165 grain bullet. Almost everything I have read says use the 180. I use the 165 fro exactly the reasons you describe. Good hunting!