If kids are that much trouble, put them up for adoption. You can sleep all you want when they are gone.
Any guy who plays golf all day when his wife has been up all week with a baby feeding at 11:00 p.m., 2:00 a.m. and 5:00 a.m. (and taking care of a two year old and four year old during the day) would be considered a selfish jerk by a lot of people, including my husband!
I don't put my kids up for adoption, but I have adopted. Your advice is noted, however.