Actually your 40s are not too shabby in that department. My wife is late mid 30s and i wouldn't trade her for anything....if I were a young buck I'd consider her a "milf"...pardon my French please.
I hope your husband never cheats on you....it can be devastating for you and worse yet for the wee ones.