"There is no chance of me being unfaithfull to my wife but there were others in the past who I had far, far stronger feelings for. So, say I settled for my wife."
How sad.
I hope as time passes your memories of other women will fade away and you will come to appreciate your wife for the gift that she is.
She deserves better than to be considered 2nd (or 3rd) best.
As with anything, there will always be something or someone better. Like interviewing job candidates, rarely to never do you come across the "perfect candidate". Instead, you collect resumes, filter them, bring in candidates for an interview and then extend an offer to the "best available".
Sometimes, a "best available" will come along who stands out from all the other "best availables". For some reason, they tend to get away. Perhaps my sincerity in communicating to them comes across as fake flattery. I'm not sure but there's something about me that I still don't fully understand.