"What's the problem?"
The problem is a man with a past.
A girl with a future should avoid a man with a past, me thinks.
If a man has no past, he has no experience.
That can't be the problem.
I don't want to beat a dog while it's down, but to comment on last nights conversation:
I had a crush on a guy from Japan, once a long time ago, and we had a lot of fun together. One of the reasons was that he told me early on, "You were born the day I met you."
I understood that to mean that within reason, what I had done in my past was to stay there, except for the lessons I had learned, and I decided that for me, it was most likely better that I apply that in my relationships in the future.
I try not to ask too many questions in the beginning, except the ones that help a person feel relaxed. If something will come of the relationship, it will evolve on its own. Otherwise....well, life has a way of providing those we need at the times we need them, even if it's only "for a little while."