He is a very confused man at this point and is obviously torn between his loyalty to his mother and the temptations of woman companionship. Will he stay with his mom or venture out once again in search of a woman?
This was obviously not the first woman this man spent the night with. His mother must have been quite dominant in his life. He always wants to run back to her after having his evening with a lady.
It's kind of sad, actually.