Listen to the Ann Margaret version. Its the best because she really sounds like she is struggling to make up her mind. She is really trying to convince herself though she has the desire to stay. That’s what the song is about. Its not really about him. He knows what he wants. its her. She is battling with herself, flitting between wanting to stay and knowing she should go.
Taken out of context, as "just a song", it is a big fat nothing! Many songs, from movies and/or Broadway musicals are like that; others aren't.