Small, technical difference. By not seeking the second term that everyone believed he was going to (he shocked the political world with this announcement), he is in effect quitting. Yes, Sarah quit without fulfilling her term, but Bayh is still "quitting".
He is serving his second term as senator. I guess you mean he should serve a third six-year term!