We have removed him. We're still there...
The offer was made for Saddam to step down. He didn't. We've accomplished much more than just removing Saddam.
http://www.angelfire.com/ak2/intelligencerreport/iraqcards.html (I don't think this reflects the current list)
Whether Saddam was a sponsor of the 9.11 attacks may not be fully proven but Iraq was a state sponsor of terrorism. Not "the only" sponsor of state terrorism. Some terrorists are arriving from other nations to fight against the US in Iraq (even some from the US and UK).
If terrorists could be afforded safe haven in Iraq (by the government) there would be a harder battle to fight terrorism. We had the legal access to take Saddam out (the violations of the agreement from the previous war). Turn over the stones one at a time.
It also shows a willingness to act and backs up the words that may have been spoken (while shooting a camel on the ass).
We occupied both Germany and Japan for five years after WWII. In fact we still have thousands of troops in both countries. So we're still in Iraq.......and??