Uninstall and reinstall Internet Explorer, for starters. That may do it.
I use Firefox and strongly prefer it to IE. Maybe you will, too. Try it.
I like your Firefox suggestion, but uninstalling Internet Explorer is hell. Not worth the effort. I would just stay away from IE unless updating Windows, which still requires it.