I too am using 2K. I never use Internet Explorer (or Outlook express, for that matter.) In my folder options, I have selected 'Use Windows Classic Desktop' and 'Use Windows Classic folders'.
I have considered deleting IE entirely from the system, (I did this when I was using Win95), but don't know if the OS would continue to operate if IE was completely eliminated because MS probably pipes some things through it that they really don't have to do.
I use Win98, and have left IE installed for the same reason you listed. In addition, I've discovered some web sites that don't look right in Netscape, but look much better in IE.