I would never even use a browser on Windows Server.
I agree, for web-at-large usage, but that's not what we're talking about here.
You're thinking of hitting sites outside your corporate LAN.
I'm talking about "browsing" to web applications UIs on applications servers within the same corporate LAN, which are written to require Flash, or Java, or something else, in the browser. Or possibly to VPN-connected remote applications.
If you're a system admin, or have had to act in that capacity, I'm sure you know what I'm talking about.