Right. But there are many viruses and other pathogens that weaken the immune system. Secondary infections are responsible for a lot of the deaths.
But one, in particular, nukes the CD4 count.