I don’t think the zombies bit him (he doesn’t appear to be bitten - except for the fingers the Governor bit off). The Governor shot and killed him, and then he turned.
According to their chat in Talking Dead, the Gov intentionally shot him in the chest, knowing he would turn, rather than in the head, which would have killed him.