He took a bullet to the head at end of previous episode.
Yep! And they showed the bullet hole in his head and the beginning of this episode, so there’s no doubt that the Governor is dead and not a Walker.