I don't think they ever actually said. The Governor said that he had the tanks to help him prepare for the outside world. I think they were just some form of sick entertainment.
The heads of Michonne's "pets" were in the tanks, too, so not all of the heads were from victims that the Governor personnally killed.
How so? Where did you see that?