He was only polarizing to those who felt guilty about their lifestyles, as he reminded them of their sinfulness.
Joseph Ratzinger was one of the more influential persons at Vatican II, but when 1968 came, he saw that matters had gone awry, and he set his face against those who wanted to separate the Church from Holy Tradition and from Rome.