I have wondered the same thing (also St. Peter's immediate successors), it is possible that the Romans did not allow any synagogues in Rome, but I have no idea. Regardless, John Paul II was certainly the only Pope since the earliest days of Christianity to visit one.
The synagogue John Paul II visited was in Rome. There have been synagogues in Rome continuously for 2000 years, probably longer.