That's easy to do!
By the time St. Peter was writing his Epistles, the historical Babylon was in ruins. It was a modest caravan stop, nothing more. The capital city of the region was moved to Seleucia when that city was built in 305 BC. (Ancient Seleucia is now a southern suburb of Baghdad.) Wikipedia, for what it's worth, says that Babylon was in a state of "complete desolation and obscurity" by 141 BC.
There has been an uninterrupted Christian presence in Iraq since the time of the Apostles. The people there say that their churches were founded by the Apostle Thomas, not by Peter. Thomas later went on to plant Christianity in India, where he was eventually martyred.
And that Babylonian Talmud. I guess it was written in some Jewish school on Long Island? And all those Jewish schools in the area, such as Pembeditha. Were they just 7-11s.? Josephus tells us that there were quite a lot of Jews there in the Babylonian area. Some could have been running Best Western hotels, I guess.