"Babylon" in that context denotes confusion
Okay. So 1 Pet. 5:13 means "the church that is at confusion." What did Peter mean?
It's very simple. Peter was in a place of spiritual confusion. This is not to say that he was confused, but the place was confused, spiritually.