Call it what you will. It won’t change the fact that catholic means universal and all believers are part of that universal church. We are not Catholic, we are catholic. All of the early church was not Catholic as you put it.
Then it wasn't the Church, they were heretical sects, such as gnostics or later Arians, and the church condemned then as contrary to the Apostolic faith.