And Jesus never said it would be easy.
"None is so blind as he who will not see..."
Do you really think that Jesus and the Apostles set out to only pick the low-hanging fruit?
In an era where Christianity competed against Roman gods, paganism, unbelief, do you really believe that the early Christians simply cast out those who were not easily converted?
According to the history I have read, and I have read far more primary accounts than most, the answer to your question is Yes.
The Scriptures are clear on this matter:
And whosoever shall not receive you, nor hear your words, when ye depart out of that house or city, shake off the dust of your feet. Mat 10:14
And whosoever shall not receive you, nor hear you, when ye depart thence, shake off the dust under your feet for a testimony against them. Verily I say unto you, It shall be more tolerable for Sodom and Gomorrha in the day of judgment, than for that city. Mark 6:11
And whosoever will not receive you, when ye go out of that city, shake off the very dust from your feet for a testimony against them. Luke 9:5
Matthew 10:15 "Verily I say unto you, It shall be more tolerable for the land of Sodom and Gomorrha in the day of judgment, than for that city."
You may also want to check out II Peter chapter 2 with particular attention given to verses 1 through 6. He didn't spare the angels, or the world, (except Noah), or Sodom and Gomorrha, (except Lot), so your argument is invalid when compared to His Word.