Those who follow Christ alone and not some organization ARE the body of Christ.
Once again, I urge you not to fall for a non-Biblical, impossibly false dichotomy of "Christ without the Church," "Christ divorced from the Church," "Christ vs the Church."
Of course the word "Church" can be used in many senses: probably dozens of senses, including the invisible (comprising also the saints who have passed on before us), including the secret (as we pray in the Liturgy, "those whose Faith is known to You alone"), including the ecclesiastical, the historical, the sacramental, the creedal, the sociological, even the architectural (!)
But the most basic sense, I think, would be "those who are being incorporated into Christ."
Certainly if you are a baptized believer, you --- I don't say just Catholics, but YOU, baptized believer-guy --- are a member of the Church.
However you want to say it, to be dismissive of the Church is to be dismissive of His Body.