Jesus said to them again, Peace be with you. As the Father has sent me, even so I send you. And when he had said this, he breathed on them, and said to them, Receive the Holy Spirit. If you forgive the sins of any, they are forgiven; if you retain the sins of any, they are retained.
You failed to quote the previous sentences:
>>6] And the apostles and ancients assembled to consider of this matter. [7] And when there had been much disputing, Peter, rising up, said to them: Men, brethren, you know, that in former days God made choice among us, that by my mouth the Gentiles should hear the word of the gospel, and believe.<<
Christ was talking to his apostles, not Joe Blow.