Luther apparently knew. Do you consider him to the Holy Ghost?
They followed what the early fathers deemed inspired. If it was up to Luther he would have tossed out the book of James. To his credit it remained because he followed...wait for it....tradition.