Correct me if I'm wrong, but I'm pretty sure you believe the human authors of Scripture taught without error when they wrote the Bible, so at least there used to be some infallible people walking around.
I think the scriptures were written by people moved by the spirit just like the old testament prophets.
It does not make them “infallible” or perfect in the rest of their life and dealings by any stretch of the imagination.