Makes sense to me. Words from the Holy Bible were quoted by state officials and read from notebooks, not Bibles.
Doesn’t everyone do this and not even mention the words ‘Holy Bible’? Or the book and verse reference?
But the Doctor is catholic. Let’s make sure to look up what the word means with a small ‘c.’