Indeed. What makes you think he was right removing the Deuterocanonicals then?
Well, it's already been discussed how he would hardly have been alone in thinking them uninspired, even among saints. For example, Jerome caved (in his deeds), Luther didn't, but they were of a like mind on the issue of inspiration. There is also the matter that the Jews themselves threw them out well before they were canonized in any sense. Of course non-Christian Jews will throw out the entire NT, but that is apples and oranges compared to their view of the OT.