What makes you believe that those "men" taught or interpreted the scriptures correctly? Why do you believe that what they..or any man writing a commentary is by its nature inspired?The Holy Spirit was promised to all belivers not just the "church fathers".
True, the Holy Spirit was promised to all believers. And I'm sure that He is working in your life.
But the matter of interpreting Scripture infallibly is another issue. Yes, individual Catholics (aside from the Pope) are just as fallible as non-Catholics in interpreting Scripture, but the Church that Christ founded, which is "the pillar and foundation of truth," is infallible in interpreting Scripture when this authority is invoked (which is not often).
Interestingly, we can only know that Scripture itself is inspired and infallibly transmitted because of its infallible source: the Church. This article could be helpful, particularly the Spiral Argument paragraph.