Huh, I had the same thought years ago - that AI would recursively become more and more delusional as it fills the internet with inaccurate content that begets more inaccurate content. Like the old "telephone" game where you whisper a message down a line of people and it mutates to become unrecognizable by the end.
The weighting is a real problem. Back in the 90s already there was a push for IT to develop/implement knowledge bases for various tasks. The ones that were seemingly the most powerful at first always included weighting of all the input.
Those were also the first ones to degenerate into nonsense most quickly. Lazy techs and target end users along with changes in technology left everything incomplete or hopelessly out of day making nearly all of the answers false.
The result of using those types of packages was that the larger the organization and the more data that went in the more time and personnel had to be devoted to debugging the knowledge base for it to have any use whatsoever.
When the endusers regardless of role discovered that it was unreliable they refused too properly participate by using it correctly leaving management to try to police their group and needless to say most of them didnt.
This left IT with an expensive gobbledygook generator taking up a lot of storage with the clueless assistant vice executive that demanded the implementation not being able to grasp why it didnt work.