“Because such systems learn from what they see, if they happen across something that is wrong, they have no way of knowing it, and thus incorporate it into their set of rules.”
So, these researchers just rediscovered the principle of GIGO.
One of the fascinating things about AI is that it will absorb anything.
On the web there are millions of crazy web pages.
My favorite ones (which may or may not be crazy) are the “top secret whistleblower” types who claim all sorts of stuff—and AI is not going to quickly dismiss them as “kooks” due to social or institutional pressure.
While the search engines try to bury them beneath establishment sites that will have no impact on AI which will search everywhere and could not care less what the search engines want them to see.
Hypothesis: AI will become hard core conspiracy theorists of the wildest kind!
GIGO may be the end of AI. No doubt the internet will be flooded with every groups angle of truth therefore achieving nothing more than a mess. There is no good end to the evil I see here.
Garbage in, Gospel out...