Someone I worked with tried an experiment. He asked ChatGPT for the top five papers (research papers) on something related to AI and image analysis.
ChatGPT dutifully returned five papers. Titles, and author lists.
Problem was that only the first two were actual, legitimate papers. The other three were completely made up. Titles and author lists looked real, but they didn’t actually exist.
I told it no that's a made up song etc. It would apologize and give me another one. The last one was a song that does exist but not what I was looking for even though the bot claimed it contained all the criteria. I thanked it and complimented it on its ability to lie so freely.