Welcome to DU!
The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards.
Join the community:
Create a free account
Support DU (and get rid of ads!):
Become a Star Member
Latest Breaking News
Editorials & Other Articles
General Discussion
The DU Lounge
All Forums
Issue Forums
Culture Forums
Alliance Forums
Region Forums
Support Forums
Help & Search
General Discussion
Showing Original Post only (View all)You've probably heard that AI chatbots can completely fabricate quotes. It happened yesterday in a DU thread. [View all]
The thread is in the Science Fiction forum, at https://www.democraticunderground.com/12002305 . I hope you'll read all of it. But see in particular the OP and replies 8, 11, 12, 15, 17, 19, 20 and 21.
DUer raccoon was trying to remember a partucular time travel story. There were a number of replies. One, from Goonch, had both a title and author, and a quote that was apparently the ending of the story:
Elias punched the coordinates for 1924 into the brass console, desperate to see his grandmother one last time. He pulled the lever, expecting the smell of ozone and the sight of her garden; instead, he was met with an absolute, crushing silence .
When the flash faded, there was no garden. There was no air. Through the reinforced glass of his pod, Elias stared at the cold, indifferent glow of distant nebulae [3]. He hadn't accounted for galactic driftwhile he had traveled back a century in time, the Earth had continued its relentless orbit around the Sun, and the Sun had continued its 500,000-mile-per-hour sprint around the Milky Way.
He had reached the right time, but the Earth was billions of miles away . He was a ghost in the vacuum, a man who had forgotten that in the universe, you can never go back to the same place twice.
It looked like a pretty convincing answer. If I'd just run across it, I doubt I'd've thought twice about its accuracy.
But I knew it couldn't be right because I'd posted a reply hours earlier, mentioning the same story title and author, and linking to pages I'd found referring to it. I didn't have a quote from the story, and I've never read it.
But I had run across and linked to pages summarizing the story, about a girl named Marla (not a man named Elias) who went forward - not backward - in time, but also ended up in outer space.
So I asked about the source of the quotation above.
Turned out it had been fabricated by a chatbot. I've read lots of articles and social media posts about chatbots fabricating quotes, but it was the first time I'd seen this happen in a thread I was posting in. I thought it would be a perfect example to post here to show why chatbot responses should never be trusted without careful checking.
I want to thank Goonch for posting the explanation, which included the chatbot admitting the quote was apparently fabricated. Goonch also posted another helpful message with what the chatbot, Google's, had said later about chatbot dangers and the need to verify information, and it's an interesting read.
38 replies
= new reply since forum marked as read
Highlight:
NoneDon't highlight anything
5 newestHighlight 5 most recent replies
You've probably heard that AI chatbots can completely fabricate quotes. It happened yesterday in a DU thread. [View all]
highplainsdem
Friday
OP
Lol for fun I asked an AI the reason for the discrepancy and gave it the passage from your post
AZJonnie
Friday
#2
Not sure what you mean. It quoted one of my replies in that Science Fiction thread, or it quoted
highplainsdem
Friday
#4
Claude is clueless. There is an actual story. I posted links about it in the earlier thread I linked to. There
highplainsdem
Friday
#9
It's not surprising that it got confused, this entire discussion is extremely circular
AZJonnie
Friday
#13
I would've expected any bot to at least follow the links in both threads, which would have shown that
highplainsdem
Friday
#15
Interesting seeing you try to defend Claude's inane answer, when this thread links to the older thread
highplainsdem
Yesterday
#19
I guess I am, given you don't know what the actual prompt was, yet are arbitrarily coming up with a strawman
AZJonnie
22 hrs ago
#20
No, the problem using genAI is with genAI and its inherent flaws. Anyone who's ever used genAI should
highplainsdem
7 hrs ago
#27
Obviously I know I don't know nearly as much on this topic as you do, so I generally defer, Sir :)
AZJonnie
Friday
#14
These tools don't just fabricate fiction. They fabricate citations in law and science pieces.
RockRaven
Friday
#6
Yes. I mentioned that in the earlier thread I linked to. I've posted lots of warnings here over the last few years
highplainsdem
Friday
#10
+1. AI is essentially a smooth-talking buzzword-spewing bullshitter with an unlimited capacity for plagiarism
dalton99a
Friday
#12
When ChatGPT became popular, people said AI systems really need to provide sources.
Renew Deal
21 hrs ago
#24
Thanks - but I wouldn't have caught it if I hadn't already looked at a number of websites about the story so
highplainsdem
7 hrs ago
#25