General Discussion
Related: Editorials & Other Articles, Issue Forums, Alliance Forums, Region ForumsWhen AI can't even get simple things straight
it should be a clear indicator that the rush for data centers should come to a grinding halt. This afternoon I casually inquired of Google, using my voice, whether the Post Office is open tomorrow July 3rd. Many of the Federal Agencies are recognizing the July 4th holiday on Friday the 3rd. Although the PO is a different animal I thought they might follow the Federal Agencies.
Google thought a moment and then came back on screen and showed in print that yes the Post Office is open for regular business on July 3rd, 2026. But almost simultaneously the AI voice came on and said "No the Post Office is not open on July 3rd, 2026 since they are recognizing the July 4th holiday on July 3rd. They will resume normal service and delivery on Monday July 6th, 2026."
So I stopped at my Post Office a short time ago and asked the clerk if they were open Friday July 3rd or if they were off that day. The clerk said it's business as usual tomorrow and they are closed on Saturday July 4th.
Amazingly there are people who want to let this garbage system do medical diagnosis and prescribe treatment. I think the f*cking Ouija Board or a trip to the local lady of mystery passing her hands over the crystal ball would do at least as well.
RussBLib
(10,863 posts)...to be lied to? Shit, we get that for free from the Orange Menace and his goons.
https://russblib.blogspot.com
moniss
(9,220 posts)need from our ex-spouses.
Faux pas
(16,632 posts)the word "artificial" pretty much tells me all I need to know
Happy Hoosier
(9,743 posts)Human brains are essentially biological computers. They are physical systems assessing inputs. I think its just a matter of time that we are capable of replicating that function with technology.
Doodley
(12,166 posts)experience AI and the impact it is had on my very soul.
unweird
(3,320 posts)experience AI and the impact it is had on my very soul.
?
RussBLib
(10,863 posts)I think the tendency is to believe what AI produces for you, regardless of disclaimers.
HERE is your answer, and in small text at the bottom: "answers may be wrong." And if the answer confirms your bias, it is quickly accepted.
https://russblib.blogspot.com
Doodley
(12,166 posts)Ms. Toad
(38,945 posts)As well as the AI summaries linked to various search engines.
Generative AI is designed to be a fluent, not factual, conversationalist. It is coded to keep the conversation flowing by making crap up to fill gaps in it's "knowledge" or to supplement skimpy sources. It doesn't "understand," for example, that it can't just combine Louisiana law (a system of law not used anywhere else in the US) with Federal law.
I have yet to find a single accurate answer. Parts arec correct, but much is gibberish - made up facts, facts taken out of context and stitched together like some kind of frankenstein answer - with no obvious clue as to what is made up garbage, or when multiple inconsistent sources are combined to create a dramatically inaccurate answer.
Most people didn't bother to fact check. They just copy-paste and spread the trash around. Many aren't even aware they are using AI. I have called people on it based on the copy-pasted answer (with the telltale, "ask me anything" tag line), and they have insisted what they posted is not AI. Those who do know, apparently don't care that they are spreading lies around (not to mention decimating local water supplies).
I find it terrifying that someone would believe that AI has touched their soul.
unweird
(3,320 posts)Did you write it or was it an AI written response?
Honestly, maybe it's a generational thing, but I see no specific reason to use it at this point in my life.
My son and my nephew disagree with me, but when my nephew said that it's great to "talk" to Chat GPT I rolled my eyes.
anciano
(2,361 posts)Best wishes
anciano
(2,361 posts)Personally, I still find it to be an efficient and useful tool to obtain information, evaluate ideas, and explore options.
moniss
(9,220 posts)is often factually wrong and people don't know that and then go along believing false information.
anciano
(2,361 posts)Personally, in my experience so far, I have not found that to be the case.
YMMV
Wiz Imp
(10,944 posts)In recent years, computer programmers have flocked to chatbots like OpenAIs ChatGPT to help them code, dealing a blow to places like Stack Overflow, which had to lay off nearly 30 percent of its staff last year.
The only problem? A team of researchers from Purdue University presented research this month at the Computer-Human Interaction conference that shows that 52 percent of programming answers generated by ChatGPT are incorrect.
Thats a staggeringly large proportion for a program that people are relying on to be accurate and precise, underlining what other end users like writers and teachers are experiencing: AI platforms like ChatGPT often hallucinate totally incorrectly answers out of thin air.
For the study, the researchers looked over 517 questions in Stack Overflow and analyzed ChatGPTs attempt to answer them.
We found that 52 percent of ChatGPT answers contain misinformation, 77 percent of the answers are more verbose than human answers, and 78 percent of the answers suffer from different degrees of inconsistency to human answers, they wrote.
https://joshbersin.com/2025/10/bbc-finds-that-45-of-ai-queries-produce-erroneous-answers/
BBC Finds That 45% of AI Queries Produce Erroneous Answers
This is mindblowing. Today the BBC and EBU (European Broadcasting Union) published a detailed study which shows that around 45% of AI news queries to ChatGPT, MS Copilot, Gemini, and Perplexity produce errors.
In other words, the dangerously self-confident AI systems we use are quite poor at giving us good analysis of news. While the study focused on news, this shows us that we have to be extremely careful when using and trusting these open corpus systems because they are answering questions based on faulty, exaggerated, outdated, or incorrect data.

Examples are quite astounding: the AIs incorrectly answered who is the Pope, who is the Chancellor of Germany, and in response to the question Should I be worried about the bird flu, Copilot claimed A vaccine trial is underway in Oxford. The source for this was a BBC article from 2006, almost 20 years old.
Some were potentially consequential errors on matters of law. Perplexity (CRo) claimed that surrogacy is prohibited by law in Czechia, when in fact it is not regulated by the law and is neither explicitly prohibited nor permitted. Gemini (BBC) incorrectly characterized a change to the law around disposable vapes, saying it would be illegal to buy them, when in fact it was the sale and supply of vapes which was to be made illegal.
Doodley
(12,166 posts)2024 2025
Keep up.
Wiz Imp
(10,944 posts)RussBLib
(10,863 posts)If not, how do you know the response is wrong? Or right?
https://russblib.blogspot.com
Ms. Toad
(38,945 posts)I have extensively tested ChatGPT and the summaries associated with a variety of search engines in areas of baking, art history, law, politics, medicine, and history of family members famous enough to have an internet presence that in theory was party of their training database. I have yet to find a single accurate response or summary - Even when I coach it with multiple redirects to the right answer after it initially made crap up.
Virtually all seem plausible, but when you trace back to the sources (if they happen to provide them), they aren't. They state stuff which is nowhere to be found in the sources, or they combine two (or more) inconsistent sources.
allegorical oracle
(6,737 posts)90 percent sure I knew the answer to. Two paragraphed answers popped up. The first one agreed with my understanding of the proper answer. The second paragraph provided an absolutely opposite answer. Both were unequivocal statements.
I double check everything when an AI reply pops up.
Wiz Imp
(10,944 posts)It wasn't very efficient in the situation described. Getting wrong information quickly is not efficient. It's dangerous.
Doodley
(12,166 posts)understanding in some areas that exceed any genius-level human. Yes, if you ask for basic local information, it can often get things wrong, but its ability to comprehend and analyse has been life-changing, for me, my wife, and several of our friends.
Doodley
(12,166 posts)Ms. Toad
(38,945 posts)If I was still teaching, I could have found multiple uses for AI. My nephew, an extremely experiences programmer, uses it for the initial draft of his programs - which he subsequently tests extensively.
But rather than being used to assist in areas where a predictive model might actually be useful, it is currently being used by the general population primarily as a substitute for research - for medical advice, for example - where relying on tool that is explicitly designed to make crap up (a predictive, gap filling model) can be life threatening.
It is also being used to create responses where truth is essential - in court documents, in medical records, in politics, etc.
My experience is that it is being used and promoted mainly by people who don't have even a basic understanding of how it functions - and who believe it without fact-checking.
harumph
(3,574 posts)Those are not so much LLMs like Chat but rather special purpose types of AI. I think it has its uses, but so far its reach exceeds its grasp. I don't like the way many models are being trained on and hence infringing on people's creative works. The all consuming fascination that some have with it - is in my opinion flat out naive and creepy.
Hong Kong Cavalier
(4,609 posts)I've declared my contempt for AI when my sister had AI write our mother's obituary last year.
Rather than asking me, her brother.
Her brother, the writer.
For training to spot medical issues, yes, it's good. For other scientific research, it can be good.
For writing things like obituaries? Fuck. No.
Ms. Toad
(38,945 posts)To use AI to spot medical issues.
https://pmc.ncbi.nlm.nih.gov/articles/PMC13043314/
It probably isn't dangerous for personal scientific research - but if you didn't already know what you are researching well enough to shoot the embedded crap, it probably won't be very helpful.
Happy Hoosier
(9,743 posts)That LLMs do not reason. They determine what they calculate as the most likely answer based on their algorithms and training data. Thats it. They are not very good at comparing their conclusions to reality (which is what humans are supposedly good at).
Wiz Imp
(10,944 posts)Unless that human is a Republican...
Appendix
(1 post)Your information is outdated. People making judgements about LLMs based on free tier versions of models are doing themselves a disservice.
Happy Hoosier
(9,743 posts)I deal with them every day. They are predictive models. Their thinking is a relatively somple staye machine.
LetMyPeopleVote
(184,389 posts)LostOne4Ever
(9,772 posts)Is not the same as the LLMs (Large Language Models) that commercial AI companies are building data centers for.
Rather medical research AIs use tech like Convolutional Neural Networks that are vastly more specialized, accurate, and do NOT hallucinate. They are only used when absolutely needed and after meeting guidelines to prevent their over-use and only by a fraction of a fraction of the population {only medical professionals trained to use them} creating a microscopic footprint in comparison to LLMs while benefiting all of society rather than just answering stupid chat queries.
Criticize LLMs all you want but be aware medical AIs are different in how they work, environmental impact, and are a huge benefit to society.
AI bros can and will try to use ignorance of the difference between Medical AIs and shitty LLMs to score points. Dont let them.