Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News Editorials & Other Articles General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search

General Discussion

Ms. Toad

(38,950 posts)

19. Have you done the research to back that up?

Reply to anciano (Reply #9)

Fri Jul 3, 2026, 11:48 AM

Friday

I have extensively tested ChatGPT and the summaries associated with a variety of search engines in areas of baking, art history, law, politics, medicine, and history of family members famous enough to have an internet presence that in theory was party of their training database. I have yet to find a single accurate response or summary - Even when I coach it with multiple redirects to the right answer after it initially made crap up.

Virtually all seem plausible, but when you trace back to the sources (if they happen to provide them), they aren't. They state stuff which is nowhere to be found in the sources, or they combine two (or more) inconsistent sources.

Edit history

Please sign in to view edit histories.

Recommendations

1 members have recommended this reply (displayed in chronological order):

moniss

35 replies

= new reply since forum marked as read

Highlight:

When AI can't even get simple things straight [View all] moniss Thursday OP

spending billions of dollars... RussBLib Thursday #1

Most of us could get all the lies we moniss Thursday #2

Call me simple minded, Faux pas Thursday #3

I think that's a bit short sighted... Happy Hoosier Friday #25

AI makes mistakes, but it has been life-changing for me in many ways. I feel lucky to Doodley Thursday #4

Did AI Write that? unweird Thursday #6

wonder how much here is AI text? RussBLib Thursday #11

I use ChatGPT every day. Have you ever tried it? Doodley Friday #16

I have tested it extensively, Ms. Toad Friday #18

No, but again I ask unweird Friday #20

Why? Mossfern Friday #29

I'm with your nephew! I love chatting with AI. anciano Friday #30

AI isn't perfect, but what is? anciano Thursday #5

The problem is that the information being given moniss Thursday #8

"often factually wrong".... anciano Thursday #9

How do you know that it wasn't wrong? Wiz Imp Thursday #12

Like any tool, understanding it has limits and weaknesses is important, but so is in seeing where its strengths are. Doodley Friday #15

Old info ThreeNoSeep Friday #26

🙄💤 Bye! Wiz Imp Friday #27

so have you rigorously researched the responses to be sure they are accurate? RussBLib Thursday #13

Have you done the research to back that up? Ms. Toad Friday #19

Had the same experience as Moniss with Copilot. I asked a question that I was allegorical oracle Friday #32

efficient? Wiz Imp Thursday #10

In my experience, it is more efficient in some areas than any human being. It has a depth of Doodley Friday #14

I believe that the people who knock it haven't discovered its potential. Doodley Friday #17

That is nonsense. Ms. Toad Friday #22

To be fair, the consumer available versions pale in comparison with those used in industry. harumph Thursday #7

Yeah... Hong Kong Cavalier Friday #21

It is downright dangerous for the general population Ms. Toad Friday #24

It's important to remember... Happy Hoosier Friday #23

"(which is what humans are supposedly good at)" Wiz Imp Friday #28

There are different types of LLMs and most do have extensive reasoning capabilities. They can 'think.' Appendix Friday #33

Hard disagree. Happy Hoosier Friday #34

Welcome to DU LetMyPeopleVote Yesterday #35

The AI helping REAL Doctors with medical research and Diagnosis LostOne4Ever Friday #31