When AI can't even get simple things straight

[Ms. Toad]

18. I have tested it extensively,

As well as the AI summaries linked to various search engines.

Generative AI is designed to be a fluent, not factual, conversationalist. It is coded to keep the conversation flowing by making crap up to fill gaps in it's "knowledge" or to supplement skimpy sources. It doesn't "understand," for example, that it can't just combine Louisiana law (a system of law not used anywhere else in the US) with Federal law.

I have yet to find a single accurate answer. Parts arec correct, but much is gibberish - made up facts, facts taken out of context and stitched together like some kind of frankenstein answer - with no obvious clue as to what is made up garbage, or when multiple inconsistent sources are combined to create a dramatically inaccurate answer.

Most people didn't bother to fact check. They just copy-paste and spread the trash around. Many aren't even aware they are using AI. I have called people on it based on the copy-pasted answer (with the telltale, "ask me anything" tag line), and they have insisted what they posted is not AI. Those who do know, apparently don't care that they are spreading lies around (not to mention decimating local water supplies).

I find it terrifying that someone would believe that AI has touched their soul.