So, I'm gonna stir the pot a bit... don't be too harsh...

[Ms. Toad]

15. I have yet to find a single AI summary which is accurate.

It lies as casually as Trump does and unfortunately people assume what it says is true - as you apparently do.

With Google, you at least know where the information is coming from, since you are directed to a specific website. You can verify the accuracy of the website by checking it is reputation. For example, is the medical information coming from the Mayo Clinic - or - some no-name crackpot? For news sources, there are tools to check the factual reliability and political bias of the source.

It terrifies me that people are relying on AI for medical advice. I'm in a number of medical support groups in which the advice given is to paste a medical report into ChatGPT. Someone is going to die, if they haven't already.

You have no such opportunity with AI to easily test the reliability of AI output, because you have no idea where the information came from. You can fact check every single sentence - including and for which a link is provided. It is just as likely to lie about what a source says as it is to use it accurately. I have extensively fact checked several AI sources, in at least a half dozen diverse subject areas (history, medicine, law, just to name 3). Not a single answer was accurate. They generally had grains of truth, mixed well with outright lies (party affiliation of politicians, districts they represent, famous people who share certain medical conditions) and mis-contextualized facts (e.g. applying civil law to criminal cases, or mixing up the very different risk profiles for taking vancomycin orally versus intravenously)

As for telling you "No" the earth is not flat - AI is designed to be a people pleaser. If you challenge it, it is likely to apologize for getting it wrong, them tell you that you are correct the earth is indeed flat.

It is far more dangerous for an unintelligent person to use AI than it is for them to use Google. In fact (moral issues aside), I would be far less concerned about misuse of AI if it was only embraced by intelligent people who fully understood it's limitations and truly used it as a tool to make their work more productive than a replacing their own efforts.