Potentially impacting all AI search engines and chatbots known to poorly paraphrase source links, a German court has ruled that Google is liable for false statements in AI Overviews.
The ruling came in a case flagged by The Decoder, where two publishers found that Google’s AI Overviews incorrectly linked them to scams and other sketchy business practices. After smearing publishers by making affirmative statements like “Yes, [it] is known for dubious business practices and is often perceived as a scam,” Google failed to correct the misleading output, even after the publishers sent a cease-and-desist letter earlier this year.
Google tried the usual arguments to shield itself from liability for false statements in AI Overviews, such as arguing that most users understand that AI outputs aren’t always accurate and must be verified.
I think the idea is that the info is probably true, but has high enough likelihood of being false that you better check anyway, if it’s something that matters. There’s a whole topic in machine learning called “probable approximate correctness” that tries to make that notion precise. Les Valiant’s book of a similar title introduced the concept and looks very good. I have it but haven’t read it yet.