It is clear that Google Search's AI summary function gives strange answers such as 'Use glue to stick cheese to pizza'
Google is starting to add a feature to its search results page that displays an overview of search results using AI . Several users have reported that this new 'AI Overview' feature is giving strange answers.
Should You Add Glue to Pizza Cheese? Google AI Says Yes
https://www.dailydot.com/debug/google-search-results-reddit-pizza-glue-cheese/
The user who posted the problem was: 'When I searched for 'cheese won't stick to pizza,' the AI responded by saying, 'add 1/8 cup of non-toxic glue.''
Google is dead beyond comparison pic.twitter.com/EQIJhvPUoI
— PixelButts (@PixelButts) May 22, 2024
Another user did some research and speculated that the strange answer was probably the result of Google's AI learning from a joke posted on Reddit 11 years ago: 'To make cheese stick to pizza, mix 1/8 cup of glue into your sauce. It helps the sauce stick better, solves the problem of cheese slipping, and gives the sauce a unique flavor. You can use any glue you want, as long as it's non-toxic.'
Seems the origin of the Google AI's conclusion was an 11 year old Reddit post by the eminent scholar, fucksmith. https://t.co/fG8i5ZlWtl pic.twitter.com/0ijXRqA16y
— Kurt Opsahl @[email protected] (@kurtopsahl) May 23, 2024
There have been multiple reports of Google's AI Overview feature giving incorrect answers. The user below searched for 'Has a dog ever played in the NBA?' and the AI responded 'YES.'
https://t.co/NxYlTmcj5a pic.twitter.com/jsfRiTKhbc
— Patrick Cosmos (@veryimportant) May 22, 2024
In response to the question, 'Which US president graduated from the University of Wisconsin-Madison?', Google's AI Overview gives incorrect answers, such as graduating too recently and saying that Andrew Johnson , who was president from 1865 to 1869, earned 14 degrees between 1947 and 2012. Andrew Johnson came from a poor family where both his parents could not read or write, and he never attended school in the first place.
Meanwhile, over in Google Search.
— MMitchell (@mmitchell_ai) May 22, 2024
Andrew Johnson has been killin' it, I never knew. pic.twitter.com/IV2zCmI6Zv
In addition, the guidelines recommend the pointless act of 'cooling the snake' as a way to deal with a rattlesnake bite, as well as the rather unwise actions of 'cutting off the bitten area or sucking out the venom.'
You think they get it right… and it's still wrong. https://t.co/TOvEobsUZi
— ern. (@ErinEARoss) May 20, 2024
The unhelpful answer given when asked how long to boil taro was '15 to 20 minutes, or 1.5 hours.'
Yeah, you know, just whatever pic.twitter.com/6UvStJ1bas
— Onion Weigher 𓄽 𓍝 (@onionweigher) May 18, 2024
In response to the question, 'Is Batman a police officer?', he answered, 'Yes, he is a police officer who practices law as an agent of Detective Jim Gordon.' Indeed, Batman is an ally of James Gordon of the Gotham City Police Department, and he cracks down on criminals, but he is not a police officer.
lel pic.twitter.com/GnWSLw51GV
— Aravind Srinivas (@AravSrinivas) May 23, 2024
'What is a typical occupation for an Aum?' Answer: 'Prisoner'
Prison inmate pic.twitter.com/5gfkAUUTR4
— Doreen 💚 (@roundbirbart) May 22, 2024
'Adding more oil to an oil fire will put it out.'
um.
— Gary Marcus (@GaryMarcus) May 23, 2024
(I can't try this in Canada - does it replicate?) pic.twitter.com/17vYq1TuJo
The following user successfully carried out a 'website poisoning attack' to trick Google's AI into lying by fabricating his or her own award history on a website.
Yes! My website poisoning attack works on Google's new LLM-powered AI overviews! pic.twitter.com/nWyMtl7nMj
— Mark Riedl (@mark_riedl) May 22, 2024
'1919 was 20 years ago.'
https://t.co/4kvJVLDRTb pic.twitter.com/827R4txYD2
— NamesAidan (@MyNamesAidan) May 22, 2024
'What should I do if my turn signals don't make any noise?' 'Change the turn signal fluid.'
An actual search I made pic.twitter.com/6z2t4Jps37
— Iroquois Pliskin (@DaltonEverett_) May 19, 2024
In response to the news site Daily Dot, which reported the issue, Google said, 'The answers in question are extremely rare and don't represent the experiences of the majority of people. The vast majority of our AI Overviews provide high-quality information with links to dig deeper on the web. We use these individual examples to improve our system overall.'
Related Posts:
in Web Service, Posted by log1d_ts