Google announces 'video search feature' but finds fatal mistake in demo video
Google announced several search functions using generative AI in the keynote speech at 'Google I/O 2024' held on Wednesday, May 15, 2024. This announcement included a 'function to search based on shot videos,' but it has become a hot topic that the demo video for the function contains a fatal mistake.
Google I/O 2024: New generative AI experiences in Search
Google's Gemini video search makes factual error in demo - The Verge
https://www.theverge.com/2024/5/14/24156729/googles-gemini-video-search-makes-factual-error-in-demo
A demo video of the 'Search based on recorded videos' function starts at about 57 seconds in the video below.
Search in the Gemini era | Google I/O 2024 - YouTube
A man with a troubled expression on his face holding a film camera. It seems the film advance lever has stuck.
To find out how to fix the camera on Google, I activated the 'search based on video footage' feature and took a picture of the film wind lever.
While recording the video, say something like 'why is the lever not moving all the way' and your words will be displayed on the screen.
A search was performed based on the video and the sentence 'Why doesn't the lever move at all?', and a summary of the search results by AI was displayed. The search term does not include the word 'film wind lever' but only the word 'lever', but the content of the video automatically searches for 'film wind lever'.
Scrolling down, you will see a section of countermeasures created by AI titled 'Here are some things you can try'. However, if you look closely at the countermeasures, you will see that it includes an item called 'Open the back door and gently remove the film it the camera jammed'. However, if you open the back cover with the film you are shooting in, the film will be exposed to light and the contents you have shot will disappear, so this countermeasure is clearly wrong.
However, Google does not seem to have noticed the mistake, as the demo video for the 'video search feature' ends with a scene highlighting the problematic item.
The feature to search based on recorded videos is scheduled to be released for testing to English speakers in the US in Google's new feature testing program 'Search Labs', and will then be available in more areas. Therefore, the feature may be improved by the time it is officially released.
Related Posts:
in Web Service, Video, Posted by log1o_hf