Meta updates Ray-Ban Meta smart glasses to add live translation and live AI

On December 17, 2024, Meta announced that it has begun offering version 11, the latest software update for

https://www.meta.com/ja-jp/blog/quest/ray-ban-meta-v11-software-update-live-ai-translation-shazam/

Meta updates its smart glasses with real-time AI video | TechCrunch
https://techcrunch.com/2024/12/16/meta-updates-its-smart-glasses-with-real-time-ai-video/

Meta adds live AI, live translations, and Shazam to its smart glasses - The Verge
https://www.theverge.com/2024/12/16/24322628/ray-ban-meta-smart-glasses-live-ai-translation-shazam

Ray-Ban Meta software update version 11 will bring two new features to Early Access Program participants:

◆ Live AI
With Live AI, Meta AI will be able to continuously recognize what the user is looking at, allowing the AI and the user to converse more naturally than ever before. You can get hands-free help and inspiration from Meta AI in real time during everyday activities like preparing meals, gardening, and exploring your neighborhood. You can ask Meta AI questions without saying the wake word 'Hey Meta,' refer to what was discussed in the first half of the session, and stop at any time to ask a follow-up question or change the topic. In addition, Live AI will eventually be able to make useful suggestions at the right time even before the user asks a question, but details are unknown.

◆Live translation
Live translation is a feature that Meta CEO Mark Zuckerberg demonstrated at Connect Keynote 2024.

You can watch CEO Zuckerberg's live translation demonstration at around 28 minutes and 12 seconds in the video below.

Connect Keynote 2024 - YouTube


Ray-Ban Meta can translate voice between English, Spanish, French and Italian in real time. When you're talking to someone who speaks one of these languages, you can stream real-time voice translations from Ray-Ban Meta's open-ear speaker or display the translation as text on your smartphone screen. Meta wrote, 'Not only is the live translation feature perfect for travel, it should help break down language barriers and bring people closer together,' and appealed to the live translation feature.

Meta cautions that live AI and live translation are 'still in testing and may not always work correctly.'

In addition, Shazam will be available to all users in software update version 11. Just say 'Hey, Meta. What's this song?' and Shazam will tell you what music is playing hands-free. Meta wrote, 'Everyone has felt this way. You're walking down the street and a great song starts playing, but you can't remember the name or artist of the song at that moment, whether it's a new song, a little-known song, or an old favorite song. However, Ray-Ban Meta will tell you the name of the song when you hear a great song on the go instead of the user.'