Apple announces a function that allows you to talk to others with ``synthetic voice similar to yourself'' just by training for 15 minutes on the iPhone



Apple announced on May 16, 2023 that it will introduce software features to iPhones and Macs to improve visual, auditory, cognitive, and mobility accessibility. Among them, the feature that is particularly noteworthy is ' Live Speech ', which can be used for communication by synthesizing a voice that reproduces your own voice simply by recording your voice into an iPhone or iPad.

Apple previews Live Speech, Personal Voice, and more new accessibility features - Apple

https://www.apple.com/newsroom/2023/05/apple-previews-live-speech-personal-voice-and-more-new-accessibility-features/



Live Speech is scheduled to be installed on iPhone / iPad / Mac, and is a so-called Text-to-Speech function in which the software reads out the entered sentences.



A user reads a randomized set of text aloud and records 15 minutes on an iPhone or iPad.The 15 minutes of recorded audio is then synthesized using on-device machine learning to reproduce the user's voice. . Apple expects users who may lose the ability to speak in the future due to diseases such as

ALS (Amyotrophic Lateral Sclerosis) .



'At the end of the day, the most important thing is being able to communicate with friends and family,' said Philip Green, director of the ALS Patient Advocacy Group. It's extraordinary to be able to synthesize your own voice in just 15 minutes on your iPhone.'

Also announced was 'Point and Speak', which allows visually impaired users to easily manipulate physical objects with letter labels.

Many of the buttons on operable machines, such as microwave oven buttons and elevator buttons, have written instructions, but for visually impaired people, it is difficult to know which button to use if it is not accompanied by Braille. I don't know what function it has. Therefore, when shooting with the 'magnifying glass' application of iPhone or iPad, 'Point and Speak' recognizes fingers and buttons and reads out the characters written on the button you are trying to press.

You can see what kind of function 'Point and Speak' is in one shot by watching the following movie.

Point and Speak in Magnifier makes it easier for users with vision disabilities to interact with physical objects that have several text labels.


In addition, Apple also announced 'Assistive Access', a function that makes it easier to access basic functions such as messages, cameras, photos, music, calls, and FaceTime. According to Apple, by narrowing down the apps and experiences to essential functions, it reduces the cognitive load and makes it easier for people with cognitive disabilities to handle.



Messages also offers a dedicated emoji keyboard.



In addition, the following functions will be added.
・'Made for iPhone hearing devices' that allows you to pair your iPhone with your Mac and customize it so that you can hear it comfortably
・Improved operability of text input by voice.
・'Switch Control' that turns any switch into a virtual game controller and allows you to play games on your iPhone or iPad
- Easier text size adjustment.
- Automatically pause moving images such as messages and GIF animations displayed in Safari.
・You can adjust the reading speed of 'VoiceOver' and Siri's speaking speed from 0.8 times to 2 times.

“Apple has always believed that the best technology is technology built for everyone,” said Apple CEO Tim Cook. We're excited to share with you some of the amazing new features we've built with everyone in mind, giving everyone the opportunity to create, communicate, and do what they love.'

in Mobile,   Software, Posted by log1i_yk