Facebook succeeds in outputting thoughts to a computer in real time



In recent years, research on science fiction-like technology called 'reading thoughts with a computer' has actually progressed. Meanwhile, on July 14, 2021, Facebook announced that it has developed a new technology that allows people who have lost their ability to speak due to a stroke to output their thoughts to a computer.

BCI milestone: New research from UCSF with support from Facebook shows the potential of brain-computer interfaces for restoring speech communication

https://tech.fb.com/bci-milestone-new-research-from-ucsf-with-support-from-facebook-shows-the-potential-of-brain-computer-interfaces-for-restoring-speech- communication /

“Neuroprosthesis” Restores Words to Man with Paralysis | UC San Francisco
https://www.ucsf.edu/news/2021/07/420946/neuroprosthesis-restores-words-man-paralysis

Facebook's 'brain reading' tech works but it's still giving up on it --SlashGear
https://www.slashgear.com/facebooks-brain-reading-tech-works-but-its-still-giving-up-on-it-15682598/

In recent years, 'technology to read thoughts directly from the brain' has been attracting attention, including Neuralink, where Tesla and SpaceX founder Elon Musk are conducting research to extract thoughts with brain implants. If such technology is realized, the quality of life of people with physical disabilities will be greatly improved , and it will be possible to store human thoughts in computers and realize a 'hybrid' of humans and AI. It is believed to be.

Facebook Reality Labs , a research organization of Facebook, mainly conducts research in the fields of augmented reality (AR) and virtual reality (VR), but focusing on the above possibilities, it will be possible to output directly in 2017. It announced that it was planning to develop a non-invasive interface.

And on July 14, 2021, Facebook Reality Labs announced the 'Brain Computer Interface (BCI) ', which outputs thoughts to a computer at the same time as people think, as a joint research of a team of researchers at the University of California, San Francisco. .. The initial goal was to develop a non-invasive method, but this study uses brain implants.

The contents of this research are summarized in the following movie.

“Neuroprosthesis” Restores Words to Man with Paralysis --YouTube


Brain implants are placed in the areas that control human vocalizations and send brain signals to a computer.



This is the whole picture. The signal sent from the brain implant is output to the screen through computer processing such as 'brain signal processing', 'utterance detection', 'word classification', and 'language modeling'.



This is the actual video. When a subject who has lost the ability to speak due to a stroke thinks of an answer in his head to the question 'How are you feeling today?' Displayed on the screen, it is displayed as a response in real time. BCI can output 100 words per minute using brain signals. Facebook also states that when printing 15 words per minute, the median word accuracy was as high as 74%.



Meanwhile, Facebook says it 'believes in the long-term potential' of headmounts using BCI technology, but 'focuses its immediate efforts on another neural interface approach that has a short-term path to the market. I decided to let him do it. ' Another approach is Facebook's March 2021 technology that allows you to control your computer with just the movement of your hand. This is to recognize 'how a person wants to move a finger' by reading a signal called surface myoelectric potential (EMG).

Facebook is developing a wristwatch-type device that allows you to control your computer with just the movement of your hand & releases a movie --GIGAZINE

in Science,   Video, Posted by darkhorse_log