``Whole body keyboard'' that allows you to read gestures and enter keys with dance



YouTuber's 'full-body keyboard' that allows you to type sentences by gesturing continuously as if you were dancing by taking a pose in front of the camera and entering the corresponding key. Published by Fletcher Heisler.

I made a FULL-BODY keyboard!-YouTube


When Mr. Heisler waved his arms like a flag signal, the letter 'H' in capital letters was entered.



Furthermore, enter the 'e' key rhythmically. Upper case when the palm is open, lower case when the palm is closed.



'l'



When you enter the same input as before, it jumps.



I was able to type ' Hello world! '. This is the whole body keyboard developed by Mr. Heisler.



The whole body keyboard is based on the 'face-controlled keyboard' developed in 2022.



Having learned to type with facial expressions, Heisler had the idea of typing in motions similar to exercise videos from the '80s.



Mr. Heisler looking for a way to enter the alphabet with the whole body.



However, it was too difficult to represent the characters in body shape.



Mr. Heisler arrived at the idea of referring to hand flag signals.



The whole body keyboard code is published on GitHub.

GitHub - everythingishacked/Semaphore: A full-body keyboard using gestures to type through computer vision

https://github.com/everythingishacked/Semaphore



Mr. Heisler, who descended into the thread of Hacker News, a social news site that featured a full-body keyboard, listened to requests from Hacker News users to support emoji input, and can input more efficiently by referring to shorthand. I was responding to the opinion that I should try it.

in Video, Posted by log1l_ks