NVIDIA launches 'Sign,' an AI-based sign language learning tool
NVIDIA has announced a sign language learning tool called ' Sign ' that uses AI. Sign can teach sign language learners how to move their hands, and also has the ability to collect and digitize the hand movements of sign language users.
AI Platform for Teaching American Sign Language | NVIDIA Blog
Sign is an AI app that can help learn American Sign Language. It displays a model of sign language and the trajectory of the hand on the screen, and the learner can learn sign language by imitating the model. It does not require special tools such as a motion tracker, and it seems to recognize hand movements using a webcam.
At the time of writing, Sign has registered 100 different sign languages. Sign also has the ability to digitize and collect hand movements of sign language users, with the goal of collecting a total of 400,000 pieces of data corresponding to 1,000 different sign languages in the future.
The data collection using Sign will be carried out by recruiting volunteers, both beginners and experienced sign language users.
At the time of writing, Sign only focuses on hand movements, but in the future it will be able to recognize head movements and facial expressions, as well as regional variations and slang.
Related Posts:
