New High Tech Gloves that Translate Sign language in real time


The signs would be read out through a smartphone connected to the glove.



A gloves which have ability to translate sign language

Incredible new technology could change the way we communicate with people who are hard of hearing.

Researchers at UCLA created gloves that have the ability to translate sign language into speech in real time.

They have sensors that run along the fingers identifying each word, phrase, or letter in American Sign Language. 

Those motions are then sent to a smart phone app that translates them at one word per second.


And now the question is how it works

The system includes a pair of gloves with thin, stretchable sensors that run the length of each of the five fingers. These sensors, made from electrically conducting yarns, pick up hand motions and finger placements that stand for individual letters, numbers, words and phrases.

The device then turns the finger movements into electrical signals, which are sent to a dollar-coin–sized circuit board worn on the wrist. The board transmits those signals wirelessly to a smartphone that translates them into spoken words at the rate of about a one word per second.

The researchers also added adhesive sensors to testers’ faces — in between their eyebrows and on one side of their mouths — to capture facial expressions that are a part of American Sign Language.

Previous wearable systems that offered translation from American Sign Language were limited by bulky and heavy device designs or were uncomfortable to wear, Chen said.




The device developed by the UCLA team is made from lightweight and inexpensive but long-lasting, stretchable polymers. The electronic sensors are also very flexible and inexpensive.


Key features & summary 


Researchers at UCLA have developed an inexpensive, high-tech glove that can translate sign language into written and spoken words on a smartphone (via Fast Company). The system works in real time and can interpret 660 American Sign Language signs with a promising 98.63 percent accuracy. It could one day be used to teach more people sign language and help deaf people communicate with non-sign language users.

The gloves have stretchable sensors made of electrically-sensing yarn running up each of the five fingers. The signals travel to a dollar coin-sized circuit board placed on the back of the glove, which then transmits wireless signals to smartphone. An app can convert those into text in real time at a rate of up to a word per second (60 words per minute). The team also place adhesive sensors on testers’ faces to capture facial expressions that are part of American Sign language.



The concept isn’t new, but UCLA’s prototype gloves are more comfortable and far less bulky than other designs, the researchers said. Better still, the parts only cost about $50 and could drop even more with large scale production, UCLA assistant professor Jun Chen told Fast Company.

It’s still a prototype and needs to be faster and understand more signs to be practical. However after a few more years of development, it could allow deaf people to communicate more easily. “Our hope is that this opens up an easy way for people who use sign language to communicate directly with non-signers without needing someone else to translate for them,” said Chen.



Critics within the deaf community weren’t quite as impressed, saying deaf signers already have tools to help them communicate. “It would be so much easier if tech focused on user-driven and user-centered design in the first instance,” deaf post-doctoral researcher Gabrielle Hodge told CNN. However, it could also serve as an educational tool. “We hope it can help more people learn sign language themselves,” said Chen







Post a Comment

0 Comments