Wearable technology will be able to decode sign language

Written by on November 25, 2015 in News with 0 Comments

Deaf woman learning sign languageCollege Station, TX (Reuters) – The communication barrier between deaf people who use sign language and those that don’t understand it may be coming to an end thanks to a new wearable technology being developed at Texas A&M University.

The device incorporates a system of sensors that records the motion of hand gestures, as well as the electromyography or EMG signals produced by muscles in the wrist when signing.

“We decode the muscle activities we are capturing from the wrist. Some of it is coming from the fingers indirectly because if I happen to keep my fist like this versus this, the muscle activation is going to be a little different,” said Roozbeh Jafari, an Associate Professor of Biomedical Engineering at Texas A&M University.

It’s those differences that present the researchers with their biggest challenge. Fine tuning the device to process and translate the different signals accurately, in real time, requires sophisticated algorithms. The other problem is that no two people sign exactly alike, which is why they designed the system to learn from its user.

“When you wear the system for the first time the system operates with some level of accuracy. But as you start using the system more often, the system learns from your behavior and it will adapt its own learning models to fit you,” Jafari added.

Currently the proof of concept device is equipped to send the translated sign language to a computer or smartphone using Bluetooth. Going forward the team hope to miniaturize the device so it can be worn on a users’ wrist like a watch and program it to decipher complete sentences rather than just individual words. The researchers also want to incorporate a synthetic voice speaker, an upgrade that could potentially give the 70 million deaf people around the world a new voice.

(By Ben Gruber)

Tags: , ,

About the Author

About the Author: Thomson Reuters is the world's largest international multimedia news agency, providing investing news, world news, business news, technology news, headline news, small business news, news alerts, personal finance, stock market, and mutual funds information available on Reuters.com, video, mobile, and interactive television platforms. .


If you enjoyed this article, subscribe now to receive more just like it.

Subscribe via RSS Feed

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

%d bloggers like this: