Kenyan Engineer Creates Gloves That Turn Sign Language Into Audible Speech

The aim of the invention by the twenty-five-year-old Kenyan engineer and innovator, Roy Allela, is to improve the communication between deaf people and those who can hear but do not know sign language.

Allela works as a tech evangelist and program manager at Intel and graduated from the University of Nairobi with a degree in Microprocessor Technology and Instrumentation.

According to statistics, about 466 million people have disabling hearing loss around the world, and 34 million of these are children. Disabling hearing loss refers to hearing loss greater than 40 decibels (dB) in the better hearing ear in adults and a hearing loss greater than 30 dB in the better hearing ear in children.

Hearing loss can be caused by genetics, aging, complications at birth, certain infectious diseases, chronic ear infections, the use of particular drugs, and exposure to excessive noise.

Yet, 60% of childhood hearing loss is due to preventable causes. These people benefit from early detection of the issue, hearing aids, captioning and sign language, and various forms of educational and social support.

Namely, Roy has created a set of gloves, called Sign-IO gloves, which translate signed hand movements into audible speech via Bluetooth and a smartphone app.

Even though they are still in the developmental stage, these gloves won awards like the ISHOW Kenya top prize in 2017, the 2018 “Hardware Trailblazer Award” at the American Society of Mechanical Engineers (ASME) global finals in New York, and it also took home a second runner-up acknowledgment at the Royal Academy of Engineering Leaders in Innovation Fellowship in London.

Kenyan Engineer Creates Gloves That Turn Sign Language Into Audible Speech

The sensors of these gloves are located on each finger and detect the positioning of each finger, as well as how much each finger will bend into a given position. The glove connects via Bluetooth to an Android phone which will leverage use the text-to-speech function to provide translated speech to the hand gestures of a person signing.

“The application presents the user with the option of testing and setting the language locale, voice speed and voice pitch as shown in the screenshots. The settings are stored in SharedPreferences.

Kenyan Engineer Creates Gloves That Turn Sign Language Into Audible Speech

The user also sets the read request interval to the Edison for getting the advertised characteristics. It is important that users set their own preferred interval since a user just beginning to learn sign language will sign at a slower rate compared to a sign language expert. “

Kenyan Engineer Creates Gloves That Turn Sign Language Into Audible Speech

Nairobi News reports:

“Allela is among 16 young Africans who have been shortlisted by The Royal Academy of Engineering Africa Prize for inventors from six countries to receive funding, training and mentoring for projects intended to revolutionize sectors from agriculture and science to women’s health.

The winner will be awarded Sh3.2 million (£25,000) while each of the three runners up will receive Sh1.2 million (£10,000).”

Roy got the idea since she had a young niece who is deaf, and her family did not know sign language and struggled to communicate with her.

He says:

“I was trying to envision how my niece’s life would be if she had the same opportunities as everyone else in education, employment — all aspects of life. The general public in Kenya doesn’t understand sign language, so when she goes out, she always needs a translator. Imagine that dependency over the long term; how much that plagues or impairs her progress in life.

When it affects you personally, you see how hard people have it in life. That’s why I’ve really strived to develop this project to completion. My niece wears the gloves, pairs them with her phone or mine, then starts signing. I’m able to understand what she’s saying.”

He adds:

“People speak at different speeds and it’s the same with people who sign: some are really fast, others are slow, so we integrated that into the mobile application so that it’s comfortable for anyone to use it.”

Moreover,

“It fights the stigma associated with being deaf and having a speech impediment. If the gloves look cool, every kid will want to know why you have them on.”

Allela wishes that his gloves are placed in schools for special needs children throughout Kenya, and from there, to positively affect the experiences of numerous deaf of hearing-impaired children.

Loading...