StorySign: Using AI To Help Deaf Children Learn To Read

Huawei are hoping to use AI as an aid for deaf children in learning to read. With around 32 million deaf children throughout the world, the problem of bridging sign-language and text reading might finally be solved. StorySign uses optical character recognition to gather text from a paper book and uses an AI-controlled avatar to sign the contents to the hearing-impaired.

Bridging the Gap

StorySign lifts the words from the page and displays them on your smartphone next to the friendly AI character, Star, who signs the text as each word or phrase is highlighted. This allows children to keep their eyes in one place, making it a little easier to keep up.

The app, which was developed in conjunction with the EU is available for free on all Android devices in 10 EU states and comes with support for 10 languages.

Hello, Star!