Huawei has launched an Android app designed to help kids with hearing disability to enjoy bedtime stories using sign language. Called the StorySign, app leverages augmented reality and AI tools such as image recognition and optical character recognition (OCR) to display real-time sign language translation for popular books for kids.
The Chinese major has developed StorySign app in a collaboration with the nonprofit European Union for the Deaf, Penguin, and animation gurus Aardman. The app can be downloaded from Google Play and Huawei’s AppGallery in 10 markets across Western Europe, reports VentureBeat.
“At Huawei, we believe in the power of AI and that technology can make a positive difference in the world,” said Huawei’s Western Europe CMO, Andrew Garrihy. “We created StorySign to help make it possible for families with deaf children to enjoy an enriched story time.”
The StorySign app has been developed with an understanding of sign syntax to ensure a seamless translation and user experience. At the launch, the app will feature the popular children’s book ‘Where’s Spot?’, notes Huawei.
With StorySign parents and their families can simply hold their phone up to the words on the page and avatar Star will point out highlight words in sign language.
Also, since sign language varies from country-to-country, StorySign will also ask users to choose preferred sign language variant. At launch, Huawei has included languages such as in British, French, German, Italian, Spanish, Dutch, Portuguese, Irish, Belgian Flemish, and Swiss-German.