Augmented Reality used to teach sign language

Posted on August 28, 2017

(c) Yosei Labs - KinderSIGN

With the technology in the world today, there are infinite possibilities of what can be done and what can be created. Terrence Goh, a recent graduate of Ngee Ann Polytechnic, together with his team at Yosei Labs are in the process of developing KinderSIGN – an assistive technology solution that teaches sign language to children and beginner sign language users.  It comprises an interactive mobile application which uses Augmented Reality and various sets of physical flashcards with images of objects.  KinderSIGN aims to create a more inclusive society by breaking down the parent-child communication barriers and provide a means for the public to learn sign language. The team was recognised at the Ministry of Education’s Special Awards ceremony on Thursday, 17 Aug 2017 after winning the Lee Hsien Loong Interactive Digital Media Smart Nation Award. 

Another interesting example in this field is Deaf Magazine which uses mixed media and augmented reality technology to link written language directly with German sign language.


With special thanks to Sanjana Venkatakrishnan.