Page 69 - KBB_Sep_2020

User Groups
Hearing Impaired (HI), Sign Language Interpreters, Special Education Teachers, Normal People communicating with HI
Description and Functionality
The web based tool/app converts educational texts in Hindi or English into sign language for communication and education of hearing impaired. Normal people can easily communicate with hearing impaired and vice versa. The software takes English/Hindi text as input and passes it to generate lexical items as tokens. These lexical items are mapped to Hamburg sign language Notation System (HamNoSys) with the use of word to HamNoSys database. These HamNoSys words are converted to Signing Gesture Markup Language (SiGML) which is played by Signing Avatar. The Web and Mobile based application uses 3D Animation and follows ISL grammar rules. The tool support Speech to ISL Sign generation and is capable of Automatic Hindi Transliteration. This tool can be used in public places (such as railway stations) to convert announcements into sign language so that people with hearing impairment can get the information.
State-of-the-art
Hamburg sign language Notation System (HamNoSys) and HamoNoSys based dynamic generation of Sign language has been used instead of video based generation. It is first system of its kind which is available on web for conversion of English text/ Hindi text to Indian Sign Language where animations are generated in real time with the use of avatar.
Stage of Development
The tool can be accessed on web http://www.islfromtext.in or on Android Smartphone using the Android Application –Sanket (from Google Play Store)
Specifications and Approximate Cost
It is a web based system and has two interfaces, one for end user and other for administrator. The end user can generate ISL by typing English/Hindi text, while through admin interface new words can be added in database, HamNoSys can be edited or generated and admin can keep the track of changes.
Technology Developer
Dr. Parteek Kumar
Thapar Institute of Engineering and Technology,
Patiala, Punjab-147004 parteek.bhatia@thapar.edu
+91 9876175046
69