Page 71 - KBB_Sep_2020

User Groups
Hearing Impaired (HI), Sign Language Interpreters, Special Education Teachers, Normal People communicating with HI
Description and Functionality
Hearing-impaired children can use this computer-assisted learning tool to learn sign language from home without attending a special school. This is particularly important especially to those from rural and remotely located regions who have limited access to special schools for the deaf. Gestural features such as finger joint angles, hand shape and orientation, finger/hand motion, etc. corresponding to different signs will be extracted through gesture analysis and training, and then stored in the database. The computer will synthesize the sign corresponding to a query alphabet, number, word or phrase using image processing, computer vision, graphics and animation. Finger-spelling of query words, especially proper nouns that has no definite sign, can also be created by concatenating signs of the letters forming the word. Similarly, signing of sentences can be created by concatenating signs of individual words and phrases forming the sentence.
State-of-the-art
Unlike the existing online Indian Sign Language dictionaries and courses which use stored images and video clippings to display the sign, the developed tool uses gestural features corresponding to signs of different alphabet, numbers, words and phrases which will be stored in the database with reduced memory requirement. The computer will create the sign corresponding to the query alphabet, number, word or phrase by animation.
Stage of Development
The software has been extensively tested and will soon be available on web for free download.
Technology Developer
Prof. Debashis Ghosh
Indian Institute of Technology, Roorkee
Roorkee, Uttarakhand-247667 ghoshfec@iitr.ac.in
+91 97198 94674
71