Gesture to Speech Conversion in “HINDI” Language for Hearing & Speech Disabled Persons in INDIA

Abstract

Communication to each other is a very important part of human life. Still there are some persons who are not able to speak like normal people they are known as speech impaired persons or in other words we say “dumb and deaf” persons, and for them communication is a challenge. For understanding them, we have to learn their language i.e. sign language or finger language. The proposed system of this project will help to solve this problem up to some extent. In this system gestures are converted into speech by which the communication between normal people and speech impaired person can become much easier. Purpose behind this system is two-fold. This system has different modes of operation like image segmentation, feature extraction, PCA extraction, and applying neural network. The image of the sign gestures are captured through the webcam. Then the image segmentation and feature extraction is processed. The output of feature extraction is the input to the PCA and then output of the PCA plot will given into neural network. Then the sign are converted into speech by using speech recognition system. Through this project the communication gap between speech person is become much smaller between speech impaired persons and normal person.