Medindia

X

Scientists Develop Visual System That Interprets Sign Languages

by Kathy Jones on  June 4, 2010 at 10:47 PM Research News   - G J E 4
Scientists have selected over twenty signs to develop a new visual interpretation system, which allows deaf people to carry out consultations in the language they commonly use.
 Scientists Develop Visual System That Interprets Sign Languages
Scientists Develop Visual System That Interprets Sign Languages
Advertisement

Signs can vary slightly depending on each user. Project researchers took this into account during the trials carried out with different people to help the system 'become familiarised' with this variability.

Advertisement
The signs recognised by the system were programmed to allow deaf people to maintain a basic conversation, including asking for help or directions.

"For them it is a non artificial way of communicating and at the same time they can engage with people who do not speak sign language since the system translates the symbols into words in real time," CVC-UAB researcher Sergio Escalera said.

The hardware includes a video camera which records image sequences when it detects the presence of a user wanting to make a consultation.

A computer vision and automatic learning system detects face, hand and arm movements, as well as any screen scrolling, and incorporates these into a classification system which identifies each movement with the word associated with the sign.

One of the aspects worth highlighting is the ability to adapt the system to any other sign language, since the methodology used is general. The system would only need to be reprogrammed with the signs used in that specific language.

The amount of signs the system can recognise is also scalable, although researchers do admit that new data will increase the difficulty in differentiating them.

Applications such as the one developed by CVC-UAB researchers require extreme precision in the identification phase and are very difficult to configure given that the surroundings in which they will be used include changes in light and shadow, different physiognomies and speeds at which the signs are formed.

Source: ANI
Advertisement

Post your Comments

Comments should be on the topic and should not be abusive. The editorial team reserves the right to review and moderate the comments posted on the site.
User Avatar
* Your comment can be maximum of 2500 characters
Notify me when reply is posted I agree to the terms and conditions

You May Also Like

Advertisement
View All