A new technology has been developed, which allows users to interact in a virtual environment using mouth gestures, reveals a new study.
The proliferation of affordable virtual reality head-mounted displays provides users with realistic immersive visual experiences. However, head-mounted displays occlude the upper half of a user's face and prevent facial action recognition from the entire face.
Children Who Use Gestures Perform Better in Cognitive Tasks
Children who use gestures perform better than their peers in cognitive tasks, shows a new study.
Advertisement
‘Mouth gestures can be interpreted within virtual reality environment in real-time with the help of the new technology developed.’
Tweet it Now
The study was conducted by the research team at Binghamton University, State University of New York. To combat this issue, Binghamton University Professor of Computer Science Lijun Yin and his team created a new framework that interprets mouth gestures as a medium for interaction within virtual reality in real-time.
Yin's team tested the application on a group of graduate students. Once a user put on a head-mounted display, they were presented with a simplistic game; the objective of the game was to guide the player's avatar around a forest and eat as many cakes as possible.
![Brain Mechanism Underlying the Recognition of Hand Gestures Not Influenced by Vision]( "Brain Mechanism Underlying the Recognition of Hand Gestures Not Influenced by Vision")
Activated brain regions of congenitally blind individuals and activated brain regions of normal sight individuals share common regions.
Players had to select their movement direction using head rotation, move using mouth gestures and could only eat the cake by smiling. The system was able to describe and classify the user's mouth movements, and it achieved high correct recognition rates. The system has also been demonstrated and validated through a real-time virtual reality application.
"We hope to make this applicable to more than one person, maybe two. Think Skype interviews and communication," said Yin.
"Imagine if it felt like you were in the same geometric space, face to face, and the computer program can efficiently depict your facial expressions and replicate them so it looks real."
Though the tech is still in the prototype phase, Yin believes his technology is applicable to a plethora of fields.
"The virtual world isn't only for entertainment. For instance, health care uses VR to help disabled patients," said Yin.
"Medical professionals or even military personal can go through training exercises that may not be possible to experience in real life. This technology allows the experience to be more realistic."
Students Umur Aybars Ciftci and Xing Zhang contributed to this research.
The paper, "Partially occluded facial action recognition and interaction in virtual reality applications," was presented at the 2017 IEEE International Conference on Multimedia and Expo.
Source: Eurekalert
Brain Mechanism Underlying the Recognition of Hand Gestures Not Influenced by Vision
Activated brain regions of congenitally blind individuals and activated brain regions of normal sight individuals share common regions.
Advertisement
Players had to select their movement direction using head rotation, move using mouth gestures and could only eat the cake by smiling. The system was able to describe and classify the user's mouth movements, and it achieved high correct recognition rates. The system has also been demonstrated and validated through a real-time virtual reality application.
"We hope to make this applicable to more than one person, maybe two. Think Skype interviews and communication," said Yin.
"Imagine if it felt like you were in the same geometric space, face to face, and the computer program can efficiently depict your facial expressions and replicate them so it looks real."
Though the tech is still in the prototype phase, Yin believes his technology is applicable to a plethora of fields.
"The virtual world isn't only for entertainment. For instance, health care uses VR to help disabled patients," said Yin.
"Medical professionals or even military personal can go through training exercises that may not be possible to experience in real life. This technology allows the experience to be more realistic."
Students Umur Aybars Ciftci and Xing Zhang contributed to this research.
The paper, "Partially occluded facial action recognition and interaction in virtual reality applications," was presented at the 2017 IEEE International Conference on Multimedia and Expo.
Source: Eurekalert
Infants Can't Actually Copy Our Gestures, Facial Expressions
Imitation is not an innate behaviour in infants, in fact, babies might learn to imitate other people based on watching other people imitate them.
Advertisement
 New App Enables Users to Operate Smartphone With GesturesResearchers have developed a new app enabling users to operate their smartphone with gestures. | Advertisement
|
Advertisement
Recommended Readings
Latest Environmental Health
Forever chemicals or per- and polyfluoroalkyl substances (PFAS) exposure in children, may cause them to mature later during puberty.
To achieve more substantial reductions in emissions, hospital sustainability efforts must extend their focus beyond the surface.
Most parents in Canada support moving school activities indoors to protect children from poor air quality.
The increasing demand for bioinsecticides reflects a broader shift toward sustainable agriculture, prioritizing long-term ecological health and food security.
Health-related consequences of climate change are worsening due to the rapid global heating resulting from greenhouse gas emissions, reveal experts.
