A system that recognizes hand gestures to control a robotic scrub nurse or tell a computer to display medical images of the patient during an operation is being developed by researchers.

The "vision-based hand gesture recognition" technology could have other applications, including the coordination of emergency response activities during disasters.
The new approach is a system that uses a camera and specialized algorithms to recognize hand gestures as commands to instruct a computer or robot.
At the same time, a robotic scrub nurse represents a potential new tool that might improve operating-room efficiency, said Wachs.
"One challenge will be to develop the proper shapes of hand poses and the proper hand trajectory movements to reflect and express certain medical functions," said Wachs.
Other challenges include providing computers with the ability to understand the context in which gestures are made and to discriminate between intended gestures versus unintended gestures.
Advertisement
"While it will be very difficult using a robot to achieve the same level of performance as an experienced nurse who has been working with the same surgeon for years, often scrub nurses have had very limited experience with a particular surgeon, maximizing the chances for misunderstandings, delays and sometimes mistakes in the operating room. In that case, a robotic scrub nurse could be better," he said.
Advertisement
The findings have been detailed in the journal Communications of the ACM, the flagship publication of the Association for Computing Machinery.
Source-ANI