Print 6 comment(s) - last by tmouse.. on Feb 7 at 9:02 AM

Robots could soon possess hand gesture recognition in the emergency room  (Source: Purdue University photo/Mark Simons)
Approach was inspired by the Tom Cruise film, "The Minority Report"

Purdue University researchers are developing a system that controls robots working in the hospital through hand gesture recognition.

Juan Pablo Wachs, an assistant professor of industrial engineering at Purdue University, along with researchers from the Naval Postgraduate School in Monterey, California and Ben-Gurion University of Negev, Israel, are developing a system of robotic scrub nurses and computers that can obey commands through the use of hand gestures in a hospital setting.  

"It's a concept Tom Cruise demonstrated vividly in the film 'Minority Report,'" said Wachs. 

Research on the vision-based hand gesture recognition system started years ago by researchers at Washington Hospital Center and Ben-Gurion University, which included Wachs when he was a research fellow and doctoral student. Now, Wachs is working to develop and continuously improve the system at Purdue University. 

This hand gesture recognition system consists of a camera and specific algorithms that apply anthropometry, which predicts the position of the robot's hands based on where the surgeon's head is. The camera, which is a Kinect camera developed by Microsoft that maps images in 3-D, is mounted over a screen that shows the surgeon medical images of a patient during an operation. The robotic scrub nurse is used to assist the surgeon during surgery and is capable of helping because of advanced algorithms. 

"While it will be very difficult using a robot to achieve the same level of performance as an experienced nurse who has been working with the same surgeon for years, often scrub nurses have had very limited experience with a particular surgeon, maximizing the chances for misunderstandings, delays and sometimes mistakes in the operating room," said Wachs. "In that case, a robotic scrub nurse could be better."

While this technology could have huge benefits in the operating room, such as reducing the length of surgeries, coordinating emergency response efforts and assisting surgeons efficiently during an operation, there are still a few challenges ahead that need to be overcome before this system can be applied to an actual hospital. 

"One challenge will be to develop the proper shapes of hand poses and the proper hand trajectory movements to reflect and express certain medical functions," said Wachs. "You want to use intuitive and natural gestures for the surgeon, to express medical image navigation activities, but you also need to consider cultural and physical differences between surgeons. They may have different preferences regarding what gestures they may want to use."

Other roadblocks that may temporarily hinder this technology would be the development of computers that understand the meaning of certain hand gestures as well as "discriminate" between intended and unintended gestures. 

Wachs and his fellow researchers plan to make the system recognize easy vocabulary and simple gestures. They also want to make it so that surgeons do not have to wear virtual reality gloves, and that the system responds with an "OK" when it understands a command. Of course, the system is to be accurate and as low-cost as possible. In addition, they'd like the system to configure itself quickly when placed in different environments.  

"Eventually we also want to integrate voice recognition, but the biggest challenges are in gesture recognition," said Wachs. "Much is already known about voice recognition." 

This study was published in Communications of the ACM.

Comments     Threshold

This article is over a month old, voting and posting comments is disabled

RE: This is silly
By DarkAvator on 2/6/2011 11:34:17 AM , Rating: 2
Da Vinci first off is already a waste of money with the cost of the machine and training doctors on it. It's is more of a hospital marketing strategy. Yes, surgery with Da vinci does help with healing time compared to open surgery (Laparotomy), but only about a dozen of surgery can be done with a robot. Any currently serious surgery or unpredictable surgery like a trauma case is not done with a robot.

The alternative to robot surgery is laproscopic surgery where surgeon use small holes and manually manipulate the tools poked thru them instead of controlling a robot hand to manipulate the same tools.

On the topic of nurse/scrub tech, surgeons need to develop a better bedside manner, be nice to the nurses, do a pre-surgery checklist much like a pilot, and teach the nurses what to expect, what tools they want next. That's cost effective.

RE: This is silly
By phantom505 on 2/6/2011 11:56:35 AM , Rating: 2
Well I guess the 2 years I worked for some of the worlds best neurosurgeons (as an Neuroscience ICU RN) and the subsequent medical degree I am currently working on disqualifies my opinion.

Thanks for telling me what a laproscopic surgery is though. I couldn't have figured that one out, nor could the other readers on this site.

There is one thing you can't remove from a surgeon: his/her physiologic tremor. Every surgeon I spoke to had nothing but good to say about the technique. Some of the comments were how much smoother it was, how they don't have to worry about tremor in awkward positions and access to very small/difficult structures. The key to neurosurgery is precise access and that often means doing things your hands can not.

Just having a highly flexible optical scope revolutionized neurosurgery, for example.

Yes, there are few procedures, currently, that are well known. Here's the catch, currently. Add more capability to the machine, like I suggested, and perhaps we can expand it.

Trauma surgeries are quite a bit rarer than planned surgeries. To imply there is limited use for da Vinci on that basis is ridiculous.

PS: They do a pre-surgery checklist. (not always the attending but usually his first assistant/senor residents/etc)

"Let's face it, we're not changing the world. We're building a product that helps people buy more crap - and watch porn." -- Seagate CEO Bill Watkins

Most Popular Articles5 Cases for iPhone 7 and 7 iPhone Plus
September 18, 2016, 10:08 AM
Automaker Porsche may expand range of Panamera Coupe design.
September 18, 2016, 11:00 AM
Walmart may get "Robot Shopping Carts?"
September 17, 2016, 6:01 AM
No More Turtlenecks - Try Snakables
September 19, 2016, 7:44 AM
ADHD Diagnosis and Treatment in Children: Problem or Paranoia?
September 19, 2016, 5:30 AM

Copyright 2016 DailyTech LLC. - RSS Feed | Advertise | About Us | Ethics | FAQ | Terms, Conditions & Privacy Information | Kristopher Kubicki