A 'SONIC flashlight' developed by a biomedical engineer at the University of Pittsburgh makes the human body seem translucent right in front of your eyes. The prototype device merges the visual outer surface of the patient's skin with a live ultrasound scan of what lies beneath. It creates the effect of a translucent ultrasound image floating in its actual 3D location with the patient, showing blood vessels, muscle tissue, and other internal anatomy.
"In the practice of medicine, the standard method of viewing an image is still to examine a film or screen rather than look directly into the patient," said George Stetten, assistant professor of bioengineering. Doctors now use ultratsound to guide invasive procedures, such as inserting a needle in a vein. But to do so, they must look away from the patient at an ultrasound display screen. This causes a displaced sense of hand and eye coordination.
AdvertisementHis device enables viewers to look at patients and see their internal anatomy. Previous attempts to fuse medical images with direct vision have been largely unsuccessful, in part because of their complexity. Some have tried using miniature video cameras mounted on a headpiece. Others have used an approach similar to Stetten's but requiring the user to wear a tracking device to determine viewer location.
Stetten has eliminated the need for tracking devices and transmitters by taking full advantage of the way in which a translucent mirror superimposes images from both sides of the glass. He strategically positions an ultrasound scanner and the ultrasound display on opposite sides of a half-silvered, translucent mirror. The viewer looks through the mirror to see the patient and the ultrasound scanner positioned in the patient's skin. At the same time, the ultrasound image is projected on the viewer's side of the mirror in perfect alignment with the corresponding location within the patient's body.
This makes the ultrasound image appear to occupy the same physical space as the body part being imaged. Even if the viewing angle changes, the combined images remain true. The effect relies on geometric relationships between the ultrasound slices being scanned, the monitor displaying the slice, and the mirror."We are merging virtual image in 3D with interior of the patient," Stetten said.