Augmented Reality App Guides Surgeons During Tumor Removal

Augmented Reality App Guides Surgeons During Tumor Removal

A new app from the Fraunhofer Institute for Medical Image Computing MEVIS in Germany guides surgeons through complex procedures.

John Pugh, BI
  • 8 september 2013

Tablets and smartphones have recently found a wide range of uses in the healthcare industry, from building image databases for doctors to helping patients better understand their surgical procedures. Taking these mobile technologies one step further, we look at an application that takes augmented reality into the operating room to assist doctors with complex procedures. Imagine if at the touch of a button, your surgeon could map your internal organs and pinpoint the correct blood vessel or location of a tumor, rather than having to rely on memory or constantly refer to images and charts.

A new iPad app from the Fraunhofer Institute for Medical Image Computing MEVIS in Germany is using augmented reality technology to help surgeons remove liver tumors without damaging critical vessels within the organ. Before the surgery takes place, a CT scan is performed on the patient, allowing an accompanying software to identify and image the pathways of blood vessels. This information is then transferred to an iPad, which can be used during the surgery.


The surgeon can navigate the imaged liver to see where the vessels are, and if the camera is turned on and pointed at the exposed liver the app automatically superimposes the vessel structure of the organ onto the live picture. Liver surgery is more than a little dangerous – with so many blood vessels, one wrong cut can lead to disaster. When using augmented reality to pinpoint exactly where the surgeon needs to focus, much of the painstaking identification or guesswork is removed from the procedure.


The challenge with complex operations is that a large amount of data must be efficiently reduced so that the surgeon is always supplied with the most recent and important information. Tablet computers such as the iPad are a compact and intuitive way to allow doctors to reference this real-time data quickly and easily. Looking ahead, teams at MEVIS are working to develop navigation systems similar to those found in cars, to project  data directly on the patient, and guide surgeons every step of the way. While doctors will still need to undergo rigorous training to hone their skills, technologies like this one can help eliminate much of the potential human error. This may just be the start, and the future certainly holds much more for interesting innovations using tablets and smartphones in the medical world.

Fraunhofer Institute for Medical Image Computing MEVIS

PSFK has partnered with  Boehringer Ingelheim to bring you a steady stream of inspiring news and ideas in the health and wellness space. Once each week, we will be posting an article on If you would like to gain access to the full stream of content, please check out Boehringer Ingelheim’s Facebook Page, where they are publishing a regular stream of inspiring and informative content.


Why The Apple Watch Is Taking Foot In The Restaurant Industry

Food Today

Chef Turns Invasive Species Into Delicious Sushi

Creator Bun Lai is adapting strange new ingredients for his menu, which responds to the ecological impact of overabundant creatures in the local environment

Travel Today

Build Your Own Subway System In This Minimalist Game

Mini Metro lets you design your own fully functional transit network, simulating the flow of urban commuters with pared-down visuals


Get PSFK's Related Report: Sports Debrief

See All
Work Today

Keyboard Designed To Help Women Use More Assertive Language

The device is a commentary on gender roles in the workplace, and features easy access to "power verbs" that help reinforce a habit of being direct in writing

Arts & Culture Today

Spanish Artist Dreams Up What Animals Would Look Like In Modern Clothing

Yago Partal's portraits depict the fantasized style preferences of creatures worldwide, from an Arctic wolf to a zebra

Fitness & Sport Today

New Data Technologies Make Hyper-Personalized Training A Reality

The Sports Debrief from PSFK Labs looks at how analytics tools are being developed to optimize human performance across all industries

Technology Today

IBM Watson Helps Grammy-Winning Producer Craft An EP

The computer system's data technology generated musical scores for Alex Da Kid's first solo project

Travel Yesterday

30-Year-Old Photographs Used As Travel Guides

A new photo series revolves around tracing the origins of images from the past


Future Of Automotive
Scenarios Driving The Digital Transformation Of An Industry

PSFK Op-Ed october 26, 2016

Creative Leadership Expert: Experiencing A Seismic Shift From Brand Loyalty To Interface Loyalty

Marc Shillum, founder of Chief Creative Office, explains why product designers must rethink the way they capture consumer attention

PSFK Labs october 25, 2016

The Keys For Exceptional Performance On And Off The Field

PSFK Labs' new report highlights five important insights for businesses to perform better than the competition

Children Yesterday

IKEA Is Letting Kids Design Its New Line Of Toys

The products are taken from fanciful drawings that showcase the imagination of those who use it most

Technology Yesterday

Album Turns Into Something New Each Time It’s Streamed

Bill Baird's new album explores the relationship between time and music through a website crafted by design team, One Pixel Wide

Health Yesterday

VR App Prescribed For Pain Relief

A pharmacy chain in Sweden is stepping away from tradition to develop a happy place for the pain-afflicted

Retail Yesterday

Banks Are Coming Together To Create A New Payment Network That Rivals Venmo

A number of financial institutions are collaborating to make a new person-to-person monetary system called Zelle for their customers

Media & Publishing Yesterday

Pocket Camera Aims To Facilitate The Struggles Of Live Streams

The Mevo helps resolve the complexities of streaming video with an intuitive setup and smart editing controls

Health Yesterday

Startup Believes Traceability Will Help Disrupt The Multivitamin Industry

Ritual is a daily supplement for women that traces every ingredient back to its source

Arts & Culture Yesterday

Photo Series Brutally Murders Some Of Your Favorite Fast Food

The portraits by artist duo Ilka & Franz do away with mealtime regulars in a way that is both beautiful and humorous

Mobile Yesterday

Coffeemaker Teaches You How To Make The Perfect Cup

The device comes with an accompanying app that guides novices and experts alike through the brewing process

No search results found.