A01: Contextually Aware Assistance System for Minimally Invasive Surgery

The aim of the project is to develop an integrated, contextually aware, minimally invasive assistance system to provide support during conventional laparoscopic and robotic-assisted interventions within the OR1® integrated theatre system. A contextually aware assistance that can, for example, visualize risk structures will be generated by means of a knowledge-based, real-time analysis of the operation workflow with intraoperative sensor data. With such a system, the laparoscopic, oncological rectal resection, an intervention predestined for such a system, should become safer, more accurate and easier to operate. At a later stage, the results will also be applied to the surgical therapy of the pancreas.

Project Leaders

Prof. Dr. med. Beat Müller
Dr.-Ing. Stefanie Speidel

Our Team


Bodenstedt S, Wagner M, Mayer B, Stemmer K, Kenngott H, Müller-Stich B, Dillmann R, and Speidel S.

"Image-Based Laparoscopic Bowel Measurement."

International Journal of Computer Assisted Radiology and Surgery, September 26, 2015.


Katić D, Julliard C, Wekerle A, Kenngott H, Müller-Stich BP, Dillmann R, Speidel S, Jannin P, and Gibaud B.

"LapOntoSPM: An Ontology for Laparoscopic Surgeries and Its Application to Surgical Phase Recognition."

International Journal of Computer Assisted Radiology and Surgery 10, no. 9 (September 2015): 1427–34.


Katić D, Wekerle A, Gärtner F, Kenngott H, Müller-Stich BP, Dillmann R, and Speidel S. 

"Knowledge-Driven Formalization of Laparoscopic Surgeries for Rule-Based Intraoperative Context-Aware Assistance."

In Information Processing in Computer-Assisted Interventions, edited by Danail Stoyanov, D. Louis Collins, Ichiro Sakuma, Purang Abolmaesumi, and Pierre Jannin, 158–67. Lecture Notes in Computer Science. Springer International Publishing, 2014


Kenngott HG, Wünscher JJ, Wagner M, Preukschas A, Wekerle A-L, Neher P, Suwelack S, Speidel S, Nickel F, Oladokun D, Maier-Hein L, Dillmann R, Meinzer H-P, Müller-Stich BP.

"OpenHELP (Heidelberg Laparoscopy Phantom): Development of an Open-Source Surgical Evaluation and Training Tool."

Surgical Endoscopy, February 12, 2015.


Kenngott HG, Wagner M, Gondan M, Nickel F, Nolden M, Fetzer A, Weitz J, Fischer L, Speidel S, Meinzer H-P, Böckler D, Büchler MW, Müller-Stich BP.

"Real-Time Image Guidance in Laparoscopic Liver Surgery: First Clinical Experience with a Guidance System Based on Intraoperative CT Imaging."

Surgical Endoscopy 28, no. 3 (March 2014): 933–40.


Maier-Hein L, Kondermann D, Roß T, Mersmann S, Heim E,  Bodenstedt S, Kenngott HG, Sanchez A, Wagner M, Preukschas A, Wekerle A-L, Helfert S, März K, Mehrabi A, Speidel S, Stock C.

"Crowdtruth Validation: A New Paradigm for Validating Algorithms That Rely on Image Correspondences."

International Journal of Computer Assisted Radiology and Surgery, April 2015, 1–12.


Reichard D, Bodenstedt S, Suwelack S, Mayer B, Preukschas A, Wagner M, Kenngott H, Müller-Stich B, Dillmann R, and Speidel S.

"Intraoperative on-the-Fly Organ-Mosaicking for Laparoscopic Surgery."

Journal of Medical Imaging (Bellingham, Wash.) 2, no. 4 (October 2015): 045001.


Röhl S, Bodenstedt S, Suwelack S, Kenngott H, Müller-Stich BP, Dillmann R, and Speidel S.

"Dense GPU-Enhanced Surface Reconstruction from Stereo Endoscopic Images for Intraoperative Registration."

Medical Physics 39, no. 3 (March 1, 2012): 1632–45.


Suwelack S, Röhl S, Bodenstedt S, Reichard D, Dillmann R, dos Santos T, Maier-Hein L, Wagner M, Wünsche J, Kenngott H, Müller BP, Speidel S.

"Physics-Based Shape Matching for Intraoperative Image Guidance."

Medical Physics 41, no. 11 (November 2014): 111901.


Wagner M, Gondan M, Zöllner C, Wünscher JJ, Nickel F, Albala L, Groch A, Suwelack S, Speidel S, Maier-Hein L, Müller-Stich BP, Kenngott HG.

"Electromagnetic Organ Tracking Allows for Real-Time Compensation of Tissue Shift in Image-Guided Laparoscopic Rectal Surgery: Results of a Phantom Study."

Surgical Endoscopy, June 23, 2015.