Robotic Ultrasound

With surgical interventions becoming more and more complex, there is an increasing need for image guidance solutions in the OR. While X-ray systems expose the surgical staff to significant ionizing radiation, and the usage of bulky MRI scanners is regularly not feasible, ultrasound (US) systems could offer a practical and economic solution. However, ultrasound imaging is less straight-forward in terms of manual handling of the transducer and the achievable image quality, and therefore highly depends on the experience and the dexterity of the operating physician. We believe that automatic robotic support for image-guided navigation can overcome these challenges in the operating theater.

Robotic US for Needle Guidance

Interventional robotic 3D ultrasound acquisition of a spine phantom (red) registered with CT image for interventional guidance, e.g. facet joint needle insertion.

In this project, we are investigating ways to perform automatic robotic US acquisitions, including automatic trajectory planning for optimal organ coverage, trajectory execution with force control for sufficient acoustic coupling, 3D compounding, automatic needle guidance and inseration, as well as visual servoing-inspired control laws to track both moving anatomy and moving tools and to update the trajectory in real-time.

Abdominal Robotic US Acquisition

Internal torque sensors of the robot and force control schemes allow safe ultrasound acquisitions.

Update: First results of an ongoing clinical study (see publication below) demonstrate that robotic ultrasound-assisted facet joint insertions lead to success rates comparable to current clinical practice while lowering the X-ray dose and offering additional anatomical context for needle trajectory planning.

Have a look at our publications:

Robotic ultrasound-guided facet joint insertion

Esteban, Javier; Simson, Walter; Witzig, Sebastian Requena; Rienmüller, Anna; Virga, Salvatore; Frisch, Benjamin; Zettinig, Oliver; Sakara, Drazen; Ryang, Yu-Mi; Navab, Nassir; Hennersperger, Christoph

Robotic ultrasound-guided facet joint insertion Journal Article

In: International Journal of Computer Assisted Radiology and Surgery, 13 (6), pp. 895–904, 2018.

BibTeX | Links:

On the Reproducibility of Expert-Operated and Robotic Ultrasound Acquisitions

Kojcev, Risto; Khakzar, Ashkan; Fuerst, Bernhard; Zettinig, Oliver; Fakhry, Carole; DeJong, Robert; Richmon, Jeremy; Taylor, Russell; Sinibaldi, Edoardo; Navab, Nassir

On the Reproducibility of Expert-Operated and Robotic Ultrasound Acquisitions Journal Article

In: International Journal of Computer Assisted Radiology and Surgery, 12 (6), pp. 1003–1011, 2017.

BibTeX | Links:

Towards MRI-Based Autonomous Robotic US Acquisitions: A First Feasibility Study

Hennersperger, Christoph; Fuerst, Bernhard; Virga, Salvatore; Zettinig, Oliver; Frisch, Benjamin; Neff, Thomas; Navab, Nassir

Towards MRI-Based Autonomous Robotic US Acquisitions: A First Feasibility Study Journal Article

In: IEEE Transactions on Medical Imaging, 36 (2), pp. 538–548, 2017.

BibTeX | Links:

3D Ultrasound Registration-based Visual Servoing for Neurosurgical Navigation

Zettinig, Oliver; Frisch, Benjamin; Virga, Salvatore; Esposito, Marco; Rienmüller, Anna; Meyer, Bernhard; Hennersperger, Christoph; Ryang, Yu-Mi; Navab, Nassir

3D Ultrasound Registration-based Visual Servoing for Neurosurgical Navigation Journal Article

In: International Journal of Computer Assisted Radiology and Surgery, 12 (9), pp. 1607–1619, 2017.

BibTeX | Links:

Dual-Robot Ultrasound-Guided Needle Placement: Closing the Planning-Imaging-Action 	Loop

Kojcev, Risto; Fuerst, Bernhard; Zettinig, Oliver; Fotouhi, Javad; Lee, Sing Chun; Frisch, Benjamin; Taylor, Russell; Sinibaldi, Edoardo; Navab, Nassir

Dual-Robot Ultrasound-Guided Needle Placement: Closing the Planning-Imaging-Action Loop Journal Article

In: International Journal of Computer Assisted Radiology and Surgery, 11 (6), pp. 1173–1181, 2016.

BibTeX | Links:

Automatic Force-Compliant Robotic Ultrasound Screening of Abdominal Aortic Aneurysms

Virga, Salvatore; Zettinig, Oliver; Esposito, Marco; Pfister, Karin; Frisch, Benjamin; Neff, Thomas; Navab, Nassir; Hennersperger, Christoph

Automatic Force-Compliant Robotic Ultrasound Screening of Abdominal Aortic Aneurysms Inproceedings

In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 508–513, 2016.

BibTeX | Links:

Collaborative Robotic Ultrasound: Towards Clinical Application

Frisch, Benjamin; Zettinig, Oliver; Fuerst, Bernhard; Virga, Salvatore; Hennersperger, Christoph; Navab, Nassir

Collaborative Robotic Ultrasound: Towards Clinical Application Inproceedings

In: Radiological Society of North America (RSNA) Annual Meeting, pp. SSM12-04, 2016.

BibTeX | Links:

Toward Real-time 3D Ultrasound Registration-based Visual Servoing for Interventional Navigation

Zettinig, Oliver; Fuerst, Bernhard; Kojcev, Risto; Esposito, Marco; Salehi, Mehrdad; Wein, Wolfgang; Rackerseder, Julia; Sinibaldi, Edoardo; Frisch, Benjamin; Navab, Nassir

Toward Real-time 3D Ultrasound Registration-based Visual Servoing for Interventional Navigation Inproceedings

In: IEEE International Conference on Robotics and Automation (ICRA), pp. 945–950, IEEE 2016.

BibTeX | Links: