In various scenarios, accurate 3D tracking of ultrasound probes (e.g. by optical or electro-magnetic tracking) is not feasible, but recovering the 3D trajectory of the ultrasound scan would be helpful for diagnosis, measurements, or image registration.
Using only Deep Learning, potentially an inertial measurement unit, and the powerful 3D image registration capabilities of the ImFusion Suite, we have been able to accurately predict probe motion in extremity scans, to reconstruct the 3D shape of the thyroid, and to register liver scans even when there are breathing artifacts.
This work did not only lead to successful productization by piur imaging but also high-profile publications:
Wein, Wolfgang; Lupetti, Mattia; Zettinig, Oliver; Jagoda, Simon; Salehi, Mehrdad; Markova, Viktoria; Zonoobi, Dornoosh; Prevost, Raphael
Three-dimensional thyroid assessment from untracked 2D ultrasound clips Proceedings Article
In: Medical Image Computing and Computer-Assisted Intervention–MICCAI 2020. Lecture Notes in Computer Science., pp. 514-523, Springer, Cham, 2020.
BibTeX | Links:
@inproceedings{wein2020miccai,
title = {Three-dimensional thyroid assessment from untracked 2D ultrasound clips},
author = {Wolfgang Wein and Mattia Lupetti and Oliver Zettinig and Simon Jagoda and Mehrdad Salehi and Viktoria Markova and Dornoosh Zonoobi and Raphael Prevost},
url = {https://www.zettinig.eu/down/wein2020miccai.pdf},
doi = {10.1007/978-3-030-59716-0_49},
year = {2020},
date = {2020-09-29},
urldate = {2020-09-29},
booktitle = {Medical Image Computing and Computer-Assisted Intervention--MICCAI 2020. Lecture Notes in Computer Science.},
volume = {12263},
pages = {514-523},
publisher = {Springer, Cham},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Prevost, Raphael; Salehi, Mehrdad; Jagoda, Simon; Kumar, Navneet; Sprung, Julian; Ladikos, Alexander; Bauer, Robert; Zettinig, Oliver; Wein, Wolfgang
3D Freehand Ultrasound Without External Tracking Using Deep Learning Journal Article
In: Medical Image Analysis, vol. 48, pp. 187β202, 2018.
BibTeX | Links:
@article{prevost2018deep,
title = {3D Freehand Ultrasound Without External Tracking Using Deep Learning},
author = {Raphael Prevost and Mehrdad Salehi and Simon Jagoda and Navneet Kumar and Julian Sprung and Alexander Ladikos and Robert Bauer and Oliver Zettinig and Wolfgang Wein},
url = {https://www.zettinig.eu/down/prevost2018media.pdf},
doi = {10.1016/j.media.2018.06.003},
year = {2018},
date = {2018-01-01},
urldate = {2018-01-01},
journal = {Medical Image Analysis},
volume = {48},
pages = {187--202},
keywords = {},
pubstate = {published},
tppubtype = {article}
}