1
|
Mancino AV, Milano FE, Risk MR, Ritacco LE. Open-source navigation system for tracking dissociated parts with multi-registration. Int J Comput Assist Radiol Surg 2023; 18:2167-2177. [PMID: 36881354 DOI: 10.1007/s11548-023-02853-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2022] [Accepted: 02/08/2023] [Indexed: 03/08/2023]
Abstract
PURPOSE During reconstructive surgery, knee and hip replacements, and orthognathic surgery, small misalignments in the pose of prosthesis and bones can lead to severe complications. Hence, the translational and angular accuracies are critical. However, traditional image-based surgical navigation lacks orientation data between structures, and imageless systems are unsuitable for cases of deformed anatomy. We introduce an open-source navigation system using a multiple registration approach that can track instruments, implants, and bones to precisely guide the surgeon in emulating a preoperative plan. METHODS We derived the analytical error of our method and designed a set of phantom experiments to measure its precision and accuracy. Additionally, we trained two classification models to predict the system reliability from fiducial points and surface matching registration data. Finally, to demonstrate the procedure feasibility, we conducted a complete workflow for a real clinical case of a patient with fibrous dysplasia and anatomical misalignment of the right femur using plastic bones. RESULTS The system is able to track the dissociated fragments of the clinical case and average alignment errors in the anatomical phantoms of [Formula: see text] mm and [Formula: see text]. While the fiducial-points registration showed satisfactory results given enough points and covered volume, we acknowledge that the surface refinement step is mandatory when attempting surface matching registrations. CONCLUSION We believe that our device could bring significant advantages for the personalized treatment of complex surgical cases and that its multi-registration attribute is convenient for intraoperative registration loosening cases.
Collapse
Affiliation(s)
- A V Mancino
- Instituto Tecnológico de Buenos Aires, Buenos Aires, Argentina.
- Consejo Nacional de Investigaciones Científicas y Técnicas, Buenos Aires, Argentina.
- Instituto de Medicina Traslacional e Ingeniería Biomédica, Buenos Aires, Argentina.
- Computer Assisted Surgery Unit, Hospital Italiano de Buenos Aires, Buenos Aires, Argentina.
| | - F E Milano
- Instituto Tecnológico de Buenos Aires, Buenos Aires, Argentina
- Consejo Nacional de Investigaciones Científicas y Técnicas, Buenos Aires, Argentina
| | - M R Risk
- Consejo Nacional de Investigaciones Científicas y Técnicas, Buenos Aires, Argentina
- Instituto de Medicina Traslacional e Ingeniería Biomédica, Buenos Aires, Argentina
| | - L E Ritacco
- Consejo Nacional de Investigaciones Científicas y Técnicas, Buenos Aires, Argentina
- Instituto de Medicina Traslacional e Ingeniería Biomédica, Buenos Aires, Argentina
- Computer Assisted Surgery Unit, Hospital Italiano de Buenos Aires, Buenos Aires, Argentina
| |
Collapse
|
2
|
Vasileiou G, Costa MJ, Long C, Wetzler IR, Hoyer J, Kraus C, Popp B, Emons J, Wunderle M, Wenkel E, Uder M, Beckmann MW, Jud SM, Fasching PA, Cavallaro A, Reis A, Hammon M. Breast MRI texture analysis for prediction of BRCA-associated genetic risk. BMC Med Imaging 2020; 20:86. [PMID: 32727387 PMCID: PMC7388478 DOI: 10.1186/s12880-020-00483-2] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2020] [Accepted: 07/10/2020] [Indexed: 01/31/2023] Open
Abstract
Background BRCA1/2 deleterious variants account for most of the hereditary breast and ovarian cancer cases. Prediction models and guidelines for the assessment of genetic risk rely heavily on criteria with high variability such as family cancer history. Here we investigated the efficacy of MRI (magnetic resonance imaging) texture features as a predictor for BRCA mutation status. Methods A total of 41 female breast cancer individuals at high genetic risk, sixteen with a BRCA1/2 pathogenic variant and twenty five controls were included. From each MRI 4225 computer-extracted voxels were analyzed. Non-imaging features including clinical, family cancer history variables and triple negative receptor status (TNBC) were complementarily used. Lasso-principal component regression (L-PCR) analysis was implemented to compare the predictive performance, assessed as area under the curve (AUC), when imaging features were used, and lasso logistic regression or conventional logistic regression for the remaining analyses. Results Lasso-selected imaging principal components showed the highest predictive value (AUC 0.86), surpassing family cancer history. Clinical variables comprising age at disease onset and bilateral breast cancer yielded a relatively poor AUC (~ 0.56). Combination of imaging with the non-imaging variables led to an improvement of predictive performance in all analyses, with TNBC along with the imaging components yielding the highest AUC (0.94). Replacing family history variables with imaging components yielded an improvement of classification performance of ~ 4%, suggesting that imaging compensates the predictive information arising from family cancer structure. Conclusions The L-PCR model uncovered evidence for the utility of MRI texture features in distinguishing between BRCA1/2 positive and negative high-risk breast cancer individuals, which may suggest value to diagnostic routine. Integration of computer-extracted texture analysis from MRI modalities in prediction models and inclusion criteria might play a role in reducing false positives or missed cases especially when established risk variables such as family history are missing.
Collapse
Affiliation(s)
- Georgia Vasileiou
- Institute of Human Genetics, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, Schwabachanlage 10, 91054, Erlangen, Germany.
| | - Maria J Costa
- Siemens Healthcare, Imaging Analytics Germany, 91054, Erlangen, Germany
| | - Christopher Long
- Siemens Healthcare, Imaging Analytics Germany, 91054, Erlangen, Germany
| | - Iris R Wetzler
- Department of Radiology, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91054, Erlangen, Germany
| | - Juliane Hoyer
- Institute of Human Genetics, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, Schwabachanlage 10, 91054, Erlangen, Germany
| | - Cornelia Kraus
- Institute of Human Genetics, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, Schwabachanlage 10, 91054, Erlangen, Germany
| | - Bernt Popp
- Institute of Human Genetics, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, Schwabachanlage 10, 91054, Erlangen, Germany
| | - Julius Emons
- Department of Gynecology and Obstetrics, University Hospital Erlangen, Comprehensive Cancer Center Erlangen-EMN, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91054, Erlangen, Germany
| | - Marius Wunderle
- Department of Gynecology and Obstetrics, University Hospital Erlangen, Comprehensive Cancer Center Erlangen-EMN, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91054, Erlangen, Germany
| | - Evelyn Wenkel
- Department of Radiology, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91054, Erlangen, Germany
| | - Michael Uder
- Department of Radiology, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91054, Erlangen, Germany
| | - Matthias W Beckmann
- Department of Gynecology and Obstetrics, University Hospital Erlangen, Comprehensive Cancer Center Erlangen-EMN, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91054, Erlangen, Germany
| | - Sebastian M Jud
- Department of Gynecology and Obstetrics, University Hospital Erlangen, Comprehensive Cancer Center Erlangen-EMN, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91054, Erlangen, Germany
| | - Peter A Fasching
- Department of Gynecology and Obstetrics, University Hospital Erlangen, Comprehensive Cancer Center Erlangen-EMN, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), 91054, Erlangen, Germany
| | - Alexander Cavallaro
- Department of Radiology, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91054, Erlangen, Germany
| | - André Reis
- Institute of Human Genetics, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, Schwabachanlage 10, 91054, Erlangen, Germany
| | - Matthias Hammon
- Department of Radiology, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91054, Erlangen, Germany
| |
Collapse
|
3
|
Seitz PK, Baumann B, Johnen W, Lissek C, Seidel J, Bendl R. Development of a robot-assisted ultrasound-guided radiation therapy (USgRT). Int J Comput Assist Radiol Surg 2019; 15:491-501. [DOI: 10.1007/s11548-019-02104-y] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2019] [Accepted: 12/04/2019] [Indexed: 11/30/2022]
|
4
|
Dankl L, Mayr A, Kaufmann G, Thaler M, Nogler M, Putzer D. Measuring bone defects for acetabular revision surgery for choosing an appropriate reconstruction strategy: A concept study on plastic models. Comput Biol Med 2019; 111:103336. [PMID: 31276945 DOI: 10.1016/j.compbiomed.2019.103336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2019] [Revised: 05/20/2019] [Accepted: 06/17/2019] [Indexed: 11/28/2022]
Abstract
BACKGROUND Bone defects can be filled with autografts, allografts and artificial bone-materials. The aim of this study was to evaluate whether the digitization of known defect models with a navigation system is a reliable measurement method for estimating the size of a bone defect. METHODS Six preformed, cylindrical and cone-shaped defects on an artificial hip-bone were digitalized by six different observers. Reference volumes were gathered by measuring the depth of the defects, using an alginate impression material to fill out the defects and calculating the volumes from a CT scan. RESULTS One out of the six preformed defects showed a statistically significant difference between the digitalization and the calculation, four showed a significant difference between the digitalization and the mould as well as between the digitalization and the CT calculation. CONCLUSIONS This technique offers satisfactory results and consistent reproducibility when digitalizing big defects with relatively simple shape. Decreasing size and increasing complexity of the defects leads to more imprecise measurements.
Collapse
Affiliation(s)
- Lukas Dankl
- Medical University of Innsbruck, Department of Trauma Surgery, Anichstrasse 35, 6020, Innsbruck, Austria
| | - Agnes Mayr
- Medical University of Innsbruck, Department of Radiology, Anichstrasse 35, 6020, Innsbruck, Austria
| | - Gerhard Kaufmann
- Orthopaedic and Foot Center, Innsbruck, Innrain 2, 6020, Innsbruck, Austria
| | - Martin Thaler
- Medical University of Innsbruck, Department of Orthopaedic Surgery, Anichstrasse 35, 6020, Innsbruck, Austria
| | - Michael Nogler
- Medical University of Innsbruck, Department of Orthopaedics - Experimental Orthopaedics, Innrain 36, 6020, Innsbruck, Austria
| | - David Putzer
- Medical University of Innsbruck, Department of Orthopaedics - Experimental Orthopaedics, Innrain 36, 6020, Innsbruck, Austria.
| |
Collapse
|
5
|
Computed tomography data collection of the complete human mandible and valid clinical ground truth models. Sci Data 2019; 6:190003. [PMID: 30694227 PMCID: PMC6350631 DOI: 10.1038/sdata.2019.3] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2018] [Accepted: 12/14/2018] [Indexed: 11/08/2022] Open
Abstract
Image-based algorithmic software segmentation is an increasingly important topic in many medical fields. Algorithmic segmentation is used for medical three-dimensional visualization, diagnosis or treatment support, especially in complex medical cases. However, accessible medical databases are limited, and valid medical ground truth databases for the evaluation of algorithms are rare and usually comprise only a few images. Inaccuracy or invalidity of medical ground truth data and image-based artefacts also limit the creation of such databases, which is especially relevant for CT data sets of the maxillomandibular complex. This contribution provides a unique and accessible data set of the complete mandible, including 20 valid ground truth segmentation models originating from 10 CT scans from clinical practice without artefacts or faulty slices. From each CT scan, two 3D ground truth models were created by clinical experts through independent manual slice-by-slice segmentation, and the models were statistically compared to prove their validity. These data could be used to conduct serial image studies of the human mandible, evaluating segmentation algorithms and developing adequate image tools.
Collapse
|
6
|
Franz AM, Seitel A, Cheray D, Maier-Hein L. Polhemus EM tracked Micro Sensor for CT-guided interventions. Med Phys 2018; 46:15-24. [PMID: 30414277 DOI: 10.1002/mp.13280] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2018] [Revised: 10/10/2018] [Accepted: 10/11/2018] [Indexed: 12/26/2022] Open
Abstract
PURPOSE Electromagnetic (EM) tracking is a key technology in image-guided therapy. A new EM Micro Sensor was presented by Polhemus Inc.; it is the first to enable localization of medical instruments through their trackers. Different field generators (FGs) are available by Polhemus, one being almost as small as a sugar cube. As accuracy and robustness of tracking are known challenges to using EM trackers in clinical environments, the goal of this study was a standardized assessment of the Micro Sensor in both a laboratory (lab) and a computed tomography (CT) environment. METHODS The Micro Sensor was assessed by means of Hummel et al.'s standardized protocol; it was assessed in conjunction with a Polhemus Liberty tracker and three FGs - with edge lengths of 1 (TX1), 2 (TX2), and 4 (TX4) inches. Precision as well as positional and rotational accuracy were determined in a lab and a CT suite. Distortions by four different metallic cylinders and tracking of two typical medical instruments - a hypodermic needle and a flexible endoscope - were also tested. RESULTS A jitter of 0.02 mm or less was found for all FGs in the different environments, except for the TX2 FG for which no valid data could be obtained in the CT. Errors of 5 cm distance measurements were 0.6 mm or less for all FGs in the lab. While the distance errors of the TX1 FG were only slightly increased up to 1.6 mm in the CT, those of the TX4 FG were found to be up to around 10% of the measured distance (5.4 mm on average). The mean orientation error was found to be 0.9° /0.5° /0.1° for the TX4/TX2/TX1 FG in the lab. In the CT environment, rotation errors were in the same range: less than 1.2° /0.1° for the TX4/TX1 FG. Deviation under the presence of metallic cylinders stayed below 1 mm in most cases. Precision and orientational accuracy do not seem to be affected by instrument tracking and stayed in the same range as for the other measurements whereas distance errors were slightly increased up to 1.7 mm. CONCLUSION This study shows that accurate tracking of medical instruments is possible with the new Micro Sensor; it demonstrated a jitter of 0.01 mm or less, position errors below 2 mm, and rotation errors of less than 0.3° . As with other EM trackers, errors increase when large tracking volumes with ranges of up to 50 cm are required in clinical environments. For smaller tracking volumes with ranges of up to 15 cm, a high accuracy and robustness was found. This is interesting especially for the TX1 FG which can easily be placed in close vicinity to the region of interest.
Collapse
Affiliation(s)
- Alfred M Franz
- Department of Computer Science, Ulm University of Applied Sciences, Ulm, Germany.,Division of Computer Assisted Medical Interventions, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Alexander Seitel
- Division of Computer Assisted Medical Interventions, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Dominique Cheray
- Division of Computer Assisted Medical Interventions, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Lena Maier-Hein
- Division of Computer Assisted Medical Interventions, German Cancer Research Center (DKFZ), Heidelberg, Germany
| |
Collapse
|
7
|
Frank T, Krieger A, Leonard S, Patel NA, Tokuda J. ROS-IGTL-Bridge: an open network interface for image-guided therapy using the ROS environment. Int J Comput Assist Radiol Surg 2017; 12:1451-1460. [PMID: 28567563 DOI: 10.1007/s11548-017-1618-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2017] [Accepted: 05/18/2017] [Indexed: 01/18/2023]
Abstract
PURPOSE With the growing interest in advanced image-guidance for surgical robot systems, rapid integration and testing of robotic devices and medical image computing software are becoming essential in the research and development. Maximizing the use of existing engineering resources built on widely accepted platforms in different fields, such as robot operating system (ROS) in robotics and 3D Slicer in medical image computing could simplify these tasks. We propose a new open network bridge interface integrated in ROS to ensure seamless cross-platform data sharing. METHODS A ROS node named ROS-IGTL-Bridge was implemented. It establishes a TCP/IP network connection between the ROS environment and external medical image computing software using the OpenIGTLink protocol. The node exports ROS messages to the external software over the network and vice versa simultaneously, allowing seamless and transparent data sharing between the ROS-based devices and the medical image computing platforms. RESULTS Performance tests demonstrated that the bridge could stream transforms, strings, points, and images at 30 fps in both directions successfully. The data transfer latency was <1.2 ms for transforms, strings and points, and 25.2 ms for color VGA images. A separate test also demonstrated that the bridge could achieve 900 fps for transforms. Additionally, the bridge was demonstrated in two representative systems: a mock image-guided surgical robot setup consisting of 3D slicer, and Lego Mindstorms with ROS as a prototyping and educational platform for IGT research; and the smart tissue autonomous robot surgical setup with 3D Slicer. CONCLUSION The study demonstrated that the bridge enabled cross-platform data sharing between ROS and medical image computing software. This will allow rapid and seamless integration of advanced image-based planning/navigation offered by the medical image computing software such as 3D Slicer into ROS-based surgical robot systems.
Collapse
Affiliation(s)
- Tobias Frank
- Institute of Mechatronic Systems, Gottfried Wilhelm Leibniz Universität Hannover, Appelstrasse 11 a, 30167, Hannover, Germany.
| | - Axel Krieger
- Sheikh Zayed Institute for Pediatric Surgical Innovation, Childrens National Health System, 111 Michigan Avenue Northwest, Washington, DC, 20010, USA
| | - Simon Leonard
- Department of Computer Science, Johns Hopkins University, 3400 North Charles Street, Baltimore, MD, 21218, USA
| | - Niravkumar A Patel
- Automation and Interventional Medicine (AIM) Laboratory, Worcester Polytechnic Institute, 100 Institute Road, Worcester, MA, 01609, USA
| | - Junichi Tokuda
- Department of Radiology, Brigham and Womens Hospital and Harvard Medical School, 75 Francis Street, Boston, MA, 02115, USA
| |
Collapse
|
8
|
Egger J, Gall M, Wallner J, Boechat P, Hann A, Li X, Chen X, Schmalstieg D. HTC Vive MeVisLab integration via OpenVR for medical applications. PLoS One 2017; 12:e0173972. [PMID: 28323840 PMCID: PMC5360258 DOI: 10.1371/journal.pone.0173972] [Citation(s) in RCA: 62] [Impact Index Per Article: 8.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2016] [Accepted: 03/01/2017] [Indexed: 01/30/2023] Open
Abstract
Virtual Reality, an immersive technology that replicates an environment via computer-simulated reality, gets a lot of attention in the entertainment industry. However, VR has also great potential in other areas, like the medical domain, Examples are intervention planning, training and simulation. This is especially of use in medical operations, where an aesthetic outcome is important, like for facial surgeries. Alas, importing medical data into Virtual Reality devices is not necessarily trivial, in particular, when a direct connection to a proprietary application is desired. Moreover, most researcher do not build their medical applications from scratch, but rather leverage platforms like MeVisLab, MITK, OsiriX or 3D Slicer. These platforms have in common that they use libraries like ITK and VTK, and provide a convenient graphical interface. However, ITK and VTK do not support Virtual Reality directly. In this study, the usage of a Virtual Reality device for medical data under the MeVisLab platform is presented. The OpenVR library is integrated into the MeVisLab platform, allowing a direct and uncomplicated usage of the head mounted display HTC Vive inside the MeVisLab platform. Medical data coming from other MeVisLab modules can directly be connected per drag-and-drop to the Virtual Reality module, rendering the data inside the HTC Vive for immersive virtual reality inspection.
Collapse
Affiliation(s)
- Jan Egger
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz, Austria
- BioTechMed-Graz, Krenngasse 37/1, Graz, Austria
- * E-mail:
| | - Markus Gall
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz, Austria
| | - Jürgen Wallner
- Medical University of Graz, Department of Oral and Maxillofacial Surgery, Auenbruggerplatz 5/1, Graz, Austria
| | - Pedro Boechat
- Medical University of Graz, Department of Oral and Maxillofacial Surgery, Auenbruggerplatz 5/1, Graz, Austria
| | - Alexander Hann
- Department of Internal Medicine I, Ulm University, Albert-Einstein-Allee 23, Ulm, Germany
| | - Xing Li
- Shanghai Jiao Tong University, School of Mechanical Engineering, Shanghai, China
| | - Xiaojun Chen
- Shanghai Jiao Tong University, School of Mechanical Engineering, Shanghai, China
| | - Dieter Schmalstieg
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz, Austria
| |
Collapse
|