1
|
Cheng P, Cao X, Yang Y, Zhang G, He Y. Automatically recognize and segment morphological features of the 3D vertebra based on topological data analysis. Comput Biol Med 2022; 149:106031. [DOI: 10.1016/j.compbiomed.2022.106031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2022] [Revised: 08/02/2022] [Accepted: 08/20/2022] [Indexed: 11/26/2022]
|
2
|
Cui Y, Zhu J, Duan Z, Liao Z, Wang S, Liu W. Artificial Intelligence in Spinal Imaging: Current Status and Future Directions. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:11708. [PMID: 36141981 PMCID: PMC9517575 DOI: 10.3390/ijerph191811708] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Revised: 09/14/2022] [Accepted: 09/15/2022] [Indexed: 06/16/2023]
Abstract
Spinal maladies are among the most common causes of pain and disability worldwide. Imaging represents an important diagnostic procedure in spinal care. Imaging investigations can provide information and insights that are not visible through ordinary visual inspection. Multiscale in vivo interrogation has the potential to improve the assessment and monitoring of pathologies thanks to the convergence of imaging, artificial intelligence (AI), and radiomic techniques. AI is revolutionizing computer vision, autonomous driving, natural language processing, and speech recognition. These revolutionary technologies are already impacting radiology, diagnostics, and other fields, where automated solutions can increase precision and reproducibility. In the first section of this narrative review, we provide a brief explanation of the many approaches currently being developed, with a particular emphasis on those employed in spinal imaging studies. The previously documented uses of AI for challenges involving spinal imaging, including imaging appropriateness and protocoling, image acquisition and reconstruction, image presentation, image interpretation, and quantitative image analysis, are then detailed. Finally, the future applications of AI to imaging of the spine are discussed. AI has the potential to significantly affect every step in spinal imaging. AI can make images of the spine more useful to patients and doctors by improving image quality, imaging efficiency, and diagnostic accuracy.
Collapse
Affiliation(s)
- Yangyang Cui
- Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China
- Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China
- Biomechanics and Biotechnology Lab, Research Institute of Tsinghua University in Shenzhen, Shenzhen 518057, China
| | - Jia Zhu
- Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China
- Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China
- Biomechanics and Biotechnology Lab, Research Institute of Tsinghua University in Shenzhen, Shenzhen 518057, China
| | - Zhili Duan
- Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China
- Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China
- Biomechanics and Biotechnology Lab, Research Institute of Tsinghua University in Shenzhen, Shenzhen 518057, China
| | - Zhenhua Liao
- Biomechanics and Biotechnology Lab, Research Institute of Tsinghua University in Shenzhen, Shenzhen 518057, China
| | - Song Wang
- Biomechanics and Biotechnology Lab, Research Institute of Tsinghua University in Shenzhen, Shenzhen 518057, China
| | - Weiqiang Liu
- Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China
- Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China
- Biomechanics and Biotechnology Lab, Research Institute of Tsinghua University in Shenzhen, Shenzhen 518057, China
| |
Collapse
|
3
|
Rak M, Steffen J, Meyer A, Hansen C, Tönnies KD. Combining convolutional neural networks and star convex cuts for fast whole spine vertebra segmentation in MRI. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2019; 177:47-56. [PMID: 31319960 DOI: 10.1016/j.cmpb.2019.05.003] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/16/2018] [Revised: 03/26/2019] [Accepted: 05/09/2019] [Indexed: 06/10/2023]
Abstract
BACKGROUND AND OBJECTIVE We propose an automatic approach for fast vertebral body segmentation in three-dimensional magnetic resonance images of the whole spine. Previous works are limited to the lower thoracolumbar section and often take minutes to compute, which is problematic in clinical routine, for study data sets with numerous subjects or when the cervical or upper thoracic spine is to be analyzed. METHODS We address these limitations by a novel graph cut formulation based on vertebra patches extracted along the spine. For each patch, our formulation incorporates appearance and shape information derived from a task-specific convolutional neural network as well as star-convexity constraints that ensure a topologically correct segmentation of each vertebra. When segmenting vertebrae individually, ambiguities will occur due to overlapping segmentations of adjacent vertebrae. We tackle this problem by novel non-overlap constraints between neighboring patches based on so-called encoding swaps. The latter allow us to obtain a globally optimal multi-label segmentation of all vertebrae in polynomial time. RESULTS We validated our approach on two data sets. The first contains T1- and T2-weighted whole spine images of 64 subjects with varying health conditions. The second comprises 23 T2-weighted thoracolumbar images of young healthy adults and is publicly available. Our method yielded Dice coefficients of 93.8 ± 2.6% and 96.0 ± 1.0% for both data sets with a run time of 1.35 ± 0.08 s and 0.90 ± 0.03 s per vertebra on consumer hardware. A complete whole spine segmentation took 32.4 ± 1.92 s on average. CONCLUSIONS Our results are superior to those of previous works at a fraction of their run time, which illustrates the efficiency and effectiveness of our whole spine segmentation approach.
Collapse
Affiliation(s)
- Marko Rak
- Department of Simulation and Graphics, University of Magdeburg Universitätsplatz 2, Magdeburg, 39106 Germany.
| | - Johannes Steffen
- Department of Simulation and Graphics, University of Magdeburg Universitätsplatz 2, Magdeburg, 39106 Germany.
| | - Anneke Meyer
- Department of Simulation and Graphics, University of Magdeburg Universitätsplatz 2, Magdeburg, 39106 Germany
| | - Christian Hansen
- Department of Simulation and Graphics, University of Magdeburg Universitätsplatz 2, Magdeburg, 39106 Germany
| | - Klaus-Dietz Tönnies
- Department of Simulation and Graphics, University of Magdeburg Universitätsplatz 2, Magdeburg, 39106 Germany
| |
Collapse
|
4
|
Galbusera F, Casaroli G, Bassani T. Artificial intelligence and machine learning in spine research. JOR Spine 2019; 2:e1044. [PMID: 31463458 PMCID: PMC6686793 DOI: 10.1002/jsp2.1044] [Citation(s) in RCA: 128] [Impact Index Per Article: 21.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/14/2018] [Revised: 01/31/2019] [Accepted: 01/31/2019] [Indexed: 12/21/2022] Open
Abstract
Artificial intelligence (AI) and machine learning (ML) techniques are revolutionizing several industrial and research fields like computer vision, autonomous driving, natural language processing, and speech recognition. These novel tools are already having a major impact in radiology, diagnostics, and many other fields in which the availability of automated solution may benefit the accuracy and repeatability of the execution of critical tasks. In this narrative review, we first present a brief description of the various techniques that are being developed nowadays, with special focus on those used in spine research. Then, we describe the applications of AI and ML to problems related to the spine which have been published so far, including the localization of vertebrae and discs in radiological images, image segmentation, computer-aided diagnosis, prediction of clinical outcomes and complications, decision support systems, content-based image retrieval, biomechanics, and motion analysis. Finally, we briefly discuss major ethical issues related to the use of AI in healthcare, namely, accountability, risk of biased decisions as well as data privacy and security, which are nowadays being debated in the scientific community and by regulatory agencies.
Collapse
Affiliation(s)
- Fabio Galbusera
- Laboratory of Biological Structures MechanicsIRCCS Istituto Ortopedico GaleazziMilanItaly
| | - Gloria Casaroli
- Laboratory of Biological Structures MechanicsIRCCS Istituto Ortopedico GaleazziMilanItaly
| | - Tito Bassani
- Laboratory of Biological Structures MechanicsIRCCS Istituto Ortopedico GaleazziMilanItaly
| |
Collapse
|
5
|
Computed tomography data collection of the complete human mandible and valid clinical ground truth models. Sci Data 2019; 6:190003. [PMID: 30694227 PMCID: PMC6350631 DOI: 10.1038/sdata.2019.3] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2018] [Accepted: 12/14/2018] [Indexed: 11/08/2022] Open
Abstract
Image-based algorithmic software segmentation is an increasingly important topic in many medical fields. Algorithmic segmentation is used for medical three-dimensional visualization, diagnosis or treatment support, especially in complex medical cases. However, accessible medical databases are limited, and valid medical ground truth databases for the evaluation of algorithms are rare and usually comprise only a few images. Inaccuracy or invalidity of medical ground truth data and image-based artefacts also limit the creation of such databases, which is especially relevant for CT data sets of the maxillomandibular complex. This contribution provides a unique and accessible data set of the complete mandible, including 20 valid ground truth segmentation models originating from 10 CT scans from clinical practice without artefacts or faulty slices. From each CT scan, two 3D ground truth models were created by clinical experts through independent manual slice-by-slice segmentation, and the models were statistically compared to prove their validity. These data could be used to conduct serial image studies of the human mandible, evaluating segmentation algorithms and developing adequate image tools.
Collapse
|
6
|
Fallah F, Walter SS, Bamberg F, Yang B. Simultaneous Volumetric Segmentation of Vertebral Bodies and Intervertebral Discs on Fat-Water MR Images. IEEE J Biomed Health Inform 2018; 23:1692-1701. [PMID: 30281501 DOI: 10.1109/jbhi.2018.2872810] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Fat-water magnetic resonance (MR) images allow automated noninvasive analysis of morphological properties and fat fractions of vertebral bodies (VBs) and intervertebral discs (IVDs) that constitute an important part of human biomechanical systems. In this paper, we propose a fully automated approach for simultaneously segmenting multiple VBs and IVDs on fat-water MR images without prior localization or geometry estimation. This method involved a hierarchical random forest (HRF) classifier and a hierarchical conditional random field (HCRF) that encoded a multi-resolution image pyramid based on a set of multiscale local and contextual features. The HRF classifier employed penalized multivariate linear discriminants and SMOTEBagging to handle limited and imbalanced training data with large feature dimension. The HCRF estimated optimum labels according to their spatial and hierarchical consistencies by using the layer-wise significant features determined over the trained HRF classifier. To handle variable sample numbers at different resolutions, resolution-specific hyperparameters were used. This method was trained and evaluated for segmenting 15 thoracic and lumbar VBs and their IVDs on fat-water MR images of a subset of a large cohort data set. It was further evaluated for segmenting seven IVDs of the lower spine on fat-water images of a public grand challenge. These evaluations revealed the comparable accuracy of this method with the state-of-the-art while requiring less computational burden due to a simultaneous localization and segmentation.
Collapse
|
7
|
Semi-Automatic Segmentation of Vertebral Bodies in MR Images of Human Lumbar Spines. APPLIED SCIENCES-BASEL 2018; 8. [PMID: 30637136 PMCID: PMC6326189 DOI: 10.3390/app8091586] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
We propose a semi-automatic algorithm for the segmentation of vertebral bodies in magnetic resonance (MR) images of the human lumbar spine. Quantitative analysis of spine MR images often necessitate segmentation of the image into specific regions representing anatomic structures of interest. Existing algorithms for vertebral body segmentation require heavy inputs from the user, which is a disadvantage. For example, the user needs to define individual regions of interest (ROIs) for each vertebral body, and specify parameters for the segmentation algorithm. To overcome these drawbacks, we developed a semi-automatic algorithm that considerably reduces the need for user inputs. First, we simplified the ROI placement procedure by reducing the requirement to only one ROI, which includes a vertebral body; subsequently, a correlation algorithm is used to identify the remaining vertebral bodies and to automatically detect the ROIs. Second, the detected ROIs are adjusted to facilitate the subsequent segmentation process. Third, the segmentation is performed via graph-based and line-based segmentation algorithms. We tested our algorithm on sagittal MR images of the lumbar spine and achieved a 90% dice similarity coefficient, when compared with manual segmentation. Our new semi-automatic method significantly reduces the user's role while achieving good segmentation accuracy.
Collapse
|
8
|
Cabitza F, Locoro A, Banfi G. Machine Learning in Orthopedics: A Literature Review. Front Bioeng Biotechnol 2018; 6:75. [PMID: 29998104 PMCID: PMC6030383 DOI: 10.3389/fbioe.2018.00075] [Citation(s) in RCA: 119] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2018] [Accepted: 05/23/2018] [Indexed: 12/12/2022] Open
Abstract
In this paper we present the findings of a systematic literature review covering the articles published in the last two decades in which the authors described the application of a machine learning technique and method to an orthopedic problem or purpose. By searching both in the Scopus and Medline databases, we retrieved, screened and analyzed the content of 70 journal articles, and coded these resources following an iterative method within a Grounded Theory approach. We report the survey findings by outlining the articles' content in terms of the main machine learning techniques mentioned therein, the orthopedic application domains, the source data and the quality of their predictive performance.
Collapse
Affiliation(s)
- Federico Cabitza
- Dipartimento di Informatica, Sistemistica e Comunicazione, Universitá degli Studi di Milano-Bicocca, Milan, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | | | - Giuseppe Banfi
- Dipartimento di Informatica, Sistemistica e Comunicazione, Universitá degli Studi di Milano-Bicocca, Milan, Italy
| |
Collapse
|
9
|
Wallner J, Hochegger K, Chen X, Mischak I, Reinbacher K, Pau M, Zrnc T, Schwenzer-Zimmerer K, Zemann W, Schmalstieg D, Egger J. Clinical evaluation of semi-automatic open-source algorithmic software segmentation of the mandibular bone: Practical feasibility and assessment of a new course of action. PLoS One 2018; 13:e0196378. [PMID: 29746490 PMCID: PMC5944980 DOI: 10.1371/journal.pone.0196378] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2016] [Accepted: 04/12/2018] [Indexed: 11/19/2022] Open
Abstract
INTRODUCTION Computer assisted technologies based on algorithmic software segmentation are an increasing topic of interest in complex surgical cases. However-due to functional instability, time consuming software processes, personnel resources or licensed-based financial costs many segmentation processes are often outsourced from clinical centers to third parties and the industry. Therefore, the aim of this trial was to assess the practical feasibility of an easy available, functional stable and licensed-free segmentation approach to be used in the clinical practice. MATERIAL AND METHODS In this retrospective, randomized, controlled trail the accuracy and accordance of the open-source based segmentation algorithm GrowCut was assessed through the comparison to the manually generated ground truth of the same anatomy using 10 CT lower jaw data-sets from the clinical routine. Assessment parameters were the segmentation time, the volume, the voxel number, the Dice Score and the Hausdorff distance. RESULTS Overall semi-automatic GrowCut segmentation times were about one minute. Mean Dice Score values of over 85% and Hausdorff Distances below 33.5 voxel could be achieved between the algorithmic GrowCut-based segmentations and the manual generated ground truth schemes. Statistical differences between the assessment parameters were not significant (p<0.05) and correlation coefficients were close to the value one (r > 0.94) for any of the comparison made between the two groups. DISCUSSION Complete functional stable and time saving segmentations with high accuracy and high positive correlation could be performed by the presented interactive open-source based approach. In the cranio-maxillofacial complex the used method could represent an algorithmic alternative for image-based segmentation in the clinical practice for e.g. surgical treatment planning or visualization of postoperative results and offers several advantages. Due to an open-source basis the used method could be further developed by other groups or specialists. Systematic comparisons to other segmentation approaches or with a greater data amount are areas of future works.
Collapse
Affiliation(s)
- Jürgen Wallner
- Department of Oral & Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 5/1, Graz, Austria
- Computer Algorithms for Medicine (Cafe) Laboratory, Graz, Austria
| | - Kerstin Hochegger
- Computer Algorithms for Medicine (Cafe) Laboratory, Graz, Austria
- Institute for Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz, Austria
| | - Xiaojun Chen
- School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Irene Mischak
- Department of Dental Medicine and Oral Health, Medical University of Graz, Billrothgasse 4, Graz, Austria
| | - Knut Reinbacher
- Department of Oral & Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 5/1, Graz, Austria
| | - Mauro Pau
- Department of Oral & Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 5/1, Graz, Austria
| | - Tomislav Zrnc
- Department of Oral & Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 5/1, Graz, Austria
| | - Katja Schwenzer-Zimmerer
- Department of Oral & Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 5/1, Graz, Austria
| | - Wolfgang Zemann
- Department of Oral & Maxillofacial Surgery, Medical University of Graz, Auenbruggerplatz 5/1, Graz, Austria
| | - Dieter Schmalstieg
- Institute for Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz, Austria
| | - Jan Egger
- Computer Algorithms for Medicine (Cafe) Laboratory, Graz, Austria
- Institute for Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz, Austria
- BioTechMed-Graz, Krenngasse 37/1, Graz, Austria
| |
Collapse
|
10
|
Hille G, Saalfeld S, Serowy S, Tönnies K. Vertebral body segmentation in wide range clinical routine spine MRI data. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 155:93-99. [PMID: 29512508 DOI: 10.1016/j.cmpb.2017.12.013] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2017] [Revised: 11/27/2017] [Accepted: 12/11/2017] [Indexed: 06/08/2023]
Abstract
BACKGROUND AND OBJECTIVE In this work we propose a 3D vertebral body segmentation approach for clinical magnetic resonance (MR) spine imaging. So far, vertebrae segmentation approaches in MR spine imaging are either limited to particular MR imaging sequences or require minutes to compute, which can be hindering in clinical routine. The major contribution of our work is a reasonably precise segmentation result, within seconds and with minimal user interaction, for spine MR imaging commonly used in clinical routine. Our focus lies on the applicability towards a large variety of clinical MR imaging sequences, dealing with low image quality, high anisotropy and spine pathologies. METHODS Our method starts with a intensity correction step to deal with bias field artifacts and a minimal user-assisted initialization. Next, appearance-based vertebral body probability maps guide a subsequent hybrid level-set segmentation. RESULTS We tested our method on different MR imaging sequences from 48 subjects. Overall, our evaluation set contains 63 datasets including 419 vertebral bodies, which differ in age, sex and presence of spine pathologies. This is the largest set of reference segmentations of clinical routine spine MR imaging so far. We achieved a Dice coefficient of 86.0%, a mean Euclidean surface distance error of 1.59 ± 0.24 mm and a Hausdorff distance of 6.86 mm. CONCLUSIONS These results illustrate the robustness of our segmentation approach towards the variety of MR image data, which is a pivotal aspect for clinical usefulness and reliable diagnosis.
Collapse
Affiliation(s)
- Georg Hille
- Department of Simulation and Graphics, University of Magdeburg, Universitätsplatz 2, Magdeburg 39106, Germany.
| | - Sylvia Saalfeld
- Department of Simulation and Graphics, University of Magdeburg, Universitätsplatz 2, Magdeburg 39106, Germany
| | - Steffen Serowy
- Department of Neuroradiology, University Hospital of Magdeburg, Leipziger Straße 44, Magdeburg 39120, Germany
| | - Klaus Tönnies
- Department of Simulation and Graphics, University of Magdeburg, Universitätsplatz 2, Magdeburg 39106, Germany
| |
Collapse
|
11
|
Egger J, Nimsky C, Chen X. Vertebral body segmentation with GrowCut: Initial experience, workflow and practical application. SAGE Open Med 2017; 5:2050312117740984. [PMID: 29163946 PMCID: PMC5686877 DOI: 10.1177/2050312117740984] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2016] [Accepted: 10/16/2017] [Indexed: 11/16/2022] Open
Abstract
Objectives: Spinal diseases are very common; for example, the risk of osteoporotic fracture is 40% for White women and 13% for White men in the United States during their lifetime. Hence, the total number of surgical spinal treatments is on the rise with the aging population, and accurate diagnosis is of great importance to avoid complications and a reappearance of the symptoms. Imaging and analysis of a vertebral column is an exhausting task that can lead to wrong interpretations. The overall goal of this contribution is to study a cellular automata-based approach for the segmentation of vertebral bodies between the compacta and surrounding structures yielding to time savings and reducing interpretation errors. Methods: To obtain the ground truth, T2-weighted magnetic resonance imaging acquisitions of the spine were segmented in a slice-by-slice procedure by several neurosurgeons. Subsequently, the same vertebral bodies have been segmented by a physician using the cellular automata approach GrowCut. Results: Manual and GrowCut segmentations have been evaluated against each other via the Dice Score and the Hausdorff distance resulting in 82.99% ± 5.03% and 18.91 ± 7.2 voxel, respectively. Moreover, the times have been determined during the slice-by-slice and the GrowCut course of actions, indicating a significantly reduced segmentation time (5.77 ± 0.73 min) of the algorithmic approach. Conclusion: In this contribution, we used the GrowCut segmentation algorithm publicly available in three-dimensional Slicer for three-dimensional segmentation of vertebral bodies. To the best of our knowledge, this is the first time that the GrowCut method has been studied for the usage of vertebral body segmentation. In brief, we found that the GrowCut segmentation times were consistently less than the manual segmentation times. Hence, GrowCut provides an alternative to a manual slice-by-slice segmentation process.
Collapse
Affiliation(s)
- Jan Egger
- Institute of Computer Graphics and Vision, Graz University of Technology (TUG), Graz, Austria.,BioTechMed-Graz, Graz, Austria.,Department of Neurosurgery, University Hospital Marburg, Marburg, Germany.,Computer Algorithms for Medicine (Cafe) Laboratory, Graz, Austria
| | - Christopher Nimsky
- Department of Neurosurgery, University Hospital Marburg, Marburg, Germany
| | - Xiaojun Chen
- School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
12
|
Hann A, Bettac L, Haenle MM, Graeter T, Berger AW, Dreyhaupt J, Schmalstieg D, Zoller WG, Egger J. Algorithm guided outlining of 105 pancreatic cancer liver metastases in Ultrasound. Sci Rep 2017; 7:12779. [PMID: 28986569 PMCID: PMC5630585 DOI: 10.1038/s41598-017-12925-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2017] [Accepted: 09/20/2017] [Indexed: 12/19/2022] Open
Abstract
Manual segmentation of hepatic metastases in ultrasound images acquired from patients suffering from pancreatic cancer is common practice. Semiautomatic measurements promising assistance in this process are often assessed using a small number of lesions performed by examiners who already know the algorithm. In this work, we present the application of an algorithm for the segmentation of liver metastases due to pancreatic cancer using a set of 105 different images of metastases. The algorithm and the two examiners had never assessed the images before. The examiners first performed a manual segmentation and, after five weeks, a semiautomatic segmentation using the algorithm. They were satisfied in up to 90% of the cases with the semiautomatic segmentation results. Using the algorithm was significantly faster and resulted in a median Dice similarity score of over 80%. Estimation of the inter-operator variability by using the intra class correlation coefficient was good with 0.8. In conclusion, the algorithm facilitates fast and accurate segmentation of liver metastases, comparable to the current gold standard of manual segmentation.
Collapse
Affiliation(s)
- Alexander Hann
- Department of Internal Medicine I, Ulm University, Ulm, Germany. .,Department of Internal Medicine and Gastroenterology, Katharinenhospital, Kriegsbergstraße 60, 70174, Stuttgart, Germany.
| | - Lucas Bettac
- Department of Internal Medicine I, Ulm University, Ulm, Germany
| | - Mark M Haenle
- Department of Internal Medicine I, Ulm University, Ulm, Germany
| | - Tilmann Graeter
- Department of Diagnostic and Interventional Radiology, Ulm University, Ulm, Germany
| | | | - Jens Dreyhaupt
- Institute of Epidemiology & Medical Biometry, Ulm University, Ulm, Germany
| | - Dieter Schmalstieg
- Institute for Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Austria
| | - Wolfram G Zoller
- Department of Internal Medicine and Gastroenterology, Katharinenhospital, Kriegsbergstraße 60, 70174, Stuttgart, Germany
| | - Jan Egger
- Institute for Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Austria.,BioTechMed, Krenngasse 37/1, 8010, Graz, Austria
| |
Collapse
|
13
|
Egger J, Wallner J, Gall M, Chen X, Schwenzer-Zimmerer K, Reinbacher K, Schmalstieg D. Computer-aided position planning of miniplates to treat facial bone defects. PLoS One 2017; 12:e0182839. [PMID: 28817607 PMCID: PMC5560576 DOI: 10.1371/journal.pone.0182839] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2017] [Accepted: 07/25/2017] [Indexed: 11/18/2022] Open
Abstract
In this contribution, a software system for computer-aided position planning of miniplates to treat facial bone defects is proposed. The intra-operatively used bone plates have to be passively adapted on the underlying bone contours for adequate bone fragment stabilization. However, this procedure can lead to frequent intra-operatively performed material readjustments especially in complex surgical cases. Our approach is able to fit a selection of common implant models on the surgeon's desired position in a 3D computer model. This happens with respect to the surrounding anatomical structures, always including the possibility of adjusting both the direction and the position of the used osteosynthesis material. By using the proposed software, surgeons are able to pre-plan the out coming implant in its form and morphology with the aid of a computer-visualized model within a few minutes. Further, the resulting model can be stored in STL file format, the commonly used format for 3D printing. Using this technology, surgeons are able to print the virtual generated implant, or create an individually designed bending tool. This method leads to adapted osteosynthesis materials according to the surrounding anatomy and requires further a minimum amount of money and time.
Collapse
Affiliation(s)
- Jan Egger
- Institute for Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Graz, Austria
- BioTechMed-Graz, Graz, Austria
| | - Jürgen Wallner
- Department of Oral & Maxillofacial Surgery, Medical University of Graz, Graz, Styria, Austria
| | - Markus Gall
- Institute for Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Graz, Austria
| | - Xiaojun Chen
- Institute of Biomedical Manufacturing and Life Quality Engineering, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | | | - Knut Reinbacher
- Department of Oral & Maxillofacial Surgery, Medical University of Graz, Graz, Styria, Austria
| | - Dieter Schmalstieg
- Institute for Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Graz, Austria
| |
Collapse
|
14
|
Gall M, Schmalstieg D, Egger J. Computer-aided planning and reconstruction of cranial 3D implants. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2016:1179-1183. [PMID: 28268535 DOI: 10.1109/embc.2016.7590915] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
In this contribution, a prototype for semiautomatic computer-aided planning and reconstruction of cranial 3D Implants is presented. The software prototype guides the user through the workflow, beginning with loading and mirroring the patient's head to obtain an initial curvature of the cranial implant. However, naïve mirroring is not sufficient for an implant, because human heads are in general too asymmetric. Thus, the user can perform Laplacian smoothing, followed by Delaunay triangulation, for generating an aesthetic looking and well-fitting implant. Finally, our software prototype allows to save the designed 3D model of the implant as a STL-file for 3D printing. The 3D printed implant can be used for further pre-interventional planning or even as the final implant for the patient. In summary, our findings show that a customized MeVisLab prototype can be an alternative to complex commercial planning software, which may not be available in a clinic.
Collapse
|
15
|
Gaonkar B, Xia Y, Villaroman DS, Ko A, Attiah M, Beckett JS, Macyszyn L. Multi-Parameter Ensemble Learning for Automated Vertebral Body Segmentation in Heterogeneously Acquired Clinical MR Images. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE-JTEHM 2017; 5:1800412. [PMID: 29018631 PMCID: PMC5515511 DOI: 10.1109/jtehm.2017.2717982] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/14/2016] [Revised: 02/14/2017] [Accepted: 05/30/2017] [Indexed: 11/20/2022]
Abstract
The development of quantitative imaging biomarkers in medicine requires automatic delineation of relevant anatomical structures using available imaging data. However, this task is complicated in clinical medicine due to the variation in scanning parameters and protocols, even within a single medical center. Existing literature on automatic image segmentation using MR data is based on the analysis of highly homogenous images obtained using a fixed set of pulse sequence parameters (TR/TE). Unfortunately, algorithms that operate on fixed scanning parameters do not avail themselves to real-world daily clinical use due to the existing variation in scanning parameters and protocols. Thus, it is necessary to develop algorithmic techniques that can address the challenge of MR image segmentation using real clinical data. Toward this goal, we developed a multi-parametric ensemble learning technique to automatically detect and segment lumbar vertebral bodies using MR images of the spine. We use spine imaging data to illustrate our techniques since low back pain is an extremely common condition and a typical spine clinic evaluates patients that have been referred with a wide range of scanning parameters. This method was designed with special emphasis on robustness so that it can perform well despite the inherent variation in scanning protocols. Specifically, we show how a single multi-parameter ensemble model trained with manually labeled T2 scans can autonomously segment vertebral bodies on scans with echo times varying between 24 and 147 ms and relaxation times varying between 1500 and 7810 ms. Furthermore, even though the model was trained using T2-MR imaging data, it can accurately segment vertebral bodies on T1-MR and CT, further demonstrating the robustness and versatility of our methodology. We believe that robust segmentation techniques, such as the one presented here, are necessary for translating computer assisted diagnosis into everyday clinical practice.
Collapse
Affiliation(s)
- Bilwaj Gaonkar
- Department of NeurosurgeryUniversity of California at Los Angeles
| | - Yihao Xia
- Department of NeurosurgeryUniversity of California at Los Angeles
| | | | - Allison Ko
- Department of NeurosurgeryUniversity of California at Los Angeles
| | - Mark Attiah
- Department of NeurosurgeryUniversity of California at Los Angeles
| | - Joel S Beckett
- Department of NeurosurgeryUniversity of California at Los Angeles
| | - Luke Macyszyn
- Department of NeurosurgeryUniversity of California at Los Angeles
| |
Collapse
|
16
|
Interactive Outlining of Pancreatic Cancer Liver Metastases in Ultrasound Images. Sci Rep 2017; 7:892. [PMID: 28420871 PMCID: PMC5429849 DOI: 10.1038/s41598-017-00940-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2016] [Accepted: 03/20/2017] [Indexed: 02/01/2023] Open
Abstract
Ultrasound (US) is the most commonly used liver imaging modality worldwide. Due to its low cost, it is increasingly used in the follow-up of cancer patients with metastases localized in the liver. In this contribution, we present the results of an interactive segmentation approach for liver metastases in US acquisitions. A (semi-) automatic segmentation is still very challenging because of the low image quality and the low contrast between the metastasis and the surrounding liver tissue. Thus, the state of the art in clinical practice is still manual measurement and outlining of the metastases in the US images. We tackle the problem by providing an interactive segmentation approach providing real-time feedback of the segmentation results. The approach has been evaluated with typical US acquisitions from the clinical routine, and the datasets consisted of pancreatic cancer metastases. Even for difficult cases, satisfying segmentations results could be achieved because of the interactive real-time behavior of the approach. In total, 40 clinical images have been evaluated with our method by comparing the results against manual ground truth segmentations. This evaluation yielded to an average Dice Score of 85% and an average Hausdorff Distance of 13 pixels.
Collapse
|
17
|
Egger J, Gall M, Wallner J, Boechat P, Hann A, Li X, Chen X, Schmalstieg D. HTC Vive MeVisLab integration via OpenVR for medical applications. PLoS One 2017; 12:e0173972. [PMID: 28323840 PMCID: PMC5360258 DOI: 10.1371/journal.pone.0173972] [Citation(s) in RCA: 62] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2016] [Accepted: 03/01/2017] [Indexed: 01/30/2023] Open
Abstract
Virtual Reality, an immersive technology that replicates an environment via computer-simulated reality, gets a lot of attention in the entertainment industry. However, VR has also great potential in other areas, like the medical domain, Examples are intervention planning, training and simulation. This is especially of use in medical operations, where an aesthetic outcome is important, like for facial surgeries. Alas, importing medical data into Virtual Reality devices is not necessarily trivial, in particular, when a direct connection to a proprietary application is desired. Moreover, most researcher do not build their medical applications from scratch, but rather leverage platforms like MeVisLab, MITK, OsiriX or 3D Slicer. These platforms have in common that they use libraries like ITK and VTK, and provide a convenient graphical interface. However, ITK and VTK do not support Virtual Reality directly. In this study, the usage of a Virtual Reality device for medical data under the MeVisLab platform is presented. The OpenVR library is integrated into the MeVisLab platform, allowing a direct and uncomplicated usage of the head mounted display HTC Vive inside the MeVisLab platform. Medical data coming from other MeVisLab modules can directly be connected per drag-and-drop to the Virtual Reality module, rendering the data inside the HTC Vive for immersive virtual reality inspection.
Collapse
Affiliation(s)
- Jan Egger
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz, Austria
- BioTechMed-Graz, Krenngasse 37/1, Graz, Austria
- * E-mail:
| | - Markus Gall
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz, Austria
| | - Jürgen Wallner
- Medical University of Graz, Department of Oral and Maxillofacial Surgery, Auenbruggerplatz 5/1, Graz, Austria
| | - Pedro Boechat
- Medical University of Graz, Department of Oral and Maxillofacial Surgery, Auenbruggerplatz 5/1, Graz, Austria
| | - Alexander Hann
- Department of Internal Medicine I, Ulm University, Albert-Einstein-Allee 23, Ulm, Germany
| | - Xing Li
- Shanghai Jiao Tong University, School of Mechanical Engineering, Shanghai, China
| | - Xiaojun Chen
- Shanghai Jiao Tong University, School of Mechanical Engineering, Shanghai, China
| | - Dieter Schmalstieg
- Institute of Computer Graphics and Vision, Graz University of Technology, Inffeldgasse 16c/II, Graz, Austria
| |
Collapse
|
18
|
Egger J, Hochegger K, Gall M, Chen X, Reinbacher K, Schwenzer-Zimmerer K, Schmalstieg D, Wallner J. Algorithmic evaluation of lower jawbone segmentations. SPIE PROCEEDINGS 2017; 10137:101370C. [DOI: 10.1117/12.2249532] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2025]
|
19
|
Baxter JSH, Inoue J, Drangova M, Peters TM. Shape complexes: the intersection of label orderings and star convexity constraints in continuous max-flow medical image segmentation. J Med Imaging (Bellingham) 2016; 3:044005. [PMID: 28018937 DOI: 10.1117/1.jmi.3.4.044005] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2016] [Accepted: 11/28/2016] [Indexed: 11/14/2022] Open
Abstract
Optimization-based segmentation approaches deriving from discrete graph-cuts and continuous max-flow have become increasingly nuanced, allowing for topological and geometric constraints on the resulting segmentation while retaining global optimality. However, these two considerations, topological and geometric, have yet to be combined in a unified manner. The concept of "shape complexes," which combine geodesic star convexity with extendable continuous max-flow solvers, is presented. These shape complexes allow more complicated shapes to be created through the use of multiple labels and super-labels, with geodesic star convexity governed by a topological ordering. These problems can be optimized using extendable continuous max-flow solvers. Previous approaches required computationally expensive coordinate system warping, which are ill-defined and ambiguous in the general case. These shape complexes are demonstrated in a set of synthetic images as well as vessel segmentation in ultrasound, valve segmentation in ultrasound, and atrial wall segmentation from contrast-enhanced CT. Shape complexes represent an extendable tool alongside other continuous max-flow methods that may be suitable for a wide range of medical image segmentation problems.
Collapse
Affiliation(s)
- John S H Baxter
- Western University, Robarts Research Institute, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada; Western University, Biomedical Engineering Graduate Program, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada
| | - Jiro Inoue
- Western University , Robarts Research Institute, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada
| | - Maria Drangova
- Western University, Robarts Research Institute, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada; Western University, Biomedical Engineering Graduate Program, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada
| | - Terry M Peters
- Western University, Robarts Research Institute, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada; Western University, Biomedical Engineering Graduate Program, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada
| |
Collapse
|
20
|
Hwang D, Kim S, Abeydeera NA, Statum S, Masuda K, Chung CB, Siriwanarangsun P, Bae WC. Quantitative magnetic resonance imaging of the lumbar intervertebral discs. Quant Imaging Med Surg 2016; 6:744-755. [PMID: 28090450 DOI: 10.21037/qims.2016.12.09] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
Human lumbar spine is composed of multiple tissue components that serve to provide structural stability and proper nutrition. Conventional magnetic resonance (MR) imaging techniques have been useful for evaluation of IVD, but inadequate at imaging the discovertebral junction and ligamentous tissues due primarily to their short T2 nature. Ultrashort time to echo (UTE) MR techniques acquire sufficient MR signal from these short T2 tissues, thereby allowing direct and quantitative evaluation. This article discusses the anatomy of the lumbar spine, MR techniques available for morphologic and quantitative MR evaluation of long and short T2 tissues of the lumbar spine, considerations for T2 relaxation modeling and fitting, and existing and new techniques for spine image post-processing, focusing on segmentation. This article will be of interest to radiologic and orthopaedic researchers performing lumbar spine imaging.
Collapse
Affiliation(s)
- Dosik Hwang
- Department of Radiology, VA San Diego Healthcare System, San Diego, CA, USA; ; School of Electrical and Electronic Engineering, Yonsei University, Seoul, Korea
| | - Sewon Kim
- School of Electrical and Electronic Engineering, Yonsei University, Seoul, Korea
| | - Nirusha A Abeydeera
- Department of Radiology, University of California-San Diego, La Jolla, CA, USA
| | - Sheronda Statum
- Department of Radiology, VA San Diego Healthcare System, San Diego, CA, USA; ; Department of Radiology, University of California-San Diego, La Jolla, CA, USA
| | - Koichi Masuda
- Department of Orthopaedic Surgery, University of California-San Diego, La Jolla, CA, USA
| | - Christine B Chung
- Department of Radiology, VA San Diego Healthcare System, San Diego, CA, USA; ; Department of Radiology, University of California-San Diego, La Jolla, CA, USA
| | - Palanan Siriwanarangsun
- Department of Radiology, University of California-San Diego, La Jolla, CA, USA;; Department of Radiology, Faculty of Medicine, Siriraj Hospital, Mahidol University, Bangkok, Thailand
| | - Won C Bae
- Department of Radiology, VA San Diego Healthcare System, San Diego, CA, USA; ; Department of Radiology, University of California-San Diego, La Jolla, CA, USA
| |
Collapse
|
21
|
Zheng G, Chu C, Belavý DL, Ibragimov B, Korez R, Vrtovec T, Hutt H, Everson R, Meakin J, Andrade IL, Glocker B, Chen H, Dou Q, Heng PA, Wang C, Forsberg D, Neubert A, Fripp J, Urschler M, Stern D, Wimmer M, Novikov AA, Cheng H, Armbrecht G, Felsenberg D, Li S. Evaluation and comparison of 3D intervertebral disc localization and segmentation methods for 3D T2 MR data: A grand challenge. Med Image Anal 2016; 35:327-344. [PMID: 27567734 DOI: 10.1016/j.media.2016.08.005] [Citation(s) in RCA: 41] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2016] [Revised: 07/19/2016] [Accepted: 08/16/2016] [Indexed: 10/21/2022]
Abstract
The evaluation of changes in Intervertebral Discs (IVDs) with 3D Magnetic Resonance (MR) Imaging (MRI) can be of interest for many clinical applications. This paper presents the evaluation of both IVD localization and IVD segmentation methods submitted to the Automatic 3D MRI IVD Localization and Segmentation challenge, held at the 2015 International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI2015) with an on-site competition. With the construction of a manually annotated reference data set composed of 25 3D T2-weighted MR images acquired from two different studies and the establishment of a standard validation framework, quantitative evaluation was performed to compare the results of methods submitted to the challenge. Experimental results show that overall the best localization method achieves a mean localization distance of 0.8 mm and the best segmentation method achieves a mean Dice of 91.8%, a mean average absolute distance of 1.1 mm and a mean Hausdorff distance of 4.3 mm, respectively. The strengths and drawbacks of each method are discussed, which provides insights into the performance of different IVD localization and segmentation methods.
Collapse
Affiliation(s)
- Guoyan Zheng
- Institute for Surgical Technology and Biomechanics, University of Bern, Switzerland.
| | - Chengwen Chu
- Institute for Surgical Technology and Biomechanics, University of Bern, Switzerland
| | - Daniel L Belavý
- Institute of Physical Activity and Nutrition Research, Deakin University, Burwood, Victoria, Australia; Charité University Medical School Berlin, Germany
| | | | | | | | - Hugo Hutt
- University of Exeter, The United Kingdom
| | | | | | | | | | - Hao Chen
- The Chinese University of HongKong, China
| | - Qi Dou
- The Chinese University of HongKong, China
| | | | | | - Daniel Forsberg
- Sectra, Linköping, Sweden; Case Western Reserve University and University Hospitals Case Medical Center, USA
| | - Aleš Neubert
- University of Queensland, Australia; The Australian e-Health Research Centre, CSIRO Health and Biosecurity, Australia
| | - Jurgen Fripp
- The Australian e-Health Research Centre, CSIRO Health and Biosecurity, Australia
| | | | - Darko Stern
- Ludwig Boltzmann Institute for Clinical Forensic Imaging, Austria
| | - Maria Wimmer
- VRVis Center for Virtual Reality and Visualization, Austria
| | | | - Hui Cheng
- Institute for Surgical Technology and Biomechanics, University of Bern, Switzerland
| | | | | | - Shuo Li
- University of Western Ontario, Canada.
| |
Collapse
|
22
|
On computerized methods for spine analysis in MRI: a systematic review. Int J Comput Assist Radiol Surg 2016; 11:1445-65. [DOI: 10.1007/s11548-016-1350-2] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2015] [Accepted: 01/06/2016] [Indexed: 10/22/2022]
|
23
|
Model-Based Segmentation of Vertebral Bodies from MR Images with 3D CNNs. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION – MICCAI 2016 2016. [DOI: 10.1007/978-3-319-46723-8_50] [Citation(s) in RCA: 38] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/02/2022]
|
24
|
Chu C, Belavý DL, Armbrecht G, Bansmann M, Felsenberg D, Zheng G. Fully Automatic Localization and Segmentation of 3D Vertebral Bodies from CT/MR Images via a Learning-Based Method. PLoS One 2015; 10:e0143327. [PMID: 26599505 PMCID: PMC4658120 DOI: 10.1371/journal.pone.0143327] [Citation(s) in RCA: 55] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2015] [Accepted: 11/03/2015] [Indexed: 11/18/2022] Open
Abstract
In this paper, we address the problems of fully automatic localization and segmentation of 3D vertebral bodies from CT/MR images. We propose a learning-based, unified random forest regression and classification framework to tackle these two problems. More specifically, in the first stage, the localization of 3D vertebral bodies is solved with random forest regression where we aggregate the votes from a set of randomly sampled image patches to get a probability map of the center of a target vertebral body in a given image. The resultant probability map is then further regularized by Hidden Markov Model (HMM) to eliminate potential ambiguity caused by the neighboring vertebral bodies. The output from the first stage allows us to define a region of interest (ROI) for the segmentation step, where we use random forest classification to estimate the likelihood of a voxel in the ROI being foreground or background. The estimated likelihood is combined with the prior probability, which is learned from a set of training data, to get the posterior probability of the voxel. The segmentation of the target vertebral body is then done by a binary thresholding of the estimated probability. We evaluated the present approach on two openly available datasets: 1) 3D T2-weighted spine MR images from 23 patients and 2) 3D spine CT images from 10 patients. Taking manual segmentation as the ground truth (each MR image contains at least 7 vertebral bodies from T11 to L5 and each CT image contains 5 vertebral bodies from L1 to L5), we evaluated the present approach with leave-one-out experiments. Specifically, for the T2-weighted MR images, we achieved for localization a mean error of 1.6 mm, and for segmentation a mean Dice metric of 88.7% and a mean surface distance of 1.5 mm, respectively. For the CT images we achieved for localization a mean error of 1.9 mm, and for segmentation a mean Dice metric of 91.0% and a mean surface distance of 0.9 mm, respectively.
Collapse
Affiliation(s)
- Chengwen Chu
- Institution for Surgical Technology and Biomechanics, University of Bern, 3014 Bern, Switzerland
| | - Daniel L. Belavý
- Charité - University Medicine Berlin, Centre of Muscle and Bone Research, Campus Benjamin Franklin, Free University & Humboldt-University Berlin, 12200 Berlin, Germany
- Centre for Physical Activity and Nutrition Research, School of Exercise and Nutrition Sciences, Deakin University Burwood Campus, Burwood VIC 3125, Australia
| | - Gabriele Armbrecht
- Centre for Physical Activity and Nutrition Research, School of Exercise and Nutrition Sciences, Deakin University Burwood Campus, Burwood VIC 3125, Australia
| | - Martin Bansmann
- Institut für Diagnostische und Interventionelle Radiologie, Krankenhaus Porz Am Rhein gGmbH, 51149 Köln, Germany
| | - Dieter Felsenberg
- Centre for Physical Activity and Nutrition Research, School of Exercise and Nutrition Sciences, Deakin University Burwood Campus, Burwood VIC 3125, Australia
| | - Guoyan Zheng
- Institution for Surgical Technology and Biomechanics, University of Bern, 3014 Bern, Switzerland
| |
Collapse
|
25
|
Egger J, Busse H, Brandmaier P, Seider D, Gawlitza M, Strocka S, Voglreiter P, Dokter M, Hofmann M, Kainz B, Chen X, Hann A, Boechat P, Yu W, Freisleben B, Alhonnoro T, Pollari M, Moche M, Schmalstieg D. RFA-cut: Semi-automatic segmentation of radiofrequency ablation zones with and without needles via optimal s-t-cuts. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2015; 2015:2423-2429. [PMID: 26736783 DOI: 10.1109/embc.2015.7318883] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
In this contribution, we present a semi-automatic segmentation algorithm for radiofrequency ablation (RFA) zones via optimal s-t-cuts. Our interactive graph-based approach builds upon a polyhedron to construct the graph and was specifically designed for computed tomography (CT) acquisitions from patients that had RFA treatments of Hepatocellular Carcinomas (HCC). For evaluation, we used twelve post-interventional CT datasets from the clinical routine and as evaluation metric we utilized the Dice Similarity Coefficient (DSC), which is commonly accepted for judging computer aided medical segmentation tasks. Compared with pure manual slice-by-slice expert segmentations from interventional radiologists, we were able to achieve a DSC of about eighty percent, which is sufficient for our clinical needs. Moreover, our approach was able to handle images containing (DSC=75.9%) and not containing (78.1%) the RFA needles still in place. Additionally, we found no statistically significant difference (p<;0.423) between the segmentation results of the subgroups for a Mann-Whitney test. Finally, to the best of our knowledge, this is the first time a segmentation approach for CT scans including the RFA needles is reported and we show why another state-of-the-art segmentation method fails for these cases. Intraoperative scans including an RFA probe are very critical in the clinical practice and need a very careful segmentation and inspection to avoid under-treatment, which may result in tumor recurrence (up to 40%). If the decision can be made during the intervention, an additional ablation can be performed without removing the entire needle. This decreases the patient stress and associated risks and costs of a separate intervention at a later date. Ultimately, the segmented ablation zone containing the RFA needle can be used for a precise ablation simulation as the real needle position is known.
Collapse
|
26
|
Egger J. Refinement-cut: user-guided segmentation algorithm for translational science. Sci Rep 2014; 4:5164. [PMID: 24893650 PMCID: PMC4044619 DOI: 10.1038/srep05164] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2014] [Accepted: 05/12/2014] [Indexed: 11/30/2022] Open
Abstract
In this contribution, a semi-automatic segmentation algorithm for (medical) image analysis is presented. More precise, the approach belongs to the category of interactive contouring algorithms, which provide real-time feedback of the segmentation result. However, even with interactive real-time contouring approaches there are always cases where the user cannot find a satisfying segmentation, e.g. due to homogeneous appearances between the object and the background, or noise inside the object. For these difficult cases the algorithm still needs additional user support. However, this additional user support should be intuitive and rapid integrated into the segmentation process, without breaking the interactive real-time segmentation feedback. I propose a solution where the user can support the algorithm by an easy and fast placement of one or more seed points to guide the algorithm to a satisfying segmentation result also in difficult cases. These additional seed(s) restrict(s) the calculation of the segmentation for the algorithm, but at the same time, still enable to continue with the interactive real-time feedback segmentation. For a practical and genuine application in translational science, the approach has been tested on medical data from the clinical routine in 2D and 3D.
Collapse
Affiliation(s)
- Jan Egger
- Faculty of Computer Science and Biomedical Engineering, Institute for Computer Graphics and Vision, Graz University of Technology, Graz, Styria, Austria
| |
Collapse
|