1
|
Szentimrey Z, Al-Hayali A, de Ribaupierre S, Fenster A, Ukwatta E. Semi-supervised learning framework with shape encoding for neonatal ventricular segmentation from 3D ultrasound. Med Phys 2024. [PMID: 38857570 DOI: 10.1002/mp.17242] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Revised: 05/27/2024] [Accepted: 05/27/2024] [Indexed: 06/12/2024] Open
Abstract
BACKGROUND Three-dimensional (3D) ultrasound (US) imaging has shown promise in non-invasive monitoring of changes in the lateral brain ventricles of neonates suffering from intraventricular hemorrhaging. Due to the poorly defined anatomical boundaries and low signal-to-noise ratio, fully supervised methods for segmentation of the lateral ventricles in 3D US images require a large dataset of annotated images by trained physicians, which is tedious, time-consuming, and expensive. Training fully supervised segmentation methods on a small dataset may lead to overfitting and hence reduce its generalizability. Semi-supervised learning (SSL) methods for 3D US segmentation may be able to address these challenges but most existing SSL methods have been developed for magnetic resonance or computed tomography (CT) images. PURPOSE To develop a fast, lightweight, and accurate SSL method, specifically for 3D US images, that will use unlabeled data towards improving segmentation performance. METHODS We propose an SSL framework that leverages the shape-encoding ability of an autoencoder network to enforce complex shape and size constraints on a 3D U-Net segmentation model. The autoencoder created pseudo-labels, based on the 3D U-Net predicted segmentations, that enforces shape constraints. An adversarial discriminator network then determined whether images came from the labeled or unlabeled data distributions. We used 887 3D US images, of which 87 had manually annotated labels and 800 images were unlabeled. Training/validation/testing sets of 25/12/50, 25/12/25 and 50/12/25 images were used for model experimentation. The Dice similarity coefficient (DSC), mean absolute surface distance (MAD), and absolute volumetric difference (VD) were used as metrics for comparing to other benchmarks. The baseline benchmark was the fully supervised vanilla 3D U-Net while dual task consistency, shape-aware semi-supervised network, correlation-aware mutual learning, and 3D U-Net Ensemble models were used as state-of-the-art benchmarks with DSC, MAD, and VD as comparison metrics. The Wilcoxon signed-rank test was used to test statistical significance between algorithms for DSC and VD with the threshold being p < 0.05 and corrected to p < 0.01 using the Bonferroni correction. The random-access memory (RAM) trace and number of trainable parameters were used to compare the computing efficiency between models. RESULTS Relative to the baseline 3D U-Net model, our shape-encoding SSL method reported a mean DSC improvement of 6.5%, 7.7%, and 4.1% with a 95% confidence interval of 4.2%, 5.7%, and 2.1% using image data splits of 25/12/50, 25/12/25, and 50/12/25, respectively. Our method only used a 1GB increase in RAM compared to the baseline 3D U-Net and required less than half the RAM and trainable parameters compared to the 3D U-Net ensemble method. CONCLUSIONS Based on our extensive literature survey, this is one of the first reported works to propose an SSL method designed for segmenting organs in 3D US images and specifically one that incorporates unlabeled data for segmenting neonatal cerebral lateral ventricles. When compared to the state-of-the-art SSL and fully supervised learning methods, our method yielded the highest DSC and lowest VD while being computationally efficient.
Collapse
Affiliation(s)
| | | | - Sandrine de Ribaupierre
- Department of Clinical Neurological Sciences, London Health Sciences Centre, London, Ontario, Canada
| | - Aaron Fenster
- Robarts Research Institute, University of Western Ontario, London, Ontario, Canada
| | - Eranga Ukwatta
- School of Engineering, University of Guelph, Guelph, Ontario, Canada
| |
Collapse
|
2
|
Czajkowska J, Borak M. Computer-Aided Diagnosis Methods for High-Frequency Ultrasound Data Analysis: A Review. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22218326. [PMID: 36366024 PMCID: PMC9653964 DOI: 10.3390/s22218326] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 10/21/2022] [Accepted: 10/25/2022] [Indexed: 05/31/2023]
Abstract
Over the last few decades, computer-aided diagnosis systems have become a part of clinical practice. They have the potential to assist clinicians in daily diagnostic tasks. The image processing techniques are fast, repeatable, and robust, which helps physicians to detect, classify, segment, and measure various structures. The recent rapid development of computer methods for high-frequency ultrasound image analysis opens up new diagnostic paths in dermatology, allergology, cosmetology, and aesthetic medicine. This paper, being the first in this area, presents a research overview of high-frequency ultrasound image processing techniques, which have the potential to be a part of computer-aided diagnosis systems. The reviewed methods are categorized concerning the application, utilized ultrasound device, and image data-processing type. We present the bridge between diagnostic needs and already developed solutions and discuss their limitations and future directions in high-frequency ultrasound image analysis. A search was conducted of the technical literature from 2005 to September 2022, and in total, 31 studies describing image processing methods were reviewed. The quantitative and qualitative analysis included 39 algorithms, which were selected as the most effective in this field. They were completed by 20 medical papers and define the needs and opportunities for high-frequency ultrasound application and CAD development.
Collapse
|
3
|
Zachary S, Sandrine DR, Aaron F, Eranga U. Automated 3D U-net based segmentation of neonatal cerebral ventricles from 3D ultrasound images. Med Phys 2021; 49:1034-1046. [PMID: 34958147 DOI: 10.1002/mp.15432] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2021] [Revised: 12/08/2021] [Accepted: 12/09/2021] [Indexed: 11/07/2022] Open
Abstract
BACKGROUND Intraventricular hemorrhaging (IVH) within cerebral lateral ventricles affects 20-30% of very low birth weight infants (<1500g). As the ventricles increase in size, the intracranial pressure increases leading to post-hemorrhagic ventricle dilatation (PHVD), an abnormal enlargement of the head. The most widely used imaging tool for measuring IVH and PHVD is cranial two-dimensional (2D) ultrasound (US). Estimating volumetric changes over time with 2D US is unreliable due to high user variability when locating the same anatomical location at different scanning sessions. Compared to 2D US, three-dimensional (3D) US is more sensitive to volumetric changes in the ventricles and does not suffer from variability in slice acquisition. However, 3D US images require segmentation of the ventricular surface, which is tedious and time-consuming when done manually. PURPOSE A fast, automated ventricle segmentation method for 3D US would provide quantitative information in a timely manner when monitoring IVH and PHVD in pre-term neonates. To this end, we developed a fast and fully automated segmentation method to segment neonatal cerebral lateral ventricles from 3D ultrasound images using deep learning. METHODS Our method consists of a 3D U-Net ensemble model comprised of three U-Net variants, each highlighting various aspects of the segmentation task such as the shape and boundary of the ventricles. The ensemble is made of a U-Net++, Attention U-Net, and U-Net with a deep learning-based shape prior combined using a mean voting strategy. We used a dataset consisting of 190 3D US images, which was separated into two subsets, one set of 87 images contained both ventricles and one set of 103 images contained only one ventricle (caused by limited field-of-view during acquisition). We conducted 5-fold cross-validation to evaluate the performance of the models on a larger amount of test data; 165 test images of which 75 have two ventricles (two-ventricle images) and 90 have one ventricle (one-ventricle images). We compared these results to each stand-alone model and to previous works including 2D multiplane U-Net and 2D SegNet models. RESULTS Using 5-fold cross-validation, the ensemble method reported a Dice similarity coefficient (DSC) of 0.720±0.074, absolute volumetric difference (VD) of 3.7±4.1cm3 , and a mean absolute surface distance (MAD) of 1.14±0.41mm on 75 two-ventricle test images. Using 90 test images with a single ventricle, the model after cross-validation reported DSC, VD, and MAD values of 0.806±0.111, 3.5±2.9cm3 , and 1.37±1.70mm, respectively. Compared to alternatives, the proposed ensemble yielded a higher accuracy in segmentation on both test data sets. Our method required approximately five seconds to segment one image and was substantially faster than the state-of-the-art conventional methods. CONCLUSIONS Compared to the state-of-the-art non-deep learning methods, our method based on deep learning was more efficient in segmenting neonatal cerebral lateral ventricles from 3D US images with comparable or better DSC, VD, and MAD performance. Our dataset was the largest to date (190 images) for this segmentation problem and the first to segment images that show only one lateral cerebral ventricle. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
| | - de Ribaupierre Sandrine
- Department of Clinical Neurological Sciences, Schulich School of Medicine and Dentistry, University of Western Ontario, London, Ontario, Canada
| | - Fenster Aaron
- Robarts Research Institute, University of Western Ontario, London, Ontario, Canada
| | - Ukwatta Eranga
- School of Engineering, University of Guelph, Guelph, Ontario, Canada
| |
Collapse
|
4
|
Martin M, Sciolla B, Sdika M, Quétin P, Delachartre P. Automatic segmentation and location learning of neonatal cerebral ventricles in 3D ultrasound data combining CNN and CPPN. Comput Biol Med 2021; 131:104268. [PMID: 33639351 DOI: 10.1016/j.compbiomed.2021.104268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2020] [Revised: 02/09/2021] [Accepted: 02/09/2021] [Indexed: 10/22/2022]
Abstract
Preterm neonates are highly likely to suffer from ventriculomegaly, a dilation of the Cerebral Ventricular System (CVS). This condition can develop into life-threatening hydrocephalus and is correlated with future neuro-developmental impairments. Consequently, it must be detected and monitored by physicians. In clinical routing, manual 2D measurements are performed on 2D ultrasound (US) images to estimate the CVS volume but this practice is imprecise due to the unavailability of 3D information. A way to tackle this problem would be to develop automatic CVS segmentation algorithms for 3D US data. In this paper, we investigate the potential of 2D and 3D Convolutional Neural Networks (CNN) to solve this complex task and propose to use Compositional Pattern Producing Network (CPPN) to enable Fully Convolutional Networks (FCN) to learn CVS location. Our database was composed of 25 3D US volumes collected on 21 preterm nenonates at the age of 35.8±1.6 gestational weeks. We found that the CPPN enables to encode CVS location, which increases the accuracy of the CNNs when they have few layers. Accuracy of the 2D and 3D FCNs reached intraobserver variability (IOV) in the case of dilated ventricles with Dice of 0.893±0.008 and 0.886±0.004 respectively (IOV = 0.898±0.008) and with volume errors of 0.45±0.42 cm3 and 0.36±0.24 cm3 respectively (IOV = 0.41±0.05 cm3). 3D FCNs were more accurate than 2D FCNs in the case of normal ventricles with Dice of 0.797±0.041 against 0.776±0.038 (IOV = 0.816±0.009) and volume errors of 0.35±0.29 cm3 against 0.35±0.24 cm3 (IOV = 0.2±0.11 cm3). The best segmentation time of volumes of size 320×320×320 was obtained by a 2D FCN in 3.5±0.2 s.
Collapse
Affiliation(s)
- Matthieu Martin
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206, F-69621, LYON, France.
| | - Bruno Sciolla
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206, F-69621, LYON, France
| | - Michaël Sdika
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206, F-69621, LYON, France
| | | | - Philippe Delachartre
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206, F-69621, LYON, France
| |
Collapse
|
5
|
Clark AE, Biffi B, Sivera R, Dall'Asta A, Fessey L, Wong TL, Paramasivam G, Dunaway D, Schievano S, Lees CC. Developing and testing an algorithm for automatic segmentation of the fetal face from three-dimensional ultrasound images. ROYAL SOCIETY OPEN SCIENCE 2020; 7:201342. [PMID: 33391808 PMCID: PMC7735327 DOI: 10.1098/rsos.201342] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/17/2020] [Accepted: 10/06/2020] [Indexed: 06/12/2023]
Abstract
Fetal craniofacial abnormalities are challenging to detect and diagnose on prenatal ultrasound (US). Image segmentation and computer analysis of three-dimensional US volumes of the fetal face may provide an objective measure to quantify fetal facial features and identify abnormalities. We have developed and tested an atlas-based partially automated facial segmentation algorithm; however, the volumes require additional manual segmentation (MS), which is time and labour intensive and may preclude this method from clinical adoption. These manually refined segmentations can then be used as a reference (atlas) by the partially automated segmentation algorithm to improve algorithmic performance with the aim of eliminating the need for manual refinement and developing a fully automated system. This study assesses the inter- and intra-operator variability of MS and tests an optimized version of our automatic segmentation (AS) algorithm. The manual refinements of 15 fetal faces performed by three operators and repeated by one operator were assessed by Dice score, average symmetrical surface distance and volume difference. The performance of the partially automatic algorithm with difference size atlases was evaluated by Dice score and computational time. Assessment of the manual refinements showed low inter- and intra-operator variability demonstrating its suitability for optimizing the AS algorithm. The algorithm showed improved performance following an increase in the atlas size in turn reducing the need for manual refinement.
Collapse
Affiliation(s)
- A. E. Clark
- Queen Charlotte's and Chelsea Hospital, Imperial Healthcare NHS Trust, London, UK
- Imperial College London, London, UK
| | - B. Biffi
- Imperial College London, London, UK
| | | | - A. Dall'Asta
- Queen Charlotte's and Chelsea Hospital, Imperial Healthcare NHS Trust, London, UK
- Imperial College London, London, UK
- Department of Medicine and Surgery, Obstetrics and Gynaecology Unit, University of Parma, Italy
| | | | - T.-L. Wong
- Queen Charlotte's and Chelsea Hospital, Imperial Healthcare NHS Trust, London, UK
| | - G. Paramasivam
- Queen Charlotte's and Chelsea Hospital, Imperial Healthcare NHS Trust, London, UK
- Imperial College London, London, UK
| | - D. Dunaway
- University College London GOS Institute of Child Health, London, UK
- Great Ormond Street Hospital for Children, London, UK
| | - S. Schievano
- University College London GOS Institute of Child Health, London, UK
- Great Ormond Street Hospital for Children, London, UK
| | - C. C. Lees
- Queen Charlotte's and Chelsea Hospital, Imperial Healthcare NHS Trust, London, UK
- Institute of Reproductive and Developmental Biology, Department of Metabolism, Digestion and Reproduction, Imperial College London, London, UK
| |
Collapse
|
6
|
Tabrizi PR, Mansoor A, Obeid R, Cerrolaza JJ, Perez DA, Zember J, Penn A, Linguraru MG. Ultrasound-Based Phenotyping of Lateral Ventricles to Predict Hydrocephalus Outcome in Premature Neonates. IEEE Trans Biomed Eng 2020; 67:3026-3034. [PMID: 32086190 DOI: 10.1109/tbme.2020.2974650] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECTIVE Prediction of post-hemorrhagic hydrocephalus (PHH) outcome-i.e., whether it requires intervention or not-in premature neonates using cranial ultrasound (CUS) images is challenging. In this paper, we present a novel fully-automatic method to perform phenotyping of the brain lateral ventricles and predict PHH outcome from CUS. METHODS Our method consists of two parts: ventricle quantification followed by prediction of PHH outcome. First, cranial bounding box and brain interhemispheric fissure are detected to determine the anatomical position of ventricles and correct the cranium rotation. Then, lateral ventricles are extracted using a new deep learning-based method by incorporating the convolutional neural network into a probabilistic atlas-based weighted loss function and an image-specific adaption. PHH outcome is predicted using a support vector machine classifier trained using ventricular morphological phenotypes and clinical information. RESULTS Experiments demonstrated that our method achieves accurate ventricle segmentation results with an average Dice similarity coefficient of 0.86, as well as very good PHH outcome prediction with accuracy of 0.91. CONCLUSION Automatic CUS-based ventricular phenotyping in premature newborns could objectively and accurately predict the progression to severe PHH. SIGNIFICANCE Early prediction of severe PHH development in premature newborns could potentially advance criteria for diagnosis and offer an opportunity for early interventions to improve outcome.
Collapse
|
7
|
Tabrizi PR, Obeid R, Cerrolaza JJ, Penn A, Mansoor A, Linguraru MG. Automatic Segmentation of Neonatal Ventricles from Cranial Ultrasound for Prediction of Intraventricular Hemorrhage Outcome. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2019; 2018:3136-3139. [PMID: 30441059 DOI: 10.1109/embc.2018.8513097] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Intraventricular hemorrhage (IVH) followed by post hemorrhagic hydrocephalus (PHH) in premature neonates is one of the recognized reasons of brain injury in newborns. Cranial ultrasound (CUS) is a noninvasive imaging tool that has been used widely to diagnose and monitor neonates with IVH. In our previous work, we showed the potential of quantitative morphological analysis of lateral ventricles from early CUS to predict the PHH outcome in neonates with IVH. In this paper, we first present a new automatic method for ventricle segmentation in 2D CUS images. We detect the brain bounding box and brain mid-line to estimate the anatomical positions of ventricles and correct the brain rotation. The ventricles are segmented using a combination of fuzzy c-means, phase congruency, and active contour algorithms. Finally, we compare this fully automated approach with our previous work for the prediction of the outcome of PHH on a set of 2D CUS images taken from 60 premature neonates with different IVH grades. Experimental results showed that our method could segment ventricles with an average Dice similarity coefficient of 0.8 ± 0.12. In addition, our fully automated method could predict the outcome of PHH based on the extracted ventricle regions with similar accuracy to our previous semi-automated approach (83% vs. 84%, respectively, p-value = 0.8). This method has the potential to standardize the evaluation of CUS images and can be a helpful clinical tool for early monitoring and treatment of IVH and PHH.
Collapse
|
8
|
Boucher MA, Lippé S, Dupont C, Knoth IS, Lopez G, Shams R, El-Jalbout R, Damphousse A, Kadoury S. Computer-aided lateral ventricular and brain volume measurements in 3D ultrasound for assessing growth trajectories in newborns and neonates. ACTA ACUST UNITED AC 2018; 63:225012. [DOI: 10.1088/1361-6560/aaea85] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
9
|
Kishimoto J, Fenster A, Lee DSC, de Ribaupierre S. Quantitative 3-D head ultrasound measurements of ventricle volume to determine thresholds for preterm neonates requiring interventional therapies following posthemorrhagic ventricle dilatation. J Med Imaging (Bellingham) 2018; 5:026001. [PMID: 29963579 PMCID: PMC6018129 DOI: 10.1117/1.jmi.5.2.026001] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2017] [Accepted: 06/04/2018] [Indexed: 01/04/2023] Open
Abstract
Dilatation of the cerebral ventricles is a common condition in preterm neonates with intraventricular hemorrhage. This posthemorrhagic ventricle dilatation (PHVD) can lead to lifelong neurological impairment through ischemic injury due to increased intracranial pressure, and without treatment can lead to death. Two-dimensional ultrasound (US) through the fontanelles of the patients is serially acquired to monitor the progression of PHVD. These images are used in conjunction with clinical experience and physical exams to determine when interventional therapies such as needle aspiration of the built up cerebrospinal fluid (ventricle tap, VT) might be indicated for a patient; however, quantitative measurements of the ventricles size are often not performed. We describe the potential utility of the quantitative three-dimensional (3-D) US measurements of ventricle volumes (VVs) in 38 preterm neonates to monitor and manage PHVD. Specifically, we determined 3-D US VV thresholds for patients who received VT in comparison to patients with PHVD who resolve without intervention. In addition, since many patients who have an initial VT will receive subsequent interventions, we determined which PHVD patients will receive additional VT after the initial one has been performed.
Collapse
Affiliation(s)
- Jessica Kishimoto
- University of Western Ontario, Department of Medical Biophysics, London, Ontario, Canada.,University of Western Ontario, Robarts Research Institute, Imaging Research Laboratories, London, Ontario, Canada
| | - Aaron Fenster
- University of Western Ontario, Department of Medical Biophysics, London, Ontario, Canada.,University of Western Ontario, Robarts Research Institute, Imaging Research Laboratories, London, Ontario, Canada
| | - David S C Lee
- University of Western Ontario, London Health Sciences Centre, Department of Clinical Neurological Sciences, London, Ontario, Canada
| | - Sandrine de Ribaupierre
- University of Western Ontario, Department of Medical Biophysics, London, Ontario, Canada.,University of Western Ontario, Robarts Research Institute, Imaging Research Laboratories, London, Ontario, Canada.,University of Western Ontario, London Health Sciences Centre, Department of Clinical Neurological Sciences, London, Ontario, Canada
| |
Collapse
|
10
|
|
11
|
Mason SA, O’Shea TP, White IM, Lalondrelle S, Downey K, Baker M, Behrens CF, Bamber JC, Harris EJ. Towards ultrasound-guided adaptive radiotherapy for cervical cancer: Evaluation of Elekta's semiautomated uterine segmentation method on 3D ultrasound images. Med Phys 2017; 44:3630-3638. [PMID: 28493295 PMCID: PMC5575494 DOI: 10.1002/mp.12325] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2016] [Revised: 02/10/2017] [Accepted: 03/29/2017] [Indexed: 11/06/2022] Open
Abstract
PURPOSE 3D ultrasound (US) images of the uterus may be used to adapt radiotherapy (RT) for cervical cancer patients based on changes in daily anatomy. This requires accurate on-line segmentation of the uterus. The aim of this work was to assess the accuracy of Elekta's "Assisted Gyne Segmentation" (AGS) algorithm in semi-automatically segmenting the uterus on 3D transabdominal ultrasound images by comparison with manual contours. MATERIALS & METHODS Nine patients receiving RT for cervical cancer were imaged with the 3D Clarity® transabdominal probe at RT planning, and 1 to 7 times during treatment. Image quality was rated from unusable (0)-excellent (3). Four experts segmented the uterus (defined as the uterine body and cervix) manually and using AGS on images with a ranking > 0. Pairwise analysis between manual contours was evaluated to determine interobserver variability. The accuracy of the AGS method was assessed by measuring its agreement with manual contours via pairwise analysis. RESULTS 35/44 images acquired (79.5%) received a ranking > 0. For the manual contour variation, the median [interquartile range (IQR)] distance between centroids (DC) was 5.41 [5.0] mm, the Dice similarity coefficient (DSC) was 0.78 [0.11], the mean surface-to-surface distance (MSSD) was 3.20 [1.8] mm, and the uniform margin of 95% (UM95) was 4.04 [5.8] mm. There was no correlation between image quality and manual contour agreement. AGS failed to give a result in 19.3% of cases. For the remaining cases, the level of agreement between AGS contours and manual contours depended on image quality. There were no significant differences between the AGS segmentations and the manual segmentations on the images that received a quality rating of 3. However, the AGS algorithm had significantly worse agreement with manual contours on images with quality ratings of 1 and 2 compared with the corresponding interobserver manual variation. The overall median [IQR] DC, DSC, MSSD, and UM95 between AGS and manual contours was 5.48 [5.45] mm, 0.77 [0.14], 3.62 [2.7] mm, and 5.19 [8.1] mm, respectively. CONCLUSIONS The AGS tool was able to represent uterine shape of cervical cancer patients in agreement with manual contouring in cases where the image quality was excellent, but not in cases where image quality was degraded by common artifacts such as shadowing and signal attenuation. The AGS tool should be used with caution for adaptive RT purposes, as it is not reliable in accurately segmenting the uterus on 'good' or 'poor' quality images. The interobserver agreement between manual contours of the uterus drawn on 3D US was consistent with results of similar studies performed on CT and MRI images.
Collapse
Affiliation(s)
- Sarah A. Mason
- Joint Department of Physics at the Institute of Cancer Research and Royal Marsden NHS Foundation TrustSutton and LondonUK
| | - Tuathan P. O’Shea
- Joint Department of Physics at the Institute of Cancer Research and Royal Marsden NHS Foundation TrustSutton and LondonUK
| | - Ingrid M. White
- Joint Department of Physics at the Institute of Cancer Research and Royal Marsden NHS Foundation TrustSutton and LondonUK
| | - Susan Lalondrelle
- Joint Department of Physics at the Institute of Cancer Research and Royal Marsden NHS Foundation TrustSutton and LondonUK
| | - Kate Downey
- Joint Department of Physics at the Institute of Cancer Research and Royal Marsden NHS Foundation TrustSutton and LondonUK
| | - Mariwan Baker
- Department of OncologyHerlev Hospital, University of CopenhagenHerlevDenmark
| | - Claus F. Behrens
- Department of OncologyHerlev Hospital, University of CopenhagenHerlevDenmark
| | - Jeffrey C. Bamber
- Joint Department of Physics at the Institute of Cancer Research and Royal Marsden NHS Foundation TrustSutton and LondonUK
| | - Emma J. Harris
- Joint Department of Physics at the Institute of Cancer Research and Royal Marsden NHS Foundation TrustSutton and LondonUK
| |
Collapse
|
12
|
Qiu W, Chen Y, Kishimoto J, de Ribaupierre S, Chiu B, Fenster A, Menon BK, Yuan J. Longitudinal Analysis of Pre-Term Neonatal Cerebral Ventricles From 3D Ultrasound Images Using Spatial-Temporal Deformable Registration. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:1016-1026. [PMID: 28026756 DOI: 10.1109/tmi.2016.2643635] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Preterm neonates with a very low birth weight of less than 1,500 grams are at increased risk for developing intraventricular hemorrhage (IVH), which is a major cause of brain injury in preterm neonates. Quantitative measurements of ventricular dilatation or shrinkage play an important role in monitoring patients and evaluating treatment options. 3D ultrasound (US) has been developed to monitor ventricle volume as a biomarker for ventricular changes. However, ventricle volume as a global indicator does not allow for precise analysis of local ventricular changes, which could be linked to specific neurological problems often seen in the patient population later in life. In this work, a 3D+t spatial-temporal deformable registration approachis proposed, which is applied to the analysis of the detailed local changes of preterm IVH neonatal ventricles from 3D US images. In particular, a novel sequential convex/dual optimization algorithm is introduced to extract the optimal 3D+t spatial-temporal deformable field, which simultaneously optimizes the sequence of 3D deformation fieldswhile enjoying both efficiencyand simplicity in numerics. The developed registration technique was evaluated by comparing two manually extracted ventricle surfaces from the baseline and the registered follow-up images using the metrics of Dice similarity coefficient (DSC), mean absolute surface distance (MAD), and maximum absolute surface distance (MAXD). The performed experiments using 14 patients with 5 time-point images per patient show that the proposed 3D+t registration approach accurately recovered the longitudinal deformation of ventricle surfaces from 3D US images. The proposed approach may be potentially used to analyse the change pattern of cerebral ventricles of IVH patients, their response to different treatment options, and to elucidate the deficiencies that a patient could have later in life. To the best of our knowledge, this paper reports the first study on the longitudinalanalysis of neonatal ventricular system from 3D US images.
Collapse
|
13
|
Suárez-Mejías C, Pérez-Carrasco JA, Serrano C, López-Guerra JL, Gómez-Cía T, Parra-Calderón CL, Acha B. Validation of a method for retroperitoneal tumor segmentation. Int J Comput Assist Radiol Surg 2017; 12:2055-2067. [PMID: 28188486 DOI: 10.1007/s11548-017-1530-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2016] [Accepted: 01/25/2017] [Indexed: 11/28/2022]
Abstract
PURPOSE In 2005, an application for surgical planning called AYRA[Formula: see text] was designed and validated by different surgeons and engineers at the Virgen del Rocío University Hospital, Seville (Spain). However, the segmentation methods included in AYRA and in other surgical planning applications are not able to segment accurately tumors that appear in soft tissue. The aims of this paper are to offer an exhaustive validation of an accurate semiautomatic segmentation tool to delimitate retroperitoneal tumors from CT images and to aid physicians in planning both radiotherapy doses and surgery. METHODS A panel of 6 experts manually segmented 11 cases of tumors, and the segmentation results were compared exhaustively with: the results provided by a surgical planning tool (AYRA), the segmentations obtained using a radiotherapy treatment planning system (Pinnacle[Formula: see text]), the segmentation results obtained by a group of experts in the delimitation of retroperitoneal tumors and the segmentation results using the algorithm under validation. RESULTS 11 cases of retroperitoneal tumors were tested. The proposed algorithm provided accurate results regarding the segmentation of the tumor. Moreover, the algorithm requires minimal computational time-an average of 90.5% less than that required when manually contouring the same tumor. CONCLUSION A method developed for the semiautomatic selection of retroperitoneal tumor has been validated in depth. AYRA, as well as other surgical and radiotherapy planning tools, could be greatly improved by including this algorithm.
Collapse
Affiliation(s)
- Cristina Suárez-Mejías
- Technological Innovation Group, Virgen del Rocío University Hospital, Avda Manuel Siurot, s/n, 41013, Sevilla, Spain
| | - José A Pérez-Carrasco
- Signal Theory and Communications Department, University of Seville, Camino de los Descubrimientos, s/n, 41092, Sevilla, Spain.
| | - Carmen Serrano
- Signal Theory and Communications Department, University of Seville, Camino de los Descubrimientos, s/n, 41092, Sevilla, Spain
| | - José L López-Guerra
- Oncology Unit, Virgen del Rocío University Hospital, Avda Manuel Siurot, s/n, 41013, Sevilla, Spain
| | - Tomás Gómez-Cía
- Surgery Unit, Virgen del Rocío University Hospital, Avda Manuel Siurot, s/n, 41013, Sevilla, Spain
| | - Carlos L Parra-Calderón
- Technological Innovation Group, Virgen del Rocío University Hospital, Avda Manuel Siurot, s/n, 41013, Sevilla, Spain
| | - Begoña Acha
- Signal Theory and Communications Department, University of Seville, Camino de los Descubrimientos, s/n, 41092, Sevilla, Spain
| |
Collapse
|
14
|
Sciolla B, Cowell L, Dambry T, Guibert B, Delachartre P. Segmentation of Skin Tumors in High-Frequency 3-D Ultrasound Images. ULTRASOUND IN MEDICINE & BIOLOGY 2017; 43:227-238. [PMID: 27720519 DOI: 10.1016/j.ultrasmedbio.2016.08.029] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/29/2016] [Revised: 07/21/2016] [Accepted: 08/29/2016] [Indexed: 06/06/2023]
Abstract
High-frequency 3-D ultrasound imaging is an informative tool for diagnosis, surgery planning and skin lesion examination. The purpose of this article was to describe a semi-automated segmentation tool providing easy access to the extent, shape and volume of a lesion. We propose an adaptive log-likelihood level-set segmentation procedure using non-parametric estimates of the intensity distribution. The algorithm has a single parameter to control the smoothness of the contour, and we describe how a fixed value yields satisfactory segmentation results with an average Dice coefficient of D = 0.76. The algorithm is implemented on a grid, which increases the speed by a factor of 100 compared with a standard pixelwise segmentation. We compare the method with parametric methods making the hypothesis of Rayleigh or Nakagami distributed signals, and illustrate that our method has greater robustness with similar computational speed. Benchmarks are made on realistic synthetic ultrasound images and a data set of nine clinical 3-D images acquired with a 50-MHz imaging system. The proposed algorithm is suitable for use in a clinical context as a post-processing tool.
Collapse
Affiliation(s)
| | - Lester Cowell
- Melanoma Skin Cancer Clinic, Hamilton Hill, Western Australia, Australia
| | | | | | | |
Collapse
|
15
|
Qiu W, Chen Y, Kishimoto J, de Ribaupierre S, Chiu B, Fenster A, Yuan J. Automatic segmentation approach to extracting neonatal cerebral ventricles from 3D ultrasound images. Med Image Anal 2017; 35:181-191. [DOI: 10.1016/j.media.2016.06.038] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2015] [Revised: 06/28/2016] [Accepted: 06/30/2016] [Indexed: 01/26/2023]
|
16
|
Kishimoto J, de Ribaupierre S, Salehi F, Romano W, Lee DSC, Fenster A. Preterm neonatal lateral ventricle volume from three-dimensional ultrasound is not strongly correlated to two-dimensional ultrasound measurements. J Med Imaging (Bellingham) 2016; 3:046003. [PMID: 27872874 DOI: 10.1117/1.jmi.3.4.046003] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2016] [Accepted: 10/06/2016] [Indexed: 11/14/2022] Open
Abstract
The aim of this study is to compare longitudinal two-dimensional (2-D) and three-dimensional (3-D) ultrasound (US) estimates of ventricle size in preterm neonates with posthemorrhagic ventricular dilatation (PHVD) using quantitative measurements of the lateral ventricles. Cranial 2-D US and 3-D US images were acquired from neonatal patients with diagnosed PHVD within 10 min of each other one to two times per week and analyzed offline. Ventricle index, anterior horn width, third ventricle width, and thalamo-occipital distance were measured on the 2-D images and ventricle volume (VV) was measured from 3-D US images. Changes in the measurements between successive image sets were also recorded. No strong correlations were found between VV and 2-D US measurements ([Formula: see text] between 0.69 and 0.36). Additionally, weak correlations were found between changes in 2-D US measurements and 3-D US VV ([Formula: see text] between 0.13 and 0.02). A trend was found between increasing 2-D US measurements and 3-D US-based VV, but this was not the case when comparing changes between 3-D US VV and 2-D US measurements. If 3-D US-based VV provides a more accurate estimate of ventricle size than 2-D US measurements, moderate-weak correlations with 3-D US suggest that monitoring preterm patients with PHVD using 2-D US measurements alone might not accurately represent whether the ventricles are progressively dilating. A volumetric measure (3-D US or MRI) could be used instead to more accurately represent changes.
Collapse
Affiliation(s)
- Jessica Kishimoto
- The University of Western Ontario, Robarts Research Institute, Imaging Research Laboratories, 1151 Richmond Street, London, Ontario N6A 3K7, Canada; The University of Western Ontario, Department of Medical Biophysics, 1151 Richmond Street, London, Ontario N6A 3K7, Canada
| | - Sandrine de Ribaupierre
- The University of Western Ontario, Department of Medical Biophysics, 1151 Richmond Street, London, Ontario N6A 3K7, Canada; London Health Sciences Centre, Children's Hospital, Department of Paediatrics, 800 Commissioners Road East, London, Ontario N6A 5W9, Canada; London Health Sciences Centre, Department of Clinical Neurological Sciences, 339 Windermere Road, London, Ontario N6A 5A5, Canada
| | - Fateme Salehi
- The University of Western Ontario , Department of Radiology, 1151 Richmond Street, London, Ontario N6A 3K7, Canada
| | - Walter Romano
- The University of Western Ontario , Department of Radiology, 1151 Richmond Street, London, Ontario N6A 3K7, Canada
| | - David S C Lee
- London Health Sciences Centre , Children's Hospital, Department of Paediatrics, 800 Commissioners Road East, London, Ontario N6A 5W9, Canada
| | - Aaron Fenster
- The University of Western Ontario, Robarts Research Institute, Imaging Research Laboratories, 1151 Richmond Street, London, Ontario N6A 3K7, Canada; The University of Western Ontario, Department of Medical Biophysics, 1151 Richmond Street, London, Ontario N6A 3K7, Canada
| |
Collapse
|
17
|
Kishimoto J, Fenster A, Lee DSC, de Ribaupierre S. In Vivo Validation of a 3-D Ultrasound System for Imaging the Lateral Ventricles of Neonates. ULTRASOUND IN MEDICINE & BIOLOGY 2016; 42:971-979. [PMID: 26782271 DOI: 10.1016/j.ultrasmedbio.2015.11.010] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/04/2015] [Revised: 11/05/2015] [Accepted: 11/13/2015] [Indexed: 06/05/2023]
Abstract
Intra-ventricular hemorrhage, with the resultant cerebral ventricle dilation, is a common cause of brain injury in preterm neonates. Clinically, monitoring is performed using 2-D ultrasound (US); however, its clinical utility in dilation is limited because it cannot provide accurate measurements of irregular volumes such as those of the ventricles, and this might delay treatment until the patient's condition deteriorates severely. We have developed a 3-D US system to image the lateral ventricles of neonates within the confines of incubators. We describe an in vivo ventricle volume validation study in two parts: (i) comparisons between ventricle volumes derived from 3-D US and magnetic resonance images obtained within 24 h; and (ii) the difference between 3-D US ventricle volumes before and after clinically necessary interventions (ventricle taps), which remove cerebral spinal fluid. Magnetic resonance imaging ventricle volumes were found to be 13% greater than 3-D US ventricle volumes; however, we observed high correlations (R(2) = 0.99) when comparing the two modalities. Differences in ventricle volume pre- and post-intervention compared with the reported volume of cerebrospinal fluid removed also were highly correlated (R(2) = 0.93); the slope was not found to be statistically significantly different from 1 (p < 0.05), and the y-intercept was not found to be statistically different from 0 (p < 0.05). Comparison between 3-D US images can detect the volume change after neonatal intra-ventricular hemorrhage. This could be used to determine which patients will have progressive ventricle dilation and allow for more timely surgical interventions. However, 3-D US ventricle volumes should not be directly compared with magnetic resonance imaging ventricle volumes.
Collapse
Affiliation(s)
- Jessica Kishimoto
- Department of Medical Biophysics, University of Western Ontario, London, Ontario, Canada; Robarts Imaging, University of Western Ontario, London, Ontario, Canada.
| | - Aaron Fenster
- Department of Medical Biophysics, University of Western Ontario, London, Ontario, Canada; Robarts Imaging, University of Western Ontario, London, Ontario, Canada
| | - David S C Lee
- Department of Paediatrics, University of Western Ontario, London Health Sciences Centre, London, Ontario, Canada
| | - Sandrine de Ribaupierre
- Department of Medical Biophysics, University of Western Ontario, London, Ontario, Canada; Department of Paediatrics, University of Western Ontario, London Health Sciences Centre, London, Ontario, Canada; Department of Clinical Neurological Sciences, University of Western Ontario, London Health Sciences Centre, London, Ontario, Canada
| |
Collapse
|
18
|
Chen Y, Qiu W, Kishimoto J, Gao Y, Chan RHM, de Ribaupierre S, Fenster A, Chiu B. A framework for quantification and visualization of segmentation accuracy and variability in 3D lateral ventricle ultrasound images of preterm neonates. Med Phys 2015; 42:6387-405. [PMID: 26520730 DOI: 10.1118/1.4932366] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Intraventricular hemorrhage (IVH) is a major cause of brain injury in preterm neonates. Three dimensional ultrasound (US) imaging systems have been developed to visualize 3D anatomical structure of preterm neonatal intracranial ventricular system with IVH and ventricular dilation. To allow quantitative analysis, the ventricle system is required to be segmented accurately and efficiently from 3D US images. Although semiautomatic segmentation algorithms have been developed, local segmentation accuracy and variability associated with these algorithms should be evaluated statistically before they can be applied in clinical settings. This work proposes a statistical framework to quantify the local accuracy and variability and performs statistical tests to identify locations where the semiautomatically segmented surfaces are significantly different from manually segmented surfaces. METHODS Three dimensional lateral ventricle US images of preterm neonates were each segmented six times manually and using a semiautomated segmentation algorithm. The local difference between manually and algorithmically segmented surfaces as well as the segmentation variability for each method was computed and superimposed on the ventricular surface of each subject. To summarize the segmentation performance for a whole group of subjects, the subject-specific local difference and standard deviation maps were registered onto a 3D template ventricular surface using a nonrigid registration algorithm. Pointwise, intersubject average accuracy and pooled variability for the whole group of subjects can be computed and visualized on the template surface, providing a summary of performance of the segmentation algorithm for the whole group of ventricles with highly variable geometry. In addition to pointwise statistical analysis performed on the template surface, statistical conclusion regarding the accuracy of the segmentation algorithm was made for subregions and the whole ventricle with the spatial correlation of pointwise accuracy taken into account. RESULTS Ten 3D US images were involved in this study. Pointwise local difference, ΔS, its absolute value |ΔS| as well as the standard deviations of the manual and algorithm segmentations were computed and superimposed on the each ventricle surface. Regions with lower segmentation accuracy and higher segmentation variability can be identified from these maps, and the localized information was applied to improve the accuracy of the algorithm. Intersubject average ΔS and |ΔS| as well as pooled standard deviations was computed on the template surface. Intersubject average ΔS and |ΔS| indicated that the algorithm underestimated regions in the neighborhood of the tips of anterior, inferior, and posterior horns. Intersubject pooled standard deviations indicated that manual segmentation had a higher segmentation variability than algorithm segmentation over the whole ventricle. Statistical analysis on the template surface showed that there was significant difference between algorithm and manual methods for segmenting the right lateral ventricle but not for the left lateral ventricle. CONCLUSIONS A framework was proposed for evaluating, visualizing, and summarizing the local accuracy and variability of a segmentation algorithm. This framework can be used for improving the accuracy of segmentation algorithms, as well as providing useful feedback to improve the manual segmentation performance. More importantly, this framework can be applied for longitudinal monitoring of local ventricular changes of neonates with IVH.
Collapse
Affiliation(s)
- Yimin Chen
- Department of Electronic Engineering, City University of Hong Kong, Kowloon, Hong Kong
| | - Wu Qiu
- Imaging Research Laboratories, Robarts Research Institute, The University of Western Ontario, London, Ontario N6A 5K8, Canada
| | - Jessica Kishimoto
- Imaging Research Laboratories, Robarts Research Institute, The University of Western Ontario, London, Ontario N6A 5K8, Canada
| | - Yuan Gao
- Department of Electronic Engineering, City University of Hong Kong, Kowloon, Hong Kong
| | - Rosa H M Chan
- Department of Electronic Engineering, City University of Hong Kong, Kowloon, Hong Kong
| | - Sandrine de Ribaupierre
- Department of Clinical Neurological Science, The University of Western Ontario, London, Ontario N6A 5K8, Canada
| | - Aaron Fenster
- Imaging Research Laboratories, Robarts Research Institute, The University of Western Ontario, London, Ontario N6A 5K8, Canada
| | - Bernard Chiu
- Department of Electronic Engineering, City University of Hong Kong, Kowloon, Hong Kong
| |
Collapse
|