1
|
Duong MT, Rudie JD, Wang J, Xie L, Mohan S, Gee JC, Rauschecker AM. Convolutional Neural Network for Automated FLAIR Lesion Segmentation on Clinical Brain MR Imaging. AJNR Am J Neuroradiol 2019; 40:1282-1290. [PMID: 31345943 PMCID: PMC6697209 DOI: 10.3174/ajnr.a6138] [Citation(s) in RCA: 39] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2019] [Accepted: 06/17/2019] [Indexed: 12/17/2022]
Abstract
BACKGROUND AND PURPOSE Most brain lesions are characterized by hyperintense signal on FLAIR. We sought to develop an automated deep learning-based method for segmentation of abnormalities on FLAIR and volumetric quantification on clinical brain MRIs across many pathologic entities and scanning parameters. We evaluated the performance of the algorithm compared with manual segmentation and existing automated methods. MATERIALS AND METHODS We adapted a U-Net convolutional neural network architecture for brain MRIs using 3D volumes. This network was retrospectively trained on 295 brain MRIs to perform automated FLAIR lesion segmentation. Performance was evaluated on 92 validation cases using Dice scores and voxelwise sensitivity and specificity, compared with radiologists' manual segmentations. The algorithm was also evaluated on measuring total lesion volume. RESULTS Our model demonstrated accurate FLAIR lesion segmentation performance (median Dice score, 0.79) on the validation dataset across a large range of lesion characteristics. Across 19 neurologic diseases, performance was significantly higher than existing methods (Dice, 0.56 and 0.41) and approached human performance (Dice, 0.81). There was a strong correlation between the predictions of lesion volume of the algorithm compared with true lesion volume (ρ = 0.99). Lesion segmentations were accurate across a large range of image-acquisition parameters on >30 different MR imaging scanners. CONCLUSIONS A 3D convolutional neural network adapted from a U-Net architecture can achieve high automated FLAIR segmentation performance on clinical brain MR imaging across a variety of underlying pathologies and image acquisition parameters. The method provides accurate volumetric lesion data that can be incorporated into assessments of disease burden or into radiologic reports.
Collapse
Affiliation(s)
- M T Duong
- From the Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania
| | - J D Rudie
- From the Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania
| | - J Wang
- From the Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania
| | - L Xie
- From the Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania
| | - S Mohan
- From the Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania
| | - J C Gee
- From the Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania
| | - A M Rauschecker
- From the Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, Pennsylvania.
| |
Collapse
|
2
|
Sperry MM, Kandel BM, Wehrli S, Bass KN, Das SR, Dhillon PS, Gee JC, Barr GA. Mapping of pain circuitry in early post-natal development using manganese-enhanced MRI in rats. Neuroscience 2017; 352:180-189. [PMID: 28391012 PMCID: PMC7276061 DOI: 10.1016/j.neuroscience.2017.03.052] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2016] [Revised: 03/08/2017] [Accepted: 03/28/2017] [Indexed: 12/14/2022]
Abstract
Premature or ill full-term infants are subject to a number of noxious procedures as part of their necessary medical care. Although we know that human infants show neural changes in response to such procedures, we know little of the sensory or affective brain circuitry activated by pain. In rodent models, the focus has been on spinal cord and, more recently, midbrain and medulla. The present study assesses activation of brain circuits using manganese-enhanced magnetic resonance imaging (MEMRI). Uptake of manganese, a paramagnetic contrast agent that is transported across active synapses and along axons, was measured in response to a hindpaw injection of dilute formalin in 12-day-old rat pups, the age at which rats begin to show aversion learning and which is roughly the equivalent of full-term human infants. Formalin induced the oft-reported biphasic response at this age and induced a conditioned aversion to cues associated with its injection, thus demonstrating the aversiveness of the stimulation. Morphometric analyses, structural equation modeling and co-expression analysis showed that limbic and sensory paths were activated, the most prominent of which were the prefrontal and anterior cingulate cortices, nucleus accumbens, amygdala, hypothalamus, several brainstem structures, and the cerebellum. Therefore, both sensory and affective circuits, which are activated by pain in the adult, can also be activated by noxious stimulation in 12-day-old rat pups.
Collapse
Affiliation(s)
- M M Sperry
- Department of Bioengineering, University of Pennsylvania, United States
| | - B M Kandel
- Penn Image Computing and Science Laboratory, Department of Radiology, University of Pennsylvania, United States
| | - S Wehrli
- NMR Core, Children's Hospital of Philadelphia, United States
| | - K N Bass
- Anesthesiology and Critical Care Medicine, Children's Hospital of Philadelphia, Perelman School of Medicine, University of Pennsylvania, United States
| | - S R Das
- Penn Image Computing and Science Laboratory, Department of Radiology, University of Pennsylvania, United States
| | - P S Dhillon
- Penn Image Computing and Science Laboratory, Department of Radiology, University of Pennsylvania, United States
| | - J C Gee
- Penn Image Computing and Science Laboratory, Department of Radiology, University of Pennsylvania, United States
| | - G A Barr
- Anesthesiology and Critical Care Medicine, Children's Hospital of Philadelphia, Perelman School of Medicine, University of Pennsylvania, United States.
| |
Collapse
|
3
|
Wu J, Awate SP, Licht DJ, Clouchoux C, du Plessis AJ, Avants BB, Vossough A, Gee JC, Limperopoulos C. Assessment of MRI-Based Automated Fetal Cerebral Cortical Folding Measures in Prediction of Gestational Age in the Third Trimester. AJNR Am J Neuroradiol 2015; 36:1369-74. [PMID: 26045578 DOI: 10.3174/ajnr.a4357] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2014] [Accepted: 12/20/2014] [Indexed: 11/07/2022]
Abstract
BACKGROUND AND PURPOSE Traditional methods of dating a pregnancy based on history or sonographic assessment have a large variation in the third trimester. We aimed to assess the ability of various quantitative measures of brain cortical folding on MR imaging in determining fetal gestational age in the third trimester. MATERIALS AND METHODS We evaluated 8 different quantitative cortical folding measures to predict gestational age in 33 healthy fetuses by using T2-weighted fetal MR imaging. We compared the accuracy of the prediction of gestational age by these cortical folding measures with the accuracy of prediction by brain volume measurement and by a previously reported semiquantitative visual scale of brain maturity. Regression models were constructed, and measurement biases and variances were determined via a cross-validation procedure. RESULTS The cortical folding measures are accurate in the estimation and prediction of gestational age (mean of the absolute error, 0.43 ± 0.45 weeks) and perform better than (P = .024) brain volume (mean of the absolute error, 0.72 ± 0.61 weeks) or sonography measures (SDs approximately 1.5 weeks, as reported in literature). Prediction accuracy is comparable with that of the semiquantitative visual assessment score (mean, 0.57 ± 0.41 weeks). CONCLUSIONS Quantitative cortical folding measures such as global average curvedness can be an accurate and reliable estimator of gestational age and brain maturity for healthy fetuses in the third trimester and have the potential to be an indicator of brain-growth delays for at-risk fetuses and preterm neonates.
Collapse
Affiliation(s)
- J Wu
- From the Department of Radiology (J.W., B.B.A., A.V., J.C.G.), Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
| | - S P Awate
- Department of Computer Science and Engineering (S.P.A.), Indian Institute of Technology Bombay, Mumbai, India
| | - D J Licht
- Neurovascular Imaging Lab (D.J.L.), Children's Hospital of Philadelphia, Philadelphia, Pennsylvania
| | - C Clouchoux
- Advanced Pediatric Brain Imaging Research Laboratory (C.C., C.L.), Children's National Medical Center, Washington, DC Departments of Neurology, Radiology, and Pediatrics (C.C., A.J.d.P., C.L.), George Washington University School of Medicine and Health Sciences, Washington, DC
| | - A J du Plessis
- Departments of Neurology, Radiology, and Pediatrics (C.C., A.J.d.P., C.L.), George Washington University School of Medicine and Health Sciences, Washington, DC
| | - B B Avants
- From the Department of Radiology (J.W., B.B.A., A.V., J.C.G.), Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
| | - A Vossough
- From the Department of Radiology (J.W., B.B.A., A.V., J.C.G.), Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
| | - J C Gee
- From the Department of Radiology (J.W., B.B.A., A.V., J.C.G.), Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
| | - C Limperopoulos
- Advanced Pediatric Brain Imaging Research Laboratory (C.C., C.L.), Children's National Medical Center, Washington, DC Departments of Neurology, Radiology, and Pediatrics (C.C., A.J.d.P., C.L.), George Washington University School of Medicine and Health Sciences, Washington, DC
| |
Collapse
|
4
|
Lindsay WD, Berlind CG, Gee JC, Simone CB. SU-E-T-630: Predictive Modeling of Mortality, Tumor Control, and Normal Tissue Complications After Stereotactic Body Radiotherapy for Stage I Non-Small Cell Lung Cancer. Med Phys 2015. [DOI: 10.1118/1.4924993] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|
5
|
Awate SP, Yushkevich P, Song Z, Licht D, Gee JC. Multivariate Cortical Folding Pattern Analysis in Neonatal Complex Congenital Heart Disease. Neuroimage 2009. [DOI: 10.1016/s1053-8119(09)71582-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
|
6
|
Das SR, Oliver RT, Avants BB, Radoeva PD, Brainard DH, Aguirre GK, Gee JC. Reliability of semi-automated visual area definitions in retinotopy. Neuroimage 2009. [DOI: 10.1016/s1053-8119(09)70195-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
|
7
|
Avants BB, Cook P, Pluta J, Duda JT, Rao H, Giannetta J, Hurt H, Das SR, Gee JC. Multivariate Diffeomorphic Analysis of Longitudinal Increase in White Matter Directionality and Decrease in Cortical Thickness between Ages 14 and 18. Neuroimage 2009. [DOI: 10.1016/s1053-8119(09)70918-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
|
8
|
Avants BB, Epstein CL, Grossman M, Gee JC. Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Med Image Anal 2008; 12:26-41. [PMID: 17659998 PMCID: PMC2276735 DOI: 10.1016/j.media.2007.06.004] [Citation(s) in RCA: 2909] [Impact Index Per Article: 181.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2006] [Revised: 05/23/2007] [Accepted: 06/06/2007] [Indexed: 10/23/2022]
Abstract
One of the most challenging problems in modern neuroimaging is detailed characterization of neurodegeneration. Quantifying spatial and longitudinal atrophy patterns is an important component of this process. These spatiotemporal signals will aid in discriminating between related diseases, such as frontotemporal dementia (FTD) and Alzheimer's disease (AD), which manifest themselves in the same at-risk population. Here, we develop a novel symmetric image normalization method (SyN) for maximizing the cross-correlation within the space of diffeomorphic maps and provide the Euler-Lagrange equations necessary for this optimization. We then turn to a careful evaluation of our method. Our evaluation uses gold standard, human cortical segmentation to contrast SyN's performance with a related elastic method and with the standard ITK implementation of Thirion's Demons algorithm. The new method compares favorably with both approaches, in particular when the distance between the template brain and the target brain is large. We then report the correlation of volumes gained by algorithmic cortical labelings of FTD and control subjects with those gained by the manual rater. This comparison shows that, of the three methods tested, SyN's volume measurements are the most strongly correlated with volume measurements gained by expert labeling. This study indicates that SyN, with cross-correlation, is a reliable method for normalizing and making anatomical measurements in volumetric MRI of patients and at-risk elderly individuals.
Collapse
Affiliation(s)
- B B Avants
- Department of Radiology, University of Pennsylvania, 3600 Market Street, Philadelphia, PA 19104, United States.
| | | | | | | |
Collapse
|
9
|
Avants BB, Duda JT, Zhang H, Gee JC. Multivariate normalization with symmetric diffeomorphisms for multivariate studies. Med Image Comput Comput Assist Interv 2007; 10:359-366. [PMID: 18051079 DOI: 10.1007/978-3-540-75757-3_44] [Citation(s) in RCA: 28] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
Current clinical and research neuroimaging protocols acquire images using multiple modalities, for instance, T1, T2, diffusion tensor and cerebral blood flow magnetic resonance images (MRI). These multivariate datasets provide unique and often complementary anatomical and physiological information about the subject of interest. We present a method that uses fused multiple modality (scalar and tensor) datasets to perform intersubject spatial normalization. Our multivariate approach has the potential to eliminate inconsistencies that occur when normalization is performed on each modality separately. Furthermore, the multivariate approach uses a much richer anatomical and physiological image signature to infer image correspondences and perform multivariate statistical tests. In this initial study, we develop the theory for Multivariate Symmetric Normalization (MVSyN), establish its feasibility and discuss preliminary results on a multivariate statistical study of 22q deletion syndrome.
Collapse
Affiliation(s)
- B B Avants
- Penn Image Computing and Science Laboratory, University of Pennsylvania, Philadelphia, PA 19104-6389, USA.
| | | | | | | |
Collapse
|
10
|
Cook PA, Zhang H, Avants BB, Yushkevich P, Alexander DC, Gee JC, Ciccarelli O, Thompson AJ. An automated approach to connectivity-based partitioning of brain structures. ACTA ACUST UNITED AC 2006; 8:164-71. [PMID: 16685842 DOI: 10.1007/11566465_21] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/09/2023]
Abstract
We present an automated approach to the problem of connectivity-based partitioning of brain structures using diffusion imaging. White-matter fibres connect different areas of the brain, allowing them to interact with each other. Diffusion-tensor MRI measures the orientation of white-matter fibres in vivo, allowing us to perform connectivity-based partitioning non-invasively. Our new approach leverages atlas-based segmentation to automate anatomical labeling of the cortex. White-matter connectivities are inferred using a probabilistic tractography algorithm that models crossing pathways explicitly. The method is demonstrated with the partitioning of the corpus callosum of eight healthy subjects.
Collapse
Affiliation(s)
- P A Cook
- Centre for Medical Image Computing, Department of Computer Science, University College London, UK
| | | | | | | | | | | | | | | |
Collapse
|
11
|
Handley JW, Mead C, Rausina GA, Waid LJ, Gee JC, Herron SJ. The use of inert carriers in regulatory biodegradation tests of low density poorly water-soluble substances. Chemosphere 2002; 48:529-534. [PMID: 12146631 DOI: 10.1016/s0045-6535(02)00132-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
Many poorly water-soluble compounds fail regulatory ready biodegradation tests as the method of test material preparation limits the bioavailability of the chemical. The recognised method for delivery of poorly soluble materials into biodegradability tests consists of coating test material inside the test vessel or onto inert substrates (i.e., glass cover slide, boiling beads, filter paper, or Teflon stir bar) that are placed inside the vessels. Volatile solvents are often used to augment this process. Although these substrates work fairly well for delivering many poorly soluble materials into biodegradability tests, they have not been effective in keeping low density, poorly water-soluble substances in the test medium. Soon after medium is added to the test vessels, these chemicals break loose from the substrates and float on the surface where they have limited contact with micro-organisms in the test medium. Hence, there is a reduced potential for measuring substantial biodegradability in the test. This paper describes the work undertaken to establish a standard method of adding low density, poorly water-soluble substances into test vessels of biodegradability studies to ensure these materials remain in contact with micro-organisms in the test medium. The substances are prepared for testing by adsorption onto silica gel followed by dispersion into the culture medium. This method of delivery may provide greater intra- and inter-laboratory consistency in biodegradability test results for low density, poorly water-soluble substances and it may more closely mimic the probable transport and fate of these substances in the environment.
Collapse
|
12
|
Abstract
We address the problem of applying spatial transformations (or "image warps") to diffusion tensor magnetic resonance images. The orientational information that these images contain must be handled appropriately when they are transformed spatially during image registration. We present solutions for global transformations of three-dimensional images up to 12-parameter affine complexity and indicate how our methods can be extended for higher order transformations. Several approaches are presented and tested using synthetic data. One method, the preservation of principal direction algorithm, which takes into account shearing, stretching and rigid rotation, is shown to be the most effective. Additional registration experiments are performed on human brain data obtained from a single subject, whose head was imaged in three different orientations within the scanner. All of our methods improve the consistency between registered and target images over naïve warping algorithms.
Collapse
Affiliation(s)
- D C Alexander
- Department of Computer Science, University College London, UK.
| | | | | | | |
Collapse
|
13
|
Abstract
To evaluate our system for elastically deforming a three-dimensional atlas to match anatomical brain images, six deformed versions of an atlas were generated. The deformed atlases were created by elastically mapping an anatomical brain atlas onto different MR brain image volumes. The mapping matches the edges of the ventricles and the surface of the brain; the resultant deformations are propagated through the atlas volume, deforming the remainder of the structures in the process. The atlas was then elastically matched to its deformed versions. The accuracy of the resultant matches was evaluated by determining the correspondence of 32 cortical and subcortical structures. The system on average matched the centroid of a structure to within 1 mm of its true position and fit a structure to within 11% of its true volume. The overlap between the matched and true structures, defined by the ratio between the volume of their intersection and the volume of their union, averaged 66%. When the gray-white interface was included for matching, the mean overlap improved to 78%; each structure was matched to within 0.6 mm of its true position and fit to within 6% of its true volume. Preliminary studies were also made to determine the effect of the compliance of the atlas on the resultant match.
Collapse
Affiliation(s)
- J C Gee
- Department of Computer and Information Science, University of Pennsylvania, Philadelphia 19104
| | | | | |
Collapse
|
14
|
Hood JC, Murphy JE, Gee JC. Characteristics of outpatient medications and implications with hospitalizations. Drug Intell Clin Pharm 1977; 11:362-5. [PMID: 10235895 DOI: 10.1177/106002807701100604] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
A series of 839 patients who entered Bayfront Medical Center with their own medications was studied to determine the number of mislabeled, unlabeled, and unidentifiable medications. Thirty-four percent of the patients entered with improperly labeled medications. Such medications accounted for 23 percent of the total medications (2398) involved. In reviewing the disposition of patients involved in the study, it was found that the general study population exhibited a mortality rate of 3.38 percent compared to the hospital mortality of 3.7 percent during the same period. Of the 28 patients in the study who expired, 15 (53.6 percent) were from the group who entered with improperly labeled medications. The results emphasize the high incidence of improperly labeled drugs possessed by patients at the time of admission, and indicate the possibility of this being associated with increased mortality. The results also underline the responsibility of the pharmacist in informing the physician of the status and characteristics of such medications.
Collapse
|