51
|
Fang Y, Bakian-Dogaheh K, Moghaddam M. Real-Time 3D Microwave Medical Imaging With Enhanced Variational Born Iterative Method. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:268-280. [PMID: 36166569 DOI: 10.1109/tmi.2022.3210494] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
In this paper, we present a new variational Born iterative method (VBIM) for real-time microwave imaging (MWI) applications. The S-parameter volume integral equation and waveport vector Green's function are implemented to utilize the measured signal of the MWI system. Meanwhile, the real and imaginary separation (RIS) approach is used at each iterative step to simultaneously reconstruct the dielectric permittivity and conductivity of unknown objects. Compared with the Born iterative method and distorted Born iterative method, VBIM requires less computational time to reach the convergence threshold. The graphics processing unit based acceleration technique is implemented for real-time imaging. To demonstrate the efficiency and accuracy of this VBIM-RIS method, synthetic analysis of a complex multi-layer spherical phantom is first conducted. Then, the algorithm is tested with measured data using our new MWI system prototype. Finally, a synthetic brain-tumor phantom model under a thermal therapy procedure is monitored to exemplify the real-time imaging with about 5 seconds per reconstruction frame.
Collapse
|
52
|
Shi W, Xu H, Sun C, Sun J, Li Y, Xu X, Zheng T, Zhang Y, Wang G, Wu D. AFFIRM: Affinity Fusion-Based Framework for Iteratively Random Motion Correction of Multi-Slice Fetal Brain MRI. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:209-219. [PMID: 36129858 DOI: 10.1109/tmi.2022.3208277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
Multi-slice magnetic resonance images of the fetal brain are usually contaminated by severe and arbitrary fetal and maternal motion. Hence, stable and robust motion correction is necessary to reconstruct high-resolution 3D fetal brain volume for clinical diagnosis and quantitative analysis. However, the conventional registration-based correction has a limited capture range and is insufficient for detecting relatively large motions. Here, we present a novel Affinity Fusion-based Framework for Iteratively Random Motion (AFFIRM) correction of the multi-slice fetal brain MRI. It learns the sequential motion from multiple stacks of slices and integrates the features between 2D slices and reconstructed 3D volume using affinity fusion, which resembles the iterations between slice-to-volume registration and volumetric reconstruction in the regular pipeline. The method accurately estimates the motion regardless of brain orientations and outperforms other state-of-the-art learning-based methods on the simulated motion-corrupted data, with a 48.4% reduction of mean absolute error for rotation and 61.3% for displacement. We then incorporated AFFIRM into the multi-resolution slice-to-volume registration and tested it on the real-world fetal MRI scans at different gestation stages. The results indicated that adding AFFIRM to the conventional pipeline improved the success rate of fetal brain super-resolution reconstruction from 77.2% to 91.9%.
Collapse
|
53
|
Xu X, Sun C, Sun J, Shi W, Shen Y, Zhao R, Luo W, Li M, Wang G, Wu D. Spatiotemporal Atlas of the Fetal Brain Depicts Cortical Developmental Gradient. J Neurosci 2022; 42:9435-9449. [PMID: 36323525 PMCID: PMC9794379 DOI: 10.1523/jneurosci.1285-22.2022] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Revised: 10/17/2022] [Accepted: 10/25/2022] [Indexed: 11/12/2022] Open
Abstract
The fetal brains experience rapid and complex development in utero during the second and third trimesters. In utero MRI of the fetal brain in this period enables us to quantify normal fetal brain development in the spatiotemporal domain. In this study, we established a high-quality spatiotemporal atlas between 23 and 38 weeks gestational age (GA) from 90 healthy Chinese human fetuses of both sexes using a pairwise and groupwise registration pipeline. We quantified the fetal cortical morphology indices and characterized their spatiotemporal developmental pattern. The cortical thickness exhibited a biphasic pattern that first increased and then decreased; the curvature fitted well into the Gompertz growth model; sulcal depth increased linearly, while surface area expanded exponentially. The cortical thickness and curvature trajectories consistently pointed to a characteristic time point around GA of 31 weeks. The characteristic GA and growth rate obtained from individual cortical regions suggested a central-to-peripheral developmental gradient, with the earliest development in the parietal lobe, and we also observed a superior-to-inferior gradient within the temporal lobe. These findings may be linked to biophysical events, such as dendritic arborization and thalamocortical fibers ingrowth. The proposed atlas was also compared with an existing fetal atlas from a white/mixed population. Finally, we examined the structural asymmetry of the fetal brains and found extensive asymmetry that dynamically changed with development. The current study depicted a comprehensive profile of fetal cortical development, and the established atlas could be used as a normative reference for neurodevelopmental and diagnostic purposes, especially in the Chinese population.SIGNIFICANCE STATEMENT We generated a high-quality 4D spatiotemporal atlas of the normal fetal brain development from 23 to 38 gestational weeks in a Chinese population and characterized the spatiotemporal developmental pattern of cortical morphology. According to the cortical development trajectories, the fetal cerebral cortex development follows a central-to-peripheral developmental gradient that may be related to the underlying cellular events. The majority of cortical regions already exhibit significant asymmetry during the fetal period.
Collapse
Affiliation(s)
- Xinyi Xu
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, 310027, P. R. China
| | - Cong Sun
- Department of Radiology, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing, 100730, P. R. China
| | - Jiwei Sun
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, 310027, P. R. China
| | - Wen Shi
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, 310027, P. R. China
- Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, Maryland 21287
| | - Yao Shen
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, 310027, P. R. China
| | - Ruoke Zhao
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, 310027, P. R. China
| | - Wanrong Luo
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, 310027, P. R. China
| | - Mingyang Li
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, 310027, P. R. China
| | - Guangbin Wang
- Department of Radiology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, 250021, P. R. China
| | - Dan Wu
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, 310027, P. R. China
| |
Collapse
|
54
|
Hufnagel S, Metzner S, Kerkering KM, Aigner CS, Kofler A, Schulz-Menger J, Schaeffter T, Kolbitsch C. 3D model-based super-resolution motion-corrected cardiac T1 mapping. Phys Med Biol 2022; 67. [PMID: 36265478 DOI: 10.1088/1361-6560/ac9c40] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Accepted: 10/20/2022] [Indexed: 12/13/2022]
Abstract
Objective. To provide 3D high-resolution cardiac T1 maps using model-based super-resolution reconstruction (SRR).Approach. Due to signal-to-noise ratio limitations and the motion of the heart during imaging, often 2D T1 maps with only low through-plane resolution (i.e. slice thickness of 6-8 mm) can be obtained. Here, a model-based SRR approach is presented, which combines multiple stacks of 2D acquisitions with 6-8 mm slice thickness and generates 3D high-resolution T1 maps with a slice thickness of 1.5-2 mm. Every stack was acquired in a different breath hold (BH) and any misalignment between BH was corrected retrospectively. The novelty of the proposed approach is the BH correction and the application of model-based SRR on cardiac T1 Mapping. The proposed approach was evaluated in numerical simulations and phantom experiments and demonstrated in four healthy subjects.Main results. Alignment of BH states was essential for SRR even in healthy volunteers. In simulations, respiratory motion could be estimated with an RMS error of 0.18 ± 0.28 mm. SRR improved the visualization of small structures. High accuracy and precision (average standard deviation of 69.62 ms) of the T1 values was ensured by SRR while the detectability of small structures increased by 40%.Significance. The proposed SRR approach provided T1 maps with high in-plane and high through-plane resolution (1.3 × 1.3 × 1.5-2 mm3). The approach led to improvements in the visualization of small structures and precise T1 values.
Collapse
Affiliation(s)
- Simone Hufnagel
- Physikalisch-Technische Bundesanstalt (PTB), Braunschweig and Berlin, Germany
| | - Selma Metzner
- Physikalisch-Technische Bundesanstalt (PTB), Braunschweig and Berlin, Germany
| | | | | | - Andreas Kofler
- Physikalisch-Technische Bundesanstalt (PTB), Braunschweig and Berlin, Germany
| | - Jeanette Schulz-Menger
- Charité Medical Faculty University Medicine, Berlin, Germany.,Working Group on Cardiovascular Magnetic Resonance, Experimental and Clinical Research Center (ECRC), Charité Humboldt University Berlin, DZHK partner site Berlin, Berlin, Germany.,Department of Cardiology and Nephrology, HELIOS Klinikum Berlin Buch, Berlin, Germany
| | - Tobias Schaeffter
- Physikalisch-Technische Bundesanstalt (PTB), Braunschweig and Berlin, Germany.,School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom.,Department of Biomedical Engineering, Technical University of Berlin, Berlin, Germany
| | - Christoph Kolbitsch
- Physikalisch-Technische Bundesanstalt (PTB), Braunschweig and Berlin, Germany
| |
Collapse
|
55
|
De Asis-Cruz J, Limperopoulos C. Harnessing the Power of Advanced Fetal Neuroimaging to Understand In Utero Footprints for Later Neuropsychiatric Disorders. Biol Psychiatry 2022; 93:867-879. [PMID: 36804195 DOI: 10.1016/j.biopsych.2022.11.019] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/01/2022] [Revised: 11/03/2022] [Accepted: 11/25/2022] [Indexed: 12/12/2022]
Abstract
Adverse intrauterine events may profoundly impact fetal risk for future adult diseases. The mechanisms underlying this increased vulnerability are complex and remain poorly understood. Contemporary advances in fetal magnetic resonance imaging (MRI) have provided clinicians and scientists with unprecedented access to in vivo human fetal brain development to begin to identify emerging endophenotypes of neuropsychiatric disorders such as autism spectrum disorder, attention-deficit/hyperactivity disorder, and schizophrenia. In this review, we discuss salient findings of normal fetal neurodevelopment from studies using advanced, multimodal MRI that have provided unparalleled characterization of in utero prenatal brain morphology, metabolism, microstructure, and functional connectivity. We appraise the clinical utility of these normative data in identifying high-risk fetuses before birth. We highlight available studies that have investigated the predictive validity of advanced prenatal brain MRI findings and long-term neurodevelopmental outcomes. We then discuss how ex utero quantitative MRI findings can inform in utero investigations toward the pursuit of early biomarkers of risk. Lastly, we explore future opportunities to advance our understanding of the prenatal origins of neuropsychiatric disorders using precision fetal imaging.
Collapse
|
56
|
Mazher M, Qayyum A, Puig D, Abdel-Nasser M. Effective Approaches to Fetal Brain Segmentation in MRI and Gestational Age Estimation by Utilizing a Multiview Deep Inception Residual Network and Radiomics. ENTROPY (BASEL, SWITZERLAND) 2022; 24:1708. [PMID: 36554113 PMCID: PMC9778347 DOI: 10.3390/e24121708] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Revised: 11/16/2022] [Accepted: 11/18/2022] [Indexed: 06/17/2023]
Abstract
To completely comprehend neurodevelopment in healthy and congenitally abnormal fetuses, quantitative analysis of the human fetal brain is essential. This analysis requires the use of automatic multi-tissue fetal brain segmentation techniques. This paper proposes an end-to-end automatic yet effective method for a multi-tissue fetal brain segmentation model called IRMMNET. It includes a inception residual encoder block (EB) and a dense spatial attention (DSAM) block, which facilitate the extraction of multi-scale fetal-brain-tissue-relevant information from multi-view MRI images, enhance the feature reuse, and substantially reduce the number of parameters of the segmentation model. Additionally, we propose three methods for predicting gestational age (GA)-GA prediction by using a 3D autoencoder, GA prediction using radiomics features, and GA prediction using the IRMMNET segmentation model's encoder. Our experiments were performed on a dataset of 80 pathological and non-pathological magnetic resonance fetal brain volume reconstructions across a range of gestational ages (20 to 33 weeks) that were manually segmented into seven different tissue categories. The results showed that the proposed fetal brain segmentation model achieved a Dice score of 0.791±0.18, outperforming the state-of-the-art methods. The radiomics-based GA prediction methods achieved the best results (RMSE: 1.42). We also demonstrated the generalization capabilities of the proposed methods for tasks such as head and neck tumor segmentation and the prediction of patients' survival days.
Collapse
Affiliation(s)
- Moona Mazher
- Departament d’Enginyeria Informatica i Matemátiques, Universitat Rovira i Virgili, 43007 Tarragona, Spain
| | - Abdul Qayyum
- School of Biomedical Engineering and Imaging Sciences, Kings College London, London SE1 9RT, UK
| | - Domenec Puig
- Departament d’Enginyeria Informatica i Matemátiques, Universitat Rovira i Virgili, 43007 Tarragona, Spain
| | - Mohamed Abdel-Nasser
- Electronics and Communication Engineering Section, Electrical Engineering Department, Aswan University, Aswan 81528, Egypt
| |
Collapse
|
57
|
Wang J, Nichols ES, Mueller ME, de Vrijer B, Eagleson R, McKenzie CA, de Ribaupierre S, Duerden EG. Semi-automatic segmentation of the fetal brain from magnetic resonance imaging. Front Neurosci 2022; 16:1027084. [PMID: 36440277 PMCID: PMC9692018 DOI: 10.3389/fnins.2022.1027084] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Accepted: 10/19/2022] [Indexed: 11/13/2023] Open
Abstract
Background Volumetric measurements of fetal brain maturation in the third trimester of pregnancy are key predictors of developmental outcomes. Improved understanding of fetal brain development trajectories may aid in identifying and clinically managing at-risk fetuses. Currently, fetal brain structures in magnetic resonance images (MRI) are often manually segmented, which requires both time and expertise. To facilitate the targeting and measurement of brain structures in the fetus, we compared the results of five segmentation methods applied to fetal brain MRI data to gold-standard manual tracings. Methods Adult women with singleton pregnancies (n = 21), of whom five were scanned twice, approximately 3 weeks apart, were recruited [26 total datasets, median gestational age (GA) = 34.8, IQR = 30.9-36.6]. T2-weighted single-shot fast spin echo images of the fetal brain were acquired on 1.5T and 3T MRI scanners. Images were first combined into a single 3D anatomical volume. Next, a trained tracer manually segmented the thalamus, cerebellum, and total cerebral volumes. The manual segmentations were compared with five automatic methods of segmentation available within Advanced Normalization Tools (ANTs) and FMRIB's Linear Image Registration Tool (FLIRT) toolboxes. The manual and automatic labels were compared using Dice similarity coefficients (DSCs). The DSC values were compared using Friedman's test for repeated measures. Results Comparing cerebellum and thalamus masks against the manually segmented masks, the median DSC values for ANTs and FLIRT were 0.72 [interquartile range (IQR) = 0.6-0.8] and 0.54 (IQR = 0.4-0.6), respectively. A Friedman's test indicated that the ANTs registration methods, primarily nonlinear methods, performed better than FLIRT (p < 0.001). Conclusion Deformable registration methods provided the most accurate results relative to manual segmentation. Overall, this semi-automatic subcortical segmentation method provides reliable performance to segment subcortical volumes in fetal MR images. This method reduces the costs of manual segmentation, facilitating the measurement of typical and atypical fetal brain development.
Collapse
Affiliation(s)
- Jianan Wang
- Biomedical Engineering, Western University, London, ON, Canada
| | - Emily S. Nichols
- Applied Psychology, Faculty of Education, Western University, London, ON, Canada
- Western Institute for Neuroscience, Western University, London, ON, Canada
| | - Megan E. Mueller
- Applied Psychology, Faculty of Education, Western University, London, ON, Canada
| | - Barbra de Vrijer
- Department of Obstetrics and Gynaecology, Schulich School of Medicine & Dentistry, Western University, London, ON, Canada
| | - Roy Eagleson
- Biomedical Engineering, Western University, London, ON, Canada
- Western Institute for Neuroscience, Western University, London, ON, Canada
- Department of Electrical and Computer Engineering, Western University, London, ON, Canada
| | - Charles A. McKenzie
- Department of Medical Biophysics, Schulich School of Medicine & Dentistry, Western University, London, ON, Canada
| | - Sandrine de Ribaupierre
- Biomedical Engineering, Western University, London, ON, Canada
- Western Institute for Neuroscience, Western University, London, ON, Canada
- Department of Clinical Neurological Sciences, Schulich School of Medicine & Dentistry, Western University, London, ON, Canada
- Department of Anatomy and Cell Biology, Schulich School of Medicine & Dentistry, Western University, London, ON, Canada
| | - Emma G. Duerden
- Biomedical Engineering, Western University, London, ON, Canada
- Applied Psychology, Faculty of Education, Western University, London, ON, Canada
- Western Institute for Neuroscience, Western University, London, ON, Canada
| |
Collapse
|
58
|
Impact of COVID-19 Related Maternal Stress on Fetal Brain Development: A Multimodal MRI Study. J Clin Med 2022; 11:jcm11226635. [PMID: 36431112 PMCID: PMC9695517 DOI: 10.3390/jcm11226635] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Revised: 11/04/2022] [Accepted: 11/05/2022] [Indexed: 11/11/2022] Open
Abstract
BACKGROUND Disruptions in perinatal care and support due to the COVID-19 pandemic was an unprecedented but significant stressor among pregnant women. Various neurostructural differences have been re-ported among fetuses and infants born during the pandemic compared to pre-pandemic counterparts. The relationship between maternal stress due to pandemic related disruptions and fetal brain is yet unexamined. METHODS Pregnant participants with healthy pregnancies were prospectively recruited in 2020-2022 in the greater Los Angeles Area. Participants completed multiple self-report assessments for experiences of pandemic related disruptions, perceived stress, and coping behaviors and underwent fetal MRI. Maternal perceived stress exposures were correlated with quantitative multimodal MRI measures of fetal brain development using multivariate models. RESULTS Increased maternal perception of pandemic related stress positively correlated with normalized fetal brainstem volume (suggesting accelerated brainstem maturation). In contrast, increased maternal perception of pandemic related stress correlated with reduced global fetal brain temporal functional variance (suggesting reduced functional connectivity). CONCLUSIONS We report alterations in fetal brainstem structure and global functional fetal brain activity associated with increased maternal stress due to pandemic related disruptions, suggesting altered fetal programming. Long term follow-up studies are required to better understand the sequalae of these early multi-modal brain disruptions among infants born during the COVID-19 pandemic.
Collapse
|
59
|
Rajagopalan V, Reynolds WT, Zepeda J, Lopez J, Ponrartana S, Wood J, Ceschin R, Panigrahy A. Impact of COVID-19 related maternal stress on fetal brain development: A Multimodal MRI study. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2022:2022.10.26.22281575. [PMID: 36324796 PMCID: PMC9628193 DOI: 10.1101/2022.10.26.22281575] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Background Disruptions in perinatal care and support due to the COVID-19 pandemic was an unprecedented but significant stressor among pregnant women. Various neurostructural differences have been re-ported among fetuses and infants born during the pandemic compared to pre-pandemic counterparts. The relationship between maternal stress due to pandemic related disruptions and fetal brain is yet unexamined. Methods Pregnant participants with healthy pregnancies were prospectively recruited in 2020-2022 in the greater Los Angeles Area. Participants completed multiple self-report assessments for experiences of pandemic related disruptions, perceived stress, and coping behaviors and underwent fetal MRI. Maternal perceived stress exposures were correlated with quantitative multimodal MRI measures of fetal brain development using ltivariate models. Results Fetal brain stem volume increased with increased maternal perception of pandemic related stress positively correlated with normalized fetal brainstem volume (suggesting accelerated brainstem maturation). In contrast, increased maternal perception of pandemic related stress correlated with reduced global fetal brain temporal functional variance (suggesting reduced functional connectivity). Conclusions We report alterations in fetal brainstem structure and global functional fetal brain activity associated with increased maternal stress due to pandemic related disruptions, suggesting altered fetal programming. Long term follow-up studies are required to better understand the sequalae of these early multi-modal brain disruptions among infants born during the COVID-19 pandemic.
Collapse
Affiliation(s)
- Vidya Rajagopalan
- Department of Radiology Childrens Hospital Los Angeles, Keck School of Medicine University of Southern California, Los Angeles CA
| | - William T. Reynolds
- Department of Biomedical Informatics University of Pittsburgh, Pittsburgh, PA 15206, USA
| | - Jeremy Zepeda
- Department of Radiology Childrens Hospital Los Angeles, Los Angeles CA
| | - Jeraldine Lopez
- Neuropsychology Core, The Saban Research Institute, Childrens Hospital Los Angeles
| | - Skorn Ponrartana
- Department of Pediatric Radiology, Keck School of Medicine University of Southern California, Los Angeles CA
| | - John Wood
- Departments of Radiology and Pediatrics, Childrens Hospital Los Angeles, Keck School of Medicine University of Southern California, Los Angeles CA
| | - Rafael Ceschin
- Department of Radiology, University of Pittsburgh School of Medicine, Pittsburgh, PA 15206
| | - Ashok Panigrahy
- Department of Pediatric Radiology, Children’s Hospital of Pittsburgh of UPMC, Pittsburgh, PA 15224, USA
| |
Collapse
|
60
|
Hoopes A, Mora JS, Dalca AV, Fischl B, Hoffmann M. SynthStrip: skull-stripping for any brain image. Neuroimage 2022; 260:119474. [PMID: 35842095 PMCID: PMC9465771 DOI: 10.1016/j.neuroimage.2022.119474] [Citation(s) in RCA: 53] [Impact Index Per Article: 26.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2022] [Revised: 06/17/2022] [Accepted: 07/11/2022] [Indexed: 01/18/2023] Open
Abstract
The removal of non-brain signal from magnetic resonance imaging (MRI) data, known as skull-stripping, is an integral component of many neuroimage analysis streams. Despite their abundance, popular classical skull-stripping methods are usually tailored to images with specific acquisition properties, namely near-isotropic resolution and T1-weighted (T1w) MRI contrast, which are prevalent in research settings. As a result, existing tools tend to adapt poorly to other image types, such as stacks of thick slices acquired with fast spin-echo (FSE) MRI that are common in the clinic. While learning-based approaches for brain extraction have gained traction in recent years, these methods face a similar burden, as they are only effective for image types seen during the training procedure. To achieve robust skull-stripping across a landscape of imaging protocols, we introduce SynthStrip, a rapid, learning-based brain-extraction tool. By leveraging anatomical segmentations to generate an entirely synthetic training dataset with anatomies, intensity distributions, and artifacts that far exceed the realistic range of medical images, SynthStrip learns to successfully generalize to a variety of real acquired brain images, removing the need for training data with target contrasts. We demonstrate the efficacy of SynthStrip for a diverse set of image acquisitions and resolutions across subject populations, ranging from newborn to adult. We show substantial improvements in accuracy over popular skull-stripping baselines - all with a single trained model. Our method and labeled evaluation data are available at https://w3id.org/synthstrip.
Collapse
Affiliation(s)
- Andrew Hoopes
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, 149 13(th) St, Charlestown, MA, USA
| | - Jocelyn S Mora
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, 149 13(th) St, Charlestown, MA, USA
| | - Adrian V Dalca
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, 149 13(th) St, Charlestown, MA, USA; Department of Radiology, Harvard Medical School, 25 Shattuck St, Boston, MA, USA; Computer Science and Artificial Intelligence Lab, Massachusetts Institute of Technology, 32 Vassar St, Cambridge, MA, USA
| | - Bruce Fischl
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, 149 13(th) St, Charlestown, MA, USA; Department of Radiology, Harvard Medical School, 25 Shattuck St, Boston, MA, USA; Computer Science and Artificial Intelligence Lab, Massachusetts Institute of Technology, 32 Vassar St, Cambridge, MA, USA; Harvard-MIT Division of Health Sciences and Technology, 77 Massachusetts Ave, Cambridge, MA, USA
| | - Malte Hoffmann
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, 149 13(th) St, Charlestown, MA, USA; Department of Radiology, Harvard Medical School, 25 Shattuck St, Boston, MA, USA.
| |
Collapse
|
61
|
David AL, Spencer RN. Clinical Assessment of Fetal Well-Being and Fetal Safety Indicators. J Clin Pharmacol 2022; 62 Suppl 1:S67-S78. [PMID: 36106777 PMCID: PMC9544851 DOI: 10.1002/jcph.2126] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Accepted: 07/24/2022] [Indexed: 12/03/2022]
Abstract
Delivering safe clinical trials of novel therapeutics is central to enable pregnant women and their babies to access medicines for better outcomes. This review describes clinical monitoring of fetal well-being and safety. Current pregnancy surveillance includes regular antenatal checks of blood pressure and urine for signs of gestational hypertension. Fetal and placental development is assessed routinely using the first-trimester "dating" and mid-trimester "anomaly" ultrasound scans, but the detection of fetal anomalies can continue throughout pregnancy using targeted sonography or magnetic resonance imaging (MRI). Serial sonography can be used to assess fetal size, well-being, and placental function. Carefully defined reproducible imaging parameters, such as the head circumference (HC), abdominal circumference (AC), and femur length (FL), are combined to calculate an estimate of the fetal weight. Doppler analysis of maternal uterine blood flow predicts placental insufficiency, which is associated with poor fetal growth. Fetal doppler analysis can indicate circulatory decompensation and fetal hypoxia, requiring delivery to be expedited. Novel ways to assess fetal well-being and placental function using MRI, computerized cardiotocography (CTG), serum circulating fetoplacental proteins, and mRNA may improve the assessment of the safety and efficacy of maternal and fetal interventions. Progress has been made in how to define and grade clinical trial safety in pregnant women, the fetus, and neonate. A new system for improved safety monitoring for clinical trials in pregnancy, Maternal and Fetal Adverse Event Terminology (MFAET), describes 12 maternal and 18 fetal adverse event (AE) definitions and severity grading criteria developed through an international modified Delphi consensus process. This fills a vital gap in maternal and fetal translational medicine research.
Collapse
Affiliation(s)
- Anna L. David
- Elizabeth Garrett Anderson Institute for Women's HealthUniversity College LondonLondonUK
- National Institute for Health and Care Research (NIHR) University College London Hospitals NHS Foundation Trust (UCLH)Biomedical Research CentreLondonUK
| | - Rebecca N. Spencer
- Elizabeth Garrett Anderson Institute for Women's HealthUniversity College LondonLondonUK
- School of MedicineUniversity of LeedsLeedsUK
| |
Collapse
|
62
|
Fidon L, Viola E, Mufti N, David AL, Melbourne A, Demaerel P, Ourselin S, Vercauteren T, Deprest J, Aertsen M. A spatio-temporal atlas of the developing fetal brain with spina bifida aperta. OPEN RESEARCH EUROPE 2022; 1:123. [PMID: 37645096 PMCID: PMC10445840 DOI: 10.12688/openreseurope.13914.2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 08/25/2022] [Indexed: 08/31/2023]
Abstract
Background: Spina bifida aperta (SBA) is a birth defect associated with severe anatomical changes in the developing fetal brain. Brain magnetic resonance imaging (MRI) atlases are popular tools for studying neuropathology in the brain anatomy, but previous fetal brain MRI atlases have focused on the normal fetal brain. We aimed to develop a spatio-temporal fetal brain MRI atlas for SBA. Methods: We developed a semi-automatic computational method to compute the first spatio-temporal fetal brain MRI atlas for SBA. We used 90 MRIs of fetuses with SBA with gestational ages ranging from 21 to 35 weeks. Isotropic and motion-free 3D reconstructed MRIs were obtained for all the examinations. We propose a protocol for the annotation of anatomical landmarks in brain 3D MRI of fetuses with SBA with the aim of making spatial alignment of abnormal fetal brain MRIs more robust. In addition, we propose a weighted generalized Procrustes method based on the anatomical landmarks for the initialization of the atlas. The proposed weighted generalized Procrustes can handle temporal regularization and missing annotations. After initialization, the atlas is refined iteratively using non-linear image registration based on the image intensity and the anatomical land-marks. A semi-automatic method is used to obtain a parcellation of our fetal brain atlas into eight tissue types: white matter, ventricular system, cerebellum, extra-axial cerebrospinal fluid, cortical gray matter, deep gray matter, brainstem, and corpus callosum. Results: An intra-rater variability analysis suggests that the seven anatomical land-marks are sufficiently reliable. We find that the proposed atlas outperforms a normal fetal brain atlas for the automatic segmentation of brain 3D MRI of fetuses with SBA. Conclusions: We make publicly available a spatio-temporal fetal brain MRI atlas for SBA, available here: https://doi.org/10.7303/syn25887675. This atlas can support future research on automatic segmentation methods for brain 3D MRI of fetuses with SBA.
Collapse
Affiliation(s)
- Lucas Fidon
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London, SE1 7EU, UK
| | - Elizabeth Viola
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London, SE1 7EU, UK
| | - Nada Mufti
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London, SE1 7EU, UK
- Elizabeth Garrett Anderson Institute for Women’s Health, University College London, London, WC1E 6DB, UK
| | - Anna L. David
- Elizabeth Garrett Anderson Institute for Women’s Health, University College London, London, WC1E 6DB, UK
- Department of Obstetrics and Gynaecology, University Hospitals Leuven, 3000 Leuven, Belgium
| | - Andrew Melbourne
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London, SE1 7EU, UK
| | - Philippe Demaerel
- Department of Radiology, University Hospitals Leuven, 3000 Leuven, Belgium
| | - Sébastien Ourselin
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London, SE1 7EU, UK
| | - Tom Vercauteren
- School of Biomedical Engineering & Imaging Sciences, King’s College London, London, SE1 7EU, UK
| | - Jan Deprest
- Elizabeth Garrett Anderson Institute for Women’s Health, University College London, London, WC1E 6DB, UK
- Department of Obstetrics and Gynaecology, University Hospitals Leuven, 3000 Leuven, Belgium
- Department of Radiology, University Hospitals Leuven, 3000 Leuven, Belgium
| | - Michael Aertsen
- Department of Radiology, University Hospitals Leuven, 3000 Leuven, Belgium
| |
Collapse
|
63
|
Uus AU, Grigorescu I, van Poppel MPM, Steinweg JK, Roberts TA, Rutherford MA, Hajnal JV, Lloyd DFA, Pushparajah K, Deprez M. Automated 3D reconstruction of the fetal thorax in the standard atlas space from motion-corrupted MRI stacks for 21-36 weeks GA range. Med Image Anal 2022; 80:102484. [PMID: 35649314 PMCID: PMC7614011 DOI: 10.1016/j.media.2022.102484] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Revised: 04/22/2022] [Accepted: 05/20/2022] [Indexed: 01/21/2023]
Abstract
Slice-to-volume registration (SVR) methods allow reconstruction of high-resolution 3D images from multiple motion-corrupted stacks. SVR-based pipelines have been increasingly used for motion correction for T2-weighted structural fetal MRI since they allow more informed and detailed diagnosis of brain and body anomalies including congenital heart defects (Lloyd et al., 2019). Recently, fully automated rigid SVR reconstruction of the fetal brain in the atlas space was achieved in Salehi et al. (2019) that used convolutional neural networks (CNNs) for segmentation and pose estimation. However, these CNN-based methods have not yet been applied to the fetal trunk region. Meanwhile, the existing rigid and deformable SVR (DSVR) solutions (Uus et al., 2020) for the fetal trunk region are limited by the requirement of manual input as well the narrow capture range of the classical gradient descent based registration methods that cannot resolve severe fetal motion frequently occurring at the early gestational age (GA). Furthermore, in our experience, the conventional 2D slice-wise CNN-based brain masking solutions are reportedly prone to errors that require manual corrections when applied on a wide range of acquisition protocols or abnormal cases in clinical setting. In this work, we propose a fully automated pipeline for reconstruction of the fetal thorax region for 21-36 weeks GA range T2-weighted MRI datasets. It includes 3D CNN-based intra-uterine localisation of the fetal trunk and landmark-guided pose estimation steps that allow automated DSVR reconstruction in the standard radiological space irrespective of the fetal trunk position or the regional stack coverage. The additional step for generation of the common template space and rejection of outliers provides the means for automated exclusion of stacks affected by low image quality or extreme motion. The pipeline was quantitatively evaluated on a series of experiments including fetal MRI datasets and simulated rotation motion. Furthermore, we performed a qualitative assessment of the image reconstruction quality in terms of the definition of vascular structures on 100 early (median 23.14 weeks) and late (median 31.79 weeks) GA group MRI datasets covering 21 to 36 weeks GA range.
Collapse
Affiliation(s)
- Alena U Uus
- School of Imaging Sciences & Biomedical Engineering, King's College London, St. Thomas' Hospital, London, SE1 7EH, UK.
| | - Irina Grigorescu
- School of Imaging Sciences & Biomedical Engineering, King's College London, St. Thomas' Hospital, London, SE1 7EH, UK
| | - Milou P M van Poppel
- School of Imaging Sciences & Biomedical Engineering, King's College London, St. Thomas' Hospital, London, SE1 7EH, UK; Department of Congenital Heart Disease, Evelina London Children's Hospital, London, SE1 7EH, UK
| | - Johannes K Steinweg
- School of Imaging Sciences & Biomedical Engineering, King's College London, St. Thomas' Hospital, London, SE1 7EH, UK; Department of Congenital Heart Disease, Evelina London Children's Hospital, London, SE1 7EH, UK
| | - Thomas A Roberts
- School of Imaging Sciences & Biomedical Engineering, King's College London, St. Thomas' Hospital, London, SE1 7EH, UK
| | - Mary A Rutherford
- Centre for the Developing Brain, King's College London, London, SE1 7EH, UK
| | - Joseph V Hajnal
- School of Imaging Sciences & Biomedical Engineering, King's College London, St. Thomas' Hospital, London, SE1 7EH, UK; Centre for the Developing Brain, King's College London, London, SE1 7EH, UK
| | - David F A Lloyd
- School of Imaging Sciences & Biomedical Engineering, King's College London, St. Thomas' Hospital, London, SE1 7EH, UK; Department of Congenital Heart Disease, Evelina London Children's Hospital, London, SE1 7EH, UK
| | - Kuberan Pushparajah
- School of Imaging Sciences & Biomedical Engineering, King's College London, St. Thomas' Hospital, London, SE1 7EH, UK; Department of Congenital Heart Disease, Evelina London Children's Hospital, London, SE1 7EH, UK
| | - Maria Deprez
- School of Imaging Sciences & Biomedical Engineering, King's College London, St. Thomas' Hospital, London, SE1 7EH, UK
| |
Collapse
|
64
|
Improving Development of Drug Treatments for Pregnant Women and the Fetus. Ther Innov Regul Sci 2022; 56:976-990. [PMID: 35881237 PMCID: PMC9315086 DOI: 10.1007/s43441-022-00433-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Accepted: 06/30/2022] [Indexed: 12/12/2022]
Abstract
The exclusion of pregnant populations, women of reproductive age, and the fetus from clinical trials of therapeutics is a major global public health issue. It is also a problem of inequity in medicines development, as pregnancy is a protected characteristic. The current regulatory requirements for drugs in pregnancy are being analyzed by a number of agencies worldwide. There has been considerable investment in developing expertise in pregnancy clinical trials (for the pregnant person and the fetus) such as the Obstetric-Fetal Pharmacology Research Centers funded by the National Institute of Child Health and Human Development. Progress has also been made in how to define and grade clinical trial safety in pregnant women, the fetus, and neonate. Innovative methods to model human pregnancy physiology and pharmacology using computer simulations are also gaining interest. Novel ways to assess fetal well-being and placental function using magnetic resonance imaging, computerized cardiotocography, serum circulating fetoplacental proteins, and mRNA may permit better assessment of the safety and efficacy of interventions in the mother and fetus. The core outcomes in women’s and newborn health initiative is facilitating the consistent reporting of data from pregnancy trials. Electronic medical records integrated with pharmacy services should improve the strength of pharmacoepidemiologic and pharmacovigilance studies. Incentives such as investigational plans and orphan disease designation have been taken up for obstetric, fetal, and neonatal diseases. This review describes the progress that is being made to better understand the extent of the problem and to develop applicable solutions.
Collapse
|
65
|
Moser F, Huang R, Papież BW, Namburete AIL. BEAN: Brain Extraction and Alignment Network for 3D Fetal Neurosonography. Neuroimage 2022; 258:119341. [PMID: 35654376 DOI: 10.1016/j.neuroimage.2022.119341] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Revised: 04/08/2022] [Accepted: 05/28/2022] [Indexed: 01/18/2023] Open
Abstract
Brain extraction (masking of extra-cerebral tissues) and alignment are fundamental first steps of most neuroimage analysis pipelines. The lack of automated solutions for 3D ultrasound (US) has therefore limited its potential as a neuroimaging modality for studying fetal brain development using routinely acquired scans. In this work, we propose a convolutional neural network (CNN) that accurately and consistently aligns and extracts the fetal brain from minimally pre-processed 3D US scans. Our multi-task CNN, Brain Extraction and Alignment Network (BEAN), consists of two independent branches: 1) a fully-convolutional encoder-decoder branch for brain extraction of unaligned scans, and 2) a two-step regression-based branch for similarity alignment of the brain to a common coordinate space. BEAN was tested on 356 fetal head 3D scans spanning the gestational range of 14 to 30 weeks, significantly outperforming all current alternatives for fetal brain extraction and alignment. BEAN achieved state-of-the-art performance for both tasks, with a mean Dice Similarity Coefficient (DSC) of 0.94 for the brain extraction masks, and a mean DSC of 0.93 for the alignment of the target brain masks. The presented experimental results show that brain structures such as the thalamus, choroid plexus, cavum septum pellucidum, and Sylvian fissure, are consistently aligned throughout the dataset and remain clearly visible when the scans are averaged together. The BEAN implementation and related code can be found under www.github.com/felipemoser/kelluwen.
Collapse
Affiliation(s)
- Felipe Moser
- Oxford Machine Learning in Neuroimaging laboratory, OMNI, Department of Computer Science, University of Oxford, Oxford, UK.
| | - Ruobing Huang
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK
| | -
- Nuffield Department of Women's and Reproductive Health, John Radcliffe Hospital, University of Oxford, Oxford, UK
| | - Bartłomiej W Papież
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK; Big Data Institute, Li Ka Shing Centre for Health Information and Discovery, University of Oxford, Oxford, UK
| | - Ana I L Namburete
- Oxford Machine Learning in Neuroimaging laboratory, OMNI, Department of Computer Science, University of Oxford, Oxford, UK; Wellcome Centre for Integrative Neuroimaging, FMRIB, Nuffield Department of Clinical Neurosciences, University of Oxford, United Kingdom
| |
Collapse
|
66
|
A Fetal Brain magnetic resonance Acquisition Numerical phantom (FaBiAN). Sci Rep 2022; 12:8682. [PMID: 35606398 PMCID: PMC9127105 DOI: 10.1038/s41598-022-10335-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Accepted: 04/05/2022] [Indexed: 11/28/2022] Open
Abstract
Accurate characterization of in utero human brain maturation is critical as it involves complex and interconnected structural and functional processes that may influence health later in life. Magnetic resonance imaging is a powerful tool to investigate equivocal neurological patterns during fetal development. However, the number of acquisitions of satisfactory quality available in this cohort of sensitive subjects remains scarce, thus hindering the validation of advanced image processing techniques. Numerical phantoms can mitigate these limitations by providing a controlled environment with a known ground truth. In this work, we present FaBiAN, an open-source Fetal Brain magnetic resonance Acquisition Numerical phantom that simulates clinical T2-weighted fast spin echo sequences of the fetal brain. This unique tool is based on a general, flexible and realistic setup that includes stochastic fetal movements, thus providing images of the fetal brain throughout maturation comparable to clinical acquisitions. We demonstrate its value to evaluate the robustness and optimize the accuracy of an algorithm for super-resolution fetal brain magnetic resonance imaging from simulated motion-corrupted 2D low-resolution series compared to a synthetic high-resolution reference volume. We also show that the images generated can complement clinical datasets to support data-intensive deep learning methods for fetal brain tissue segmentation.
Collapse
|
67
|
Kebiri H, Canales-Rodríguez EJ, Lajous H, de Dumast P, Girard G, Alemán-Gómez Y, Koob M, Jakab A, Bach Cuadra M. Through-Plane Super-Resolution With Autoencoders in Diffusion Magnetic Resonance Imaging of the Developing Human Brain. Front Neurol 2022; 13:827816. [PMID: 35585848 PMCID: PMC9109939 DOI: 10.3389/fneur.2022.827816] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2021] [Accepted: 03/28/2022] [Indexed: 11/13/2022] Open
Abstract
Fetal brain diffusion magnetic resonance images (MRI) are often acquired with a lower through-plane than in-plane resolution. This anisotropy is often overcome by classical upsampling methods such as linear or cubic interpolation. In this work, we employ an unsupervised learning algorithm using an autoencoder neural network for single-image through-plane super-resolution by leveraging a large amount of data. Our framework, which can also be used for slice outliers replacement, overperformed conventional interpolations quantitatively and qualitatively on pre-term newborns of the developing Human Connectome Project. The evaluation was performed on both the original diffusion-weighted signal and the estimated diffusion tensor maps. A byproduct of our autoencoder was its ability to act as a denoiser. The network was able to generalize fetal data with different levels of motions and we qualitatively showed its consistency, hence supporting the relevance of pre-term datasets to improve the processing of fetal brain images.
Collapse
Affiliation(s)
- Hamza Kebiri
- Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
- CIBM Center for Biomedical Imaging, Lausanne, Switzerland
| | - Erick J. Canales-Rodríguez
- Signal Processing Laboratory 5 (LTS5), Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - Hélène Lajous
- Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
- CIBM Center for Biomedical Imaging, Lausanne, Switzerland
| | - Priscille de Dumast
- Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
- CIBM Center for Biomedical Imaging, Lausanne, Switzerland
| | - Gabriel Girard
- Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
- CIBM Center for Biomedical Imaging, Lausanne, Switzerland
- Signal Processing Laboratory 5 (LTS5), Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - Yasser Alemán-Gómez
- Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
| | - Mériam Koob
- Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
| | - András Jakab
- Center for MR Research University Children's Hospital Zurich, Zurich, Switzerland
- Neuroscience Center Zurich, University of Zurich, Zurich, Switzerland
| | - Meritxell Bach Cuadra
- Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
- CIBM Center for Biomedical Imaging, Lausanne, Switzerland
- Signal Processing Laboratory 5 (LTS5), Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| |
Collapse
|
68
|
Beirinckx Q, Jeurissen B, Nicastro M, Poot DH, Verhoye M, Dekker AJD, Sijbers J. Model-based super-resolution reconstruction with joint motion estimation for improved quantitative MRI parameter mapping. Comput Med Imaging Graph 2022; 100:102071. [DOI: 10.1016/j.compmedimag.2022.102071] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2021] [Revised: 04/07/2022] [Accepted: 04/29/2022] [Indexed: 01/18/2023]
|
69
|
Sobotka D, Ebner M, Schwartz E, Nenning KH, Taymourtash A, Vercauteren T, Ourselin S, Kasprian G, Prayer D, Langs G, Licandro R. Motion correction and volumetric reconstruction for fetal functional magnetic resonance imaging data. Neuroimage 2022; 255:119213. [PMID: 35430359 DOI: 10.1016/j.neuroimage.2022.119213] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Revised: 03/21/2022] [Accepted: 04/13/2022] [Indexed: 10/18/2022] Open
Abstract
Motion correction is an essential preprocessing step in functional Magnetic Resonance Imaging (fMRI) of the fetal brain with the aim to remove artifacts caused by fetal movement and maternal breathing and consequently to suppress erroneous signal correlations. Current motion correction approaches for fetal fMRI choose a single 3D volume from a specific acquisition timepoint with least motion artefacts as reference volume, and perform interpolation for the reconstruction of the motion corrected time series. The results can suffer, if no low-motion frame is available, and if reconstruction does not exploit any assumptions about the continuity of the fMRI signal. Here, we propose a novel framework, which estimates a high-resolution reference volume by using outlier-robust motion correction, and by utilizing Huber L2 regularization for intra-stack volumetric reconstruction of the motion-corrected fetal brain fMRI. We performed an extensive parameter study to investigate the effectiveness of motion estimation and present in this work benchmark metrics to quantify the effect of motion correction and regularised volumetric reconstruction approaches on functional connectivity computations. We demonstrate the proposed framework's ability to improve functional connectivity estimates, reproducibility and signal interpretability, which is clinically highly desirable for the establishment of prognostic noninvasive imaging biomarkers. The motion correction and volumetric reconstruction framework is made available as an open-source package of NiftyMIC.
Collapse
Affiliation(s)
- Daniel Sobotka
- Computational Imaging Research Lab, Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria
| | - Michael Ebner
- School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Ernst Schwartz
- Computational Imaging Research Lab, Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria
| | - Karl-Heinz Nenning
- Computational Imaging Research Lab, Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria; Center for Biomedical Imaging and Neuromodulation, Nathan Kline Institute, Orangeburg, NY, USA
| | - Athena Taymourtash
- Computational Imaging Research Lab, Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria
| | - Tom Vercauteren
- School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Sebastien Ourselin
- School of Biomedical Engineering & Imaging Sciences, King's College London, London, United Kingdom
| | - Gregor Kasprian
- Division of Neuroradiology and Musculoskeletal Radiology, Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria
| | - Daniela Prayer
- Division of Neuroradiology and Musculoskeletal Radiology, Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria
| | - Georg Langs
- Computational Imaging Research Lab, Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria.
| | - Roxane Licandro
- Computational Imaging Research Lab, Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria; Laboratory for Computational Neuroimaging, Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, USA.
| |
Collapse
|
70
|
Gagoski B, Xu J, Wighton P, Tisdall MD, Frost R, Lo WC, Golland P, van der Kouwe A, Adalsteinsson E, Grant PE. Automated detection and reacquisition of motion-degraded images in fetal HASTE imaging at 3 T. Magn Reson Med 2022; 87:1914-1922. [PMID: 34888942 PMCID: PMC8810713 DOI: 10.1002/mrm.29106] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Revised: 10/19/2021] [Accepted: 11/12/2021] [Indexed: 11/07/2022]
Abstract
PURPOSE Fetal brain Magnetic Resonance Imaging suffers from unpredictable and unconstrained fetal motion that causes severe image artifacts even with half-Fourier single-shot fast spin echo (HASTE) readouts. This work presents the implementation of a closed-loop pipeline that automatically detects and reacquires HASTE images that were degraded by fetal motion without any human interaction. METHODS A convolutional neural network that performs automatic image quality assessment (IQA) was run on an external GPU-equipped computer that was connected to the internal network of the MRI scanner. The modified HASTE pulse sequence sent each image to the external computer, where the IQA convolutional neural network evaluated it, and then the IQA score was sent back to the sequence. At the end of the HASTE stack, the IQA scores from all the slices were sorted, and only slices with the lowest scores (corresponding to the slices with worst image quality) were reacquired. RESULTS The closed-loop HASTE acquisition framework was tested on 10 pregnant mothers, for a total of 73 acquisitions of our modified HASTE sequence. The IQA convolutional neural network, which was successfully employed by our modified sequence in real time, achieved an accuracy of 85.2% and area under the receiver operator characteristic of 0.899. CONCLUSION The proposed acquisition/reconstruction pipeline was shown to successfully identify and automatically reacquire only the motion degraded fetal brain HASTE slices in the prescribed stack. This minimizes the overall time spent on HASTE acquisitions by avoiding the need to repeat the entire stack if only few slices in the stack are motion-degraded.
Collapse
Affiliation(s)
- Borjan Gagoski
- Fetal Neonatal Neuroimaging and Developmental Science Center, Boston Children's Hospital, Boston, Massachusetts, USA
- Department of Radiology, Harvard Medical School, Boston, Massachusetts, USA
| | - Junshen Xu
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
| | - Paul Wighton
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, USA
| | - M. Dylan Tisdall
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Robert Frost
- Department of Radiology, Harvard Medical School, Boston, Massachusetts, USA
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, USA
| | - Wei-Ching Lo
- Siemens Medical Solutions USA, Inc, Charlestown, Massachusetts, USA
| | - Polina Golland
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
- Computer Science and Artificial Intelligence Laboratory (CSAIL), Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
| | - Andre van der Kouwe
- Department of Radiology, Harvard Medical School, Boston, Massachusetts, USA
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts, USA
| | - Elfar Adalsteinsson
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
- Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
| | - P. Ellen Grant
- Fetal Neonatal Neuroimaging and Developmental Science Center, Boston Children's Hospital, Boston, Massachusetts, USA
- Department of Radiology, Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
71
|
Snider SB, Fischer D, McKeown ME, Cohen AL, Schaper FLWVJ, Amorim E, Fox MD, Scirica B, Bevers MB, Lee JW. Regional Distribution of Brain Injury After Cardiac Arrest: Clinical and Electrographic Correlates. Neurology 2022; 98:e1238-e1247. [PMID: 35017304 PMCID: PMC8967331 DOI: 10.1212/wnl.0000000000013301] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2021] [Accepted: 12/27/2021] [Indexed: 11/15/2022] Open
Abstract
BACKGROUND AND OBJECTIVES Disorders of consciousness, EEG background suppression, and epileptic seizures are associated with poor outcome after cardiac arrest. Our objective was to identify the distribution of diffusion MRI-measured anoxic brain injury after cardiac arrest and to define the regional correlates of disorders of consciousness, EEG background suppression, and seizures. METHODS We analyzed patients from a single-center database of unresponsive patients who underwent diffusion MRI after cardiac arrest (n = 204). We classified each patient according to recovery of consciousness (command following) before discharge, the most continuous EEG background (burst suppression vs continuous), and the presence or absence of seizures. Anoxic brain injury was measured with the apparent diffusion coefficient (ADC) signal. We identified ADC abnormalities relative to controls without cardiac arrest (n = 48) and used voxel lesion symptom mapping to identify regional associations with disorders of consciousness, EEG background suppression, and seizures. We then used a bootstrapped lasso regression procedure to identify robust, multivariate regional associations with each outcome variable. Last, using area under receiver operating characteristic curves, we then compared the classification ability of the strongest regional associations to that of brain-wide summary measures. RESULTS Compared to controls, patients with cardiac arrest demonstrated ADC signal reduction that was most significant in the occipital lobes. Disorders of consciousness were associated with reduced ADC most prominently in the occipital lobes but also in deep structures. Regional injury more accurately classified patients with disorders of consciousness than whole-brain injury. Background suppression mapped to a similar set of brain regions, but regional injury could no better classify patients than whole-brain measures. Seizures were less common in patients with more severe anoxic injury, particularly in those with injury to the lateral temporal white matter. DISCUSSION Anoxic brain injury was most prevalent in posterior cerebral regions, and this regional pattern of injury was a better predictor of disorders of consciousness than whole-brain injury measures. EEG background suppression lacked a specific regional association, but patients with injury to the temporal lobe were less likely to have seizures. Regional patterns of anoxic brain injury are relevant to the clinical and electrographic sequelae of cardiac arrest and may hold importance for prognosis. CLASSIFICATION OF EVIDENCE This study provides Class IV evidence that disorders of consciousness after cardiac arrest are associated with widely lower ADC values on diffusion MRI and are most strongly associated with reductions in occipital ADC.
Collapse
Affiliation(s)
- Samuel B Snider
- From the Division of Neurocritical Care, Department of Neurology, (S.B.S., D.F., M.E.M., M.B.B.), Departments of Neurology, Psychiatry, and Radiology (A.L.C., F.L.W.V.J.S., M.D.F.), Center for Brain Circuit Therapeutics, Division of Cardiology, Department of Medicine (B.S.), and Division of Epilepsy, Department of Neurology (J.W.L.), Brigham and Women's Hospital, Harvard Medical School; Departments of Neurology and Radiology (A.L.C.), Computational Radiology Laboratory, Boston Children's Hospital, Harvard Medical School, MA; Department of Neurology (E.A.), Weill Institute for Neurosciences, University of California at San Francisco; Neurology Service (E.A.), Zuckerberg San Francisco General Hospital, CA; Departments of Neurology and Radiology (M.D.F.), Athinoula A. Martinos Centre for Biomedical Imaging, Massachusetts General Hospital, Charlestown; and Department of Neurology (M.D.F.), Berenson-Allen Center for Noninvasive Brain Stimulation, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA.
| | - David Fischer
- From the Division of Neurocritical Care, Department of Neurology, (S.B.S., D.F., M.E.M., M.B.B.), Departments of Neurology, Psychiatry, and Radiology (A.L.C., F.L.W.V.J.S., M.D.F.), Center for Brain Circuit Therapeutics, Division of Cardiology, Department of Medicine (B.S.), and Division of Epilepsy, Department of Neurology (J.W.L.), Brigham and Women's Hospital, Harvard Medical School; Departments of Neurology and Radiology (A.L.C.), Computational Radiology Laboratory, Boston Children's Hospital, Harvard Medical School, MA; Department of Neurology (E.A.), Weill Institute for Neurosciences, University of California at San Francisco; Neurology Service (E.A.), Zuckerberg San Francisco General Hospital, CA; Departments of Neurology and Radiology (M.D.F.), Athinoula A. Martinos Centre for Biomedical Imaging, Massachusetts General Hospital, Charlestown; and Department of Neurology (M.D.F.), Berenson-Allen Center for Noninvasive Brain Stimulation, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA
| | - Morgan E McKeown
- From the Division of Neurocritical Care, Department of Neurology, (S.B.S., D.F., M.E.M., M.B.B.), Departments of Neurology, Psychiatry, and Radiology (A.L.C., F.L.W.V.J.S., M.D.F.), Center for Brain Circuit Therapeutics, Division of Cardiology, Department of Medicine (B.S.), and Division of Epilepsy, Department of Neurology (J.W.L.), Brigham and Women's Hospital, Harvard Medical School; Departments of Neurology and Radiology (A.L.C.), Computational Radiology Laboratory, Boston Children's Hospital, Harvard Medical School, MA; Department of Neurology (E.A.), Weill Institute for Neurosciences, University of California at San Francisco; Neurology Service (E.A.), Zuckerberg San Francisco General Hospital, CA; Departments of Neurology and Radiology (M.D.F.), Athinoula A. Martinos Centre for Biomedical Imaging, Massachusetts General Hospital, Charlestown; and Department of Neurology (M.D.F.), Berenson-Allen Center for Noninvasive Brain Stimulation, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA
| | - Alexander Li Cohen
- From the Division of Neurocritical Care, Department of Neurology, (S.B.S., D.F., M.E.M., M.B.B.), Departments of Neurology, Psychiatry, and Radiology (A.L.C., F.L.W.V.J.S., M.D.F.), Center for Brain Circuit Therapeutics, Division of Cardiology, Department of Medicine (B.S.), and Division of Epilepsy, Department of Neurology (J.W.L.), Brigham and Women's Hospital, Harvard Medical School; Departments of Neurology and Radiology (A.L.C.), Computational Radiology Laboratory, Boston Children's Hospital, Harvard Medical School, MA; Department of Neurology (E.A.), Weill Institute for Neurosciences, University of California at San Francisco; Neurology Service (E.A.), Zuckerberg San Francisco General Hospital, CA; Departments of Neurology and Radiology (M.D.F.), Athinoula A. Martinos Centre for Biomedical Imaging, Massachusetts General Hospital, Charlestown; and Department of Neurology (M.D.F.), Berenson-Allen Center for Noninvasive Brain Stimulation, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA
| | - Frederic L W V J Schaper
- From the Division of Neurocritical Care, Department of Neurology, (S.B.S., D.F., M.E.M., M.B.B.), Departments of Neurology, Psychiatry, and Radiology (A.L.C., F.L.W.V.J.S., M.D.F.), Center for Brain Circuit Therapeutics, Division of Cardiology, Department of Medicine (B.S.), and Division of Epilepsy, Department of Neurology (J.W.L.), Brigham and Women's Hospital, Harvard Medical School; Departments of Neurology and Radiology (A.L.C.), Computational Radiology Laboratory, Boston Children's Hospital, Harvard Medical School, MA; Department of Neurology (E.A.), Weill Institute for Neurosciences, University of California at San Francisco; Neurology Service (E.A.), Zuckerberg San Francisco General Hospital, CA; Departments of Neurology and Radiology (M.D.F.), Athinoula A. Martinos Centre for Biomedical Imaging, Massachusetts General Hospital, Charlestown; and Department of Neurology (M.D.F.), Berenson-Allen Center for Noninvasive Brain Stimulation, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA
| | - Edilberto Amorim
- From the Division of Neurocritical Care, Department of Neurology, (S.B.S., D.F., M.E.M., M.B.B.), Departments of Neurology, Psychiatry, and Radiology (A.L.C., F.L.W.V.J.S., M.D.F.), Center for Brain Circuit Therapeutics, Division of Cardiology, Department of Medicine (B.S.), and Division of Epilepsy, Department of Neurology (J.W.L.), Brigham and Women's Hospital, Harvard Medical School; Departments of Neurology and Radiology (A.L.C.), Computational Radiology Laboratory, Boston Children's Hospital, Harvard Medical School, MA; Department of Neurology (E.A.), Weill Institute for Neurosciences, University of California at San Francisco; Neurology Service (E.A.), Zuckerberg San Francisco General Hospital, CA; Departments of Neurology and Radiology (M.D.F.), Athinoula A. Martinos Centre for Biomedical Imaging, Massachusetts General Hospital, Charlestown; and Department of Neurology (M.D.F.), Berenson-Allen Center for Noninvasive Brain Stimulation, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA
| | - Michael D Fox
- From the Division of Neurocritical Care, Department of Neurology, (S.B.S., D.F., M.E.M., M.B.B.), Departments of Neurology, Psychiatry, and Radiology (A.L.C., F.L.W.V.J.S., M.D.F.), Center for Brain Circuit Therapeutics, Division of Cardiology, Department of Medicine (B.S.), and Division of Epilepsy, Department of Neurology (J.W.L.), Brigham and Women's Hospital, Harvard Medical School; Departments of Neurology and Radiology (A.L.C.), Computational Radiology Laboratory, Boston Children's Hospital, Harvard Medical School, MA; Department of Neurology (E.A.), Weill Institute for Neurosciences, University of California at San Francisco; Neurology Service (E.A.), Zuckerberg San Francisco General Hospital, CA; Departments of Neurology and Radiology (M.D.F.), Athinoula A. Martinos Centre for Biomedical Imaging, Massachusetts General Hospital, Charlestown; and Department of Neurology (M.D.F.), Berenson-Allen Center for Noninvasive Brain Stimulation, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA
| | - Benjamin Scirica
- From the Division of Neurocritical Care, Department of Neurology, (S.B.S., D.F., M.E.M., M.B.B.), Departments of Neurology, Psychiatry, and Radiology (A.L.C., F.L.W.V.J.S., M.D.F.), Center for Brain Circuit Therapeutics, Division of Cardiology, Department of Medicine (B.S.), and Division of Epilepsy, Department of Neurology (J.W.L.), Brigham and Women's Hospital, Harvard Medical School; Departments of Neurology and Radiology (A.L.C.), Computational Radiology Laboratory, Boston Children's Hospital, Harvard Medical School, MA; Department of Neurology (E.A.), Weill Institute for Neurosciences, University of California at San Francisco; Neurology Service (E.A.), Zuckerberg San Francisco General Hospital, CA; Departments of Neurology and Radiology (M.D.F.), Athinoula A. Martinos Centre for Biomedical Imaging, Massachusetts General Hospital, Charlestown; and Department of Neurology (M.D.F.), Berenson-Allen Center for Noninvasive Brain Stimulation, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA
| | - Matthew B Bevers
- From the Division of Neurocritical Care, Department of Neurology, (S.B.S., D.F., M.E.M., M.B.B.), Departments of Neurology, Psychiatry, and Radiology (A.L.C., F.L.W.V.J.S., M.D.F.), Center for Brain Circuit Therapeutics, Division of Cardiology, Department of Medicine (B.S.), and Division of Epilepsy, Department of Neurology (J.W.L.), Brigham and Women's Hospital, Harvard Medical School; Departments of Neurology and Radiology (A.L.C.), Computational Radiology Laboratory, Boston Children's Hospital, Harvard Medical School, MA; Department of Neurology (E.A.), Weill Institute for Neurosciences, University of California at San Francisco; Neurology Service (E.A.), Zuckerberg San Francisco General Hospital, CA; Departments of Neurology and Radiology (M.D.F.), Athinoula A. Martinos Centre for Biomedical Imaging, Massachusetts General Hospital, Charlestown; and Department of Neurology (M.D.F.), Berenson-Allen Center for Noninvasive Brain Stimulation, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA
| | - Jong Woo Lee
- From the Division of Neurocritical Care, Department of Neurology, (S.B.S., D.F., M.E.M., M.B.B.), Departments of Neurology, Psychiatry, and Radiology (A.L.C., F.L.W.V.J.S., M.D.F.), Center for Brain Circuit Therapeutics, Division of Cardiology, Department of Medicine (B.S.), and Division of Epilepsy, Department of Neurology (J.W.L.), Brigham and Women's Hospital, Harvard Medical School; Departments of Neurology and Radiology (A.L.C.), Computational Radiology Laboratory, Boston Children's Hospital, Harvard Medical School, MA; Department of Neurology (E.A.), Weill Institute for Neurosciences, University of California at San Francisco; Neurology Service (E.A.), Zuckerberg San Francisco General Hospital, CA; Departments of Neurology and Radiology (M.D.F.), Athinoula A. Martinos Centre for Biomedical Imaging, Massachusetts General Hospital, Charlestown; and Department of Neurology (M.D.F.), Berenson-Allen Center for Noninvasive Brain Stimulation, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA
| |
Collapse
|
72
|
Meshaka R, Gaunt T, Shelmerdine SC. Artificial intelligence applied to fetal MRI: A scoping review of current research. Br J Radiol 2022:20211205. [PMID: 35286139 DOI: 10.1259/bjr.20211205] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
Artificial intelligence (AI) is defined as the development of computer systems to perform tasks normally requiring human intelligence. A subset of AI, known as machine learning (ML), takes this further by drawing inferences from patterns in data to 'learn' and 'adapt' without explicit instructions meaning that computer systems can 'evolve' and hopefully improve without necessarily requiring external human influences. The potential for this novel technology has resulted in great interest from the medical community regarding how it can be applied in healthcare. Within radiology, the focus has mostly been for applications in oncological imaging, although new roles in other subspecialty fields are slowly emerging.In this scoping review, we performed a literature search of the current state-of-the-art and emerging trends for the use of artificial intelligence as applied to fetal magnetic resonance imaging (MRI). Our search yielded several publications covering AI tools for anatomical organ segmentation, improved imaging sequences and aiding in diagnostic applications such as automated biometric fetal measurements and the detection of congenital and acquired abnormalities. We highlight our own perceived gaps in this literature and suggest future avenues for further research. It is our hope that the information presented highlights the varied ways and potential that novel digital technology could make an impact to future clinical practice with regards to fetal MRI.
Collapse
Affiliation(s)
- Riwa Meshaka
- Department of Clinical Radiology, Great Ormond Street Hospital for Children NHS Foundation Trust, Great Ormond Street, London, UK
| | - Trevor Gaunt
- Department of Radiology, University College London Hospitals NHS Foundation Trust, London, UK
| | - Susan C Shelmerdine
- Department of Clinical Radiology, Great Ormond Street Hospital for Children NHS Foundation Trust, Great Ormond Street, London, UK.,UCL Great Ormond Street Institute of Child Health, Great Ormond Street Hospital for Children, London, UK.,NIHR Great Ormond Street Hospital Biomedical Research Centre, 30 Guilford Street, Bloomsbury, London, UK.,Department of Radiology, St. George's Hospital, Blackshaw Road, London, UK
| |
Collapse
|
73
|
Dovjak GO, Hausmaninger G, Zalewski T, Schmidbauer V, Weber M, Worda C, Seidl-Mlczoch E, Berger-Kulemann V, Prayer D, Kasprian GJ, Ulm B. Brainstem and cerebellar volumes at magnetic resonance imaging are smaller in fetuses with congenital heart disease. Am J Obstet Gynecol 2022; 227:282.e1-282.e15. [PMID: 35305961 DOI: 10.1016/j.ajog.2022.03.030] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Revised: 03/12/2022] [Accepted: 03/14/2022] [Indexed: 12/11/2022]
Abstract
BACKGROUND Congenital heart disease is associated with an increased risk of smaller brain volumes and structural brain damage, and impaired growth of supratentorial brain structures in utero has been linked to poor neurodevelopmental outcomes. However, little is known on brainstem and cerebellar volumes in fetuses with congenital heart disease. Moreover, it is not clear whether impaired infratentorial growth, if present, is associated with only certain types of fetal cardiac defects or with supratentorial brain growth, and whether altered biometry is already present before the third trimester. OBJECTIVE This study aimed to investigate brainstem and cerebellar volumes in fetuses with congenital heart disease and to compare them to infratentorial brain volumes in fetuses with normal hearts. Secondarily, the study aimed to identify associations between infratentorial brain biometry and the type of cardiac defects, supratentorial brain volumes, and gestational age. STUDY DESIGN In this retrospective case-control study, 141 magnetic resonance imaging studies of 135 fetuses with congenital heart disease and 141 magnetic resonance imaging studies of 125 controls with normal hearts at 20 to 37 gestational weeks (median, 25 weeks) were evaluated. All cases and controls had normal birthweight and no evidence of structural brain disease or genetic syndrome. Six types of congenital heart disease were included: tetralogy of Fallot (n=32); double-outlet right ventricle (n=22); transposition of the great arteries (n=27); aortic obstruction (n=24); hypoplastic left heart syndrome (n=22); and hypoplastic right heart syndrome (n=14). First, brainstem and cerebellar volumes of each fetus were segmented and compared between cases and controls. In addition, transverse cerebellar diameters, vermian areas, and supratentorial brain and cerebrospinal fluid volumes were quantified and differences assessed between cases and controls. Volumetric differences were further analyzed according to types of cardiac defects and supratentorial brain volumes. Finally, volume ratios were created for each brain structure ([volume in fetus with congenital heart disease/respective volume in control fetus] × 100) and correlated to gestational age. RESULTS Brainstem (cases, 2.1 cm3 vs controls, 2.4 cm3; P<.001) and cerebellar (cases, 3.2 cm3 vs controls, 3.4 cm3; P<.001) volumes were smaller in fetuses with congenital heart disease than in controls, whereas transverse cerebellar diameters (P=.681) and vermian areas (P=.947) did not differ between groups. Brainstem and cerebellar volumes differed between types of cardiac defects. Overall, the volume ratio of cases to controls was 80.8% for the brainstem, 90.5% for the cerebellum, and 90.1% for the supratentorial brain. Fetuses with tetralogy of Fallot and transposition of the great arteries were most severely affected by total brain volume reduction. Gestational age had no effect on volume ratios. CONCLUSION The volume of the infratentorial brain, which contains structures considered crucial to brain function, is significantly smaller in fetuses with congenital heart disease than in controls from midgestation onward. These findings suggest that impaired growth of both supra- and infratentorial brain structures in fetuses with congenital heart disease occurs in the second trimester. Further research is needed to elucidate associations between fetal brain volumes and neurodevelopmental outcomes in congenital heart disease.
Collapse
|
74
|
Russo F, Benachi A, Gratacos E, Zani A, Keijzer R, Partridge E, Sananes N, De Coppi P, Aertsen M, Nicolaides KH, Deprest J. Antenatal Management of Congenital Diaphragmatic Hernia: what's next ? Prenat Diagn 2022; 42:291-300. [PMID: 35199368 DOI: 10.1002/pd.6120] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Revised: 02/19/2022] [Accepted: 02/20/2022] [Indexed: 11/07/2022]
Abstract
Congenital diaphragmatic hernia (CDH) can be diagnosed in the prenatal period and its severity can be measured by fetal imaging. There is now level I evidence that, in selected cases, Fetoscopic Endoluminal Tracheal Occlusion (FETO) increases survival to discharge from the neonatal unit as well as the risk for prematurity. Both effects are dependent on the time point of tracheal occlusion. FETO may also lead to iatrogenic death when done in unexperienced centres. The implementation of the findings from our clinical studies, may also vary based on local conditions. These may be different in terms of available skill set, access to fetal therapy, as well as outcome based on local neonatal management. We encourage prior benchmarking of local outcomes with optimal postnatal management, based on large enough numbers and using identical criteria as in the recent trials. We propose to work further on prenatal prediction methods, and the improvement of fetal intervention. In this manuscript, we describe a research agenda from a fetal medicine perspective. This research should be in parallel with innovation in neonatal and pediatric (surgical) management of this condition. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Francesca Russo
- Department of Development and Regeneration, Cluster Woman and Child, KU Leuven and Clinical Department of Obstetrics and Gynaecology, UZ Leuven, Leuven, Belgium
| | - Alexandra Benachi
- Department of Obstetrics and Gynaecology, Hospital Antoine Béclère, Université Paris Saclay, Clamart, France
| | | | - Augusto Zani
- Division of General and Thoracic Surgery, The Hospital for Sick Children, Toronto and Department of Surgery, University of Toronto, Toronto, Ontario, Canada
| | - Richard Keijzer
- Department of Pediatric Surgery, University of Manitoba, Winnipeg, Manitoba, Canada
| | - Emily Partridge
- Department of Pediatric Surgery, Children's Hospital of Philadelphia, PA, USA
| | - Nicolas Sananes
- Department Obstetrics and Gynaecology, University Hospitals Strasbourg, Strasbourg, France
| | | | - Michael Aertsen
- Department of Radiology, University Hospitals Leuven, Leuven, Belgium
| | | | - Jan Deprest
- Department of Development and Regeneration, Cluster Woman and Child, KU Leuven and Clinical Department of Obstetrics and Gynaecology, UZ Leuven, Leuven, Belgium.,Institute of Women's Health, University College London, London, United Kingdom
| |
Collapse
|
75
|
Ueki W, Nishii T, Umehara K, Ota J, Higuchi S, Ohta Y, Nagai Y, Murakawa K, Ishida T, Fukuda T. Generative adversarial network-based post-processed image super-resolution technology for accelerating brain MRI: comparison with compressed sensing. Acta Radiol 2022; 64:336-345. [PMID: 35118883 DOI: 10.1177/02841851221076330] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
BACKGROUND It is unclear whether deep-learning-based super-resolution technology (SR) or compressed sensing technology (CS) can accelerate magnetic resonance imaging (MRI) . PURPOSE To compare SR accelerated images with CS images regarding the image similarity to reference 2D- and 3D gradient-echo sequence (GRE) brain MRI. MATERIAL AND METHODS We prospectively acquired 1.3× and 2.0× faster 2D and 3D GRE images of 20 volunteers from the reference time by reducing the matrix size or increasing the CS factor. For SR, we trained the generative adversarial network (GAN), upscaling the low-resolution images to the reference images with twofold cross-validation. We compared the structural similarity (SSIM) index of accelerated images to the reference image. The rate of incorrect answers of a radiologist discriminating faster and reference image was used as a subjective image similarity (ISM) index. RESULTS The SR demonstrated significantly higher SSIM than the CS (SSIM=0.9993-0.999 vs. 0.9947-0.9986; P < 0.001). In 2D GRE, it was challenging to discriminate the SR image from the reference image, compared to the CS (ISM index 40% vs. 17.5% in 1.3×; P = 0.039 and 17.5% vs. 2.5% in 2.0×; P = 0.034). In 3D GRE, the CS revealed a significantly higher ISM index than the SR (22.5% vs. 2.5%; P = 0.011) in 2.0 × faster images. However, the ISM index was identical for the 2.0× CS and 1.3× SR (22.5% vs. 27.5%; P = 0.62) with comparable time costs. CONCLUSION The GAN-based SR outperformed CS in image similarity with 2D GRE for MRI acceleration. In addition, CS was more advantageous in 3D GRE than SR.
Collapse
Affiliation(s)
- Wataru Ueki
- Department of Radiology, National Cerebral and Cardiovascular Center, Suita, Osaka, Japan
| | - Tatsuya Nishii
- Department of Radiology, National Cerebral and Cardiovascular Center, Suita, Osaka, Japan
| | - Kensuke Umehara
- Medical Informatics Section, QST Hospital, National Institutes for Quantum Science and Technology, Chiba, Japan
- Applied MRI Research, Department of Molecular Imaging and Theranostics, Institute for Quantum Medical Science, National Institutes for Quantum Science and Technology, Chiba, Japan
- Department of Medical Physics and Engineering, Graduate School of Medicine, Osaka University, Suita, Osaka, Japan
| | - Junko Ota
- Medical Informatics Section, QST Hospital, National Institutes for Quantum Science and Technology, Chiba, Japan
- Applied MRI Research, Department of Molecular Imaging and Theranostics, Institute for Quantum Medical Science, National Institutes for Quantum Science and Technology, Chiba, Japan
- Department of Medical Physics and Engineering, Graduate School of Medicine, Osaka University, Suita, Osaka, Japan
| | - Satoshi Higuchi
- Department of Radiology, National Cerebral and Cardiovascular Center, Suita, Osaka, Japan
| | - Yasutoshi Ohta
- Department of Radiology, National Cerebral and Cardiovascular Center, Suita, Osaka, Japan
| | - Yasuhiro Nagai
- Department of Radiology, National Cerebral and Cardiovascular Center, Suita, Osaka, Japan
| | - Keizo Murakawa
- Department of Radiology, National Cerebral and Cardiovascular Center, Suita, Osaka, Japan
| | - Takayuki Ishida
- Department of Medical Physics and Engineering, Graduate School of Medicine, Osaka University, Suita, Osaka, Japan
| | - Tetsuya Fukuda
- Department of Radiology, National Cerebral and Cardiovascular Center, Suita, Osaka, Japan
| |
Collapse
|
76
|
Coupeau P, Fasquel JB, Mazerand E, Menei P, Montero-Menei CN, Dinomais M. Patch-based 3D U-Net and transfer learning for longitudinal piglet brain segmentation on MRI. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 214:106563. [PMID: 34890993 DOI: 10.1016/j.cmpb.2021.106563] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/15/2021] [Revised: 11/26/2021] [Accepted: 11/26/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND AND OBJECTIVES In order to study neural plasticity in immature brain following early brain lesion, large animal model are needed. Because of its morphological similarities with the human developmental brain, piglet is a suitable but little used one. Its study from Magnetic Resonance Imaging (MRI) requires the development of automatic algorithms for the segmentation of the different structures and tissues. A crucial preliminary step consists in automatically segmenting the brain. METHODS We propose a fully automatic brain segmentation method applied to piglets by combining a 3D patch-based U-Net and a post-processing pipeline for spatial regularization and elimination of false positives. Our approach also integrates a transfer-learning strategy for managing an automated longitudinal monitoring evaluated for four developmental stages (2, 6, 10 and 18 weeks), facing the issue of MRI changes resulting from the rapid brain development. It is compared to a 2D approach and the Brain Extraction Tool (BET) as well as techniques adapted to other animals (rodents, macaques). The influence of training patches size and distribution is studied as well as the benefits of spatial regularization. RESULTS Results show that our approach is efficient in terms of average Dice score (0.952) and Hausdorff distance (8.51), outperforming the use of a 2D U-Net (Dice: 0.919, Hausdorff distance: 11.06) and BET (Dice: 0.764, Hausdorff distance: 25.91). The transfer-learning strategy achieves a good performance on older piglets (Dice of 0.934 at 6 weeks, 0.956 at 10 weeks and 0.958 at 18 weeks) compared to a standard training strategy with few data (Dice of 0.636 at 6 weeks, 0.907 at 10 weeks, not calculable at 18 weeks because of too few training piglets). CONCLUSIONS In conclusion, we provide a method for longitudinal MRI piglet brain segmentation based on 3D U-Net and transfer learning which can be used for future morphometric studies and applied to other animals.
Collapse
Affiliation(s)
- P Coupeau
- Université d'Angers, LARIS, SFR MATHSTIC, F-49000 Angers, France.
| | - J-B Fasquel
- Université d'Angers, LARIS, SFR MATHSTIC, F-49000 Angers, France
| | - E Mazerand
- CRCINA, UMR 1232, INSERM, Université de Nantes, Université d'Angers, F-49933 Angers, France; Département de neurochirurgie, Centre Hospitalier Universitaire d'Angers, France
| | - P Menei
- CRCINA, UMR 1232, INSERM, Université de Nantes, Université d'Angers, F-49933 Angers, France; Département de neurochirurgie, Centre Hospitalier Universitaire d'Angers, France
| | - C N Montero-Menei
- CRCINA, UMR 1232, INSERM, Université de Nantes, Université d'Angers, F-49933 Angers, France
| | - M Dinomais
- Université d'Angers, LARIS, SFR MATHSTIC, F-49000 Angers, France; Département de médecine physique et de réadaptation, Centre Hospitalier Universitaire d'Angers, France
| |
Collapse
|
77
|
Pringle C, Kilday JP, Kamaly-Asl I, Stivaros SM. The role of artificial intelligence in paediatric neuroradiology. Pediatr Radiol 2022; 52:2159-2172. [PMID: 35347371 PMCID: PMC9537195 DOI: 10.1007/s00247-022-05322-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/07/2021] [Revised: 08/22/2021] [Accepted: 02/11/2022] [Indexed: 01/17/2023]
Abstract
Imaging plays a fundamental role in the managing childhood neurologic, neurosurgical and neuro-oncological disease. Employing multi-parametric MRI techniques, such as spectroscopy and diffusion- and perfusion-weighted imaging, to the radiophenotyping of neuroradiologic conditions is becoming increasingly prevalent, particularly with radiogenomic analyses correlating imaging characteristics with molecular biomarkers of disease. However, integration into routine clinical practice remains elusive. With modern multi-parametric MRI now providing additional data beyond anatomy, informing on histology, biology and physiology, such metric-rich information can present as information overload to the treating radiologist and, as such, information relevant to an individual case can become lost. Artificial intelligence techniques are capable of modelling the vast radiologic, biological and clinical datasets that accompany childhood neurologic disease, such that this information can become incorporated in upfront prognostic modelling systems, with artificial intelligence techniques providing a plausible approach to this solution. This review examines machine learning approaches than can be used to underpin such artificial intelligence applications, with exemplars for each machine learning approach from the world literature. Then, within the specific use case of paediatric neuro-oncology, we examine the potential future contribution for such artificial intelligence machine learning techniques to offer solutions for patient care in the form of decision support systems, potentially enabling personalised medicine within this domain of paediatric radiologic practice.
Collapse
Affiliation(s)
- Catherine Pringle
- Children’s Brain Tumour Research Network (CBTRN), Royal Manchester Children’s Hospital, Manchester, UK ,Division of Informatics, Imaging, and Data Sciences, School of Health Sciences, Faculty of Biology, Medicine, and Health, University of Manchester, Manchester, UK
| | - John-Paul Kilday
- Children’s Brain Tumour Research Network (CBTRN), Royal Manchester Children’s Hospital, Manchester, UK ,The Centre for Paediatric, Teenage and Young Adult Cancer, Institute of Cancer Sciences, University of Manchester, Manchester, UK
| | - Ian Kamaly-Asl
- Children’s Brain Tumour Research Network (CBTRN), Royal Manchester Children’s Hospital, Manchester, UK ,The Centre for Paediatric, Teenage and Young Adult Cancer, Institute of Cancer Sciences, University of Manchester, Manchester, UK
| | - Stavros Michael Stivaros
- Division of Informatics, Imaging, and Data Sciences, School of Health Sciences, Faculty of Biology, Medicine, and Health, University of Manchester, Manchester, UK. .,Department of Paediatric Radiology, Royal Manchester Children's Hospital, Central Manchester University Hospitals NHS Foundation Trust, Oxford Road, Manchester, M13 9WL, UK. .,The Geoffrey Jefferson Brain Research Centre, Manchester Academic Health Science Centre, University of Manchester, Manchester, UK.
| |
Collapse
|
78
|
Rutherford S, Sturmfels P, Angstadt M, Hect J, Wiens J, van den Heuvel MI, Scheinost D, Sripada C, Thomason M. Automated Brain Masking of Fetal Functional MRI with Open Data. Neuroinformatics 2022; 20:173-185. [PMID: 34129169 PMCID: PMC9437772 DOI: 10.1007/s12021-021-09528-5] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/18/2021] [Indexed: 01/09/2023]
Abstract
Fetal resting-state functional magnetic resonance imaging (rs-fMRI) has emerged as a critical new approach for characterizing brain development before birth. Despite the rapid and widespread growth of this approach, at present, we lack neuroimaging processing pipelines suited to address the unique challenges inherent in this data type. Here, we solve the most challenging processing step, rapid and accurate isolation of the fetal brain from surrounding tissue across thousands of non-stationary 3D brain volumes. Leveraging our library of 1,241 manually traced fetal fMRI images from 207 fetuses, we trained a Convolutional Neural Network (CNN) that achieved excellent performance across two held-out test sets from separate scanners and populations. Furthermore, we unite the auto-masking model with additional fMRI preprocessing steps from existing software and provide insight into our adaptation of each step. This work represents an initial advancement towards a fully comprehensive, open-source workflow, with openly shared code and data, for fetal functional MRI data preprocessing.
Collapse
Affiliation(s)
- Saige Rutherford
- Donders Institute, Radboud University Medical Center, Nijmegen, The Netherlands.
- Department of Psychiatry, University of Michigan, MI, Ann Arbor, USA.
| | - Pascal Sturmfels
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, USA
| | - Mike Angstadt
- Department of Psychiatry, University of Michigan, MI, Ann Arbor, USA
| | - Jasmine Hect
- Department of Psychology, Wayne State University, Detroit, MI, USA
| | - Jenna Wiens
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, USA
| | | | - Dustin Scheinost
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
- Department of Statistics and Data Science, Yale University, New Haven, CT, USA
- Child Study Center, Yale School of Medicine, New Haven, CT, USA
| | - Chandra Sripada
- Department of Psychiatry, University of Michigan, MI, Ann Arbor, USA
| | - Moriah Thomason
- Department of Child and Adolescent Psychiatry, New York University School of Medicine, New York, NY, USA
- Department of Population Health, New York University School of Medicine, New York, NY, USA
| |
Collapse
|
79
|
Mufti N, Ebner M, Patel P, Aertsen M, Gaunt T, Humphries PD, Bredaki FE, Hewitt R, Butler C, Sokolska M, Kendall GS, Atkinson D, Vercauteren T, Ourselin S, Pandya PP, Deprest J, Melbourne A, David AL. Super-resolution Reconstruction MRI Application in Fetal Neck Masses and Congenital High Airway Obstruction Syndrome. OTO Open 2021; 5:2473974X211055372. [PMID: 34723053 PMCID: PMC8549475 DOI: 10.1177/2473974x211055372] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Accepted: 10/06/2021] [Indexed: 11/21/2022] Open
Abstract
Objective Reliable airway patency diagnosis in fetal tracheolaryngeal obstruction is crucial to select and plan ex utero intrapartum treatment (EXIT) surgery. We compared the clinical utility of magnetic resonance imaging (MRI) super-resolution reconstruction (SRR) of the trachea, which can mitigate unpredictable fetal motion effects, with standard 2-dimensional (2D) MRI for airway patency diagnosis and assessment of fetal neck mass anatomy. Study Design A single-center case series of 7 consecutive singleton pregnancies with complex upper airway obstruction (2013-2019). Setting A tertiary fetal medicine unit performing EXIT surgery. Methods MRI SRR of the trachea was performed involving rigid motion correction of acquired 2D MRI slices combined with robust outlier detection to reconstruct an isotropic high-resolution volume. SRR, 2D MRI, and paired data were blindly assessed by 3 radiologists in 3 experimental rounds. Results Airway patency was correctly diagnosed in 4 of 7 cases (57%) with 2D MRI as compared with 2 of 7 cases (29%) with SRR alone or paired 2D MRI and SRR. Radiologists were more confident (P = .026) in airway patency diagnosis when using 2D MRI than SRR. Anatomic clarity was higher with SRR (P = .027) or paired data (P = .041) in comparison with 2D MRI alone. Radiologists detected further anatomic details by using paired images versus 2D MRI alone (P < .001). Cognitive load, as assessed by the NASA Task Load Index, was increased with paired or SRR data in comparison with 2D MRI. Conclusion The addition of SRR to 2D MRI does not increase fetal airway patency diagnostic accuracy but does provide improved anatomic information, which may benefit surgical planning of EXIT procedures.
Collapse
Affiliation(s)
- Nada Mufti
- Elizabeth Garrett Anderson Institute for Women's Health, University College London, London, UK.,School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK
| | - Michael Ebner
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK.,Department of Medical Physics and Biomedical Engineering, University College London Hospitals, London, UK
| | - Premal Patel
- Radiology Department, Great Ormond Street Hospital for Children, London, UK
| | - Michael Aertsen
- Department of Radiology, University Hospitals Katholieke Universiteit, Leuven, Belgium
| | - Trevor Gaunt
- Radiology Department, Great Ormond Street Hospital for Children, London, UK.,Women's Health Division, University College London Hospitals, London, UK
| | - Paul D Humphries
- Radiology Department, Great Ormond Street Hospital for Children, London, UK
| | | | - Richard Hewitt
- Ear, Nose and Throat Department, Great Ormond Street Hospital for Children, London, UK
| | - Colin Butler
- Ear, Nose and Throat Department, Great Ormond Street Hospital for Children, London, UK
| | - Magdalena Sokolska
- Department of Medical Physics and Biomedical Engineering, University College London Hospitals, London, UK
| | - Giles S Kendall
- Elizabeth Garrett Anderson Institute for Women's Health, University College London, London, UK.,Women's Health Division, University College London Hospitals, London, UK
| | - David Atkinson
- Department of Medical Physics and Biomedical Engineering, University College London Hospitals, London, UK.,Centre for Medical Imaging, University College London, London, UK
| | - Tom Vercauteren
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK.,Department of Medical Physics and Biomedical Engineering, University College London Hospitals, London, UK
| | - Sebastien Ourselin
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK.,Department of Medical Physics and Biomedical Engineering, University College London Hospitals, London, UK
| | - Pranav P Pandya
- Women's Health Division, University College London Hospitals, London, UK
| | - Jan Deprest
- Elizabeth Garrett Anderson Institute for Women's Health, University College London, London, UK.,Department of Obstetrics and Gynaecology, University Hospitals Katholieke Universiteit, Leuven, Belgium
| | - Andrew Melbourne
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK.,Department of Medical Physics and Biomedical Engineering, University College London Hospitals, London, UK
| | - Anna L David
- Elizabeth Garrett Anderson Institute for Women's Health, University College London, London, UK.,Department of Obstetrics and Gynaecology, University Hospitals Katholieke Universiteit, Leuven, Belgium
| |
Collapse
|
80
|
Stout JN, Bedoya MA, Grant PE, Estroff JA. Fetal Neuroimaging Updates. Magn Reson Imaging Clin N Am 2021; 29:557-581. [PMID: 34717845 PMCID: PMC8562558 DOI: 10.1016/j.mric.2021.06.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
MR imaging is used in conjunction with ultrasound screening for fetal brain abnormalities because it offers better contrast, higher resolution, and has multiplanar capabilities that increase the accuracy and confidence of diagnosis. Fetal motion still severely limits the MR imaging sequences that can be acquired. We outline the current acquisition strategies for fetal brain MR imaging and discuss the near term advances that will improve its reliability. Prospective and retrospective motion correction aim to make the complement of MR neuroimaging modalities available for fetal diagnosis, improve the performance of existing modalities, and open new horizons to understanding in utero brain development.
Collapse
Affiliation(s)
- Jeffrey N Stout
- Fetal and Neonatal Neuroimaging and Developmental Science Center, Boston Children's Hospital, 300 Longwood Avenue, Boston, MA 02115, USA.
| | - M Alejandra Bedoya
- Department of Radiology, Boston Children's Hospital, 300 Longwood Avenue, Boston, MA 02115, USA
| | - P Ellen Grant
- Fetal and Neonatal Neuroimaging and Developmental Science Center, Boston Children's Hospital, 300 Longwood Avenue, Boston, MA 02115, USA; Department of Radiology, Boston Children's Hospital, 300 Longwood Avenue, Boston, MA 02115, USA; Department of Pediatrics, Boston Children's Hospital, 300 Longwood Avenue, Boston, MA 02115, USA
| | - Judy A Estroff
- Department of Radiology, Boston Children's Hospital, 300 Longwood Avenue, Boston, MA 02115, USA; Maternal Fetal Care Center, Boston Children's Hospital, 300 Longwood Avenue, Boston, MA 02115, USA
| |
Collapse
|
81
|
Wu J, Yu B, Wang L, Yang Q, Zhang Y. Longitudinal Chinese Population Structural Fetal Brain Atlases Construction: toward precise fetal brain segmentation. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:2745-2749. [PMID: 34891818 DOI: 10.1109/embc46164.2021.9630514] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
In magnetic resonance imaging (MRI) studies of fetal brain development, structural brain atlases usually serve as essential references for the fetal population. Individual images are spatially normalized into a common or standard atlas space to extract regional information on volumetric or morphological brain variations. However, the existing fetal brain atlases are mostly based on MR images obtained from Caucasian populations and thus are not ideal for the characterization of the brains of the Chinese population due to neuroanatomical differences related to genetic factors. In this paper, we use an unbiased template construction algorithm to create a set of age-specific Chinese fetal atlases between 21-35 weeks of gestation from 115 normally developing fetal brains. Based on the 4D spatiotemporal atlas, the morphologically developmental patterns, e.g., cortical thickness, sulcal and gyral patterns, were quantified from in utero MRI. Additionally, after applying the Chinese fetal atlases and Caucasian fetal atlases to an independent Chinese pediatric dataset, we find that the Chinese fetal atlases result in significantly higher accuracy than the Caucasian fetal atlases in guiding brain tissue segmentation. These results suggest that the Chinese fetal brain atlases are necessary for quantitative analysis of the typical and atypical development of the Chinese fetal population in the future.
Collapse
|
82
|
Hong J, Yun HJ, Park G, Kim S, Ou Y, Vasung L, Rollins CK, Ortinau CM, Takeoka E, Akiyama S, Tarui T, Estroff JA, Grant PE, Lee JM, Im K. Optimal Method for Fetal Brain Age Prediction Using Multiplanar Slices From Structural Magnetic Resonance Imaging. Front Neurosci 2021; 15:714252. [PMID: 34707474 PMCID: PMC8542770 DOI: 10.3389/fnins.2021.714252] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2021] [Accepted: 09/08/2021] [Indexed: 11/23/2022] Open
Abstract
The accurate prediction of fetal brain age using magnetic resonance imaging (MRI) may contribute to the identification of brain abnormalities and the risk of adverse developmental outcomes. This study aimed to propose a method for predicting fetal brain age using MRIs from 220 healthy fetuses between 15.9 and 38.7 weeks of gestational age (GA). We built a 2D single-channel convolutional neural network (CNN) with multiplanar MRI slices in different orthogonal planes without correction for interslice motion. In each fetus, multiple age predictions from different slices were generated, and the brain age was obtained using the mode that determined the most frequent value among the multiple predictions from the 2D single-channel CNN. We obtained a mean absolute error (MAE) of 0.125 weeks (0.875 days) between the GA and brain age across the fetuses. The use of multiplanar slices achieved significantly lower prediction error and its variance than the use of a single slice and a single MRI stack. Our 2D single-channel CNN with multiplanar slices yielded a significantly lower stack-wise MAE (0.304 weeks) than the 2D multi-channel (MAE = 0.979, p < 0.001) and 3D (MAE = 1.114, p < 0.001) CNNs. The saliency maps from our method indicated that the anatomical information describing the cortex and ventricles was the primary contributor to brain age prediction. With the application of the proposed method to external MRIs from 21 healthy fetuses, we obtained an MAE of 0.508 weeks. Based on the external MRIs, we found that the stack-wise MAE of the 2D single-channel CNN (0.743 weeks) was significantly lower than those of the 2D multi-channel (1.466 weeks, p < 0.001) and 3D (1.241 weeks, p < 0.001) CNNs. These results demonstrate that our method with multiplanar slices accurately predicts fetal brain age without the need for increased dimensionality or complex MRI preprocessing steps.
Collapse
Affiliation(s)
- Jinwoo Hong
- Department of Electronic Engineering, Hanyang University, Seoul, South Korea
- Fetal Neonatal Neuroimaging and Developmental Science Center, Boston Children’s Hospital and Harvard Medical School, Boston, MA, United States
| | - Hyuk Jin Yun
- Fetal Neonatal Neuroimaging and Developmental Science Center, Boston Children’s Hospital and Harvard Medical School, Boston, MA, United States
- Division of Newborn Medicine, Boston Children’s Hospital and Harvard Medical School, Boston, MA, United States
| | - Gilsoon Park
- USC Mark and Mary Stevens Neuroimaging and Informatics Institute, University of Southern California, Los Angeles, CA, United States
| | - Seonggyu Kim
- Department of Electronic Engineering, Hanyang University, Seoul, South Korea
| | - Yangming Ou
- Fetal Neonatal Neuroimaging and Developmental Science Center, Boston Children’s Hospital and Harvard Medical School, Boston, MA, United States
- Division of Newborn Medicine, Boston Children’s Hospital and Harvard Medical School, Boston, MA, United States
- Department of Radiology, Boston Children’s Hospital and Harvard Medical School, Boston, MA, United States
- Computational Health Informatics Program, Boston Children’s Hospital and Harvard Medical School, Boston, MA, United States
| | - Lana Vasung
- Fetal Neonatal Neuroimaging and Developmental Science Center, Boston Children’s Hospital and Harvard Medical School, Boston, MA, United States
- Division of Newborn Medicine, Boston Children’s Hospital and Harvard Medical School, Boston, MA, United States
| | - Caitlin K. Rollins
- Department of Neurology, Boston Children’s Hospital and Harvard Medical School, Boston, MA, United States
| | - Cynthia M. Ortinau
- Department of Pediatrics, Washington University in St. Louis, St. Louis, MO, United States
| | - Emiko Takeoka
- Mother Infant Research Institute, Tufts Medical Center, Boston, MA, United States
| | - Shizuko Akiyama
- Center for Perinatal and Neonatal Medicine, Tohoku University Hospital, Sendai, Japan
| | - Tomo Tarui
- Mother Infant Research Institute, Tufts Medical Center, Boston, MA, United States
| | - Judy A. Estroff
- Department of Radiology, Boston Children’s Hospital and Harvard Medical School, Boston, MA, United States
| | - Patricia Ellen Grant
- Fetal Neonatal Neuroimaging and Developmental Science Center, Boston Children’s Hospital and Harvard Medical School, Boston, MA, United States
- Division of Newborn Medicine, Boston Children’s Hospital and Harvard Medical School, Boston, MA, United States
- Department of Radiology, Boston Children’s Hospital and Harvard Medical School, Boston, MA, United States
| | - Jong-Min Lee
- Department of Biomedical Engineering, Hanyang University, Seoul, South Korea
| | - Kiho Im
- Fetal Neonatal Neuroimaging and Developmental Science Center, Boston Children’s Hospital and Harvard Medical School, Boston, MA, United States
- Division of Newborn Medicine, Boston Children’s Hospital and Harvard Medical School, Boston, MA, United States
| |
Collapse
|
83
|
Mufti N, Aertsen M, Ebner M, Fidon L, Patel P, Rahman MBA, Brackenier Y, Ekart G, Fernandez V, Vercauteren T, Ourselin S, Thomson D, De Catte L, Demaerel P, Deprest J, David AL, Melbourne A. Cortical spectral matching and shape and volume analysis of the fetal brain pre- and post-fetal surgery for spina bifida: a retrospective study. Neuroradiology 2021; 63:1721-1734. [PMID: 33934181 PMCID: PMC8460513 DOI: 10.1007/s00234-021-02725-8] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2021] [Accepted: 04/22/2021] [Indexed: 12/03/2022]
Abstract
PURPOSE A retrospective study was performed to study the effect of fetal surgery on brain development measured by MRI in fetuses with myelomeningocele (MMC). METHODS MRI scans of 12 MMC fetuses before and after surgery were compared to 24 age-matched controls without central nervous system abnormalities. An automated super-resolution reconstruction technique generated isotropic brain volumes to mitigate 2D MRI fetal motion artefact. Unmyelinated white matter, cerebellum and ventricles were automatically segmented, and cerebral volume, shape and cortical folding were thereafter quantified. Biometric measures were calculated for cerebellar herniation level (CHL), clivus-supraocciput angle (CSO), transverse cerebellar diameter (TCD) and ventricular width (VW). Shape index (SI), a mathematical marker of gyrification, was derived. We compared cerebral volume, surface area and SI before and after MMC fetal surgery versus controls. We additionally identified any relationship between these outcomes and biometric measurements. RESULTS MMC ventricular volume/week (mm3/week) increased after fetal surgery (median: 3699, interquartile range (IQR): 1651-5395) compared to controls (median: 648, IQR: 371-896); P = 0.015. The MMC SI is higher pre-operatively in all cerebral lobes in comparison to that in controls. Change in SI/week in MMC fetuses was higher in the left temporal lobe (median: 0.039, IQR: 0.021-0.054), left parietal lobe (median: 0.032, IQR: 0.023-0.039) and right occipital lobe (median: 0.027, IQR: 0.019-0.040) versus controls (P = 0.002 to 0.005). Ventricular volume (mm3) and VW (mm) (r = 0.64), cerebellar volume and TCD (r = 0.56) were moderately correlated. CONCLUSIONS Following fetal myelomeningocele repair, brain volume, shape and SI were significantly different from normal in most cerebral layers. Morphological brain changes after fetal surgery are not limited to hindbrain herniation reversal. These findings may have neurocognitive outcome implications and require further evaluation.
Collapse
Affiliation(s)
- Nada Mufti
- Elizabeth Garrett Anderson Institute for Women's Health, University College London, 1st Floor Charles Bell House, 43-45 Foley Street, W1W 7TS, London, UK.
- School of Biomedical Engineering & Imaging Sciences (BMEIS), King's College London, London, UK.
| | - Michael Aertsen
- Department of Radiology, University Hospitals Katholieke Universiteit (KU), Leuven, Belgium
| | - Michael Ebner
- School of Biomedical Engineering & Imaging Sciences (BMEIS), King's College London, London, UK
- Medical Physics and Biomedical Engineering, University College London, London, UK
| | - Lucas Fidon
- School of Biomedical Engineering & Imaging Sciences (BMEIS), King's College London, London, UK
| | - Premal Patel
- Radiology Department, Great Ormond Street Hospital for Children, London, UK
| | | | - Yannick Brackenier
- School of Biomedical Engineering & Imaging Sciences (BMEIS), King's College London, London, UK
| | - Gregor Ekart
- School of Biomedical Engineering & Imaging Sciences (BMEIS), King's College London, London, UK
| | - Virginia Fernandez
- School of Biomedical Engineering & Imaging Sciences (BMEIS), King's College London, London, UK
| | - Tom Vercauteren
- School of Biomedical Engineering & Imaging Sciences (BMEIS), King's College London, London, UK
- Medical Physics and Biomedical Engineering, University College London, London, UK
| | - Sebastien Ourselin
- School of Biomedical Engineering & Imaging Sciences (BMEIS), King's College London, London, UK
- Medical Physics and Biomedical Engineering, University College London, London, UK
| | - Dominic Thomson
- Paediatric Neurosurgery Department, Great Ormond Street Hospital for Children, London, UK
| | - Luc De Catte
- Department of Obstetrics and Gynaecology, University Hospitals, Katholieke Universiteit (KU) Leuven, Leuven, Belgium
- Cluster 'Women and Child', Dept. Development and Regeneration, Biomedical Sciences, Katholieke Universiteit (KU) Leuven, Leuven, Belgium
| | - Philippe Demaerel
- Department of Radiology, University Hospitals Katholieke Universiteit (KU), Leuven, Belgium
| | - Jan Deprest
- Elizabeth Garrett Anderson Institute for Women's Health, University College London, 1st Floor Charles Bell House, 43-45 Foley Street, W1W 7TS, London, UK
- Department of Obstetrics and Gynaecology, University Hospitals, Katholieke Universiteit (KU) Leuven, Leuven, Belgium
- Cluster 'Women and Child', Dept. Development and Regeneration, Biomedical Sciences, Katholieke Universiteit (KU) Leuven, Leuven, Belgium
| | - Anna L David
- Elizabeth Garrett Anderson Institute for Women's Health, University College London, 1st Floor Charles Bell House, 43-45 Foley Street, W1W 7TS, London, UK
- Department of Obstetrics and Gynaecology, University Hospitals, Katholieke Universiteit (KU) Leuven, Leuven, Belgium
- Cluster 'Women and Child', Dept. Development and Regeneration, Biomedical Sciences, Katholieke Universiteit (KU) Leuven, Leuven, Belgium
| | - Andrew Melbourne
- School of Biomedical Engineering & Imaging Sciences (BMEIS), King's College London, London, UK
- Medical Physics and Biomedical Engineering, University College London, London, UK
| |
Collapse
|
84
|
Upendra RR, Simon R, Linte CA. A Deep Learning Framework for Image Super-Resolution for Late Gadolinium Enhanced Cardiac MRI. COMPUTING IN CARDIOLOGY 2021; 48:10.23919/cinc53138.2021.9662790. [PMID: 35662880 PMCID: PMC9161679 DOI: 10.23919/cinc53138.2021.9662790] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
Cardiac magnetic resonance imaging (MRI) provides 3D images with high-resolution in-plane information, however, they are known to have low through-plane resolution due to the trade-off between resolution, image acquisition time and signal-to-noise ratio. This results in anisotropic 3D images which could lead to difficulty in diagnosis, especially in late gadolinium enhanced (LGE) cardiac MRI, which is the reference imaging modality for locating the extent of myocardial fibrosis in various cardiovascular diseases like myocardial infarction and atrial fibrillation. To address this issue, we propose a self-supervised deep learning-based approach to enhance the through-plane resolution of the LGE MRI images. We train a convolutional neural network (CNN) model on randomly extracted patches of short-axis LGE MRI images and this trained CNN model is used to leverage the information learnt from the high-resolution in-plane data to improve the through-plane resolution. We conducted experiments on LGE MRI dataset made available through the 2018 atrial segmentation challenge. Our proposed method achieved a mean peak signal-to-noise-ratio (PSNR) of 36.99 and 35.92 and a mean structural similarity index measure (SSIM) of 0.9 and 0.84 on training the CNN model using low-resolution images downsampled by a scale factor of 2 and 4, respectively.
Collapse
Affiliation(s)
- Roshan Reddy Upendra
- Chester F. Carlson Center for Imaging Science, Rochester Institute of Technology, Rochester, NY, USA
| | - Richard Simon
- Biomedical Engineering, Rochester Institute of Technology, Rochester, NY, USA
| | - Cristian A Linte
- Chester F. Carlson Center for Imaging Science, Rochester Institute of Technology, Rochester, NY, USA
- Biomedical Engineering, Rochester Institute of Technology, Rochester, NY, USA
| |
Collapse
|
85
|
Pei Y, Chen L, Zhao F, Wu Z, Zhong T, Wang Y, Chen C, Wang L, Zhang H, Wang L, Li G. Learning Spatiotemporal Probabilistic Atlas of Fetal Brains with Anatomically Constrained Registration Network. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2021; 12907:239-248. [PMID: 35128549 PMCID: PMC8816449 DOI: 10.1007/978-3-030-87234-2_23] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
Brain atlases are of fundamental importance for analyzing the dynamic neurodevelopment in fetal brain studies. Since the brain size, shape, and anatomical structures change rapidly during the prenatal period, it is essential to construct a spatiotemporal (4D) atlas equipped with tissue probability maps, which can preserve sharper early brain folding patterns for accurately characterizing dynamic changes in fetal brains and provide tissue prior informations for related tasks, e.g., segmentation, registration, and parcellation. In this work, we propose a novel unsupervised age-conditional learning framework to build temporally continuous fetal brain atlases by incorporating tissue segmentation maps, which outperforms previous traditional atlas construction methods in three aspects. First, our framework enables learning age-conditional deformable templates by leveraging the entire collection. Second, we leverage reliable brain tissue segmentation maps in addition to the low-contrast noisy intensity images to enhance the alignment of individual images. Third, a novel loss function is designed to enforce the similarity between the learned tissue probability map on the atlas and each subject tissue segmentation map after registration, thereby providing extra anatomical consistency supervision for atlas building. Our 4D temporally-continuous fetal brain atlases are constructed based on 82 healthy fetuses from 22 to 32 gestational weeks. Compared with the atlases built by the state-of-the-art algorithms, our atlases preserve more structural details and sharper folding patterns. Together with the learned tissue probability maps, our 4D fetal atlases provide a valuable reference for spatial normalization and analysis of fetal brain development.
Collapse
Affiliation(s)
- Yuchen Pei
- Institute of Image Processing and Pattern Recognition, Department of Automation, Shanghai Jiao Tong University, Shanghai, China
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA
| | - Liangjun Chen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA
| | - Fenqiang Zhao
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA
| | - Zhengwang Wu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA
| | - Tao Zhong
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA
| | - Ya Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA
| | - Changan Chen
- Department of Radiology, Obstetrics and Gynecology Hospital, Fudan University, Shanghai, China
| | - Li Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA
| | - He Zhang
- Department of Radiology, Obstetrics and Gynecology Hospital, Fudan University, Shanghai, China
| | - Lisheng Wang
- Institute of Image Processing and Pattern Recognition, Department of Automation, Shanghai Jiao Tong University, Shanghai, China
| | - Gang Li
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA
| |
Collapse
|
86
|
Lerman-Sagie T, Pogledic I, Leibovitz Z, Malinger G. A practical approach to prenatal diagnosis of malformations of cortical development. Eur J Paediatr Neurol 2021; 34:50-61. [PMID: 34390998 DOI: 10.1016/j.ejpn.2021.08.001] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/10/2021] [Revised: 06/27/2021] [Accepted: 08/01/2021] [Indexed: 10/20/2022]
Abstract
Malformations of cortical development (MCD) can frequently be diagnosed at multi-disciplinary Fetal Neurology clinics with the aid of multiplanar neurosonography and MRI. The patients are usually referred following prenatal sonographic screening that raises the suspicion of a possible underlying MCD. These indirect findings include, but are not limited to, ventriculomegaly (lateral ventricles larger than 10 mm), asymmetric ventricles, commissural anomalies, absent cavum septum pellucidum, cerebellar vermian and/or hemispheric anomalies, abnormal head circumference (microcephaly or macrocephaly), multiple CNS malformations, and associated systemic defects. The aim of this paper is to suggest a practical approach to prenatal diagnosis of malformations of cortical development utilizing dedicated neurosonography and MRI, based on the current literature and our own experience. We suggest that an MCD should be suspected in utero when the following intracranial imaging signs are present: abnormal development of the Sylvian fissure; delayed achievement of cortical milestones, premature appearance of sulcation; irregular ventricular borders, abnormal cortical thickness (thick, thin); abnormal shape and orientation of the sulci and gyri; irregular, abnormal, asymmetric, and enlarged hemisphere; simplified cortex; non continuous cortex or cleft; and intraparenchymal echogenic nodules. Following the putative diagnosis of fetal MCD by neurosonography and MRI, when appropriate and possible (depending on gestational age), the imaging diagnosis is supplemented by genetic studies (CMA and trio whole exome sequencing). In some instances, no further studies are required during pregnancy due to the clear dire prognosis and then the genetic evaluation can be deferred after delivery or termination of pregnancy (in countries where allowed).
Collapse
Affiliation(s)
- Tally Lerman-Sagie
- Fetal Neurology Clinic, Ultrasound in Obstetrics and Gynecology Unit, Department of Obstetrics and Gynecology, Wolfson Medical Center, Holon, Israel; Pediatric Neurology Unit, Center for Rare Diseases-Magen, Wolfson Medical Center, Holon, Israel; Sackler School of Medicine, Tel-Aviv University, Tel-Aviv, Israel.
| | - Ivana Pogledic
- Department of Biomedical Imaging and Image-guided Therapy, Division of Neuroradiology and Musculoskeletal Radiology, Medical University of Vienna, Vienna, Austria
| | - Zvi Leibovitz
- Fetal Neurology Clinic, Ultrasound in Obstetrics and Gynecology Unit, Department of Obstetrics and Gynecology, Wolfson Medical Center, Holon, Israel; Ultrasound in Obstetrics and Gynecology Unit, Bnai-Zion Medical Center, Haifa, Israel; Technion Faculty of Medicine, Haifa, Israel
| | - Gustavo Malinger
- Sackler School of Medicine, Tel-Aviv University, Tel-Aviv, Israel; Fetal Neurology Multidisciplinary Clinic, Division of Ultrasound in Obstetrics & Gynecology, Lis Hospital for Women, Tel Aviv Sourasky Medical Center, Tel-Aviv, Israel
| |
Collapse
|
87
|
Wu J, Sun T, Yu B, Li Z, Wu Q, Wang Y, Qian Z, Zhang Y, Jiang L, Wei H. Age-specific structural fetal brain atlases construction and cortical development quantification for chinese population. Neuroimage 2021; 241:118412. [PMID: 34298085 DOI: 10.1016/j.neuroimage.2021.118412] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2021] [Revised: 06/16/2021] [Accepted: 07/19/2021] [Indexed: 01/14/2023] Open
Abstract
In magnetic resonance imaging (MRI) studies of fetal brain development, structural brain atlases usually serve as essential references for the fetal population. Individual images are usually normalized into a common or standard space for analysis. However, the existing fetal brain atlases are mostly based on MR images obtained from Caucasian populations and thus are not ideal for the characterization of the fetal Chinese population due to neuroanatomical differences related to genetic factors. In this paper, we use an unbiased template construction algorithm to create a set of age-specific Chinese fetal atlases between 21-35 weeks of gestation from 115 normal fetal brains. Based on the 4D spatiotemporal atlas, the morphological development patterns, e.g., cortical thickness, cortical surface area, sulcal and gyral patterns, were quantified. The fetal brain abnormalities were detected when referencing the age-specific template. Additionally, a direct comparison of the Chinese fetal atlases and Caucasian fetal atlases reveals dramatic anatomical differences, mainly in the medial frontal and temporal regions. After applying the Chinese and Caucasian fetal atlases separately to an independent Chinese fetal brain dataset, we find that the Chinese fetal atlases result in significantly higher accuracy than the Caucasian fetal atlases in guiding brain tissue segmentation. These results suggest that the Chinese fetal brain atlases are necessary for quantitative analysis of the typical and atypical development of the Chinese fetal population in the future. The atlases with their parcellations are now publicly available at https://github.com/DeepBMI/FBA-Chinese.
Collapse
Affiliation(s)
- Jiangjie Wu
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China; School of Information Science and Technology, ShanghaiTech University, Shanghai, China
| | - Taotao Sun
- Department of Radiology, International Peace Maternity and Child Health Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China; Shanghai Key Laboratory of Embryo Original Diseases, Shanghai, China
| | - Boliang Yu
- School of Information Science and Technology, ShanghaiTech University, Shanghai, China
| | - Zhenghao Li
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Qing Wu
- School of Information Science and Technology, ShanghaiTech University, Shanghai, China
| | - Yutong Wang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Zhaoxia Qian
- Department of Radiology, International Peace Maternity and Child Health Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China; Shanghai Key Laboratory of Embryo Original Diseases, Shanghai, China
| | - Yuyao Zhang
- School of Information Science and Technology, ShanghaiTech University, Shanghai, China
| | - Ling Jiang
- Department of Radiology, International Peace Maternity and Child Health Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China; Shanghai Key Laboratory of Embryo Original Diseases, Shanghai, China.
| | - Hongjiang Wei
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China; Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China.
| |
Collapse
|
88
|
Payette K, de Dumast P, Kebiri H, Ezhov I, Paetzold JC, Shit S, Iqbal A, Khan R, Kottke R, Grehten P, Ji H, Lanczi L, Nagy M, Beresova M, Nguyen TD, Natalucci G, Karayannis T, Menze B, Bach Cuadra M, Jakab A. An automatic multi-tissue human fetal brain segmentation benchmark using the Fetal Tissue Annotation Dataset. Sci Data 2021; 8:167. [PMID: 34230489 PMCID: PMC8260784 DOI: 10.1038/s41597-021-00946-3] [Citation(s) in RCA: 35] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2020] [Accepted: 05/13/2021] [Indexed: 11/09/2022] Open
Abstract
It is critical to quantitatively analyse the developing human fetal brain in order to fully understand neurodevelopment in both normal fetuses and those with congenital disorders. To facilitate this analysis, automatic multi-tissue fetal brain segmentation algorithms are needed, which in turn requires open datasets of segmented fetal brains. Here we introduce a publicly available dataset of 50 manually segmented pathological and non-pathological fetal magnetic resonance brain volume reconstructions across a range of gestational ages (20 to 33 weeks) into 7 different tissue categories (external cerebrospinal fluid, grey matter, white matter, ventricles, cerebellum, deep grey matter, brainstem/spinal cord). In addition, we quantitatively evaluate the accuracy of several automatic multi-tissue segmentation algorithms of the developing human fetal brain. Four research groups participated, submitting a total of 10 algorithms, demonstrating the benefits the dataset for the development of automatic algorithms.
Collapse
Affiliation(s)
- Kelly Payette
- Center for MR Research, University Children's Hospital Zurich, University of Zurich, Zurich, Switzerland.
- Neuroscience Center Zurich, University of Zurich/ETH Zurich, Zurich, Switzerland.
| | - Priscille de Dumast
- CIBM, Center for Biomedical Imaging, Lausanne, Switzerland
- Medical Image Analysis Laboratory, Department of Diagnostic and Interventional Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
| | - Hamza Kebiri
- CIBM, Center for Biomedical Imaging, Lausanne, Switzerland
- Medical Image Analysis Laboratory, Department of Diagnostic and Interventional Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
| | - Ivan Ezhov
- Image-Based Biomedical Imaging Group, Technical University of Munich, München, Germany
| | - Johannes C Paetzold
- Image-Based Biomedical Imaging Group, Technical University of Munich, München, Germany
| | - Suprosanna Shit
- Image-Based Biomedical Imaging Group, Technical University of Munich, München, Germany
| | - Asim Iqbal
- Neuroscience Center Zurich, University of Zurich/ETH Zurich, Zurich, Switzerland
- Brain Research Institute, University of Zurich, Zurich, Switzerland
- Center for Intelligent Systems & Brain Mind Institute, Swiss Federal Institute of Technology (EPFL), Lausanne, Switzerland
| | - Romesa Khan
- Neuroscience Center Zurich, University of Zurich/ETH Zurich, Zurich, Switzerland
- Institute for Biomedical Engineering, UZH/ETH Zurich, Zurich, Switzerland
| | - Raimund Kottke
- Department of Diagnostic Imaging, University Children's Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Patrice Grehten
- Department of Diagnostic Imaging, University Children's Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Hui Ji
- Center for MR Research, University Children's Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Levente Lanczi
- Faculty of Medicine, Department of Medical Imaging, University of Debrecen, Debrecen, Hajdú-Bihar, Hungary
| | - Marianna Nagy
- Faculty of Medicine, Department of Medical Imaging, University of Debrecen, Debrecen, Hajdú-Bihar, Hungary
| | - Monika Beresova
- Faculty of Medicine, Department of Medical Imaging, University of Debrecen, Debrecen, Hajdú-Bihar, Hungary
| | - Thi Dao Nguyen
- Newborn Research, Department of Neonatology, University Hospital and University of Zurich, Zurich, Switzerland
| | - Giancarlo Natalucci
- Newborn Research, Department of Neonatology, University Hospital and University of Zurich, Zurich, Switzerland
- Larsson-Rosenquist Center for Neurodevelopment, Growth and Nutrition of the Newborn, Department of Neonatology, University Hospital and University of Zurich, Zurich, Switzerland
| | | | - Bjoern Menze
- Image-Based Biomedical Imaging Group, Technical University of Munich, München, Germany
| | - Meritxell Bach Cuadra
- CIBM, Center for Biomedical Imaging, Lausanne, Switzerland
- Medical Image Analysis Laboratory, Department of Diagnostic and Interventional Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
| | - Andras Jakab
- Center for MR Research, University Children's Hospital Zurich, University of Zurich, Zurich, Switzerland
- Neuroscience Center Zurich, University of Zurich/ETH Zurich, Zurich, Switzerland
| |
Collapse
|
89
|
Cross Attention Squeeze Excitation Network (CASE-Net) for Whole Body Fetal MRI Segmentation. SENSORS 2021; 21:s21134490. [PMID: 34209154 PMCID: PMC8272176 DOI: 10.3390/s21134490] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Revised: 06/26/2021] [Accepted: 06/28/2021] [Indexed: 02/01/2023]
Abstract
Segmentation of the fetus from 2-dimensional (2D) magnetic resonance imaging (MRI) can aid radiologists with clinical decision making for disease diagnosis. Machine learning can facilitate this process of automatic segmentation, making diagnosis more accurate and user independent. We propose a deep learning (DL) framework for 2D fetal MRI segmentation using a Cross Attention Squeeze Excitation Network (CASE-Net) for research and clinical applications. CASE-Net is an end-to-end segmentation architecture with relevant modules that are evidence based. The goal of CASE-Net is to emphasize localization of contextual information that is relevant in biomedical segmentation, by combining attention mechanisms with squeeze-and-excitation (SE) blocks. This is a retrospective study with 34 patients. Our experiments have shown that our proposed CASE-Net achieved the highest segmentation Dice score of 87.36%, outperforming other competitive segmentation architectures.
Collapse
|
90
|
Jakab A, Payette K, Mazzone L, Schauer S, Muller CO, Kottke R, Ochsenbein-Kölble N, Tuura R, Moehrlen U, Meuli M. Emerging magnetic resonance imaging techniques in open spina bifida in utero. Eur Radiol Exp 2021; 5:23. [PMID: 34136989 PMCID: PMC8209133 DOI: 10.1186/s41747-021-00219-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2020] [Accepted: 04/01/2021] [Indexed: 11/25/2022] Open
Abstract
Magnetic resonance imaging (MRI) has become an essential diagnostic modality for congenital disorders of the central nervous system. Recent advancements have transformed foetal MRI into a clinically feasible tool, and in an effort to find predictors of clinical outcomes in spinal dysraphism, foetal MRI began to unveil its potential. The purpose of our review is to introduce MRI techniques to experts with diverse backgrounds, who are involved in the management of spina bifida. We introduce advanced foetal MRI postprocessing potentially improving the diagnostic work-up. Importantly, we discuss how postprocessing can lead to a more efficient utilisation of foetal or neonatal MRI data to depict relevant anatomical characteristics. We provide a critical perspective on how structural, diffusion and metabolic MRI are utilised in an endeavour to shed light on the correlates of impaired development. We found that the literature is consistent about the value of MRI in providing morphological cues about hydrocephalus development, hindbrain herniation or outcomes related to shunting and motor functioning. MRI techniques, such as foetal diffusion MRI or diffusion tractography, are still far from clinical use; however, postnatal studies using these methods revealed findings that may reflect early neural correlates of upstream neuronal damage in spinal dysraphism.
Collapse
Affiliation(s)
- Andras Jakab
- Center for MR-Research, University Children's Hospital Zürich, Zürich, Switzerland. .,Neuroscience Center Zürich, University of Zürich, Zürich, Switzerland.
| | - Kelly Payette
- Center for MR-Research, University Children's Hospital Zürich, Zürich, Switzerland.,Neuroscience Center Zürich, University of Zürich, Zürich, Switzerland
| | - Luca Mazzone
- Department of Pediatric Surgery, University Children's Hospital Zurich, Zürich, Switzerland.,The Zurich Center for Fetal Diagnosis and Therapy, Zürich, Switzerland
| | - Sonja Schauer
- Department of Pediatric Surgery, University Children's Hospital Zurich, Zürich, Switzerland
| | | | - Raimund Kottke
- Department of Diagnostic Imaging, University Children's Hospital Zurich, Zurich, Switzerland
| | | | - Ruth Tuura
- Center for MR-Research, University Children's Hospital Zürich, Zürich, Switzerland
| | - Ueli Moehrlen
- Department of Pediatric Surgery, University Children's Hospital Zurich, Zürich, Switzerland.,The Zurich Center for Fetal Diagnosis and Therapy, Zürich, Switzerland.,University of Zurich, Zürich, Switzerland
| | - Martin Meuli
- Department of Pediatric Surgery, University Children's Hospital Zurich, Zürich, Switzerland.,The Zurich Center for Fetal Diagnosis and Therapy, Zürich, Switzerland.,University of Zurich, Zürich, Switzerland
| |
Collapse
|
91
|
Chen L. Editorial for "Image Quality Assessment of Fetal Brain MRI Using Multi-Instance Deep Learning Methods". J Magn Reson Imaging 2021; 54:830-831. [PMID: 34060698 DOI: 10.1002/jmri.27759] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Accepted: 05/20/2021] [Indexed: 11/06/2022] Open
Affiliation(s)
- Luguang Chen
- Department of Radiology, Changhai Hospital of Shanghai, Shanghai, China
| |
Collapse
|
92
|
Li H, Yan G, Luo W, Liu T, Wang Y, Liu R, Zheng W, Zhang Y, Li K, Zhao L, Limperopoulos C, Zou Y, Wu D. Mapping fetal brain development based on automated segmentation and 4D brain atlasing. Brain Struct Funct 2021; 226:1961-1972. [PMID: 34050792 DOI: 10.1007/s00429-021-02303-x] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Accepted: 05/19/2021] [Indexed: 12/30/2022]
Abstract
Fetal brain MRI has become an important tool for in utero assessment of brain development and disorders. However, quantitative analysis of fetal brain MRI remains difficult, partially due to the limited tools for automated preprocessing and the lack of normative brain templates. In this paper, we proposed an automated pipeline for fetal brain extraction, super-resolution reconstruction, and fetal brain atlasing to quantitatively map in utero fetal brain development during mid-to-late gestation in a Chinese population. First, we designed a U-net convolutional neural network for automated fetal brain extraction, which achieved an average accuracy of 97%. We then generated a developing fetal brain atlas, using an iterative linear and nonlinear registration approach. Based on the 4D spatiotemporal atlas, we quantified the morphological development of the fetal brain between 23 and 36 weeks of gestation. The proposed pipeline enabled the fully automated volumetric reconstruction for clinically available fetal brain MRI data, and the 4D fetal brain atlas provided normative templates for the quantitative characterization of fetal brain development, especially in the Chinese population.
Collapse
Affiliation(s)
- Haotian Li
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, Zhejiang, China
| | - Guohui Yan
- Department of Radiology, School of Medicine, Women's Hospital, Zhejiang University, Hangzhou, Zhejiang, China
| | - Wanrong Luo
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, Zhejiang, China
| | - Tingting Liu
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, Zhejiang, China
| | - Yan Wang
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, Zhejiang, China
| | - Ruibin Liu
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, Zhejiang, China
| | - Weihao Zheng
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, Zhejiang, China
| | - Yi Zhang
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, Zhejiang, China.,Department of Neurology, The First Affiliated Hospital, Zhejiang University, Hangzhou, China
| | - Kui Li
- Department of Radiology, School of Medicine, Women's Hospital, Zhejiang University, Hangzhou, Zhejiang, China
| | - Li Zhao
- Center for the Developing Brain, Diagnostic Imaging and Radiology, Children's National Medical Center, Washington, DC, USA
| | - Catherine Limperopoulos
- Center for the Developing Brain, Diagnostic Imaging and Radiology, Children's National Medical Center, Washington, DC, USA
| | - Yu Zou
- Department of Radiology, School of Medicine, Women's Hospital, Zhejiang University, Hangzhou, Zhejiang, China
| | - Dan Wu
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, Zhejiang, China.
| |
Collapse
|
93
|
Lu Q. Editorial for "Data Quality Assessment for Super-Resolution Fetal Brain MR Imaging: A Retrospective 1.5 T Study". J Magn Reson Imaging 2021; 54:1361-1362. [PMID: 33982827 DOI: 10.1002/jmri.27699] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2021] [Accepted: 05/05/2021] [Indexed: 11/10/2022] Open
Affiliation(s)
- Quin Lu
- Philips Healthcare North America, San Francisco, California, USA
| |
Collapse
|
94
|
Rubert N, Bardo DME, Vaughn J, Cornejo P, Goncalves LF. Data Quality Assessment for Super-Resolution Fetal Brain MR Imaging: A Retrospective 1.5 T Study. J Magn Reson Imaging 2021; 54:1349-1360. [PMID: 33949725 DOI: 10.1002/jmri.27665] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2021] [Revised: 04/12/2021] [Accepted: 04/13/2021] [Indexed: 11/05/2022] Open
Abstract
BACKGROUND Super-resolution is a promising technique to create isotropic image volumes from stacks of two-dimensional (2D) motion-corrupted images in fetal magnetic resonance imaging (MRI). PURPOSE To determine an acquisition quality metric and correlate that metric with radiologist perception of three-dimensional (3D) image quality. STUDY TYPE Retrospective. SUBJECTS Eighty-seven patients, mean gestational age 29 ± 6 weeks. FIELD STRENGTH/SEQUENCE 1.5 T/2D fast spin-echo. ASSESSMENT Four radiologists (L.G., D.M.E.B., P.C., and J.V.; 31, 21, 7, and 7 years' experience, respectively) graded reconstructions on a 0 to 4 scale for overall appearance and visibility of specific anatomy. During reconstruction, slices were labeled as inliers based on correlation between a simulated vs. actual acquisition. The fraction of brain voxels in inlier slicers vs. total brain voxels was measured for each acquisition. STATISTICAL TESTS Paired sample t test, Pearson's correlation, intra-class correlation. RESULTS The average brain mask inlier fraction for all acquisitions was 0.8. There was a statistically significant correlation (0.71) between overall reconstruction appearance and number of acquisitions with inlier fraction above 0.73. There was low correlation (0.21, P = 0.05) between the number of acquisitions used in the reconstruction and overall score when no data quality measure was considered. Similar results were found for ratings of specific anatomy. Statistically significant differences in overall perception of image quality were found when using three vs. four, four vs. five, and three vs. five high-quality acquisitions in the reconstruction. Five high-quality acquisitions were sufficient to yield an average radiologist rating of 3.59 out of 4.0 for overall image quality. DATA CONCLUSION Reconstruction quality can be reliably predicted using the brain mask inlier fraction. Real-time super-resolution protocols could exploit this to terminate acquisition when enough high-quality acquisitions have been collected. To achieve consistent 3D image quality it may be necessary to acquire more than five scans to compensate for severely motion-corrupted acquisitions. LEVEL OF EVIDENCE 3 TECHNICAL EFFICACY: 1.
Collapse
Affiliation(s)
- Nicholas Rubert
- Department of Radiology, Phoenix Children's Hospital, Phoenix, Arizona, USA
| | - Dianna M E Bardo
- Department of Radiology, Phoenix Children's Hospital, Phoenix, Arizona, USA.,Departments of Radiology and Child Health, University of Arizona, Phoenix, Arizona, USA.,Department of Radiology, Mayo Clinic, Scottsdale, Arizona, USA.,Department of Radiology, Creighton University, Phoenix, Arizona, USA.,Department of Neuroradiology, Barrows Neurological Institute, Phoenix, Arizona, USA
| | - Jennifer Vaughn
- Department of Radiology, Phoenix Children's Hospital, Phoenix, Arizona, USA.,Departments of Radiology and Child Health, University of Arizona, Phoenix, Arizona, USA.,Department of Radiology, Creighton University, Phoenix, Arizona, USA.,Department of Neuroradiology, Barrows Neurological Institute, Phoenix, Arizona, USA
| | - Patricia Cornejo
- Department of Radiology, Phoenix Children's Hospital, Phoenix, Arizona, USA.,Departments of Radiology and Child Health, University of Arizona, Phoenix, Arizona, USA.,Department of Radiology, Mayo Clinic, Scottsdale, Arizona, USA.,Department of Radiology, Creighton University, Phoenix, Arizona, USA.,Department of Neuroradiology, Barrows Neurological Institute, Phoenix, Arizona, USA
| | - Luis F Goncalves
- Department of Radiology, Phoenix Children's Hospital, Phoenix, Arizona, USA.,Departments of Radiology and Child Health, University of Arizona, Phoenix, Arizona, USA
| |
Collapse
|
95
|
Largent A, Kapse K, Barnett SD, De Asis-Cruz J, Whitehead M, Murnick J, Zhao L, Andersen N, Quistorff J, Lopez C, Limperopoulos C. Image Quality Assessment of Fetal Brain MRI Using Multi-Instance Deep Learning Methods. J Magn Reson Imaging 2021; 54:818-829. [PMID: 33891778 DOI: 10.1002/jmri.27649] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2020] [Revised: 04/09/2021] [Accepted: 04/12/2021] [Indexed: 11/06/2022] Open
Abstract
BACKGROUND Due to random motion of fetuses and maternal respirations, image quality of fetal brain MRIs varies considerably. To address this issue, visual inspection of the images is performed during acquisition phase and after 3D-reconstruction, and the images are re-acquired if they are deemed to be of insufficient quality. However, this process is time-consuming and subjective. Multi-instance (MI) deep learning methods (DLMs) may perform this task automatically. PURPOSE To propose an MI count-based DLM (MI-CB-DLM), an MI vote-based DLM (MI-VB-DLM), and an MI feature-embedding DLM (MI-FE-DLM) for automatic assessment of 3D fetal-brain MR image quality. To quantify influence of fetal gestational age (GA) on DLM performance. STUDY TYPE Retrospective. SUBJECTS Two hundred and seventy-one MR exams from 211 fetuses (mean GA ± SD = 30.9 ± 5.5 weeks). FIELD STRENGTH/SEQUENCE T2 -weighted single-shot fast spin-echo acquired at 1.5 T. ASSESSMENT The T2 -weighted images were reconstructed in 3D. Then, two fetal neuroradiologists, a clinical neuroscientist, and a fetal MRI technician independently labeled the reconstructed images as 1 or 0 based on image quality (1 = high; 0 = low). These labels were fused and served as ground truth. The proposed DLMs were trained and evaluated using three repeated 10-fold cross-validations (training and validation sets of 244 and 27 scans). To quantify GA influence, this variable was included as an input of the DLMs. STATISTICAL TESTS DLM performance was evaluated using precision, recall, F-score, accuracy, and AUC values. RESULTS Precision, recall, F-score, accuracy, and AUC averaged over the three cross validations were 0.85 ± 0.01, 0.85 ± 0.01, 0.85 ± 0.01, 0.85 ± 0.01, 0.93 ± 0.01, for MI-CB-DLM (without GA); 0.75 ± 0.03, 0.75 ± 0.03, 0.75 ± 0.03, 0.75 ± 0.03, 0.81 ± 0.03, for MI-VB-DLM (without GA); 0.81 ± 0.01, 0.81 ± 0.01, 0.81 ± 0.01, 0.81 ± 0.01, 0.89 ± 0.01, for MI-FE-DLM (without GA); and 0.86 ± 0.01, 0.86 ± 0.01, 0.86 ± 0.01, 0.86 ± 0.01, 0.93 ± 0.01, for MI-CB-DLM with GA. DATA CONCLUSION MI-CB-DLM performed better than other DLMs. Including GA as an input of MI-CB-DLM improved its performance. MI-CB-DLM may potentially be used to objectively and rapidly assess fetal MR image quality. EVIDENCE LEVEL 4 TECHNICAL EFFICACY: Stage 3.
Collapse
Affiliation(s)
- Axel Largent
- Developing Brain Institute, Division of Diagnostic Imaging and Radiology, Children's National Hospital, Washington, District of Columbia, USA
| | - Kushal Kapse
- Developing Brain Institute, Division of Diagnostic Imaging and Radiology, Children's National Hospital, Washington, District of Columbia, USA
| | - Scott D Barnett
- Developing Brain Institute, Division of Diagnostic Imaging and Radiology, Children's National Hospital, Washington, District of Columbia, USA
| | - Josepheen De Asis-Cruz
- Developing Brain Institute, Division of Diagnostic Imaging and Radiology, Children's National Hospital, Washington, District of Columbia, USA
| | - Matthew Whitehead
- Developing Brain Institute, Division of Diagnostic Imaging and Radiology, Children's National Hospital, Washington, District of Columbia, USA.,Department of Neurology, Children's National Hospital, Washington, District of Columbia, USA
| | - Jonathan Murnick
- Developing Brain Institute, Division of Diagnostic Imaging and Radiology, Children's National Hospital, Washington, District of Columbia, USA
| | - Li Zhao
- Developing Brain Institute, Division of Diagnostic Imaging and Radiology, Children's National Hospital, Washington, District of Columbia, USA
| | - Nicole Andersen
- Developing Brain Institute, Division of Diagnostic Imaging and Radiology, Children's National Hospital, Washington, District of Columbia, USA
| | - Jessica Quistorff
- Developing Brain Institute, Division of Diagnostic Imaging and Radiology, Children's National Hospital, Washington, District of Columbia, USA
| | - Catherine Lopez
- Developing Brain Institute, Division of Diagnostic Imaging and Radiology, Children's National Hospital, Washington, District of Columbia, USA
| | - Catherine Limperopoulos
- Developing Brain Institute, Division of Diagnostic Imaging and Radiology, Children's National Hospital, Washington, District of Columbia, USA.,Department of Radiology, Pediatrics, George Washington University, Washington, District of Columbia, USA.,Neurology School of Medicine and Health Sciences, George Washington University, Washington, District of Columbia, USA
| |
Collapse
|
96
|
Isallari M, Rekik I. Brain graph super-resolution using adversarial graph neural network with application to functional brain connectivity. Med Image Anal 2021; 71:102084. [PMID: 33971574 DOI: 10.1016/j.media.2021.102084] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2020] [Revised: 04/11/2021] [Accepted: 04/15/2021] [Indexed: 11/30/2022]
Abstract
Brain image analysis has advanced substantially in recent years with the proliferation of neuroimaging datasets acquired at different resolutions. While research on brain image super-resolution has undergone a rapid development in the recent years, brain graph super-resolution is still poorly investigated because of the complex nature of non-Euclidean graph data. In this paper, we propose the first-ever deep graph super-resolution (GSR) framework that attempts to automatically generate high-resolution (HR) brain graphs with N' nodes (i.e., anatomical regions of interest (ROIs)) from low-resolution (LR) graphs with N nodes where N<N'. First, we formalize our GSR problem as a node feature embedding learning task. Once the HR nodes' embeddings are learned, the pairwise connectivity strength between brain ROIs can be derived through an aggregation rule based on a novel Graph U-Net architecture. While typically the Graph U-Net is a node-focused architecture where graph embedding depends mainly on node attributes, we propose a graph-focused architecture where the node feature embedding is based on the graph topology. Second, inspired by graph spectral theory, we break the symmetry of the U-Net architecture by super-resolving the low-resolution brain graph structure and node content with a GSR layer and two graph convolutional network layers to further learn the node embeddings in the HR graph. Third, to handle the domain shift between the ground-truth and the predicted HR brain graphs, we incorporate adversarial regularization to align their respective distributions. Our proposed AGSR-Net framework outperformed its variants for predicting high-resolution functional brain graphs from low-resolution ones. Our AGSR-Net code is available on GitHub at https://github.com/basiralab/AGSR-Net.
Collapse
Affiliation(s)
- Megi Isallari
- BASIRA lab, Faculty of Computer and Informatics Engineering, Istanbul Technical University, Istanbul, Turkey. http://basira-lab.com/
| | - Islem Rekik
- BASIRA lab, Faculty of Computer and Informatics Engineering, Istanbul Technical University, Istanbul, Turkey; School of Science and Engineering, Computing, University of Dundee, UK
| |
Collapse
|
97
|
Schwartz E, Diogo MC, Glatter S, Seidl R, Brugger PC, Gruber GM, Kiss H, Nenning KH, Langs G, Prayer D, Kasprian G. The Prenatal Morphomechanic Impact of Agenesis of the Corpus Callosum on Human Brain Structure and Asymmetry. Cereb Cortex 2021; 31:4024-4037. [PMID: 33872347 DOI: 10.1093/cercor/bhab066] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2020] [Revised: 02/23/2021] [Accepted: 02/23/2021] [Indexed: 11/14/2022] Open
Abstract
Genetic, molecular, and physical forces together impact brain morphogenesis. The early impact of deficient midline crossing in agenesis of the Corpus Callosum (ACC) on prenatal human brain development and architecture is widely unknown. Here we analyze the changes of brain structure in 46 fetuses with ACC in vivo to identify their deviations from normal development. Cases of complete ACC show an increase in the thickness of the cerebral wall in the frontomedial regions and a reduction in the temporal, insular, medial occipital and lateral parietal regions, already present at midgestation. ACC is associated with a more symmetric configuration of the temporal lobes and increased frequency of atypical asymmetry patterns, indicating an early morphomechanic effect of callosal growth on human brain development affecting the thickness of the pallium along a ventro-dorsal gradient. Altered prenatal brain architecture in ACC emphasizes the importance of conformational forces introduced by emerging interhemispheric connectivity on the establishment of polygenically determined brain asymmetries.
Collapse
Affiliation(s)
- Ernst Schwartz
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
| | | | - Sarah Glatter
- Department of Pediatric and Adolescent Medicine, Medical University of Vienna, 1090 Vienna, Austria
| | - Rainer Seidl
- Department of Pediatric and Adolescent Medicine, Medical University of Vienna, 1090 Vienna, Austria
| | - Peter C Brugger
- Center for Anatomy and Cell Biology, Medical University of Vienna, 1090 Vienna, Austria
| | - Gerlinde M Gruber
- Department of Anatomy and Biomechanics, Karl Landsteiner University of Health Sciences, 3500 Krems an der Donau, Austria
| | - Herbert Kiss
- Department of Obstetrics and Gynecology, Medical University of Vienna, 1090 Vienna, Austria
| | - Karl-Heinz Nenning
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
| | | | - Georg Langs
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
| | - Daniela Prayer
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
| | - Gregor Kasprian
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, 1090 Vienna, Austria
| |
Collapse
|
98
|
Dou H, Karimi D, Rollins CK, Ortinau CM, Vasung L, Velasco-Annis C, Ouaalam A, Yang X, Ni D, Gholipour A. A Deep Attentive Convolutional Neural Network for Automatic Cortical Plate Segmentation in Fetal MRI. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:1123-1133. [PMID: 33351755 PMCID: PMC8016740 DOI: 10.1109/tmi.2020.3046579] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
Fetal cortical plate segmentation is essential in quantitative analysis of fetal brain maturation and cortical folding. Manual segmentation of the cortical plate, or manual refinement of automatic segmentations is tedious and time-consuming. Automatic segmentation of the cortical plate, on the other hand, is challenged by the relatively low resolution of the reconstructed fetal brain MRI scans compared to the thin structure of the cortical plate, partial voluming, and the wide range of variations in the morphology of the cortical plate as the brain matures during gestation. To reduce the burden of manual refinement of segmentations, we have developed a new and powerful deep learning segmentation method. Our method exploits new deep attentive modules with mixed kernel convolutions within a fully convolutional neural network architecture that utilizes deep supervision and residual connections. We evaluated our method quantitatively based on several performance measures and expert evaluations. Results show that our method outperforms several state-of-the-art deep models for segmentation, as well as a state-of-the-art multi-atlas segmentation technique. We achieved average Dice similarity coefficient of 0.87, average Hausdorff distance of 0.96 mm, and average symmetric surface difference of 0.28 mm on reconstructed fetal brain MRI scans of fetuses scanned in the gestational age range of 16 to 39 weeks (28.6± 5.3). With a computation time of less than 1 minute per fetal brain, our method can facilitate and accelerate large-scale studies on normal and altered fetal brain cortical maturation and folding.
Collapse
|
99
|
Morrison JL, Ayonrinde OT, Care AS, Clarke GD, Darby JRT, David AL, Dean JM, Hooper SB, Kitchen MJ, Macgowan CK, Melbourne A, McGillick EV, McKenzie CA, Michael N, Mohammed N, Sadananthan SA, Schrauben E, Regnault TRH, Velan SS. Seeing the fetus from a DOHaD perspective: discussion paper from the advanced imaging techniques of DOHaD applications workshop held at the 2019 DOHaD World Congress. J Dev Orig Health Dis 2021; 12:153-167. [PMID: 32955011 DOI: 10.1017/s2040174420000884] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Advanced imaging techniques are enhancing research capacity focussed on the developmental origins of adult health and disease (DOHaD) hypothesis, and consequently increasing awareness of future health risks across various subareas of DOHaD research themes. Understanding how these advanced imaging techniques in animal models and human population studies can be both additively and synergistically used alongside traditional techniques in DOHaD-focussed laboratories is therefore of great interest. Global experts in advanced imaging techniques congregated at the advanced imaging workshop at the 2019 DOHaD World Congress in Melbourne, Australia. This review summarizes the presentations of new imaging modalities and novel applications to DOHaD research and discussions had by DOHaD researchers that are currently utilizing advanced imaging techniques including MRI, hyperpolarized MRI, ultrasound, and synchrotron-based techniques to aid their DOHaD research focus.
Collapse
Affiliation(s)
- Janna L Morrison
- Early Origins of Adult Health Research Group, Health and Biomedical Innovation, UniSA: Clinical and Health Sciences, University of South Australia, Adelaide, SA, Australia
| | - Oyekoya T Ayonrinde
- Fiona Stanley Hospital, Murdoch, WA, Australia
- Medical School, The University of Western Australia, Perth, WA, Australia
| | - Alison S Care
- The Robinson Research Institute and Adelaide Medical School, University of Adelaide, Adelaide, SA, Australia
| | - Geoffrey D Clarke
- Department of Radiology, University of Texas Health Science Center, San Antonio, TX, USA
| | - Jack R T Darby
- Early Origins of Adult Health Research Group, Health and Biomedical Innovation, UniSA: Clinical and Health Sciences, University of South Australia, Adelaide, SA, Australia
| | - Anna L David
- Elizabeth Garrett Anderson Institute for Women's Health, University College London, London, UK
| | - Justin M Dean
- Department of Physiology, Faculty of Medical and Health Sciences, University of Auckland, Auckland, New Zealand
| | - Stuart B Hooper
- The Ritchie Centre, Hudson Institute of Medical Research, Melbourne, Victoria, Australia
- The Department of Obstetrics and Gynecology, Monash University, Melbourne, Victoria, Australia
| | - Marcus J Kitchen
- School of Physics and Astronomy, Monash University, Melbourne, Victoria, Australia
| | | | - Andrew Melbourne
- School of Biomedical Engineering and Imaging Sciences, Kings College London, London, UK
| | - Erin V McGillick
- The Ritchie Centre, Hudson Institute of Medical Research, Melbourne, Victoria, Australia
- The Department of Obstetrics and Gynecology, Monash University, Melbourne, Victoria, Australia
| | - Charles A McKenzie
- Department of Medical Biophysics, Western University, London, ON, Canada
- Lawson Health Research Institute and Children's Health Research Institute, London, ON, Canada
| | - Navin Michael
- Singapore Institute for Clinical Sciences, Agency for Science, Technology, and Research (A*STAR), Singapore, Singapore
| | - Nuruddin Mohammed
- Maternal Fetal Medicine Unit, Department of Obstetrics and Gynecology, Aga Khan University Hospital, Karachi, Pakistan
| | - Suresh Anand Sadananthan
- Singapore Institute for Clinical Sciences, Agency for Science, Technology, and Research (A*STAR), Singapore, Singapore
| | - Eric Schrauben
- Translational Medicine, Hospital for Sick Children, Toronto, ON, Canada
| | - Timothy R H Regnault
- Lawson Health Research Institute and Children's Health Research Institute, London, ON, Canada
- Department of Obstetrics and Gynecology, Western University, London, ON, Canada
- Department of Physiology and Pharmacology, Western University, London, ON, Canada
| | - S Sendhil Velan
- Singapore Bioimaging Consortium, Agency for Science, Technology, and Research (A*STAR), Singapore, Singapore
- Singapore Institute for Clinical Sciences, Agency for Science, Technology, and Research (A*STAR), Singapore, Singapore
| |
Collapse
|
100
|
Kienast P, Schwartz E, Diogo MC, Gruber GM, Brugger PC, Kiss H, Ulm B, Bartha-Doering L, Seidl R, Weber M, Langs G, Prayer D, Kasprian G. The Prenatal Origins of Human Brain Asymmetry: Lessons Learned from a Cohort of Fetuses with Body Lateralization Defects. Cereb Cortex 2021; 31:3713-3722. [PMID: 33772541 DOI: 10.1093/cercor/bhab042] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2020] [Revised: 01/13/2021] [Accepted: 02/01/2021] [Indexed: 11/14/2022] Open
Abstract
Knowledge about structural brain asymmetries of human fetuses with body lateralization defects-congenital diseases in which visceral organs are partially or completely incorrectly positioned-can improve our understanding of the developmental origins of hemispheric brain asymmetry. This study investigated structural brain asymmetry in 21 fetuses, which were diagnosed with different types of lateralization defects; 5 fetuses with ciliopathies and 26 age-matched healthy control cases, between 22 and 34 gestational weeks of age. For this purpose, a database of 4007 fetal magnetic resonance imagings (MRIs) was accessed and searched for the corresponding diagnoses. Specific temporal lobe brain asymmetry indices were quantified using in vivo, super-resolution-processed MR brain imaging data. Results revealed that the perisylvian fetal structural brain lateralization patterns and asymmetry indices did not differ between cases with lateralization defects, ciliopathies, and normal controls. Molecular mechanisms involved in the definition of the right/left body axis-including cilium-dependent lateralization processes-appear to occur independently from those involved in the early establishment of structural human brain asymmetries. Atypically inverted early structural brain asymmetries are similarly rare in individuals with lateralization defects and may have a complex, multifactorial, and neurodevelopmental background with currently unknown postnatal functional consequences.
Collapse
Affiliation(s)
- Patric Kienast
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna 1090, Austria
| | - Ernst Schwartz
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna 1090, Austria
| | - Mariana C Diogo
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna 1090, Austria
| | - Gerlinde M Gruber
- Department of Anatomy and Biomechanics, Karl Landsteiner University of Health Sciences, Krems, Lower Austria 3500, Austria
| | - Peter C Brugger
- Center for Anatomy and Cell Biology, Medical University of Vienna, Vienna 1090, Austria
| | - Herbert Kiss
- Department of Obstetrics and Gynecology, Medical University of Vienna, Vienna 1090, Austria
| | - Barbara Ulm
- Department of Obstetrics and Gynecology, Medical University of Vienna, Vienna 1090, Austria
| | - Lisa Bartha-Doering
- Department of Pediatrics and Adolescent Medicine, Medical University of Vienna, Vienna 1090, Austria
| | - Rainer Seidl
- Department of Pediatrics and Adolescent Medicine, Medical University of Vienna, Vienna 1090, Austria
| | - Michael Weber
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna 1090, Austria
| | - Georg Langs
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna 1090, Austria
| | - Daniela Prayer
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna 1090, Austria
| | - Gregor Kasprian
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna 1090, Austria
| |
Collapse
|