1
|
Wang L, Zhang W, Chen W, He Z, Jia Y, Du J. Cross-Modality Reference and Feature Mutual-Projection for 3D Brain MRI Image Super-Resolution. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:2838-2851. [PMID: 38829472 PMCID: PMC11612118 DOI: 10.1007/s10278-024-01139-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 03/30/2024] [Accepted: 04/21/2024] [Indexed: 06/05/2024]
Abstract
High-resolution (HR) magnetic resonance imaging (MRI) can reveal rich anatomical structures for clinical diagnoses. However, due to hardware and signal-to-noise ratio limitations, MRI images are often collected with low resolution (LR) which is not conducive to diagnosing and analyzing clinical diseases. Recently, deep learning super-resolution (SR) methods have demonstrated great potential in enhancing the resolution of MRI images; however, most of them did not take the cross-modality and internal priors of MR seriously, which hinders the SR performance. In this paper, we propose a cross-modality reference and feature mutual-projection (CRFM) method to enhance the spatial resolution of brain MRI images. Specifically, we feed the gradients of HR MRI images from referenced imaging modality into the SR network to transform true clear textures to LR feature maps. Meanwhile, we design a plug-in feature mutual-projection (FMP) method to capture the cross-scale dependency and cross-modality similarity details of MRI images. Finally, we fuse all feature maps with parallel attentions to produce and refine the HR features adaptively. Extensive experiments on MRI images in the image domain and k-space show that our CRFM method outperforms existing state-of-the-art MRI SR methods.
Collapse
Affiliation(s)
- Lulu Wang
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology and Yunnan Key Laboratory of Computer Technologies Application, Kunming, 650500, China.
| | - Wanqi Zhang
- College of Computer Science, Chongqing University, Chongqing, 400044, China
| | - Wei Chen
- College of Computer Science, Chongqing University, Chongqing, 400044, China
| | - Zhongshi He
- College of Computer Science, Chongqing University, Chongqing, 400044, China
| | - Yuanyuan Jia
- Medical Data Science Academy and College of Medical Informatics, Chongqing Medical University, Chongqing, 400016, China
| | - Jinglong Du
- Medical Data Science Academy and College of Medical Informatics, Chongqing Medical University, Chongqing, 400016, China
| |
Collapse
|
2
|
Gage AT, Stone JR, Wilde EA, McCauley SR, Welsh RC, Mugler JP, Tustison N, Avants B, Whitlow CT, Lancashire L, Bhatt SD, Haas M. Normative Neuroimaging Library: Designing a Comprehensive and Demographically Diverse Dataset of Healthy Controls to Support Traumatic Brain Injury Diagnostic and Therapeutic Development. J Neurotrauma 2024; 41:2497-2512. [PMID: 39235436 DOI: 10.1089/neu.2024.0128] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/06/2024] Open
Abstract
The past decade has seen impressive advances in neuroimaging, moving from qualitative to quantitative outputs. Available techniques now allow for the inference of microscopic changes occurring in white and gray matter, along with alterations in physiology and function. These existing and emerging techniques hold the potential of providing unprecedented capabilities in achieving a diagnosis and predicting outcomes for traumatic brain injury (TBI) and a variety of other neurological diseases. To see this promise move from the research lab into clinical care, an understanding is needed of what normal data look like for all age ranges, sex, and other demographic and socioeconomic categories. Clinicians can only use the results of imaging scans to support their decision-making if they know how the results for their patient compare with a normative standard. This potential for utilizing magnetic resonance imaging (MRI) in TBI diagnosis motivated the American College of Radiology and Cohen Veterans Bioscience to create a reference database of healthy individuals with neuroimaging, demographic data, and characterization of psychological functioning and neurocognitive data that will serve as a normative resource for clinicians and researchers for development of diagnostics and therapeutics for TBI and other brain disorders. The goal of this article is to introduce the large, well-curated Normative Neuroimaging Library (NNL) to the research community. NNL consists of data collected from ∼1900 healthy participants. The highlights of NNL are (1) data are collected across a diverse population, including civilians, veterans, and active-duty service members with an age range (18-64 years) not well represented in existing datasets; (2) comprehensive structural and functional neuroimaging acquisition with state-of-the-art sequences (including structural, diffusion, and functional MRI; raw scanner data are preserved, allowing higher quality data to be derived in the future; standardized imaging acquisition protocols across sites reflect sequences and parameters often recommended for use with various neurological and psychiatric conditions, including TBI, post-traumatic stress disorder, stroke, neurodegenerative disorders, and neoplastic disease); and (3) the collection of comprehensive demographic details, medical history, and a broad structured clinical assessment, including cognition and psychological scales, relevant to multiple neurological conditions with functional sequelae. Thus, NNL provides a demographically diverse population of healthy individuals who can serve as a comparison group for brain injury study and clinical samples, providing a strong foundation for precision medicine. Use cases include the creation of imaging-derived phenotypes (IDPs), derivation of reference ranges of imaging measures, and use of IDPs as training samples for artificial intelligence-based biomarker development and for normative modeling to help identify injury-induced changes as outliers for precision diagnosis and targeted therapeutic development. On its release, NNL is poised to support the use of advanced imaging in clinician decision support tools, the validation of imaging biomarkers, and the investigation of brain-behavior anomalies, moving the field toward precision medicine.
Collapse
Affiliation(s)
| | - James R Stone
- Department of Radiology and Medical Imaging, University of Virginia, Charlottesville, Virginia, USA
| | - Elisabeth A Wilde
- George E. Wahlen VA, Salt Lake City Healthcare System, Salt Lake City, Utah, USA
| | - Stephen R McCauley
- Department of Neurology, Baylor College of Medicine, Houston, Texas, USA
| | - Robert C Welsh
- Department of Psychiatry and Biobehavioral Sciences, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, California, USA
| | - John P Mugler
- Department of Radiology and Medical Imaging, University of Virginia, Charlottesville, Virginia, USA
| | - Nick Tustison
- Department of Radiology and Medical Imaging, University of Virginia, Charlottesville, Virginia, USA
| | - Brian Avants
- Department of Radiology and Medical Imaging, University of Virginia, Charlottesville, Virginia, USA
| | - Christopher T Whitlow
- Department of Radiology, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
| | | | | | - Magali Haas
- Cohen Veterans Bioscience, New York, New York, USA
| |
Collapse
|
3
|
Snyder WE, Vértes PE, Kyriakopoulou V, Wagstyl K, Williams LZJ, Moraczewski D, Thomas AG, Karolis VR, Seidlitz J, Rivière D, Robinson EC, Mangin JF, Raznahan A, Bullmore ET. A bimodal taxonomy of adult human brain sulcal morphology related to timing of fetal sulcation and trans-sulcal gene expression gradients. Neuron 2024; 112:3396-3411.e6. [PMID: 39178859 PMCID: PMC11502256 DOI: 10.1016/j.neuron.2024.07.023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2023] [Revised: 05/22/2024] [Accepted: 07/29/2024] [Indexed: 08/26/2024]
Abstract
We developed a computational pipeline (now provided as a resource) for measuring morphological similarity between cortical surface sulci to construct a sulcal phenotype network (SPN) from each magnetic resonance imaging (MRI) scan in an adult cohort (n = 34,725; 45-82 years). Networks estimated from pairwise similarities of 40 sulci on 5 morphological metrics comprised two clusters of sulci, represented also by the bimodal distribution of sulci on a linear-to-complex dimension. Linear sulci were more heritable and typically located in unimodal cortex, and complex sulci were less heritable and typically located in heteromodal cortex. Aligning these results with an independent fetal brain MRI cohort (n = 228; 21-36 gestational weeks), we found that linear sulci formed earlier, and the earliest and latest-forming sulci had the least between-adult variation. Using high-resolution maps of cortical gene expression, we found that linear sulcation is mechanistically underpinned by trans-sulcal gene expression gradients enriched for developmental processes.
Collapse
Affiliation(s)
- William E Snyder
- Department of Psychiatry, University of Cambridge, Cambridge, UK; Section on Developmental Neurogenomics, Human Genetics Branch, National Institute of Mental Health Intramural Research Program, Bethesda, MD, USA.
| | - Petra E Vértes
- Department of Psychiatry, University of Cambridge, Cambridge, UK
| | - Vanessa Kyriakopoulou
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK; Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, King's College London, London, UK
| | - Konrad Wagstyl
- Wellcome Centre for Human Neuroimaging, University College London, London, UK
| | - Logan Z J Williams
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK; Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, King's College London, London, UK
| | - Dustin Moraczewski
- Data Science and Sharing Team, National Institute of Mental Health, Bethesda, MD, USA
| | - Adam G Thomas
- Data Science and Sharing Team, National Institute of Mental Health, Bethesda, MD, USA
| | - Vyacheslav R Karolis
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK; Wellcome Centre for Integrative Neuroimaging, FMRIB, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| | - Jakob Seidlitz
- Lifespan Brain Institute, Children's Hospital of Philadelphia, University of Pennsylvania, Philadelphia, PA, USA; Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, USA; Department of Child and Adolescent Psychiatry and Behavioral Science, The Children's Hospital of Philadelphia, Philadelphia, PA, USA
| | - Denis Rivière
- Université Paris-Saclay, CEA, CNRS, Neurospin, Baobab, Gif-sur-Yvette 91191, France
| | - Emma C Robinson
- Centre for the Developing Brain, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK; Department of Biomedical Engineering, School of Biomedical Engineering and Imaging Science, King's College London, London, UK
| | - Jean-Francois Mangin
- Université Paris-Saclay, CEA, CNRS, Neurospin, Baobab, Gif-sur-Yvette 91191, France
| | - Armin Raznahan
- Section on Developmental Neurogenomics, Human Genetics Branch, National Institute of Mental Health Intramural Research Program, Bethesda, MD, USA
| | - Edward T Bullmore
- Department of Psychiatry, University of Cambridge, Cambridge, UK; Cambridgeshire & Peterborough NHS Foundation Trust, Cambridge, UK
| |
Collapse
|
4
|
Gu C, Li Y, Cao D, Miao X, Paez AG, Sun Y, Cai J, Li W, Li X, Pillai JJ, Earley CJ, van Zijl PC, Hua J. On the optimization of 3D inflow-based vascular-space-occupancy (iVASO) MRI for the quantification of arterial cerebral blood volume (CBVa). Magn Reson Med 2024; 91:1893-1907. [PMID: 38115573 PMCID: PMC10950541 DOI: 10.1002/mrm.29971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Revised: 11/20/2023] [Accepted: 11/25/2023] [Indexed: 12/21/2023]
Abstract
PURPOSE The inflow-based vascular-space-occupancy (iVASO) MRI was originally developed in a single-slice mode to measure arterial cerebral blood volume (CBVa). When vascular crushers are applied in iVASO, the signals can be sensitized predominantly to small pial arteries and arterioles. The purpose of this study is to perform a systematic optimization and evaluation of a 3D iVASO sequence on both 3 T and 7 T for the quantification of CBVa values in the human brain. METHODS Three sets of experiments were performed in three separate cohorts. (1) 3D iVASO MRI protocols were compared to single-slice iVASO, and the reproducibility of whole-brain 3D iVASO MRI was evaluated. (2) The effects from different vascular crushers in iVASO were assessed. (3) 3D iVASO MRI results were evaluated in arterial and venous blood vessels identified using ultrasmall-superparamagnetic-iron-oxides-enhanced MRI to validate its arterial origin. RESULTS 3D iVASO scans showed signal-to-noise ratio (SNR) and CBVa measures consistent with single-slice iVASO with reasonable intrasubject reproducibility. Among the iVASO scans performed with different vascular crushers, the whole-brain 3D iVASO scan with a motion-sensitized-driven-equilibrium preparation with two binomial refocusing pulses and an effective TE of 50 ms showed the best suppression of macrovascular signals, with a relatively low specific absorption rate. When no vascular crusher was applied, the CBVa maps from 3D iVASO scans showed large CBVa values in arterial vessels but well-suppressed signals in venous vessels. CONCLUSION A whole-brain 3D iVASO MRI scan was optimized for CBVa measurement in the human brain. When only microvascular signals are desired, a motion-sensitized-driven-equilibrium-based vascular crusher with binomial refocusing pulses can be applied in 3D iVASO.
Collapse
Affiliation(s)
- Chunming Gu
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Yinghao Li
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Di Cao
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Xinyuan Miao
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Adrian G. Paez
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Yuanqi Sun
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Jitong Cai
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States
| | - Wenbo Li
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Xu Li
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Jay J. Pillai
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- Division of Neuroradiology, Mayo Clinic College of Medicine and Science, Rochester, MN, United States
| | - Christopher J. Earley
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Peter C.M. van Zijl
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Jun Hua
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| |
Collapse
|
5
|
Lindquist MA. Sliding windows analysis can undo the effects of preprocessing when applied to fMRI data. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.10.06.561221. [PMID: 37873165 PMCID: PMC10592634 DOI: 10.1101/2023.10.06.561221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2023]
Abstract
Resting-state fMRI (rs-fMRI) data is used to study the intrinsic functional connectivity (FC) in the human brain. In the past decade, interest has focused on studying the temporal dynamics of FC on short timescales, ranging from seconds to minutes. These studies of time-varying FC (TVFC) have enabled the classification of whole-brain dynamic FC profiles into distinct "brain states", defined as recurring whole-brain connectivity profiles reliably observed across subjects and sessions. The analysis of rs-fMRI data is complicated by the fact that the measured BOLD signal consists of changes induced by neuronal activation, as well as non-neuronal nuisance fluctuations that should be removed prior to further analysis. Thus, the data undergoes significant preprocesing prior to analysis. In previous work [24], we illustrated the potential pitfalls involved with using modular preprocessing pipelines, showing how later preprocessing steps can reintroduce correlation with signal previously removed from the data. Here we show that the problem runs deeper, and that certain statistical analysis techniques can potentially interact with preprocessing and reintroduce correlations with previously removed signal. One such technique is the popular sliding window analysis, used to compute TVFC. In this paper, we discuss the problem both theoretically and empirically in application to test-retest rs-fMRI data. Importantly, we show that we are able to obtain essentially the same brain states and state transitions when analyzing motion induced signal as we do when analyzing the preprocessed but windowed data. Our results cast doubt on whether the estimated brain states obtained using sliding window analysis are neuronal in nature, or simply reflect non-neuronal nuisance signal variation (e.g., motion).
Collapse
|
6
|
Kanakaraj P, Yao T, Cai LY, Lee HH, Newlin NR, Kim ME, Gao C, Pechman KR, Archer D, Hohman T, Jefferson A, Beason-Held LL, Resnick SM, Garyfallidis E, Anderson A, Schilling KG, Landman BA, Moyer D. DeepN4: Learning N4ITK Bias Field Correction for T1-weighted Images. Neuroinformatics 2024; 22:193-205. [PMID: 38526701 PMCID: PMC11182041 DOI: 10.1007/s12021-024-09655-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/19/2023] [Indexed: 03/27/2024]
Abstract
T1-weighted (T1w) MRI has low frequency intensity artifacts due to magnetic field inhomogeneities. Removal of these biases in T1w MRI images is a critical preprocessing step to ensure spatially consistent image interpretation. N4ITK bias field correction, the current state-of-the-art, is implemented in such a way that makes it difficult to port between different pipelines and workflows, thus making it hard to reimplement and reproduce results across local, cloud, and edge platforms. Moreover, N4ITK is opaque to optimization before and after its application, meaning that methodological development must work around the inhomogeneity correction step. Given the importance of bias fields correction in structural preprocessing and flexible implementation, we pursue a deep learning approximation / reinterpretation of the N4ITK bias fields correction to create a method which is portable, flexible, and fully differentiable. In this paper, we trained a deep learning network "DeepN4" on eight independent cohorts from 72 different scanners and age ranges with N4ITK-corrected T1w MRI and bias field for supervision in log space. We found that we can closely approximate N4ITK bias fields correction with naïve networks. We evaluate the peak signal to noise ratio (PSNR) in test dataset against the N4ITK corrected images. The median PSNR of corrected images between N4ITK and DeepN4 was 47.96 dB. In addition, we assess the DeepN4 model on eight additional external datasets and show the generalizability of the approach. This study establishes that incompatible N4ITK preprocessing steps can be closely approximated by naïve deep neural networks, facilitating more flexibility. All code and models are released at https://github.com/MASILab/DeepN4 .
Collapse
Affiliation(s)
- Praitayini Kanakaraj
- Department of Computer Science, Vanderbilt University, 400 24th Ave S, Nashville, TN, 37240, USA.
| | - Tianyuan Yao
- Department of Computer Science, Vanderbilt University, 400 24th Ave S, Nashville, TN, 37240, USA
| | - Leon Y Cai
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Ho Hin Lee
- Department of Computer Science, Vanderbilt University, 400 24th Ave S, Nashville, TN, 37240, USA
| | - Nancy R Newlin
- Department of Computer Science, Vanderbilt University, 400 24th Ave S, Nashville, TN, 37240, USA
| | - Michael E Kim
- Department of Computer Science, Vanderbilt University, 400 24th Ave S, Nashville, TN, 37240, USA
| | - Chenyu Gao
- Department of Electrical and Computer Engineering, Vanderbilt University, Nashville, TN, USA
| | - Kimberly R Pechman
- Vanderbilt Memory and Alzheimer's Center, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Derek Archer
- Vanderbilt Memory and Alzheimer's Center, Vanderbilt University Medical Center, Nashville, TN, USA
- Department of Neurology, Vanderbilt University Medical Center, Nashville, TN, USA
- Vanderbilt Genetics Institute, Vanderbilt University School of Medicine, Nashville, TN, USA
| | - Timothy Hohman
- Vanderbilt Memory and Alzheimer's Center, Vanderbilt University Medical Center, Nashville, TN, USA
- Department of Neurology, Vanderbilt University Medical Center, Nashville, TN, USA
- Vanderbilt Genetics Institute, Vanderbilt University School of Medicine, Nashville, TN, USA
| | - Angela Jefferson
- Vanderbilt Memory and Alzheimer's Center, Vanderbilt University Medical Center, Nashville, TN, USA
- Department of Neurology, Vanderbilt University Medical Center, Nashville, TN, USA
- Department of Medicine, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Lori L Beason-Held
- Laboratory of Behavioral Neuroscience, National Institute On Aging, National Institutes of Health, Baltimore, MD, USA
| | - Susan M Resnick
- Laboratory of Behavioral Neuroscience, National Institute On Aging, National Institutes of Health, Baltimore, MD, USA
| | | | - Adam Anderson
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
- Department of Radiology and Radiological Services, Vanderbilt University Medical Center, Vanderbilt University Medical, Nashville, TN, USA
| | - Kurt G Schilling
- Vanderbilt University Institute for Imaging Science, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Bennett A Landman
- Department of Computer Science, Vanderbilt University, 400 24th Ave S, Nashville, TN, 37240, USA
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
- Department of Electrical and Computer Engineering, Vanderbilt University, Nashville, TN, USA
- Department of Radiology and Radiological Services, Vanderbilt University Medical Center, Vanderbilt University Medical, Nashville, TN, USA
- Vanderbilt University Institute for Imaging Science, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Daniel Moyer
- Department of Computer Science, Vanderbilt University, 400 24th Ave S, Nashville, TN, 37240, USA
| |
Collapse
|
7
|
Li H, Jia Y, Zhu H, Han B, Du J, Liu Y. Multi-level feature extraction and reconstruction for 3D MRI image super-resolution. Comput Biol Med 2024; 171:108151. [PMID: 38387383 DOI: 10.1016/j.compbiomed.2024.108151] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2023] [Revised: 02/04/2024] [Accepted: 02/12/2024] [Indexed: 02/24/2024]
Abstract
Magnetic resonance imaging (MRI) is an essential radiology technique in clinical diagnosis, but its spatial resolution may not suffice to meet the growing need for precise diagnosis due to hardware limitations and thicker slice thickness. Therefore, it is crucial to explore suitable methods to increase the resolution of MRI images. Recently, deep learning has yielded many impressive results in MRI image super-resolution (SR) reconstruction. However, current SR networks mainly use convolutions to extract relatively single image features, which may not be optimal for further enhancing the quality of image reconstruction. In this work, we propose a multi-level feature extraction and reconstruction (MFER) method to restore the degraded high-resolution details of MRI images. Specifically, to comprehensively extract different types of features, we design the triple-mixed convolution by leveraging the strengths and uniqueness of different filter operations. For the features of each level, we then apply deconvolutions to upsample them separately at the tail of the network, followed by the feature calibration of spatial and channel attention. Besides, we also use a soft cross-scale residual operation to improve the effectiveness of parameter optimization. Experiments on lesion-free and glioma datasets indicate that our method obtains superior quantitative performance and visual effects when compared with state-of-the-art MRI image SR methods.
Collapse
Affiliation(s)
- Hongbi Li
- College of Medical Informatics, Chongqing Medical University, Chongqing 400016, China
| | - Yuanyuan Jia
- College of Medical Informatics, Chongqing Medical University, Chongqing 400016, China
| | - Huazheng Zhu
- College of Intelligent Technology and Engineering, Chongqing University of Science and Technology, Chongqing 401331, China
| | - Baoru Han
- College of Medical Informatics, Chongqing Medical University, Chongqing 400016, China
| | - Jinglong Du
- College of Medical Informatics, Chongqing Medical University, Chongqing 400016, China.
| | - Yanbing Liu
- College of Medical Informatics, Chongqing Medical University, Chongqing 400016, China; Chongqing Municipal Education Commission, Chongqing 400020, China.
| |
Collapse
|
8
|
Kanakaraj P, Yao T, Cai LY, Lee HH, Newlin NR, Kim ME, Gao C, Pechman KR, Archer D, Hohman T, Jefferson A, Beason-Held LL, Resnick SM, Garyfallidis E, Anderson A, Schilling KG, Landman BA, Moyer D. DeepN4: Learning N4ITK Bias Field Correction for T1-weighted Images. RESEARCH SQUARE 2023:rs.3.rs-3585882. [PMID: 38014176 PMCID: PMC10680935 DOI: 10.21203/rs.3.rs-3585882/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/29/2023]
Abstract
T1-weighted (T1w) MRI has low frequency intensity artifacts due to magnetic field inhomogeneities. Removal of these biases in T1w MRI images is a critical preprocessing step to ensure spatially consistent image interpretation. N4ITK bias field correction, the current state-of-the-art, is implemented in such a way that makes it difficult to port between different pipelines and workflows, thus making it hard to reimplement and reproduce results across local, cloud, and edge platforms. Moreover, N4ITK is opaque to optimization before and after its application, meaning that methodological development must work around the inhomogeneity correction step. Given the importance of bias fields correction in structural preprocessing and flexible implementation, we pursue a deep learning approximation / reinterpretation of the N4ITK bias fields correction to create a method which is portable, flexible, and fully differentiable. In this paper, we trained a deep learning network "DeepN4" on eight independent cohorts from 72 different scanners and age ranges with N4ITK-corrected T1w MRI and bias field for supervision in log space. We found that we can closely approximate N4ITK bias fields correction with naïve networks. We evaluate the peak signal to noise ratio (PSNR) in test dataset against the N4ITK corrected images. The median PSNR of corrected images between N4ITK and DeepN4 was 47.96 dB. In addition, we assess the DeepN4 model on eight additional external datasets and show the generalizability of the approach. This study establishes that incompatible N4ITK preprocessing steps can be closely approximated by naïve deep neural networks, facilitating more flexibility. All code and models are released at https://github.com/MASILab/DeepN4.
Collapse
Affiliation(s)
| | - Tianyuan Yao
- Department of Computer Science, Vanderbilt University, Nashville, TN, USA
| | - Leon Y. Cai
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Ho Hin Lee
- Department of Computer Science, Vanderbilt University, Nashville, TN, USA
| | - Nancy R. Newlin
- Department of Computer Science, Vanderbilt University, Nashville, TN, USA
| | - Michael E. Kim
- Department of Computer Science, Vanderbilt University, Nashville, TN, USA
| | | | - Kimberly R. Pechman
- Vanderbilt Memory and Alzheimer’s Center, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Derek Archer
- Vanderbilt Memory and Alzheimer’s Center, Vanderbilt University Medical Center, Nashville, TN, USA
- Department of Neurology, Vanderbilt University Medical Center, Nashville, TN, USA
- Vanderbilt Genetics Institute, Vanderbilt University School of Medicine, Nashville, TN, USA
| | - Timothy Hohman
- Vanderbilt Memory and Alzheimer’s Center, Vanderbilt University Medical Center, Nashville, TN, USA
- Department of Neurology, Vanderbilt University Medical Center, Nashville, TN, USA
- Vanderbilt Genetics Institute, Vanderbilt University School of Medicine, Nashville, TN, USA
| | - Angela Jefferson
- Vanderbilt Memory and Alzheimer’s Center, Vanderbilt University Medical Center, Nashville, TN, USA
- Department of Neurology, Vanderbilt University Medical Center, Nashville, TN, USA
- Department of Medicine, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Lori L. Beason-Held
- Laboratory of Behavioral Neuroscience, National Institute on Aging, National Institutes of Health, Baltimore, MD, USA
| | - Susan M. Resnick
- Laboratory of Behavioral Neuroscience, National Institute on Aging, National Institutes of Health, Baltimore, MD, USA
| | | | | | | | - Adam Anderson
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
- Department of Radiology and Radiological Services, Vanderbilt University Medical Center, Vanderbilt University Medical, Nashville, TN, USA
| | - Kurt G. Schilling
- Vanderbilt University Institute for Imaging Science, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Bennett A. Landman
- Department of Computer Science, Vanderbilt University, Nashville, TN, USA
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, USA
- Department of Radiology and Radiological Services, Vanderbilt University Medical Center, Vanderbilt University Medical, Nashville, TN, USA
- Vanderbilt University Institute for Imaging Science, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Daniel Moyer
- Department of Computer Science, Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
9
|
Wargnier-Dauchelle V, Grenier T, Durand-Dubief F, Cotton F, Sdika M. A Weakly Supervised Gradient Attribution Constraint for Interpretable Classification and Anomaly Detection. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:3336-3347. [PMID: 37276116 DOI: 10.1109/tmi.2023.3282789] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
The lack of interpretability of deep learning reduces understanding of what happens when a network does not work as expected and hinders its use in critical fields like medicine, which require transparency of decisions. For example, a healthy vs pathological classification model should rely on radiological signs and not on some training dataset biases. Several post-hoc models have been proposed to explain the decision of a trained network. However, they are very seldom used to enforce interpretability during training and none in accordance with the classification. In this paper, we propose a new weakly supervised method for both interpretable healthy vs pathological classification and anomaly detection. A new loss function is added to a standard classification model to constrain each voxel of healthy images to drive the network decision towards the healthy class according to gradient-based attributions. This constraint reveals pathological structures for patient images, allowing their unsupervised segmentation. Moreover, we advocate both theoretically and experimentally, that constrained training with the simple Gradient attribution is similar to constraints with the heavier Expected Gradient, consequently reducing the computational cost. We also propose a combination of attributions during the constrained training making the model robust to the attribution choice at inference. Our proposition was evaluated on two brain pathologies: tumors and multiple sclerosis. This new constraint provides a more relevant classification, with a more pathology-driven decision. For anomaly detection, the proposed method outperforms state-of-the-art especially on difficult multiple sclerosis lesions segmentation task with a 15 points Dice improvement.
Collapse
|
10
|
Gao C, Landman BA, Prince JL, Carass A. Reproducibility evaluation of the effects of MRI defacing on brain segmentation. J Med Imaging (Bellingham) 2023; 10:064001. [PMID: 38074632 PMCID: PMC10704191 DOI: 10.1117/1.jmi.10.6.064001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Revised: 09/22/2023] [Accepted: 10/24/2023] [Indexed: 12/20/2023] Open
Abstract
Purpose Recent advances in magnetic resonance (MR) scanner quality and the rapidly improving nature of facial recognition software have necessitated the introduction of MR defacing algorithms to protect patient privacy. As a result, there are a number of MR defacing algorithms available to the neuroimaging community, with several appearing in just the last 5 years. While some qualities of these defacing algorithms, such as patient identifiability, have been explored in the previous works, the potential impact of defacing on neuroimage processing has yet to be explored. Approach We qualitatively evaluate eight MR defacing algorithms on 179 subjects from the OASIS-3 cohort and 21 subjects from the Kirby-21 dataset. We also evaluate the effects of defacing on two neuroimaging pipelines-SLANT and FreeSurfer-by comparing the segmentation consistency between the original and defaced images. Results Defacing can alter brain segmentation and even lead to catastrophic failures, which are more frequent with some algorithms, such as Quickshear, MRI_Deface, and FSL_deface. Compared to FreeSurfer, SLANT is less affected by defacing. On outputs that pass the quality check, the effects of defacing are less pronounced than those of rescanning, as measured by the Dice similarity coefficient. Conclusions The effects of defacing are noticeable and should not be disregarded. Extra attention, in particular, should be paid to the possibility of catastrophic failures. It is crucial to adopt a robust defacing algorithm and perform a thorough quality check before releasing defaced datasets. To improve the reliability of analysis in scenarios involving defaced MRIs, it is encouraged to include multiple brain segmentation pipelines.
Collapse
Affiliation(s)
- Chenyu Gao
- Vanderbilt University, Department of Electrical and Computer Engineering, Nashville, Tennessee, United States
| | - Bennett A. Landman
- Vanderbilt University, Department of Electrical and Computer Engineering, Nashville, Tennessee, United States
| | - Jerry L. Prince
- The Johns Hopkins University, Department of Electrical and Computer Engineering, Baltimore, Maryland, United States
| | - Aaron Carass
- The Johns Hopkins University, Department of Electrical and Computer Engineering, Baltimore, Maryland, United States
| |
Collapse
|
11
|
Grigas O, Maskeliūnas R, Damaševičius R. Improving Structural MRI Preprocessing with Hybrid Transformer GANs. Life (Basel) 2023; 13:1893. [PMID: 37763297 PMCID: PMC10532639 DOI: 10.3390/life13091893] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2023] [Revised: 09/01/2023] [Accepted: 09/06/2023] [Indexed: 09/29/2023] Open
Abstract
Magnetic resonance imaging (MRI) is a technique that is widely used in practice to evaluate any pathologies in the human body. One of the areas of interest is the human brain. Naturally, MR images are low-resolution and contain noise due to signal interference, the patient's body's radio-frequency emissions and smaller Tesla coil counts in the machinery. There is a need to solve this problem, as MR tomographs that have the capability of capturing high-resolution images are extremely expensive and the length of the procedure to capture such images increases by the order of magnitude. Vision transformers have lately shown state-of-the-art results in super-resolution tasks; therefore, we decided to evaluate whether we can employ them for structural MRI super-resolution tasks. A literature review showed that similar methods do not focus on perceptual image quality because upscaled images are often blurry and are subjectively of poor quality. Knowing this, we propose a methodology called HR-MRI-GAN, which is a hybrid transformer generative adversarial network capable of increasing resolution and removing noise from 2D T1w MRI slice images. Experiments show that our method quantitatively outperforms other SOTA methods in terms of perceptual image quality and is capable of subjectively generalizing to unseen data. During the experiments, we additionally identified that the visual saliency-induced index metric is not applicable to MRI perceptual quality assessment and that general-purpose denoising networks are effective when removing noise from MR images.
Collapse
Affiliation(s)
- Ovidijus Grigas
- Faculty of Informatics, Kaunas University of Technology, 50254 Kaunas, Lithuania
| | - Rytis Maskeliūnas
- Faculty of Informatics, Kaunas University of Technology, 50254 Kaunas, Lithuania
| | - Robertas Damaševičius
- Faculty of Informatics, Kaunas University of Technology, 50254 Kaunas, Lithuania
- Department of Applied Informatics, Vytautas Magnus University, 44248 Kaunas, Lithuania
| |
Collapse
|
12
|
Keser Z, Meier EL, Stockbridge MD, Breining BL, Hillis AE, Sebastian R. Corticocerebellar White Matter Integrity Is Related to Naming Outcome in Post-Stroke Aphasia. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2023; 4:404-419. [PMID: 37588128 PMCID: PMC10426388 DOI: 10.1162/nol_a_00107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/21/2022] [Accepted: 04/03/2023] [Indexed: 08/18/2023]
Abstract
Studies have shown that the integrity of white matter tracts connecting different regions in the left cerebral hemisphere is important for aphasia recovery after stroke. However, the impact of the underlying structural connection between the cortex and the cerebellum in post-stroke aphasia is poorly understood. We studied the microstructural integrity of the cerebellum and the corticocerebellar connections and their role in picture naming. Fifty-six patients with left cerebral infarcts (sparing the cerebellum) underwent diffusion tensor imaging (DTI) and Boston Naming Test. We compared the fractional anisotropy (FA) and mean diffusivity (MD) values of the right and the left cerebellum (lobular gray and white matter structures) and cerebellocortical connections. Recursive feature elimination and Spearman correlation analyses were performed to evaluate the relationship between naming performance and the corticocerebellar connections. We found that the right, relative to left, cerebellar structures and their connections with the left cerebrum showed lower FA and higher MD values, both reflecting lower microstructural integrity. This trend was not observed in the healthy controls. Higher MD values of the right major cerebellar outflow tract were associated with poorer picture naming performance. Our study provides the first DTI data demonstrating the critical importance of ascending and descending corticocerebellar connections for naming outcomes after stroke.
Collapse
Affiliation(s)
- Zafer Keser
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
- Department of Neurology, Mayo Clinic, Rochester, MN, USA
| | - Erin L. Meier
- Department of Communication Sciences and Disorders, Northeastern University, Boston, MA, USA
| | - Melissa D. Stockbridge
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Bonnie L. Breining
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Argye E. Hillis
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
- Department of Cognitive Science, Johns Hopkins University, Baltimore, MD, USA
- Department of Physical Medicine and Rehabilitation, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Rajani Sebastian
- Department of Physical Medicine and Rehabilitation, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| |
Collapse
|
13
|
Gao C, Landman BA, Prince JL, Carass A. A reproducibility evaluation of the effects of MRI defacing on brain segmentation. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2023:2023.05.15.23289995. [PMID: 37293070 PMCID: PMC10246049 DOI: 10.1101/2023.05.15.23289995] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Purpose Recent advances in magnetic resonance (MR) scanner quality and the rapidly improving nature of facial recognition software have necessitated the introduction of MR defacing algorithms to protect patient privacy. As a result, there are a number of MR defacing algorithms available to the neuroimaging community, with several appearing in just the last five years. While some qualities of these defacing algorithms, such as patient identifiability, have been explored in previous works, the potential impact of defacing on neuroimage processing has yet to be explored. Approach We qualitatively evaluate eight MR defacing algorithms on 179 subjects from the OASIS-3 cohort and the 21 subjects from the Kirby-21 dataset. We also evaluate the effects of defacing on two neuroimaging pipelines-SLANT and FreeSurfer-by comparing the segmentation consistency between the original and defaced images. Results Defacing can alter brain segmentation and even lead to catastrophic failures, which are more frequent with some algorithms such as Quickshear, MRI_Deface, and FSL_deface. Compared to FreeSurfer, SLANT is less affected by defacing. On outputs that pass the quality check, the effects of defacing are less pronounced than those of rescanning, as measured by the Dice similarity coefficient. Conclusions The effects of defacing are noticeable and should not be disregarded. Extra attention, in particular, should be paid to the possibility of catastrophic failures. It is crucial to adopt a robust defacing algorithm and perform a thorough quality check before releasing defaced datasets. To improve the reliability of analysis in scenarios involving defaced MRIs, it's encouraged to include multiple brain segmentation pipelines.
Collapse
Affiliation(s)
- Chenyu Gao
- Vanderbilt University, Department of Electrical and Computer Engineering, Nashville, Tennessee, 37235
| | - Bennett A. Landman
- Vanderbilt University, Department of Electrical and Computer Engineering, Nashville, Tennessee, 37235
| | - Jerry L. Prince
- The Johns Hopkins University, Department of Electrical and Computer Engineering, Baltimore, Maryland, 21218
| | - Aaron Carass
- The Johns Hopkins University, Department of Electrical and Computer Engineering, Baltimore, Maryland, 21218
| |
Collapse
|
14
|
Miao X, Li Y, Zhou X, Luo Y, Paez AG, Liu D, van Zijl PCM, Hua J. Evaluation of T2-prepared blood oxygenation level dependent functional magnetic resonance imaging with an event-related task: Hemodynamic response function and reproducibility. Front Neurosci 2023; 17:1114045. [PMID: 36937683 PMCID: PMC10017524 DOI: 10.3389/fnins.2023.1114045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2022] [Accepted: 02/13/2023] [Indexed: 03/06/2023] Open
Abstract
T2-prepared (T2prep) blood oxygenation level dependent (BOLD) functional MRI (fMRI) is an alternative fMRI approach developed to mitigate the susceptibility artifacts that are typically observed in brain regions near air-filled cavities, bleeding and calcification, and metallic objects in echo-planar-imaging (EPI) based fMRI images. Here, T2prep BOLD fMRI was evaluated in an event-related paradigm for the first time. Functional experiments were performed using gradient-echo (GRE) EPI, spin-echo (SE) EPI, and T2prep BOLD fMRI during an event-related visual task in 10 healthy human subjects. Each fMRI method was performed with a low (3.4 × 3.4 × 4 mm3) and a high (1.5 mm isotropic) spatial resolution on 3T and a high resolution (1.5 mm isotropic) on 7T. Robust activation were detected in the visual cortex with all three fMRI methods. In each group of fMRI scans (3T low resolution, 3T high resolution, and 7T high resolution), GRE EPI showed the highest signal change (ΔS/S), largest full-width-at-half-maximum (FWHM) and longest time-to-peak (TTP) extracted from the hemodynamic response functions (HRF), indicating substantial signal contribution from large draining veins which have longer response times than microvessels. In contrast, T2prep BOLD showed the lowest ΔS/S, smallest FWHM, and shortest TTP, suggesting that T2prep BOLD may have a purer T2-weighted BOLD contrast that is more sensitive to microvessels compared to GRE/SE EPI BOLD. This trend was more obvious in fMRI scans performed with a lower spatial resolution on a lower field (3T with a 3.4 × 3.4 × 4 mm3 voxel). Scan-rescan reproducibility in the same subjects was comparable among the three fMRI methods. The results from the current study are expected to be useful to establish T2prep BOLD as a useful alternative fMRI approach for event-related fMRI in brain regions with large susceptibility artifacts.
Collapse
Affiliation(s)
- Xinyuan Miao
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F. M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Yinghao Li
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F. M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States
| | - Xinyi Zhou
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F. M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States
| | - Yu Luo
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F. M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Adrian G. Paez
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F. M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Dapeng Liu
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F. M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Peter C. M. van Zijl
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F. M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Jun Hua
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- F. M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| |
Collapse
|
15
|
Haddad E, Pizzagalli F, Zhu AH, Bhatt RR, Islam T, Ba Gari I, Dixon D, Thomopoulos SI, Thompson PM, Jahanshad N. Multisite test-retest reliability and compatibility of brain metrics derived from FreeSurfer versions 7.1, 6.0, and 5.3. Hum Brain Mapp 2023; 44:1515-1532. [PMID: 36437735 PMCID: PMC9921222 DOI: 10.1002/hbm.26147] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Revised: 10/19/2022] [Accepted: 10/19/2022] [Indexed: 11/29/2022] Open
Abstract
Automatic neuroimaging processing tools provide convenient and systematic methods for extracting features from brain magnetic resonance imaging scans. One tool, FreeSurfer, provides an easy-to-use pipeline to extract cortical and subcortical morphometric measures. There have been over 25 stable releases of FreeSurfer, with different versions used across published works. The reliability and compatibility of regional morphometric metrics derived from the most recent version releases have yet to be empirically assessed. Here, we used test-retest data from three public data sets to determine within-version reliability and between-version compatibility across 42 regional outputs from FreeSurfer versions 7.1, 6.0, and 5.3. Cortical thickness from v7.1 was less compatible with that of older versions, particularly along the cingulate gyrus, where the lowest version compatibility was observed (intraclass correlation coefficient 0.37-0.61). Surface area of the temporal pole, frontal pole, and medial orbitofrontal cortex, also showed low to moderate version compatibility. We confirm low compatibility between v6.0 and v5.3 of pallidum and putamen volumes, while those from v7.1 were compatible with v6.0. Replication in an independent sample showed largely similar results for measures of surface area and subcortical volumes, but had lower overall regional thickness reliability and compatibility. Batch effect correction may adjust for some inter-version effects when most sites are run with one version, but results vary when more sites are run with different versions. Age associations in a quality controlled independent sample (N = 106) revealed version differences in results of downstream statistical analysis. We provide a reference to highlight the regional metrics that may yield recent version-related inconsistencies in published findings. An interactive viewer is provided at http://data.brainescience.org/Freesurfer_Reliability/.
Collapse
Affiliation(s)
- Elizabeth Haddad
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA
| | - Fabrizio Pizzagalli
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA.,Department of Neurosciences, University of Turin, Turin, Italy
| | - Alyssa H Zhu
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA
| | - Ravi R Bhatt
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA
| | - Tasfiya Islam
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA
| | - Iyad Ba Gari
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA
| | - Daniel Dixon
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA
| | - Sophia I Thomopoulos
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA
| | - Paul M Thompson
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA
| | - Neda Jahanshad
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA
| |
Collapse
|
16
|
Cabeza-Ruiz R, Velázquez-Pérez L, Pérez-Rodríguez R, Reetz K. ConvNets for automatic detection of polyglutamine SCAs from brain MRIs: state of the art applications. Med Biol Eng Comput 2023; 61:1-24. [PMID: 36385616 DOI: 10.1007/s11517-022-02714-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Accepted: 10/26/2022] [Indexed: 11/17/2022]
Abstract
Polyglutamine spinocerebellar ataxias (polyQ SCAs) are a group of neurodegenerative diseases, clinically and genetically heterogeneous, characterized by loss of balance and motor coordination due to dysfunction of the cerebellum and its connections. The diagnosis of each type of polyQ SCA, alongside with genetic tests, includes medical images analysis, and its automation may help specialists to distinguish between each type. Convolutional neural networks (ConvNets or CNNs) have been recently used for medical image processing, with outstanding results. In this work, we present the main clinical and imaging features of polyglutamine SCAs, and the basics of CNNs. Finally, we review studies that have used this approach to automatically process brain medical images and may be applied to SCAs detection. We conclude by discussing the possible limitations and opportunities of using ConvNets for SCAs diagnose in the future.
Collapse
Affiliation(s)
| | - Luis Velázquez-Pérez
- Cuban Academy of Sciences, La Habana, Cuba
- Center for the Research and Rehabilitation of Hereditary Ataxias, Holguín, Cuba
| | - Roberto Pérez-Rodríguez
- CAD/CAM Study Center, University of Holguín, Holguín, Cuba
- Cuban Academy of Sciences, La Habana, Cuba
| | - Kathrin Reetz
- Department of Neurology, RWTH Aachen University, Aachen, Germany
| |
Collapse
|
17
|
Faber J, Kügler D, Bahrami E, Heinz LS, Timmann D, Ernst TM, Deike-Hofmann K, Klockgether T, van de Warrenburg B, van Gaalen J, Reetz K, Romanzetti S, Oz G, Joers JM, Diedrichsen J, Reuter M. CerebNet: A fast and reliable deep-learning pipeline for detailed cerebellum sub-segmentation. Neuroimage 2022; 264:119703. [PMID: 36349595 PMCID: PMC9771831 DOI: 10.1016/j.neuroimage.2022.119703] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2022] [Accepted: 10/18/2022] [Indexed: 11/07/2022] Open
Abstract
Quantifying the volume of the cerebellum and its lobes is of profound interest in various neurodegenerative and acquired diseases. Especially for the most common spinocerebellar ataxias (SCA), for which the first antisense oligonculeotide-base gene silencing trial has recently started, there is an urgent need for quantitative, sensitive imaging markers at pre-symptomatic stages for stratification and treatment assessment. This work introduces CerebNet, a fully automated, extensively validated, deep learning method for the lobular segmentation of the cerebellum, including the separation of gray and white matter. For training, validation, and testing, T1-weighted images from 30 participants were manually annotated into cerebellar lobules and vermal sub-segments, as well as cerebellar white matter. CerebNet combines FastSurferCNN, a UNet-based 2.5D segmentation network, with extensive data augmentation, e.g. realistic non-linear deformations to increase the anatomical variety, eliminating additional preprocessing steps, such as spatial normalization or bias field correction. CerebNet demonstrates a high accuracy (on average 0.87 Dice and 1.742mm Robust Hausdorff Distance across all structures) outperforming state-of-the-art approaches. Furthermore, it shows high test-retest reliability (average ICC >0.97 on OASIS and Kirby) as well as high sensitivity to disease effects, including the pre-ataxic stage of spinocerebellar ataxia type 3 (SCA3). CerebNet is compatible with FreeSurfer and FastSurfer and can analyze a 3D volume within seconds on a consumer GPU in an end-to-end fashion, thus providing an efficient and validated solution for assessing cerebellum sub-structure volumes. We make CerebNet available as source-code (https://github.com/Deep-MI/FastSurfer).
Collapse
Affiliation(s)
- Jennifer Faber
- German Center for Neurodegenerative Diseases (DZNE), Bonn, Germany; Department of Neurology, University Hospital Bonn, Germany
| | - David Kügler
- German Center for Neurodegenerative Diseases (DZNE), Bonn, Germany
| | - Emad Bahrami
- German Center for Neurodegenerative Diseases (DZNE), Bonn, Germany; Computer Science Department, University Bonn, Bonn, Germany
| | - Lea-Sophie Heinz
- German Center for Neurodegenerative Diseases (DZNE), Bonn, Germany
| | - Dagmar Timmann
- Department of Neurology, Center for Translational Neuro, and Behavioral Sciences (C-TNBS), University Hospital Essen, University of Duisburg-Essen, Essen, Germany
| | - Thomas M Ernst
- Department of Neurology, Center for Translational Neuro, and Behavioral Sciences (C-TNBS), University Hospital Essen, University of Duisburg-Essen, Essen, Germany
| | | | - Thomas Klockgether
- German Center for Neurodegenerative Diseases (DZNE), Bonn, Germany; Department of Neurology, University Hospital Bonn, Germany
| | - Bart van de Warrenburg
- Department of Neurology, Donders Institute for Brain, Cognition, and Behaviour, Radboud university medical center, Nijmegen, The Netherlands
| | - Judith van Gaalen
- Department of Neurology, Donders Institute for Brain, Cognition, and Behaviour, Radboud university medical center, Nijmegen, The Netherlands
| | - Kathrin Reetz
- Department of Neurology, RWTH Aachen University, Germany; JARA-Brain Institute Molecular Neuroscience and Neuroimaging, Forschungszentrum Jülich, Germany
| | | | - Gulin Oz
- Center for Magnetic Resonance Research, Department of Radiology, University of Minnesota, Minneapolis, MN, USA
| | - James M Joers
- Center for Magnetic Resonance Research, Department of Radiology, University of Minnesota, Minneapolis, MN, USA
| | - Jorn Diedrichsen
- Departments of Computer Science and Statistical and Actuarial Sciences, Western University, London, ON, Canada
| | - Martin Reuter
- German Center for Neurodegenerative Diseases (DZNE), Bonn, Germany; A.A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, USA; Department of Radiology, Harvard Medical School, Boston, MA, USA.
| |
Collapse
|
18
|
Rodrigues L, Rezende TJR, Wertheimer G, Santos Y, França M, Rittner L. A benchmark for hypothalamus segmentation on T1-weighted MR images. Neuroimage 2022; 264:119741. [PMID: 36368499 DOI: 10.1016/j.neuroimage.2022.119741] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Revised: 09/23/2022] [Accepted: 11/07/2022] [Indexed: 11/10/2022] Open
Abstract
The hypothalamus is a small brain structure that plays essential roles in sleep regulation, body temperature control, and metabolic homeostasis. Hypothalamic structural abnormalities have been reported in neuropsychiatric disorders, such as schizophrenia, amyotrophic lateral sclerosis, and Alzheimer's disease. Although mag- netic resonance (MR) imaging is the standard examination method for evaluating this region, hypothalamic morphological landmarks are unclear, leading to subjec- tivity and high variability during manual segmentation. Due to these limitations, it is common to find contradicting results in the literature regarding hypothalamic volumetry. To the best of our knowledge, only two automated methods are available in the literature for hypothalamus segmentation, the first of which is our previous method based on U-Net. However, both methods present performance losses when predicting images from different datasets than those used in training. Therefore, this project presents a benchmark consisting of a diverse T1-weighted MR image dataset comprising 1381 subjects from IXI, CC359, OASIS, and MiLI (the latter created specifically for this benchmark). All data were provided using automatically generated hypothalamic masks and a subset containing manually annotated masks. As a baseline, a method for fully automated segmentation of the hypothalamus on T1-weighted MR images with a greater generalization ability is presented. The pro- posed method is a teacher-student-based model with two blocks: segmentation and correction, where the second corrects the imperfections of the first block. After using three datasets for training (MiLI, IXI, and CC359), the prediction performance of the model was measured on two test sets: the first was composed of data from IXI, CC359, and MiLI, achieving a Dice coefficient of 0.83; the second was from OASIS, a dataset not used for training, achieving a Dice coefficient of 0.74. The dataset, the baseline model, and all necessary codes to reproduce the experiments are available at https://github.com/MICLab-Unicamp/HypAST and https://sites.google.com/ view/calgary-campinas-dataset/hypothalamus-benchmarking. In addition, a leaderboard will be maintained with predictions for the test set submitted by anyone working on the same task.
Collapse
Affiliation(s)
- Livia Rodrigues
- Medical Image Computing Lab, School of Electrical and Computer Engineering (FEEC), University of Campinas, Albert Einstein Street, 400, Campinas, SP 13083-887, Brazil.
| | - Thiago Junqueira Ribeiro Rezende
- Department of Neurology, School of Medical Sciences, University of Campinas, Tessalia Vieira de Camargo Street, 126, Campinas, SP 13083-887, Brazil
| | - Guilherme Wertheimer
- Department of Neurology, School of Medical Sciences, University of Campinas, Tessalia Vieira de Camargo Street, 126, Campinas, SP 13083-887, Brazil
| | - Yves Santos
- Department of Neurology, School of Medical Sciences, University of Campinas, Tessalia Vieira de Camargo Street, 126, Campinas, SP 13083-887, Brazil
| | - Marcondes França
- Department of Neurology, School of Medical Sciences, University of Campinas, Tessalia Vieira de Camargo Street, 126, Campinas, SP 13083-887, Brazil
| | - Leticia Rittner
- Medical Image Computing Lab, School of Electrical and Computer Engineering (FEEC), University of Campinas, Albert Einstein Street, 400, Campinas, SP 13083-887, Brazil
| |
Collapse
|
19
|
Moon HS, Heffron L, Mahzarnia A, Obeng-Gyasi B, Holbrook M, Badea CT, Feng W, Badea A. Automated multimodal segmentation of acute ischemic stroke lesions on clinical MR images. Magn Reson Imaging 2022; 92:45-57. [PMID: 35688400 PMCID: PMC9949513 DOI: 10.1016/j.mri.2022.06.001] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2022] [Revised: 06/01/2022] [Accepted: 06/02/2022] [Indexed: 02/09/2023]
Abstract
Magnetic resonance (MR) imaging (MRI) is commonly used to diagnose, assess and monitor stroke. Accurate and timely segmentation of stroke lesions provides the anatomico-structural information that can aid physicians in predicting prognosis, as well as in decision making and triaging for various rehabilitation strategies. To segment stroke lesions, MR protocols, including diffusion-weighted imaging (DWI) and T2-weighted fluid attenuated inversion recovery (FLAIR) are often utilized. These imaging sequences are usually acquired with different spatial resolutions due to time constraints. Within the same image, voxels may be anisotropic, with reduced resolution along slice direction for diffusion scans in particular. In this study, we evaluate the ability of 2D and 3D U-Net Convolutional Neural Network (CNN) architectures to segment ischemic stroke lesions using single contrast (DWI) and dual contrast images (T2w FLAIR and DWI). The predicted segmentations correlate with post-stroke motor outcome measured by the National Institutes of Health Stroke Scale (NIHSS) and Fugl-Meyer Upper Extremity (FM-UE) index based on the lesion loads overlapping the corticospinal tracts (CST), which is a neural substrate for motor movement and function. Although the four methods performed similarly, the 2D multimodal U-Net achieved the best results with a mean Dice of 0.737 (95% CI: 0.705, 0.769) and a relatively high correlation between the weighted lesion load and the NIHSS scores (both at baseline and at 90 days). A monotonically constrained quintic polynomial regression yielded R2 = 0.784 and 0.875 for weighted lesion load versus baseline and 90-Days NIHSS respectively, and better corrected Akaike information criterion (AICc) scores than those of the linear regression. In addition, using the quintic polynomial regression model to regress the weighted lesion load to the 90-Days FM-UE score results in an R2 of 0.570 with a better AICc score than that of the linear regression. Our results suggest that the multi-contrast information enhanced the accuracy of the segmentation and the prediction accuracy for upper extremity motor outcomes. Expanding the training dataset to include different types of stroke lesions and more data points will help add a temporal longitudinal aspect and increase the accuracy. Furthermore, adding patient-specific data may improve the inference about the relationship between imaging metrics and functional outcomes.
Collapse
Affiliation(s)
- Hae Sol Moon
- Department of Biomedical Engineering, Duke University, Durham, NC, United States
| | - Lindsay Heffron
- Department of Orthopaedic Surgery, Duke University School of Medicine, Durham, NC, United States
| | - Ali Mahzarnia
- Department of Radiology, Duke University School of Medicine, Durham, NC, United States
| | - Barnabas Obeng-Gyasi
- Department of Radiology, Duke University School of Medicine, Durham, NC, United States
| | - Matthew Holbrook
- Department of Radiology, Duke University School of Medicine, Durham, NC, United States
| | - Cristian T Badea
- Department of Biomedical Engineering, Duke University, Durham, NC, United States; Department of Radiology, Duke University School of Medicine, Durham, NC, United States
| | - Wuwei Feng
- Department of Neurology, Duke University School of Medicine, Durham, NC, United States
| | - Alexandra Badea
- Department of Biomedical Engineering, Duke University, Durham, NC, United States; Department of Radiology, Duke University School of Medicine, Durham, NC, United States; Department of Neurology, Duke University School of Medicine, Durham, NC, United States; Brain Imaging and Analysis Center, Duke University School of Medicine, NC, United States.
| |
Collapse
|
20
|
Larson KE, Oguz I. Synthetic Atrophy for Longitudinal Cortical Surface Analyses. FRONTIERS IN NEUROIMAGING 2022; 1:861687. [PMID: 37555187 PMCID: PMC10406236 DOI: 10.3389/fnimg.2022.861687] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Accepted: 04/22/2022] [Indexed: 08/10/2023]
Abstract
In the fields of longitudinal cortical segmentation and surface-based cortical thickness (CT) measurement, difficulty in assessing accuracy remains a substantial limitation due to the inability of experimental validation against ground truth. Although methods have been developed to create synthetic datasets for these purposes, none provide a robust mechanism for measuring exact thickness changes with surface-based approaches. This work presents a registration-based technique for inducing synthetic cortical atrophy to create a longitudinal ground truth dataset specifically designed to address this gap in surface-based accuracy validation techniques. Across the entire brain, our method can induce up to between 0.8 and 2.5 mm of localized cortical atrophy in a given gyrus depending on the region's original thickness. By calculating the image deformation to induce this atrophy at 400% of the original resolution in each direction, we can induce a sub-voxel resolution amount of atrophy while minimizing partial volume effects. We also show that cortical segmentations of synthetically atrophied images exhibit similar segmentation error to those obtained from images of naturally atrophied brains. Importantly, our method relies exclusively on publicly available software and datasets.
Collapse
Affiliation(s)
- Kathleen E. Larson
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, United States
| | - Ipek Oguz
- Department of Computer Science, Vanderbilt University, Nashville, TN, United States
| |
Collapse
|
21
|
Zhang J, Sun WW, Li L. Generalized Connectivity Matrix Response Regression with Applications in Brain Connectivity Studies. J Comput Graph Stat 2022; 32:252-262. [PMID: 36970553 PMCID: PMC10035565 DOI: 10.1080/10618600.2022.2074434] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2021] [Accepted: 04/23/2022] [Indexed: 10/18/2022]
Abstract
Multiple-subject network data are fast emerging in recent years, where a separate connectivity matrix is measured over a common set of nodes for each individual subject, along with subject covariates information. In this article, we propose a new generalized matrix response regression model, where the observed network is treated as a matrix-valued response and the subject covariates as predictors. The new model characterizes the population-level connectivity pattern through a low-rank intercept matrix, and the effect of subject covariates through a sparse slope tensor. We develop an efficient alternating gradient descent algorithm for parameter estimation, and establish the non-asymptotic error bound for the actual estimator from the algorithm, which quantifies the interplay between the computational and statistical errors. We further show the strong consistency for graph community recovery, as well as the edge selection consistency. We demonstrate the efficacy of our method through simulations and two brain connectivity studies.
Collapse
Affiliation(s)
- Jingfei Zhang
- Department of Management Science, Miami Herbert Business School, University of Miami, Miami, FL, 33146
| | - Will Wei Sun
- Krannert School of Management, Purdue University, West Lafayette, IN, 47906
| | - Lexin Li
- Department of Biostatistics and Epidemiology, School of Public Health, University of California at Berkeley, Berkeley, CA, 94720
| |
Collapse
|
22
|
Cavedo E, Tran P, Thoprakarn U, Martini JB, Movschin A, Delmaire C, Gariel F, Heidelberg D, Pyatigorskaya N, Ströer S, Krolak-Salmon P, Cotton F, Dos Santos CL, Dormont D. Validation of an automatic tool for the rapid measurement of brain atrophy and white matter hyperintensity: QyScore®. Eur Radiol 2022; 32:2949-2961. [PMID: 34973104 PMCID: PMC9038894 DOI: 10.1007/s00330-021-08385-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2020] [Revised: 09/15/2021] [Accepted: 10/21/2021] [Indexed: 12/05/2022]
Abstract
OBJECTIVES QyScore® is an imaging analysis tool certified in Europe (CE marked) and the US (FDA cleared) for the automatic volumetry of grey and white matter (GM and WM respectively), hippocampus (HP), amygdala (AM), and white matter hyperintensity (WMH). Here we compare QyScore® performances with the consensus of expert neuroradiologists. METHODS Dice similarity coefficient (DSC) and the relative volume difference (RVD) for GM, WM volumes were calculated on 50 3DT1 images. DSC and the F1 metrics were calculated for WMH on 130 3DT1 and FLAIR images. For each index, we identified thresholds of reliability based on current literature review results. We hypothesized that DSC/F1 scores obtained using QyScore® markers would be higher than the threshold. In contrast, RVD scores would be lower. Regression analysis and Bland-Altman plots were obtained to evaluate QyScore® performance in comparison to the consensus of three expert neuroradiologists. RESULTS The lower bound of the DSC/F1 confidence intervals was higher than the threshold for the GM, WM, HP, AM, and WMH, and the higher bounds of the RVD confidence interval were below the threshold for the WM, GM, HP, and AM. QyScore®, compared with the consensus of three expert neuroradiologists, provides reliable performance for the automatic segmentation of the GM and WM volumes, and HP and AM volumes, as well as WMH volumes. CONCLUSIONS QyScore® represents a reliable medical device in comparison with the consensus of expert neuroradiologists. Therefore, QyScore® could be implemented in clinical trials and clinical routine to support the diagnosis and longitudinal monitoring of neurological diseases. KEY POINTS • QyScore® provides reliable automatic segmentation of brain structures in comparison with the consensus of three expert neuroradiologists. • QyScore® automatic segmentation could be performed on MRI images using different vendors and protocols of acquisition. In addition, the fast segmentation process saves time over manual and semi-automatic methods. • QyScore® could be implemented in clinical trials and clinical routine to support the diagnosis and longitudinal monitoring of neurological diseases.
Collapse
Affiliation(s)
- Enrica Cavedo
- Qynapse SAS, 130 rue de Lourmel, 75015, Paris, France.
| | - Philippe Tran
- Qynapse SAS, 130 rue de Lourmel, 75015, Paris, France
- Equipe-Projet ARAMIS, ICM, CNRS UMR 7225, Inserm U1117, Sorbonne Université UMR_S 1127, Centre Inria de Paris, Groupe Hospitalier Pitié-Salpêtrière Charles Foix, Faculté de Médecine Sorbonne Université, Paris, France
| | | | | | | | | | - Florent Gariel
- Department of Neuroradiology, University Hospital of Bordeaux, Bordeaux, France
| | - Damien Heidelberg
- Faculty of Medicine, Claude-Bernard Lyon 1 University, 69000, Lyon, France
- Service de Radiologie and Laboratoire d'anatomie de Rockefeller, centre hospitalier Lyon Sud, hospices civils de Lyon, 69000, Lyon, France
| | - Nadya Pyatigorskaya
- Department of Neuroradiology, Groupe Hospitalier Pitié-Salpêtrière, AP-HP, Sorbonne Université UMR_S 1127, Paris, France
| | - Sébastian Ströer
- Department of Neuroradiology, Groupe Hospitalier Pitié-Salpêtrière, AP-HP, Sorbonne Université UMR_S 1127, Paris, France
| | - Pierre Krolak-Salmon
- Clinical and Research Memory Centre of Lyon, Hospices Civils de Lyon, Lyon, France
- University of Lyon, Lyon, France
- INSERM, U1028; UMR CNRS 5292, Lyon Neuroscience Research Center, Lyon, France
| | - Francois Cotton
- Radiology Department, centre hospitalier Lyon-Sud, hospices civils de Lyon, 69310, Pierre-Bénite, France
- Inserm U1044, CNRS UMR 5220, CREATIS, Université Lyon-1, 69100, Villeurbanne, France
| | | | - Didier Dormont
- Equipe-Projet ARAMIS, ICM, CNRS UMR 7225, Inserm U1117, Sorbonne Université UMR_S 1127, Centre Inria de Paris, Groupe Hospitalier Pitié-Salpêtrière Charles Foix, Faculté de Médecine Sorbonne Université, Paris, France
- Department of Neuroradiology, Groupe Hospitalier Pitié-Salpêtrière, AP-HP, Sorbonne Université UMR_S 1127, Paris, France
| |
Collapse
|
23
|
Henschel L, Kügler D, Reuter M. FastSurferVINN: Building resolution-independence into deep learning segmentation methods-A solution for HighRes brain MRI. Neuroimage 2022; 251:118933. [PMID: 35122967 PMCID: PMC9801435 DOI: 10.1016/j.neuroimage.2022.118933] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Revised: 12/22/2021] [Accepted: 01/24/2022] [Indexed: 01/04/2023] Open
Abstract
Leading neuroimaging studies have pushed 3T MRI acquisition resolutions below 1.0 mm for improved structure definition and morphometry. Yet, only few, time-intensive automated image analysis pipelines have been validated for high-resolution (HiRes) settings. Efficient deep learning approaches, on the other hand, rarely support more than one fixed resolution (usually 1.0 mm). Furthermore, the lack of a standard submillimeter resolution as well as limited availability of diverse HiRes data with sufficient coverage of scanner, age, diseases, or genetic variance poses additional, unsolved challenges for training HiRes networks. Incorporating resolution-independence into deep learning-based segmentation, i.e., the ability to segment images at their native resolution across a range of different voxel sizes, promises to overcome these challenges, yet no such approach currently exists. We now fill this gap by introducing a Voxel-size Independent Neural Network (VINN) for resolution-independent segmentation tasks and present FastSurferVINN, which (i) establishes and implements resolution-independence for deep learning as the first method simultaneously supporting 0.7-1.0 mm whole brain segmentation, (ii) significantly outperforms state-of-the-art methods across resolutions, and (iii) mitigates the data imbalance problem present in HiRes datasets. Overall, internal resolution-independence mutually benefits both HiRes and 1.0 mm MRI segmentation. With our rigorously validated FastSurferVINN we distribute a rapid tool for morphometric neuroimage analysis. The VINN architecture, furthermore, represents an efficient resolution-independent segmentation method for wider application.
Collapse
Affiliation(s)
- Leonie Henschel
- German Center for Neurodegenerative Diseases (DZNE), Bonn, Germany
| | - David Kügler
- German Center for Neurodegenerative Diseases (DZNE), Bonn, Germany
| | - Martin Reuter
- German Center for Neurodegenerative Diseases (DZNE), Bonn, Germany; A.A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, USA; Department of Radiology, Harvard Medical School, Boston, MA, USA.
| |
Collapse
|
24
|
Barbieri M, Lee PK, Brizi L, Giampieri E, Solera F, Castellani G, Hargreaves BA, Testa C, Lodi R, Remondini D. Circumventing the curse of dimensionality in magnetic resonance fingerprinting through a deep learning approach. NMR IN BIOMEDICINE 2022; 35:e4670. [PMID: 35088466 DOI: 10.1002/nbm.4670] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/10/2020] [Revised: 11/15/2021] [Accepted: 12/02/2021] [Indexed: 06/14/2023]
Abstract
Magnetic resonance fingerprinting (MRF) is a rapidly developing approach for fast quantitative MRI. A typical drawback of dictionary-based MRF is an explosion of the dictionary size as a function of the number of reconstructed parameters, according to the "curse of dimensionality", which determines an explosion of resource requirements. Neural networks (NNs) have been proposed as a feasible alternative, but this approach is still in its infancy. In this work, we design a deep learning approach to MRF using a fully connected network (FCN). In the first part we investigate, by means of simulations, how the NN performance scales with the number of parameters to be retrieved in comparison with the standard dictionary approach. Four MRF sequences were considered: IR-FISP, bSSFP, IR-FISP-B1 , and IR-bSSFP-B1 , the latter two designed to be more specific for B1+ parameter encoding. Estimation accuracy, memory usage, and computational time required to perform the estimation task were considered to compare the scalability capabilities of the dictionary-based and the NN approaches. In the second part we study optimal training procedures by including different data augmentation and preprocessing strategies during training to achieve better accuracy and robustness to noise and undersampling artifacts. The study is conducted using the IR-FISP MRF sequence exploiting both simulations and in vivo acquisitions. Results demonstrate that the NN approach outperforms the dictionary-based approach in terms of scalability capabilities. Results also allow us to heuristically determine the optimal training strategy to make an FCN able to predict T1 , T2 , and M0 maps that are in good agreement with those obtained with the original dictionary approach. k-SVD denoising is proposed and found to be critical as a preprocessing step to handle undersampled data.
Collapse
Affiliation(s)
- Marco Barbieri
- Department of Physics and Astronomy "Augusto Righi", University of Bologna, Bologna, Italy
- Department of Radiology, Stanford University, California, United States
| | - Philip K Lee
- Department of Electrical Engineering, Stanford University, California, United States
| | - Leonardo Brizi
- Department of Physics and Astronomy "Augusto Righi", University of Bologna, Bologna, Italy
- INFN, Sezione di Bologna, Bologna, Italy
| | - Enrico Giampieri
- Department of Experimental, Diagnostic and Specialty Medicine, University of Bologna, Bologna, Italy
| | | | - Gastone Castellani
- Department of Experimental, Diagnostic and Specialty Medicine, University of Bologna, Bologna, Italy
| | - Brian A Hargreaves
- Department of Radiology, Stanford University, California, United States
- Department of Electrical Engineering, Stanford University, California, United States
- Department of Bioengineering, Stanford University, California, United States
| | - Claudia Testa
- Department of Physics and Astronomy "Augusto Righi", University of Bologna, Bologna, Italy
- IRCCS Istituto delle Scienze Neurologiche di Bologna, Functional and Molecular Neuroimaging Unit, Bologna, Italy
| | - Raffaele Lodi
- IRCCS Istituto delle Scienze Neurologiche di Bologna, Functional and Molecular Neuroimaging Unit, Bologna, Italy
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| | - Daniel Remondini
- Department of Physics and Astronomy "Augusto Righi", University of Bologna, Bologna, Italy
- INFN, Sezione di Bologna, Bologna, Italy
| |
Collapse
|
25
|
Fujita S, Cencini M, Buonincontri G, Takei N, Schulte RF, Fukunaga I, Uchida W, Hagiwara A, Kamagata K, Hagiwara Y, Matsuyama Y, Abe O, Tosetti M, Aoki S. Simultaneous relaxometry and morphometry of human brain structures with 3D magnetic resonance fingerprinting: a multicenter, multiplatform, multifield-strength study. Cereb Cortex 2022; 33:729-739. [PMID: 35271703 PMCID: PMC9890456 DOI: 10.1093/cercor/bhac096] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Revised: 02/10/2022] [Accepted: 02/12/2022] [Indexed: 02/04/2023] Open
Abstract
Relaxation times and morphological information are fundamental magnetic resonance imaging-derived metrics of the human brain that reflect the status of the underlying tissue. Magnetic resonance fingerprinting (MRF) enables simultaneous acquisition of T1 and T2 maps inherently aligned to the anatomy, allowing whole-brain relaxometry and morphometry in a single scan. In this study, we revealed the feasibility of 3D MRF for simultaneous brain structure-wise morphometry and relaxometry. Comprehensive test-retest scan analyses using five 1.5-T and three 3.0-T systems from a single vendor including different scanner types across 3 institutions demonstrated that 3D MRF-derived morphological information and relaxation times are highly repeatable at both 1.5 T and 3.0 T. Regional cortical thickness and subcortical volume values showed high agreement and low bias across different field strengths. The ability to acquire a set of regional T1, T2, thickness, and volume measurements of neuroanatomical structures with high repeatability and reproducibility facilitates the ability of longitudinal multicenter imaging studies to quantitatively monitor changes associated with underlying pathologies, disease progression, and treatments.
Collapse
Affiliation(s)
- Shohei Fujita
- Corresponding author: Department of Radiology, Juntendo University School of Medicine, 12-1 Hongo, Bunkyo, Tokyo 113-8421, Japan.
| | - Matteo Cencini
- Imago7 Foundation, Pisa, Italy,IRCCS Stella Maris, Pisa, Italy
| | | | | | | | - Issei Fukunaga
- Department of Radiology, Juntendo University, Tokyo, Japan
| | - Wataru Uchida
- Department of Radiology, Juntendo University, Tokyo, Japan
| | | | - Koji Kamagata
- Department of Radiology, Juntendo University, Tokyo, Japan
| | - Yasuhiro Hagiwara
- Department of Biostatistics, School of Public Health, The University of Tokyo, Tokyo, Japan
| | - Yutaka Matsuyama
- Department of Biostatistics, School of Public Health, The University of Tokyo, Tokyo, Japan
| | - Osamu Abe
- Department of Radiology, The University of Tokyo, Tokyo, Japan
| | - Michela Tosetti
- Imago7 Foundation, Pisa, Italy,IRCCS Stella Maris, Pisa, Italy
| | - Shigeki Aoki
- Department of Radiology, Juntendo University, Tokyo, Japan
| |
Collapse
|
26
|
Adjacent slices feature transformer network for single anisotropic 3D brain MRI image super-resolution. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103339] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
27
|
Deep robust residual network for super-resolution of 2D fetal brain MRI. Sci Rep 2022; 12:406. [PMID: 35013383 PMCID: PMC8748749 DOI: 10.1038/s41598-021-03979-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2020] [Accepted: 12/06/2021] [Indexed: 01/22/2023] Open
Abstract
Spatial resolution is a key factor of quantitatively evaluating the quality of magnetic resonance imagery (MRI). Super-resolution (SR) approaches can improve its spatial resolution by reconstructing high-resolution (HR) images from low-resolution (LR) ones to meet clinical and scientific requirements. To increase the quality of brain MRI, we study a robust residual-learning SR network (RRLSRN) to generate a sharp HR brain image from an LR input. Due to the Charbonnier loss can handle outliers well, and Gradient Difference Loss (GDL) can sharpen an image, we combined the Charbonnier loss and GDL to improve the robustness of the model and enhance the texture information of SR results. Two MRI datasets of adult brain, Kirby 21 and NAMIC, were used to train and verify the effectiveness of our model. To further verify the generalizability and robustness of the proposed model, we collected eight clinical fetal brain MRI 2D data for evaluation. The experimental results have shown that the proposed deep residual-learning network achieved superior performance and high efficiency over other compared methods.
Collapse
|
28
|
Scan Once, Analyse Many: Using Large Open-Access Neuroimaging Datasets to Understand the Brain. Neuroinformatics 2022; 20:109-137. [PMID: 33974213 PMCID: PMC8111663 DOI: 10.1007/s12021-021-09519-6] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/07/2021] [Indexed: 02/06/2023]
Abstract
We are now in a time of readily available brain imaging data. Not only are researchers now sharing data more than ever before, but additionally large-scale data collecting initiatives are underway with the vision that many future researchers will use the data for secondary analyses. Here I provide an overview of available datasets and some example use cases. Example use cases include examining individual differences, more robust findings, reproducibility-both in public input data and availability as a replication sample, and methods development. I further discuss a variety of considerations associated with using existing data and the opportunities associated with large datasets. Suggestions for further readings on general neuroimaging and topic-specific discussions are also provided.
Collapse
|
29
|
Xia Y, Li L. Hypothesis Testing for Network Data with Power Enhancement. Stat Sin 2022; 32:293-321. [PMID: 35002179 PMCID: PMC8734582 DOI: 10.5705/ss.202019.0361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
Comparing two population means of network data is of paramount importance in a wide range of scientific applications. Numerous existing network inference solutions focus on global testing of entire networks, without comparing individual network links. The observed data often take the form of vectors or matrices, and the problem is formulated as comparing two covariance or precision matrices under a normal or matrix normal distribution. Moreover, many tests suffer from a limited power under a small sample size. In this article, we tackle the problem of network comparison, both global and simultaneous inferences, when the data come in a different format, i.e., in the form of a collection of symmetric matrices, each of which encodes the network structure of an individual subject. Such data format commonly arises in applications such as brain connectivity analysis and clinical genomics. We no longer require the underlying data to follow a normal distribution, but instead impose some moment conditions that are easily satisfied for numerous types of network data. Furthermore, we propose a power enhancement procedure, and show that it can control the false discovery, while it has the potential to substantially enhance the power of the test. We investigate the efficacy of our testing procedure through both an asymptotic analysis and a simulation study under a finite sample size. We further illustrate our method with examples of brain connectivity analysis.
Collapse
Affiliation(s)
- Yin Xia
- Fudan University and University of California at Berkeley
| | - Lexin Li
- Fudan University and University of California at Berkeley
| |
Collapse
|
30
|
Schilling KG, Tax CM, Rheault F, Hansen C, Yang Q, Yeh FC, Cai L, Anderson AW, Landman BA. Fiber tractography bundle segmentation depends on scanner effects, vendor effects, acquisition resolution, diffusion sampling scheme, diffusion sensitization, and bundle segmentation workflow. Neuroimage 2021; 242:118451. [PMID: 34358660 PMCID: PMC9933001 DOI: 10.1016/j.neuroimage.2021.118451] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2021] [Revised: 07/08/2021] [Accepted: 08/03/2021] [Indexed: 01/08/2023] Open
Abstract
When investigating connectivity and microstructure of white matter pathways of the brain using diffusion tractography bundle segmentation, it is important to understand potential confounds and sources of variation in the process. While cross-scanner and cross-protocol effects on diffusion microstructure measures are well described (in particular fractional anisotropy and mean diffusivity), it is unknown how potential sources of variation effect bundle segmentation results, which features of the bundle are most affected, where variability occurs, nor how these sources of variation depend upon the method used to reconstruct and segment bundles. In this study, we investigate six potential sources of variation, or confounds, for bundle segmentation: variation (1) across scan repeats, (2) across scanners, (3) across vendors (4) across acquisition resolution, (5) across diffusion schemes, and (6) across diffusion sensitization. We employ four different bundle segmentation workflows on two benchmark multi-subject cross-scanner and cross-protocol databases, and investigate reproducibility and biases in volume overlap, shape geometry features of fiber pathways, and microstructure features within the pathways. We find that the effects of acquisition protocol, in particular acquisition resolution, result in the lowest reproducibility of tractography and largest variation of features, followed by vendor-effects, scanner-effects, and finally diffusion scheme and b-value effects which had similar reproducibility as scan-rescan variation. However, confounds varied both across pathways and across segmentation workflows, with some bundle segmentation workflows more (or less) robust to sources of variation. Despite variability, bundle dissection is consistently able to recover the same location of pathways in the deep white matter, with variation at the gray matter/ white matter interface. Next, we show that differences due to the choice of bundle segmentation workflows are larger than any other studied confound, with low-to-moderate overlap of the same intended pathway when segmented using different methods. Finally, quantifying microstructure features within a pathway, we show that tractography adds variability over-and-above that which exists due to noise, scanner effects, and acquisition effects. Overall, these confounds need to be considered when harmonizing diffusion datasets, interpreting or combining data across sites, and when attempting to understand the successes and limitations of different methodologies in the design and development of new tractography or bundle segmentation methods.
Collapse
Affiliation(s)
- Kurt G. Schilling
- Department of Radiology & Radiological Science, Vanderbilt University Medical Center, Nashville, TN, United States,Vanderbilt Institute of Imaging Science, Vanderbilt University Medical Center, Nashville, TN, United States
| | - Chantal M.W. Tax
- Cardiff University Brain Research Imaging Centre (CUBRIC), Cardiff University, Cardiff, United Kingdom
| | - Francois Rheault
- Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, United States
| | - Colin Hansen
- Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, United States
| | - Qi Yang
- Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, United States
| | - Fang-Cheng Yeh
- Department of Neurological Surgery, University of Pittsburgh, United States
| | - Leon Cai
- Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, United States
| | - Adam W. Anderson
- Department of Radiology & Radiological Science, Vanderbilt University Medical Center, Nashville, TN, United States,Vanderbilt Institute of Imaging Science, Vanderbilt University Medical Center, Nashville, TN, United States,Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, United States
| | - Bennett A. Landman
- Department of Radiology & Radiological Science, Vanderbilt University Medical Center, Nashville, TN, United States,Vanderbilt Institute of Imaging Science, Vanderbilt University Medical Center, Nashville, TN, United States,Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, United States,Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, United States
| |
Collapse
|
31
|
Ledesma S, Ibarra-Manzano MA, Almanza-Ojeda DL, Fallavollita P, Steffener J. Artificial Intelligence to Analyze the Cortical Thickness Through Age. Front Artif Intell 2021; 4:549255. [PMID: 34723171 PMCID: PMC8548778 DOI: 10.3389/frai.2021.549255] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2020] [Accepted: 08/30/2021] [Indexed: 11/30/2022] Open
Abstract
In this study, Artificial Intelligence was used to analyze a dataset containing the cortical thickness from 1,100 healthy individuals. This dataset had the cortical thickness from 31 regions in the left hemisphere of the brain as well as from 31 regions in the right hemisphere. Then, 62 artificial neural networks were trained and validated to estimate the number of neurons in the hidden layer. These neural networks were used to create a model for the cortical thickness through age for each region in the brain. Using the artificial neural networks and kernels with seven points, numerical differentiation was used to compute the derivative of the cortical thickness with respect to age. The derivative was computed to estimate the cortical thickness speed. Finally, color bands were created for each region in the brain to identify a positive derivative, that is, a part of life with an increase in cortical thickness. Likewise, the color bands were used to identify a negative derivative, that is, a lifetime period with a cortical thickness reduction. Regions of the brain with similar derivatives were organized and displayed in clusters. Computer simulations showed that some regions exhibit abrupt changes in cortical thickness at specific periods of life. The simulations also illustrated that some regions in the left hemisphere do not follow the pattern of the same region in the right hemisphere. Finally, it was concluded that each region in the brain must be dynamically modeled. One advantage of using artificial neural networks is that they can learn and model non-linear and complex relationships. Also, artificial neural networks are immune to noise in the samples and can handle unseen data. That is, the models based on artificial neural networks can predict the behavior of samples that were not used for training. Furthermore, several studies have shown that artificial neural networks are capable of deriving information from imprecise data. Because of these advantages, the results obtained in this study by the artificial neural networks provide valuable information to analyze and model the cortical thickness.
Collapse
Affiliation(s)
- Sergio Ledesma
- Faculty of Health Sciences, University of Ottawa, Ottawa, ON, Canada.,School of Engineering, University of Guanajuato, Guanajuato, Mexico
| | | | | | | | - Jason Steffener
- Faculty of Health Sciences, University of Ottawa, Ottawa, ON, Canada
| |
Collapse
|
32
|
Schilling KG, Rheault F, Petit L, Hansen CB, Nath V, Yeh FC, Girard G, Barakovic M, Rafael-Patino J, Yu T, Fischi-Gomez E, Pizzolato M, Ocampo-Pineda M, Schiavi S, Canales-Rodríguez EJ, Daducci A, Granziera C, Innocenti G, Thiran JP, Mancini L, Wastling S, Cocozza S, Petracca M, Pontillo G, Mancini M, Vos SB, Vakharia VN, Duncan JS, Melero H, Manzanedo L, Sanz-Morales E, Peña-Melián Á, Calamante F, Attyé A, Cabeen RP, Korobova L, Toga AW, Vijayakumari AA, Parker D, Verma R, Radwan A, Sunaert S, Emsell L, De Luca A, Leemans A, Bajada CJ, Haroon H, Azadbakht H, Chamberland M, Genc S, Tax CMW, Yeh PH, Srikanchana R, Mcknight CD, Yang JYM, Chen J, Kelly CE, Yeh CH, Cochereau J, Maller JJ, Welton T, Almairac F, Seunarine KK, Clark CA, Zhang F, Makris N, Golby A, Rathi Y, O'Donnell LJ, Xia Y, Aydogan DB, Shi Y, Fernandes FG, Raemaekers M, Warrington S, Michielse S, Ramírez-Manzanares A, Concha L, Aranda R, Meraz MR, Lerma-Usabiaga G, Roitman L, Fekonja LS, Calarco N, Joseph M, Nakua H, Voineskos AN, Karan P, Grenier G, Legarreta JH, Adluru N, Nair VA, Prabhakaran V, Alexander AL, Kamagata K, Saito Y, Uchida W, Andica C, Abe M, Bayrak RG, Wheeler-Kingshott CAMG, D'Angelo E, Palesi F, Savini G, Rolandi N, Guevara P, Houenou J, López-López N, Mangin JF, Poupon C, Román C, Vázquez A, Maffei C, Arantes M, Andrade JP, Silva SM, Calhoun VD, Caverzasi E, Sacco S, Lauricella M, Pestilli F, Bullock D, Zhan Y, Brignoni-Perez E, Lebel C, Reynolds JE, Nestrasil I, Labounek R, Lenglet C, Paulson A, Aulicka S, Heilbronner SR, Heuer K, Chandio BQ, Guaje J, Tang W, Garyfallidis E, Raja R, Anderson AW, Landman BA, Descoteaux M. Tractography dissection variability: What happens when 42 groups dissect 14 white matter bundles on the same dataset? Neuroimage 2021; 243:118502. [PMID: 34433094 PMCID: PMC8855321 DOI: 10.1016/j.neuroimage.2021.118502] [Citation(s) in RCA: 74] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2020] [Revised: 08/10/2021] [Accepted: 08/21/2021] [Indexed: 10/20/2022] Open
Abstract
White matter bundle segmentation using diffusion MRI fiber tractography has become the method of choice to identify white matter fiber pathways in vivo in human brains. However, like other analyses of complex data, there is considerable variability in segmentation protocols and techniques. This can result in different reconstructions of the same intended white matter pathways, which directly affects tractography results, quantification, and interpretation. In this study, we aim to evaluate and quantify the variability that arises from different protocols for bundle segmentation. Through an open call to users of fiber tractography, including anatomists, clinicians, and algorithm developers, 42 independent teams were given processed sets of human whole-brain streamlines and asked to segment 14 white matter fascicles on six subjects. In total, we received 57 different bundle segmentation protocols, which enabled detailed volume-based and streamline-based analyses of agreement and disagreement among protocols for each fiber pathway. Results show that even when given the exact same sets of underlying streamlines, the variability across protocols for bundle segmentation is greater than all other sources of variability in the virtual dissection process, including variability within protocols and variability across subjects. In order to foster the use of tractography bundle dissection in routine clinical settings, and as a fundamental analytical tool, future endeavors must aim to resolve and reduce this heterogeneity. Although external validation is needed to verify the anatomical accuracy of bundle dissections, reducing heterogeneity is a step towards reproducible research and may be achieved through the use of standard nomenclature and definitions of white matter bundles and well-chosen constraints and decisions in the dissection process.
Collapse
Affiliation(s)
- Kurt G Schilling
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, TN, United States.
| | | | - Laurent Petit
- Groupe dImagerie Neurofonctionnelle, Institut Des Maladies Neurodegeneratives, CNRS, CEA University of Bordeaux, Bordeaux, France
| | - Colin B Hansen
- Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, United States
| | - Vishwesh Nath
- Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, United States
| | - Fang-Cheng Yeh
- Department of Neurological Surgery, University of Pittsburgh, Pittsburgh, PA, United States
| | - Gabriel Girard
- CIBM Center for BioMedical Imaging, Lausanne, Switzerland
| | - Muhamed Barakovic
- Translational Imaging in Neurology (ThINK), Department of Medicine and Biomedical Engineering, University Hospital and University of Basel, Basel, Switzerland
| | - Jonathan Rafael-Patino
- Signal Processing Lab (LTS5), École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Thomas Yu
- Signal Processing Lab (LTS5), École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Elda Fischi-Gomez
- Signal Processing Lab (LTS5), École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Marco Pizzolato
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, Kongens Lyngby, Denmark
| | | | - Simona Schiavi
- Department of Computer Science, University of Verona, Italy
| | | | | | - Cristina Granziera
- Translational Imaging in Neurology (ThINK), Department of Medicine and Biomedical Engineering, University Hospital and University of Basel, Basel, Switzerland
| | - Giorgio Innocenti
- Department of Neuroscience, Karolinska Institutet, Stockholm, Sweden
| | - Jean-Philippe Thiran
- Signal Processing Lab (LTS5), École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Laura Mancini
- Lysholm Department of Neuroradiology, National Hospital for Neurology & Neurosurgery, UCL Hospitals NHS Foundation Trust, London, United Kingdom
| | - Stephen Wastling
- Lysholm Department of Neuroradiology, National Hospital for Neurology & Neurosurgery, UCL Hospitals NHS Foundation Trust, London, United Kingdom
| | - Sirio Cocozza
- Department of Advanced Biomedical Sciences, University "Federico II", Naples, Italy
| | - Maria Petracca
- Department of Neurosciences and Reproductive and Odontostomatological Sciences, University "Federico II", Naples, Italy
| | - Giuseppe Pontillo
- Department of Advanced Biomedical Sciences, University "Federico II", Naples, Italy
| | - Matteo Mancini
- Department of Neuroscience, Brighton and Sussex Medical School, University of Sussex, Brighton, United Kingdom
| | - Sjoerd B Vos
- Centre for Medical Image Computing, University College London, London, United Kingdom
| | - Vejay N Vakharia
- Department of Clinical and Experimental Epilepsy, University College London, London, United Kingdom
| | - John S Duncan
- Epilepsy Society MRI Unit, Chalfont St Peter, United Kingdom
| | - Helena Melero
- Departamento de Psicobiología y Metodología en Ciencias del Comportamiento - Universidad Complutense de Madrid, Spain Laboratorio de Análisis de Imagen Médica y Biometría (LAIMBIO), Universidad Rey Juan Carlos, Madrid, Spain
| | - Lidia Manzanedo
- Facultad de Ciencias de la Salud, Universidad Rey Juan Carlos, Madrid, Spain
| | - Emilio Sanz-Morales
- Laboratorio de Análisis de Imagen Médica y Biometría (LAIMBIO), Universidad Rey Juan Carlos, Madrid, Spain
| | - Ángel Peña-Melián
- Departamento de Anatomía, Facultad de Medicina, Universidad Complutense de Madrid, Madrid, Spain
| | - Fernando Calamante
- Sydney Imaging and School of Biomedical Engineering, The University of Sydney, Sydney, Australia
| | - Arnaud Attyé
- School of Biomedical Engineering, The University of Sydney, Sydney, Australia
| | - Ryan P Cabeen
- Laboratory of Neuro Imaging, Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of USC, University of Southern California, Los Angeles, CA, United States
| | - Laura Korobova
- Center for Integrative Connectomics, Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of USC, University of Southern California, Los Angeles, CA, United States
| | - Arthur W Toga
- Laboratory of Neuro Imaging, Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of USC, University of Southern California, Los Angeles, CA, United States
| | | | - Drew Parker
- Department of Radiology, University of Pennsylvania, Philadelphia, PA, United States
| | - Ragini Verma
- Department of Radiology, University of Pennsylvania, Philadelphia, PA, United States
| | - Ahmed Radwan
- KU Leuven, Department of Imaging and Pathology, Translational MRI, B-3000, Leuven, Belgium
| | - Stefan Sunaert
- KU Leuven, Department of Imaging and Pathology, Translational MRI, B-3000, Leuven, Belgium
| | - Louise Emsell
- KU Leuven, Department of Imaging and Pathology, Translational MRI, B-3000, Leuven, Belgium
| | | | | | - Claude J Bajada
- Department of Physiology and Biochemistry, Faculty of Medicine and Surgery, University of Malta, Malta
| | - Hamied Haroon
- Division of Neuroscience & Experimental Psychology, Faculty of Biology, Medicine and Health, The University of Manchester, Manchester Academic Health Science Centre, Manchester, United Kingdom
| | | | - Maxime Chamberland
- Cardiff University Brain Research Imaging Centre (CUBRIC), Cardiff University, Cardiff, United Kingdom
| | - Sila Genc
- Cardiff University Brain Research Imaging Centre (CUBRIC), Cardiff University, Cardiff, United Kingdom
| | - Chantal M W Tax
- Cardiff University Brain Research Imaging Centre (CUBRIC), Cardiff University, Cardiff, United Kingdom
| | - Ping-Hong Yeh
- National Intrepid Center of Excellence, Walter Reed National Military Medical Center, Bethesda, MD, USA
| | - Rujirutana Srikanchana
- National Intrepid Center of Excellence, Walter Reed National Military Medical Center, Bethesda, MD, USA
| | - Colin D Mcknight
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, TN, United States
| | - Joseph Yuan-Mou Yang
- Department of Neurosurgery, Neuroscience Advanced Clinical Imaging Suite (NACIS), Royal Children's Hospital, Parkville, Melbourne, Australia
| | - Jian Chen
- Developmental Imaging, Murdoch Children's Research Institute, Melbourne, Australia
| | - Claire E Kelly
- Victorian Infant Brain Studies, Murdoch Children's Research Institute, Melbourne, Australia
| | - Chun-Hung Yeh
- Institute for Radiological Research, Chang Gung University & Chang Gung Memorial Hospital, Taoyuan, Taiwan
| | | | - Jerome J Maller
- MRI Clinical Science Specialist, General Electric Healthcare, Australia
| | | | - Fabien Almairac
- Neurosurgery department, Hôpital Pasteur, University Hospital of Nice, Côte d'Azur University, France
| | - Kiran K Seunarine
- Developmental Imaging and Biophysics Section, UCL GOS Institute of Child Health, London
| | - Chris A Clark
- Developmental Imaging and Biophysics Section, UCL GOS Institute of Child Health, London
| | - Fan Zhang
- Brigham & Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Nikos Makris
- Brigham & Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Alexandra Golby
- Brigham & Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Yogesh Rathi
- Brigham & Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Lauren J O'Donnell
- Brigham & Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Yihao Xia
- University of Southern California, Keck School of Medicine, Neuroimaging and Informatics Institute, Los Angeles, California, United States
| | - Dogu Baran Aydogan
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
| | - Yonggang Shi
- University of Southern California, Keck School of Medicine, Neuroimaging and Informatics Institute, Los Angeles, California, United States
| | | | - Mathijs Raemaekers
- UMC Utrecht Brain Center, Department of Neurology&Neurosurgery, Utrecht, the Netherlands
| | - Shaun Warrington
- Sir Peter Mansfield Imaging Centre, School of Medicine, University of Nottingham, UK
| | - Stijn Michielse
- Department of Neurosurgery, School for Mental Health and Neuroscience, Maastricht University
| | | | - Luis Concha
- Universidad Nacional Autonoma de Mexico, Institute of Neurobiology, Mexico City, Mexico
| | - Ramón Aranda
- Centro de Investigación Científica y de Educación Superior de Ensenada (CICESE-UT3), Cátedras-CONACyT, Ensenada, Mexico
| | | | | | - Lucas Roitman
- Department of Psychology, Stanford University, Stanford, California, USA
| | - Lucius S Fekonja
- Department of Neurosurgery, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Navona Calarco
- Kimel Family Translational Imaging-Genetics Laboratory, Research Imaging Centre, Centre for Addiction and Mental Health, Toronto, Ontario
| | - Michael Joseph
- Kimel Family Translational Imaging-Genetics Laboratory, Research Imaging Centre, Centre for Addiction and Mental Health, Toronto, Ontario
| | - Hajer Nakua
- Kimel Family Translational Imaging-Genetics Laboratory, Research Imaging Centre, Centre for Addiction and Mental Health, Toronto, Ontario
| | - Aristotle N Voineskos
- Kimel Family Translational Imaging-Genetics Laboratory, Research Imaging Centre, Centre for Addiction and Mental Health, Toronto, Ontario
| | | | | | | | | | - Veena A Nair
- University of Wisconsin-Madison, Madison, WI, USA
| | | | | | - Koji Kamagata
- Department of Radiology, Juntendo University Graduate School of Medicine, Tokyo Japan
| | - Yuya Saito
- Department of Radiology, Juntendo University Graduate School of Medicine, Tokyo Japan
| | - Wataru Uchida
- Department of Radiology, Juntendo University Graduate School of Medicine, Tokyo Japan
| | - Christina Andica
- Department of Radiology, Juntendo University Graduate School of Medicine, Tokyo Japan
| | - Masahiro Abe
- Department of Radiology, Juntendo University Graduate School of Medicine, Tokyo Japan
| | - Roza G Bayrak
- Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, United States
| | - Claudia A M Gandini Wheeler-Kingshott
- NMR Research Unit, Queen Square MS Centre, Department of Neuroinflammation, UCL Queen Square Institute of Neurology, Faculty of Brain Sciences, University College London, London, United Kingdom
| | - Egidio D'Angelo
- Department of Brain and Behavioral Sciences, University of Pavia, Italy
| | - Fulvia Palesi
- Department of Brain and Behavioral Sciences, University of Pavia, Italy
| | - Giovanni Savini
- Brain MRI 3T Research Center, IRCCS Mondino Foundation, Pavia, Italy
| | - Nicolò Rolandi
- Department of Brain and Behavioral Sciences, University of Pavia, Italy
| | - Pamela Guevara
- Universidad de Concepción, Faculty of Engineering, Concepción, Chile
| | - Josselin Houenou
- Université Paris-Saclay, CEA, CNRS, Neurospin, Gif-sur-Yvette, France
| | | | | | - Cyril Poupon
- Université Paris-Saclay, CEA, CNRS, Neurospin, Gif-sur-Yvette, France
| | - Claudio Román
- Universidad de Concepción, Faculty of Engineering, Concepción, Chile
| | - Andrea Vázquez
- Universidad de Concepción, Faculty of Engineering, Concepción, Chile
| | - Chiara Maffei
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Mavilde Arantes
- Department of Biomedicine, Unit of Anatomy, Faculty of Medicine of the University of Porto, Al. Professor Hernâni Monteiro, Porto, Portugal
| | - José Paulo Andrade
- Department of Biomedicine, Unit of Anatomy, Faculty of Medicine of the University of Porto, Al. Professor Hernâni Monteiro, Porto, Portugal
| | - Susana Maria Silva
- Department of Biomedicine, Unit of Anatomy, Faculty of Medicine of the University of Porto, Al. Professor Hernâni Monteiro, Porto, Portugal
| | - Vince D Calhoun
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA 30303, United States
| | - Eduardo Caverzasi
- Neurology Department UCSF Weill Institute for Neurosciences, University of California, San Francisco
| | - Simone Sacco
- Neurology Department UCSF Weill Institute for Neurosciences, University of California, San Francisco
| | - Michael Lauricella
- Memory and Aging Center. UCSF Weill Institute for Neurosciences, University of California, San Francisco, USA
| | - Franco Pestilli
- Department of Psychology, The University of Texas at Austin, TX 78731, USA
| | - Daniel Bullock
- Department of Psychology, The University of Texas at Austin, TX 78731, USA
| | - Yang Zhan
- Brain Cognition and Brain Disease Institute, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Edith Brignoni-Perez
- Developmental-Behavioral Pediatrics Division, Department of Pediatrics, Stanford School of Medicine, Stanford, CA, United States
| | - Catherine Lebel
- Department of Radiology, University of Calgary, 2500 University Drive NW, Calgary, AB, Canada, T2N 1N4
| | - Jess E Reynolds
- Department of Radiology, University of Calgary, 2500 University Drive NW, Calgary, AB, Canada, T2N 1N4
| | - Igor Nestrasil
- Division of Clinical Behavioral Neuroscience, Department of Pediatrics, University of Minnesota, Minneapolis, MN, USA
| | - René Labounek
- Division of Clinical Behavioral Neuroscience, Department of Pediatrics, University of Minnesota, Minneapolis, MN, USA
| | - Christophe Lenglet
- Center for Magnetic Resonance Research, Department of Radiology, University of Minnesota, Minneapolis, MN, USA
| | - Amy Paulson
- Division of Clinical Behavioral Neuroscience, Department of Pediatrics, University of Minnesota, Minneapolis, MN, USA
| | - Stefania Aulicka
- Department of Paediatric Neurology, University Hospital and Medicine Faculty, Masaryk University, Brno, Czech Republic
| | | | - Katja Heuer
- Center for Research and Interdisciplinarity (CRI), INSERM U1284, Université de Paris, Paris, France
| | - Bramsh Qamar Chandio
- Department of Intelligent Systems Engineering, Indiana University, Bloomington, IN, USA
| | - Javier Guaje
- Department of Intelligent Systems Engineering, Indiana University, Bloomington, IN, USA
| | - Wei Tang
- Department of Computer Science, Indiana University, Bloomington, IN, USA
| | | | - Rajikha Raja
- University of Arkansas for Medical Sciences, Little Rock, AR, USA
| | - Adam W Anderson
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Bennett A Landman
- Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN, United States
| | | |
Collapse
|
33
|
The effect of noise on the synchronization dynamics of the Kuramoto model on a large human connectome graph. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2020.04.161] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
|
34
|
Miao X, Paez AG, Rajan S, Cao D, Liu D, Pantelyat AY, Rosenthal LI, van Zijl PCM, Bassett SS, Yousem DM, Kamath V, Hua J. Functional Activities Detected in the Olfactory Bulb and Associated Olfactory Regions in the Human Brain Using T2-Prepared BOLD Functional MRI at 7T. Front Neurosci 2021; 15:723441. [PMID: 34588949 PMCID: PMC8476065 DOI: 10.3389/fnins.2021.723441] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Accepted: 08/16/2021] [Indexed: 11/17/2022] Open
Abstract
Olfaction is a fundamental sense that plays a vital role in daily life in humans, and can be altered in neuropsychiatric and neurodegenerative diseases. Blood oxygenation level-dependent (BOLD) functional magnetic resonance imaging (fMRI) using conventional echo-planar-imaging (EPI) based sequences can be challenging in brain regions important for olfactory processing, such as the olfactory bulb (OB) and orbitofrontal cortex, mainly due to the signal dropout and distortion artifacts caused by large susceptibility effects from the sinonasal cavity and temporal bone. To date, few studies have demonstrated successful fMRI in the OB in humans. T2-prepared (T2prep) BOLD fMRI is an alternative approach developed especially for performing fMRI in regions affected by large susceptibility artifacts. The purpose of this technical study is to evaluate T2prep BOLD fMRI for olfactory functional experiments in humans. Olfactory fMRI scans were performed on 7T in 14 healthy participants. T2prep BOLD showed greater sensitivity than GRE EPI BOLD in the OB, orbitofrontal cortex and the temporal pole. Functional activation was detected using T2prep BOLD in the OB and associated olfactory regions. Habituation effects and a bi-phasic pattern of fMRI signal changes during olfactory stimulation were observed in all regions. Both positively and negatively activated regions were observed during olfactory stimulation. These signal characteristics are generally consistent with literature and showed a good intra-subject reproducibility comparable to previous human BOLD fMRI studies. In conclusion, the methodology demonstrated in this study holds promise for future olfactory fMRI studies in the OB and other brain regions that suffer from large susceptibility artifacts.
Collapse
Affiliation(s)
- Xinyuan Miao
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, School of Medicine, Johns Hopkins University, Baltimore, MD, United States.,F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Adrian G Paez
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, School of Medicine, Johns Hopkins University, Baltimore, MD, United States.,F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Suraj Rajan
- Department of Neurology, School of Medicine, Johns Hopkins University, Baltimore, MD, United States
| | - Di Cao
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, School of Medicine, Johns Hopkins University, Baltimore, MD, United States.,F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States.,Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States
| | - Dapeng Liu
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, School of Medicine, Johns Hopkins University, Baltimore, MD, United States.,F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Alex Y Pantelyat
- Department of Neurology, School of Medicine, Johns Hopkins University, Baltimore, MD, United States
| | - Liana I Rosenthal
- Department of Neurology, School of Medicine, Johns Hopkins University, Baltimore, MD, United States
| | - Peter C M van Zijl
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, School of Medicine, Johns Hopkins University, Baltimore, MD, United States.,F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| | - Susan S Bassett
- Department of Psychiatry and Behavioral Sciences, School of Medicine, Johns Hopkins University, Baltimore, MD, United States
| | - David M Yousem
- Department of Radiology, Johns Hopkins Hospital, Baltimore, MD, United States
| | - Vidyulata Kamath
- Department of Psychiatry and Behavioral Sciences, School of Medicine, Johns Hopkins University, Baltimore, MD, United States
| | - Jun Hua
- Neurosection, Division of MRI Research, Russell H. Morgan Department of Radiology and Radiological Science, School of Medicine, Johns Hopkins University, Baltimore, MD, United States.,F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
| |
Collapse
|
35
|
Wang L, Du J, Gholipour A, Zhu H, He Z, Jia Y. 3D dense convolutional neural network for fast and accurate single MR image super-resolution. Comput Med Imaging Graph 2021; 93:101973. [PMID: 34543775 DOI: 10.1016/j.compmedimag.2021.101973] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2020] [Revised: 07/13/2021] [Accepted: 08/17/2021] [Indexed: 10/20/2022]
Abstract
Super-resolution (SR) MR image reconstruction has shown to be a very promising direction to improve the spatial resolution of low-resolution (LR) MR images. In this paper, we presented a novel MR image SR method based on a dense convolutional neural network (DDSR), and its enhanced version called EDDSR. There are three major innovations: first, we re-designed dense modules to extract hierarchical features directly from LR images and propagate the extracted feature maps through dense connections. Therefore, unlike other CNN-based SR MR techniques that upsample LR patches in the initial phase, our methods take the original LR images or patches as input. This effectively reduces computational complexity and speeds up SR reconstruction. Second, a final deconvolution filter in our model automatically learns filters to fuse and upscale all hierarchical feature maps to generate HR MR images. Using this, EDDSR can perform SR reconstructions at different upscale factors using a single model with one stride fixed deconvolution operation. Third, to further improve SR reconstruction accuracy, we exploited a geometric self-ensemble strategy. Experimental results on three benchmark datasets demonstrate that our methods, DDSR and EDDSR, achieved superior performance compared to state-of-the-art MR image SR methods with less computational load and memory usage.
Collapse
Affiliation(s)
- Lulu Wang
- College of Computer Science, Chongqing University, Chongqing 400044, China.
| | - Jinglong Du
- College of Computer Science, Chongqing University, Chongqing 400044, China.
| | - Ali Gholipour
- Department of Radiology, Boston Children's Hospital, Harvard Medical School, Boston, MA 02115, USA.
| | - Huazheng Zhu
- College of Intelligent Technology and Engineering, Chongqing University of Science and Technology, Chongqing 401331, China.
| | - Zhongshi He
- College of Computer Science, Chongqing University, Chongqing 400044, China.
| | - Yuanyuan Jia
- College of Medical Informatics, Chongqing Medical University, Chongqing 400016, China; Medical Data Science Academy, Chongqing Medical University, Chongqing 400016, China.
| |
Collapse
|
36
|
A deep learning approach for magnetic resonance fingerprinting: Scaling capabilities and good training practices investigated by simulations. Phys Med 2021; 89:80-92. [PMID: 34352679 DOI: 10.1016/j.ejmp.2021.07.013] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Revised: 07/12/2021] [Accepted: 07/13/2021] [Indexed: 11/22/2022] Open
Abstract
MR fingerprinting (MRF) is an innovative approach to quantitative MRI. A typical disadvantage of dictionary-based MRF is the explosive growth of the dictionary as a function of the number of reconstructed parameters, an instance of the curse of dimensionality, which determines an explosion of resource requirements. In this work, we describe a deep learning approach for MRF parameter map reconstruction using a fully connected architecture. Employing simulations, we have investigated how the performance of the Neural Networks (NN) approach scales with the number of parameters to be retrieved, compared to the standard dictionary approach. We have also studied optimal training procedures by comparing different strategies for noise addition and parameter space sampling, to achieve better accuracy and robustness to noise. Four MRF sequences were considered: IR-FISP, bSSFP, IR-FISP-B1, and IR-bSSFP-B1. A comparison between NN and the dictionary approaches in reconstructing parameter maps as a function of the number of parameters to be retrieved was performed using a numerical brain phantom. Results demonstrated that training with random sampling and different levels of noise variance yielded the best performance. NN performance was at least as good as the dictionary-based approach in reconstructing parameter maps using Gaussian noise as a source of artifacts: the difference in performance increased with the number of estimated parameters because the dictionary method suffers from the coarse resolution of the parameter space sampling. The NN proved to be more efficient in memory usage and computational burden, and has great potential for solving large-scale MRF problems.
Collapse
|
37
|
Temporal Dynamics of Brain White Matter Plasticity in Sighted Subjects during Tactile Braille Learning: A Longitudinal Diffusion Tensor Imaging Study. J Neurosci 2021; 41:7076-7085. [PMID: 34253624 DOI: 10.1523/jneurosci.2242-20.2021] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2020] [Revised: 05/05/2021] [Accepted: 06/08/2021] [Indexed: 12/26/2022] Open
Abstract
The white matter (WM) architecture of the human brain changes in response to training, though fine-grained temporal characteristics of training-induced white matter plasticity remain unexplored. We investigated white matter microstructural changes using diffusion tensor imaging at five different time points in 26 sighted female adults during 8 months of training on tactile braille reading. Our results show that training-induced white matter plasticity occurs both within and beyond the trained sensory modality, as reflected by fractional anisotropy (FA) increases in somatosensory and visual cortex, respectively. The observed changes followed distinct time courses, with gradual linear FA increase along the training in the somatosensory cortex and sudden visual cortex cross-modal plasticity occurring after braille input became linguistically meaningful. WM changes observed in these areas returned to baseline after the cessation of learning in line with the supply-demand model of plasticity. These results also indicate that the temporal dynamics of microstructural plasticity in different cortical regions might be modulated by the nature of computational demands. We provide additional evidence that observed FA training-induced changes are behaviorally relevant to tactile reading. Together, these results demonstrate that WM plasticity is a highly dynamic process modulated by the introduction of novel experiences.SIGNIFICANCE STATEMENT Throughout the lifetime the human brain is shaped by various experiences. Training-induced reorganization in white matter (WM) microstructure has been reported, but we know little about its temporal dynamics. To fill this gap, we scanned sighted subjects five times during tactile braille reading training. We observed different dynamics of WM plasticity in the somatosensory and visual cortices implicated in braille reading. The former showed a continuous increase in WM tissue anisotropy along with tactile training, while microstructural changes in the latter were observed only after the participants learned to read braille words. Our results confirm the supply-demand model of brain plasticity and provide evidence that WM reorganization depends on distinct computational demands and functional roles of regions involved in the trained skill.
Collapse
|
38
|
A deep cascade of ensemble of dual domain networks with gradient-based T1 assistance and perceptual refinement for fast MRI reconstruction. Comput Med Imaging Graph 2021; 91:101942. [PMID: 34087612 DOI: 10.1016/j.compmedimag.2021.101942] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2020] [Revised: 05/03/2021] [Accepted: 05/14/2021] [Indexed: 11/23/2022]
Abstract
Deep learning networks have shown promising results in fast magnetic resonance imaging (MRI) reconstruction. In our work, we develop deep networks to further improve the quantitative and the perceptual quality of reconstruction. To begin with, we propose reconsynergynet (RSN), a network that combines the complementary benefits of independently operating on both the image and the Fourier domain. For a single-coil acquisition, we introduce deep cascade RSN (DC-RSN), a cascade of RSN blocks interleaved with data fidelity (DF) units. Secondly, we improve the structure recovery of DC-RSN for T2 weighted Imaging (T2WI) through assistance of T1 weighted imaging (T1WI), a sequence with short acquisition time. T1 assistance is provided to DC-RSN through a gradient of log feature (GOLF) fusion. Furthermore, we propose perceptual refinement network (PRN) to refine the reconstructions for better visual information fidelity (VIF), a metric highly correlated to radiologist's opinion on the image quality. Lastly, for multi-coil acquisition, we propose variable splitting RSN (VS-RSN), a deep cascade of blocks, each block containing RSN, multi-coil DF unit, and a weighted average module. We extensively validate our models DC-RSN and VS-RSN for single-coil and multi-coil acquisitions and report the state-of-the-art performance. We obtain a SSIM of 0.768, 0.923, and 0.878 for knee single-coil-4x, multi-coil-4x, and multi-coil-8x in fastMRI, respectively. We also conduct experiments to demonstrate the efficacy of GOLF based T1 assistance and PRN.
Collapse
|
39
|
Quantitative comparison of subcortical and ventricular volumetry derived from MPRAGE and MP2RAGE images using different brain morphometry software. MAGNETIC RESONANCE MATERIALS IN PHYSICS BIOLOGY AND MEDICINE 2021; 34:903-914. [PMID: 34052900 DOI: 10.1007/s10334-021-00933-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/01/2021] [Revised: 05/07/2021] [Accepted: 05/19/2021] [Indexed: 10/21/2022]
Abstract
OBJECTIVE In brain volume assessment with MR imaging, it is of interest to know the effects of the pulse sequence and software used, to determine whether they provide equivalent data. The aim of this study was to compare cross-sectional volumes of subcortical and ventricular structures and their repeatability derived from MP2RAGE and MPRAGE images using MorphoBox, and FIRST or ALVIN. MATERIALS AND METHODS MPRAGE and MP2RAGE T1-weighted images were obtained from 24 healthy volunteers. Back-to-back scans were performed in 12 of them. Volumes, coefficients of variation, concordance, and correlations were determined. RESULTS Significant differences were found for volumes derived from MorphoBox and FIRST. Ventricular volumes determined by MorphoBox and ALVIN were similar. Differences between volumes obtained using MPRAGE and MP2RAGE were significant for a few regions. Coefficients of variation, ranged from 0.2 to 9.1%, showed a significant inverse correlation with the mean volume. There was a correlation between volume measures, but agreement was rated as poor for most regions. CONCLUSION MP2RAGE sequences and MorphoBox are valid options for assessing subcortical and ventricular volumes, in the same way as MPRAGE and FIRST or ALVIN, accepted tools for clinical research. However, caution is needed when comparing volumes obtained with different tools.
Collapse
|
40
|
Velázquez J, Mateos J, Pasaye EH, Barrios FA, Marquez-Flores JA. Cortical Thickness Estimation: A Comparison of FreeSurfer and Three Voxel-Based Methods in a Test-Retest Analysis and a Clinical Application. Brain Topogr 2021; 34:430-441. [PMID: 34008053 DOI: 10.1007/s10548-021-00852-2] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2020] [Accepted: 05/10/2021] [Indexed: 11/28/2022]
Abstract
The cortical thickness has been used as a biomarker to assess different cerebral conditions and to detect alterations in the cortical mantle. In this work, we compare methods from the FreeSurfer software, the Computational Anatomy Toolbox (CAT12), a Laplacian approach and a new method here proposed, based on the Euclidean Distance Transform (EDT), and its corresponding computational phantom designed to validate the calculation algorithm. At region of interest (ROI) level, within- and inter-method comparisons were carried out with a test-retest analysis, in a subset comprising 21 healthy subjects taken from the Multi-Modal MRI Reproducibility Resource (MMRR) dataset. From the Minimal Interval Resonance Imaging in Alzheimer's Disease (MIRIAD) data, classification methods were compared in their performance to detect cortical thickness differences between 23 healthy controls (HC) and 45 subjects with Alzheimer's disease (AD). The validation of the proposed EDT-based method showed a more accurate and precise distance measurement as voxel resolution increased. For the within-method comparisons, mean test-retest measures (percentages differences/intraclass correlation/Pearson correlation) were similar for FreeSurfer (1.80%/0.90/0.95), CAT12 (1.91%/0.83/0.91), Laplacian (1.27%/0.89/0.95) and EDT (2.20%/0.88/0.94). Inter-method correlations showed moderate to strong values (R > 0.77) and, in the AD comparison study, all methods were able to detect cortical alterations between groups. Surface- and voxel-based methods have advantages and drawbacks regarding computational demands and measurement precision, while thickness definition was mainly associated to the cortical thickness absolute differences among methods. However, for each method, measurements were reliable, followed similar trends along the cortex and allowed detection of cortical atrophies between HC and patients with AD.
Collapse
Affiliation(s)
- Juan Velázquez
- Universidad Nacional Autónoma de México, Instituto de Ciencias Aplicadas Y Tecnología, Circuito Exterior S/N, Ciudad Universitaria, 04510, Coyoacán, Mexico City, México
| | - Julieta Mateos
- Graduate Program in Computer Science and Engineering, Universidad Nacional Autónoma de México, Ciudad Universitaria, 04510, Coyoacán, Ciudad de México, México
| | - Erick H Pasaye
- Universidad Nacional Autónoma de México, Instituto de Neurobiología, Boulevar Juriquilla 3001, 76230, Querétaro, Querétaro, México
| | - Fernando A Barrios
- Universidad Nacional Autónoma de México, Instituto de Neurobiología, Boulevar Juriquilla 3001, 76230, Querétaro, Querétaro, México.
| | - Jorge A Marquez-Flores
- Universidad Nacional Autónoma de México, Instituto de Ciencias Aplicadas Y Tecnología, Circuito Exterior S/N, Ciudad Universitaria, 04510, Coyoacán, Mexico City, México.
| |
Collapse
|
41
|
Klinkmueller P, Kronenbuerger M, Miao X, Bang J, Ultz KE, Paez A, Zhang X, Duan W, Margolis RL, van Zijl PCM, Ross CA, Hua J. Impaired response of cerebral oxygen metabolism to visual stimulation in Huntington's disease. J Cereb Blood Flow Metab 2021; 41:1119-1130. [PMID: 32807001 PMCID: PMC8054727 DOI: 10.1177/0271678x20949286] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/28/2020] [Revised: 06/30/2020] [Accepted: 07/15/2020] [Indexed: 01/29/2023]
Abstract
Huntington's disease (HD) is a neurodegenerative disease caused by a CAG triplet repeat expansion in the Huntingtin gene. Metabolic and microvascular abnormalities in the brain may contribute to early physiological changes that subserve the functional impairments in HD. This study is intended to investigate potential abnormality in dynamic changes in cerebral blood volume (CBV) and cerebral blood flow (CBF), and cerebral metabolic rate of oxygen (CMRO2) in the brain in response to functional stimulation in premanifest and early manifest HD patients. A recently developed 3-D-TRiple-acquisition-after-Inversion-Preparation magnetic resonance imaging (MRI) approach was used to measure dynamic responses in CBV, CBF, and CMRO2 during visual stimulation in one single MRI scan. Experiments were conducted in 23 HD patients and 16 healthy controls. Decreased occipital cortex CMRO2 responses were observed in premanifest and early manifest HD patients compared to controls (P < 0.001), correlating with the CAG-Age Product scores in these patients (R2 = 0.4, P = 0.001). The results suggest the potential value of this reduced CMRO2 response during visual stimulation as a biomarker for HD and may illuminate the role of metabolic alterations in the pathophysiology of HD.
Collapse
Affiliation(s)
- Peter Klinkmueller
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, USA
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, USA
- Neurosection, Division of MRI Research, Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Martin Kronenbuerger
- Division of Movement Disorders, Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
- Division of Neurobiology, Department of Psychiatry, Johns Hopkins University School of Medicine, Baltimore, MD, USA
- Department of Neurology, University of Greifswald, Greifswald, Germany
| | - Xinyuan Miao
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, USA
- Neurosection, Division of MRI Research, Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Jee Bang
- Division of Movement Disorders, Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
- Division of Neurobiology, Department of Psychiatry, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Kia E Ultz
- Division of Movement Disorders, Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Adrian Paez
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, USA
- Neurosection, Division of MRI Research, Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Xiaoyu Zhang
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, USA
- Neurosection, Division of MRI Research, Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Wenzhen Duan
- Division of Neurobiology, Department of Psychiatry, Johns Hopkins University School of Medicine, Baltimore, MD, USA
- Departments of Neuroscience and Pharmacology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Russell L Margolis
- Division of Neurobiology, Department of Psychiatry, Johns Hopkins University School of Medicine, Baltimore, MD, USA
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Peter CM van Zijl
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, USA
- Neurosection, Division of MRI Research, Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Christopher A Ross
- Division of Neurobiology, Department of Psychiatry, Johns Hopkins University School of Medicine, Baltimore, MD, USA
- Departments of Neuroscience and Pharmacology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Jun Hua
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, USA
- Neurosection, Division of MRI Research, Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| |
Collapse
|
42
|
Tustison NJ, Cook PA, Holbrook AJ, Johnson HJ, Muschelli J, Devenyi GA, Duda JT, Das SR, Cullen NC, Gillen DL, Yassa MA, Stone JR, Gee JC, Avants BB. The ANTsX ecosystem for quantitative biological and medical imaging. Sci Rep 2021; 11:9068. [PMID: 33907199 PMCID: PMC8079440 DOI: 10.1038/s41598-021-87564-6] [Citation(s) in RCA: 77] [Impact Index Per Article: 19.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Accepted: 03/25/2021] [Indexed: 02/02/2023] Open
Abstract
The Advanced Normalizations Tools ecosystem, known as ANTsX, consists of multiple open-source software libraries which house top-performing algorithms used worldwide by scientific and research communities for processing and analyzing biological and medical imaging data. The base software library, ANTs, is built upon, and contributes to, the NIH-sponsored Insight Toolkit. Founded in 2008 with the highly regarded Symmetric Normalization image registration framework, the ANTs library has since grown to include additional functionality. Recent enhancements include statistical, visualization, and deep learning capabilities through interfacing with both the R statistical project (ANTsR) and Python (ANTsPy). Additionally, the corresponding deep learning extensions ANTsRNet and ANTsPyNet (built on the popular TensorFlow/Keras libraries) contain several popular network architectures and trained models for specific applications. One such comprehensive application is a deep learning analog for generating cortical thickness data from structural T1-weighted brain MRI, both cross-sectionally and longitudinally. These pipelines significantly improve computational efficiency and provide comparable-to-superior accuracy over multiple criteria relative to the existing ANTs workflows and simultaneously illustrate the importance of the comprehensive ANTsX approach as a framework for medical image analysis.
Collapse
Affiliation(s)
- Nicholas J Tustison
- Department of Radiology and Medical Imaging, University of Virginia, Charlottesville, VA, USA.
- Department of Neurobiology and Behavior, University of California, Irvine, CA, USA.
| | - Philip A Cook
- Department of Radiology, University of Pennsylvania, Philadelphia, PA, USA
| | - Andrew J Holbrook
- Department of Biostatistics, University of California, Los Angeles, CA, USA
| | - Hans J Johnson
- Department of Electrical and Computer Engineering, University of Iowa, Philadelphia, PA, USA
| | - John Muschelli
- School of Public Health, Johns Hopkins University, Baltimore, MD, USA
| | - Gabriel A Devenyi
- Department of Psychiatry, Douglas Mental Health University Institute, McGill University, Montreal, QC, Canada
| | - Jeffrey T Duda
- Department of Radiology, University of Pennsylvania, Philadelphia, PA, USA
| | - Sandhitsu R Das
- Department of Radiology, University of Pennsylvania, Philadelphia, PA, USA
| | - Nicholas C Cullen
- Department of Clinical Sciences, Lund University, Lund, Scania, Sweden
| | - Daniel L Gillen
- Department of Statistics, University of California, Irvine, CA, USA
| | - Michael A Yassa
- Department of Neurobiology and Behavior, University of California, Irvine, CA, USA
| | - James R Stone
- Department of Radiology and Medical Imaging, University of Virginia, Charlottesville, VA, USA
| | - James C Gee
- Department of Radiology, University of Pennsylvania, Philadelphia, PA, USA
| | - Brian B Avants
- Department of Radiology and Medical Imaging, University of Virginia, Charlottesville, VA, USA
| |
Collapse
|
43
|
Isherwood SJS, Bazin PL, Alkemade A, Forstmann BU. Quantity and quality: Normative open-access neuroimaging databases. PLoS One 2021; 16:e0248341. [PMID: 33705468 PMCID: PMC7951909 DOI: 10.1371/journal.pone.0248341] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2020] [Accepted: 02/24/2021] [Indexed: 11/19/2022] Open
Abstract
The focus of this article is to compare twenty normative and open-access neuroimaging databases based on quantitative measures of image quality, namely, signal-to-noise (SNR) and contrast-to-noise ratios (CNR). We further the analysis through discussing to what extent these databases can be used for the visualization of deeper regions of the brain, such as the subcortex, as well as provide an overview of the types of inferences that can be drawn. A quantitative comparison of contrasts including T1-weighted (T1w) and T2-weighted (T2w) images are summarized, providing evidence for the benefit of ultra-high field MRI. Our analysis suggests a decline in SNR in the caudate nuclei with increasing age, in T1w, T2w, qT1 and qT2* contrasts, potentially indicative of complex structural age-dependent changes. A similar decline was found in the corpus callosum of the T1w, qT1 and qT2* contrasts, though this relationship is not as extensive as within the caudate nuclei. These declines were accompanied by a declining CNR over age in all image contrasts. A positive correlation was found between scan time and the estimated SNR as well as a negative correlation between scan time and spatial resolution. Image quality as well as the number and types of contrasts acquired by these databases are important factors to take into account when selecting structural data for reuse. This article highlights the opportunities and pitfalls associated with sampling existing databases, and provides a quantitative backing for their usage.
Collapse
Affiliation(s)
- Scott Jie Shen Isherwood
- Integrative Model-Based Cognitive Neuroscience Research Unit, University of Amsterdam, Amsterdam, The Netherlands
| | - Pierre-Louis Bazin
- Integrative Model-Based Cognitive Neuroscience Research Unit, University of Amsterdam, Amsterdam, The Netherlands
- Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Anneke Alkemade
- Integrative Model-Based Cognitive Neuroscience Research Unit, University of Amsterdam, Amsterdam, The Netherlands
| | - Birte Uta Forstmann
- Integrative Model-Based Cognitive Neuroscience Research Unit, University of Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
44
|
Wang Z, Sair HI, Crainiceanu C, Lindquist M, Landman BA, Resnick S, Vogelstein JT, Caffo B. On statistical tests of functional connectome fingerprinting. CAN J STAT 2021. [DOI: 10.1002/cjs.11591] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Affiliation(s)
- Zeyi Wang
- Department of Biostatistics Johns Hopkins University Baltimore MD U.S.A
| | - Haris I. Sair
- The Russell H. Morgan Department of Radiology and Radiological Science, Division of Neuroradiology Johns Hopkins University Baltimore MD U.S.A
| | | | - Martin Lindquist
- Department of Biostatistics Johns Hopkins University Baltimore MD U.S.A
| | - Bennett A. Landman
- Department of Electrical Engineering and Computer Science Vanderbilt University Nashville TN U.S.A
| | - Susan Resnick
- Laboratory of Behavioral Neuroscience National Institute on Aging, National Institutes of Health Baltimore MD U.S.A
| | - Joshua T. Vogelstein
- Department of Biomedical Engineering Institute of Computational Medicine, JHU Baltimore Maryland U.S.A
| | - Brian Caffo
- Department of Biostatistics Johns Hopkins University Baltimore MD U.S.A
| |
Collapse
|
45
|
Honari H, Choe AS, Lindquist MA. Evaluating phase synchronization methods in fMRI: A comparison study and new approaches. Neuroimage 2021; 228:117704. [PMID: 33385554 PMCID: PMC8011682 DOI: 10.1016/j.neuroimage.2020.117704] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2020] [Revised: 11/14/2020] [Accepted: 12/21/2020] [Indexed: 12/25/2022] Open
Abstract
In recent years there has been growing interest in measuring time-varying functional connectivity between different brain regions using resting-state functional magnetic resonance imaging (rs-fMRI) data. One way to assess the relationship between signals from different brain regions is to measure their phase synchronization (PS) across time. There are several ways to perform such analyses, and we compare methods that utilize a PS metric together with a sliding window, referred to here as windowed phase synchronization (WPS), with those that directly measure the instantaneous phase synchronization (IPS). In particular, IPS has recently gained popularity as it offers single time-point resolution of time-resolved fMRI connectivity. In this paper, we discuss the underlying assumptions required for performing PS analyses and emphasize the importance of band-pass filtering the data to obtain valid results. Further, we contrast this approach with the use of Empirical Mode Decomposition (EMD) to achieve similar goals. We review various methods for evaluating PS and introduce a new approach within the IPS framework denoted the cosine of the relative phase (CRP). We contrast methods through a series of simulations and application to rs-fMRI data. Our results indicate that CRP outperforms other tested methods and overcomes issues related to undetected temporal transitions from positive to negative associations common in IPS analysis. Further, in contrast to phase coherence, CRP unfolds the distribution of PS measures, which benefits subsequent clustering of PS matrices into recurring brain states.
Collapse
Affiliation(s)
- Hamed Honari
- Department of Electrical and Computer Engineering, Johns Hopkins University, USA
| | - Ann S Choe
- F. M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, USA; International Center for Spinal Cord Injury, Kennedy Krieger Institute, USA; Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins School of Medicine, USA
| | | |
Collapse
|
46
|
Buonincontri G, Kurzawski JW, Kaggie JD, Matys T, Gallagher FA, Cencini M, Donatelli G, Cecchi P, Cosottini M, Martini N, Frijia F, Montanaro D, Gómez PA, Schulte RF, Retico A, Tosetti M. Three dimensional MRF obtains highly repeatable and reproducible multi-parametric estimations in the healthy human brain at 1.5T and 3T. Neuroimage 2021; 226:117573. [PMID: 33221451 DOI: 10.1016/j.neuroimage.2020.117573] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2020] [Revised: 11/05/2020] [Accepted: 11/10/2020] [Indexed: 12/19/2022] Open
Abstract
Magnetic resonance fingerprinting (MRF) is highly promising as a quantitative MRI technique due to its accuracy, robustness, and efficiency. Previous studies have found high repeatability and reproducibility of 2D MRF acquisitions in the brain. Here, we have extended our investigations to 3D MRF acquisitions covering the whole brain using spiral projection k-space trajectories. Our travelling head study acquired test/retest data from the brains of 12 healthy volunteers and 8 MRI systems (3 systems at 3 T and 5 at 1.5 T, all from a single vendor), using a study design not requiring all subjects to be scanned at all sites. The pulse sequence and reconstruction algorithm were the same for all acquisitions. After registration of the MRF-derived PD T1 and T2 maps to an anatomical atlas, coefficients of variation (CVs) were computed to assess test/retest repeatability and inter-site reproducibility in each voxel, while a General Linear Model (GLM) was used to determine the voxel-wise variability between all confounders, which included test/retest, subject, field strength and site. Our analysis demonstrated a high repeatability (CVs 0.7-1.3% for T1, 2.0-7.8% for T2, 1.4-2.5% for normalized PD) and reproducibility (CVs of 2.0-5.8% for T1, 7.4-10.2% for T2, 5.2-9.2% for normalized PD) in gray and white matter. Both repeatability and reproducibility improved when compared to similar experiments using 2D acquisitions. Three-dimensional MRF obtains highly repeatable and reproducible estimations of T1 and T2, supporting the translation of MRF-based fast quantitative imaging into clinical applications.
Collapse
Affiliation(s)
| | - Jan W Kurzawski
- IRCCS Stella Maris, Pisa, Italy; National Institute for Nuclear Physics (INFN), Pisa, Italy
| | - Joshua D Kaggie
- Department of Radiology, University of Cambridge and Cambridge University Hospitals NHS Foundation Trust, Cambridge, United Kingdom
| | - Tomasz Matys
- Department of Radiology, University of Cambridge and Cambridge University Hospitals NHS Foundation Trust, Cambridge, United Kingdom
| | - Ferdia A Gallagher
- Department of Radiology, University of Cambridge and Cambridge University Hospitals NHS Foundation Trust, Cambridge, United Kingdom
| | - Matteo Cencini
- IRCCS Stella Maris, Pisa, Italy; Imago7 Foundation, Pisa, Italy
| | - Graziella Donatelli
- Imago7 Foundation, Pisa, Italy; U.O. Neuroradiologia, Azienda Ospedaliera Universitaria Pisana (AOUP), Pisa, Italy
| | - Paolo Cecchi
- U.O. Neuroradiologia, Azienda Ospedaliera Universitaria Pisana (AOUP), Pisa, Italy
| | - Mirco Cosottini
- Imago7 Foundation, Pisa, Italy; U.O. Neuroradiologia, Azienda Ospedaliera Universitaria Pisana (AOUP), Pisa, Italy; Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| | - Nicola Martini
- U.O.C. Bioingegneria e Ing. Clinica, Fondazione Toscana Gabriele Monasterio, Pisa, Italy
| | - Francesca Frijia
- U.O.C. Bioingegneria e Ing. Clinica, Fondazione Toscana Gabriele Monasterio, Pisa, Italy
| | - Domenico Montanaro
- U.O.C. Risonanza Magnetica Specialistica e Neuroradiologia, Fondazione CNR/Regione Toscana G. Monasterio, Pisa-Massa, Italy
| | - Pedro A Gómez
- Imago7 Foundation, Pisa, Italy; Technical University of Munich, Munich, Germany
| | | | | | - Michela Tosetti
- IRCCS Stella Maris, Pisa, Italy; Imago7 Foundation, Pisa, Italy.
| |
Collapse
|
47
|
Larson KE, Oguz I. Synthetic atrophy for longitudinal surface-based cortical thickness measurement. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2021; 11596:115963K. [PMID: 34873357 PMCID: PMC8643351 DOI: 10.1117/12.2580907] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Difficulty in validating accuracy remains a substantial setback in the field of surface-based cortical thickness (CT) measurement due to the lack of experimental validation against ground truth. Although methods have been developed to create synthetic datasets for this purpose, none provide a robust mechanism for measuring exact thickness changes with surface-based approaches. This work presents a registration-based technique for inducing synthetic cortical atrophy to create a longitudinal, ground truth dataset specifically designed for accuracy validation of surface-based CT measurements. Across the entire brain, we show our method can induce up to between 0.6 and 2.6 mm of localized cortical atrophy in a given gyrus depending on the region's original thickness. By calculating the image deformation to induce this atrophy at 400% of the original resolution in each direction, we can induce a sub-voxel resolution amount of atrophy while minimizing partial volume effects. We also show that our method can be extended beyond application to CT measurements for the accuracy validation of longitudinal cortical segmentation and surface reconstruction pipelines when measuring accuracy against cortical landmarks. Importantly, our method relies exclusively on publicly available software and datasets.
Collapse
Affiliation(s)
| | - Ipek Oguz
- Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
48
|
Sörös P, Wölk L, Bantel C, Bräuer A, Klawonn F, Witt K. Replicability, Repeatability, and Long-term Reproducibility of Cerebellar Morphometry. THE CEREBELLUM 2021; 20:439-453. [PMID: 33421018 PMCID: PMC8213608 DOI: 10.1007/s12311-020-01227-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Accepted: 12/15/2020] [Indexed: 01/09/2023]
Abstract
To identify robust and reproducible methods of cerebellar morphometry that can be used in future large-scale structural MRI studies, we investigated the replicability, repeatability, and long-term reproducibility of three fully automated software tools: FreeSurfer, CEREbellum Segmentation (CERES), and automatic cerebellum anatomical parcellation using U-Net with locally constrained optimization (ACAPULCO). Replicability was defined as computational replicability, determined by comparing two analyses of the same high-resolution MRI data set performed with identical analysis software and computer hardware. Repeatability was determined by comparing the analyses of two MRI scans of the same participant taken during two independent MRI sessions on the same day for the Kirby-21 study. Long-term reproducibility was assessed by analyzing two MRI scans of the same participant in the longitudinal OASIS-2 study. We determined percent difference, the image intraclass correlation coefficient, the coefficient of variation, and the intraclass correlation coefficient between two analyses. Our results show that CERES and ACAPULCO use stochastic algorithms that result in surprisingly high differences between identical analyses for ACAPULCO and small differences for CERES. Changes between two consecutive scans from the Kirby-21 study were less than ± 5% in most cases for FreeSurfer and CERES (i.e., demonstrating high repeatability). As expected, long-term reproducibility was lower than repeatability for all software tools. In summary, CERES is an accurate, as demonstrated before, and reproducible tool for fully automated segmentation and parcellation of the cerebellum. We conclude with recommendations for the assessment of replicability, repeatability, and long-term reproducibility in future studies on cerebellar structure.
Collapse
Affiliation(s)
- Peter Sörös
- Department of Neurology, Carl von Ossietzky University of Oldenburg, Heiligengeisthöfe 4, 26121, Oldenburg, Germany.
- Research Center Neurosensory Science, Carl von Ossietzky University of Oldenburg, Oldenburg, Germany.
| | - Louise Wölk
- Department of Neurology, Carl von Ossietzky University of Oldenburg, Heiligengeisthöfe 4, 26121, Oldenburg, Germany
| | - Carsten Bantel
- Research Center Neurosensory Science, Carl von Ossietzky University of Oldenburg, Oldenburg, Germany
- Anesthesiology, Critical Care, Emergency Medicine, and Pain Management, Carl von Ossietzky University of Oldenburg, Oldenburg, Germany
| | - Anja Bräuer
- Research Center Neurosensory Science, Carl von Ossietzky University of Oldenburg, Oldenburg, Germany
- Department of Anatomy, Carl von Ossietzky University of Oldenburg, Oldenburg, Germany
| | - Frank Klawonn
- Biostatistics, Helmholtz Centre for Infection Research, Braunschweig, Germany
- Department of Computer Science, Ostfalia University of Applied Sciences, Wolfenbüttel, Germany
| | - Karsten Witt
- Department of Neurology, Carl von Ossietzky University of Oldenburg, Heiligengeisthöfe 4, 26121, Oldenburg, Germany
- Research Center Neurosensory Science, Carl von Ossietzky University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
49
|
Apolipoprotein E allele 4 effects on Single-Subject Gray Matter Networks in Mild Cognitive Impairment. NEUROIMAGE: CLINICAL 2021; 32:102799. [PMID: 34469849 PMCID: PMC8405842 DOI: 10.1016/j.nicl.2021.102799] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2021] [Revised: 07/23/2021] [Accepted: 08/17/2021] [Indexed: 11/23/2022] Open
Abstract
There is evidence that gray matter networks are disrupted in Mild Cognitive Impairment (MCI) and associated with cognitive impairment and faster disease progression. However, it remains unknown how these alterations are related to the presence of Apolipoprotein E isoform E4 (ApoE4), the most prominent genetic risk factor for late-onset Alzheimer's disease (AD). To investigate this topic at the individual level, we explore the impact of ApoE4 and the disease progression on the Single-Subject Gray Matter Networks (SSGMNets) using the graph theory approach. Our data sample comprised 200 MCI patients selected from the ADNI database, classified as non-Converters and Converters (will progress into AD). Each group included 50 ApoE4-positive ('Carriers', ApoE4 + ) and 50 ApoE4-negative ('non-Carriers', ApoE4-). The SSGMNets were estimated from structural MRIs at two-time points: baseline and conversion. We investigated whether altered network topological measures at baseline and their rate of change (RoC) between baseline and conversion time points were associated with ApoE4 and disease progression. We also explored the correlation of SSGMNets attributes with general cognition score (MMSE), memory (ADNI-MEM), and CSF-derived biomarkers of AD (Aβ42, T-tau, and P-tau). Our results showed that ApoE4 and the disease progression modulated the global topological network properties independently but not in their RoC. MCI converters showed a lower clustering index in several regions associated with neurodegeneration in AD. The SSGMNets' topological organization was revealed to be able to predict cognitive and memory measures. The findings presented here suggest that SSGMNets could indeed be used to identify MCI ApoE4 Carriers with a high risk for AD progression.
Collapse
|
50
|
Lyzinski V, Sussman DL. Matchability of heterogeneous networks pairs. INFORMATION AND INFERENCE : A JOURNAL OF THE IMA 2020; 9:749-783. [PMID: 33343893 PMCID: PMC7737166 DOI: 10.1093/imaiai/iaz031] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/21/2018] [Revised: 03/18/2019] [Accepted: 09/01/2019] [Indexed: 06/12/2023]
Abstract
We consider the problem of graph matchability in non-identically distributed networks. In a general class of edge-independent networks, we demonstrate that graph matchability can be lost with high probability when matching the networks directly. We further demonstrate that under mild model assumptions, matchability is almost perfectly recovered by centering the networks using universal singular value thresholding before matching. These theoretical results are then demonstrated in both real and synthetic simulation settings. We also recover analogous core-matchability results in a very general core-junk network model, wherein some vertices do not correspond between the graph pair.
Collapse
Affiliation(s)
- Vince Lyzinski
- Department of Mathematics, University of Maryland, College Park, MD, USA 20742
| | - Daniel L Sussman
- Department of Mathematics and Statistics, Boston University, Boston, MA, USA 02215
| |
Collapse
|