1
|
Upadhyay K, Jagani R, Giovanis DG, Alshareef A, Knutsen AK, Johnson CL, Carass A, Bayly PV, Shields MD, Ramesh KT. Effect of Human Head Shape on the Risk of Traumatic Brain Injury: A Gaussian Process Regression-based Machine Learning Approach. Mil Med 2024:usae199. [PMID: 38739497 DOI: 10.1093/milmed/usae199] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2023] [Revised: 03/06/2024] [Accepted: 04/02/2024] [Indexed: 05/16/2024] Open
Abstract
INTRODUCTION Computational head injury models are promising tools for understanding and predicting traumatic brain injuries. However, most available head injury models are "average" models that employ a single set of head geometry (e.g., 50th-percentile U.S. male) without considering variability in these parameters across the human population. A significant variability of head shapes exists in U.S. Army soldiers, evident from the Anthropometric Survey of U.S. Army Personnel (ANSUR II). The objective of this study is to elucidate the effects of head shape on the predicted risk of traumatic brain injury from computational head injury models. MATERIALS AND METHODS Magnetic resonance imaging scans of 25 human subjects are collected. These images are registered to the standard MNI152 brain atlas, and the resulting transformation matrix components (called head shape parameters) are used to quantify head shapes of the subjects. A generative machine learning model is used to generate 25 additional head shape parameter datasets to augment our database. Head injury models are developed for these head shapes, and a rapid injurious head rotation event is simulated to obtain several brain injury predictor variables (BIPVs): Peak cumulative maximum principal strain (CMPS), average CMPS, and the volume fraction of brain exceeding an injurious CMPS threshold. A Gaussian process regression model is trained between head shape parameters and BIPVs, which is then used to study the relative sensitivity of the various BIPVs on individual head shape parameters. We distinguish head shape parameters into 2 types: Scaling components ${T_{xx}}$, ${T_{yy}}$, and ${T_{zz}}$ that capture the breadth, length, and height of the head, respectively, and shearing components (${T_{xy}},{T_{xz}},{T_{yx}},{T_{yz}},{T_{zx}}$, and ${T_{zy}}$) that capture the relative skewness of the head shape. RESULTS An overall positive correlation is evident between scaling components and BIPVs. Notably, a very high, positive correlation is seen between the BIPVs and the head volume. As an example, a 57% increase in peak CMPS was noted between the smallest and the largest investigated head volume parameters. The variation in shearing components ${T_{xy}},{T_{xz}},{T_{yx}},{T_{yz}},{T_{zx}}$, and ${T_{zy}}$ on average does not cause notable changes in the BIPVs. From the Gaussian process regression model, all 3 BIPVs showed an increasing trend with each of the 3 scaling components, but the BIPVs are found to be most sensitive to the height dimension of the head. From the Sobol sensitivity analysis, the ${T_{zz}}$ scaling parameter contributes nearly 60% to the total variance in peak and average CMPS; ${T_{yy}}$ contributes approximately 20%, whereas ${T_{xx}}$ contributes less than 5%. The remaining contribution is from the 6 shearing components. Unlike peak and average CMPS, the VF-CMPS BIPV is associated with relatively evenly distributed Sobol indices across the 3 scaling parameters. Furthermore, the contribution of shearing components on the total variance in this case is negligible. CONCLUSIONS Head shape has a considerable influence on the injury predictions of computational head injury models. Available "average" head injury models based on a 50th-percentile U.S. male are likely associated with considerable uncertainty. In general, larger head sizes correspond to greater BIPV magnitudes, which point to potentially a greater injury risk under rapid neck rotation for people with larger heads.
Collapse
|
2
|
Liu C, Zhuo Z, Qu L, Jin Y, Hua T, Xu J, Tan G, Li Y, Duan Y, Wang T, Zhang Z, Zhang Y, Chen R, Yu P, Zhang P, Shi Y, Zhang J, Tian D, Li R, Zhang X, Shi F, Wang Y, Jiang J, Carass A, Liu Y, Ye C. DeepWMH: A deep learning tool for accurate white matter hyperintensity segmentation without requiring manual annotations for training. Sci Bull (Beijing) 2024; 69:872-875. [PMID: 38320896 DOI: 10.1016/j.scib.2024.01.034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2024]
|
3
|
Carass A, Greenman D, Dewey BE, Calabresi PA, Prince JL, Pham DL. Image harmonization improves consistency of intra-rater delineations of MS lesions in heterogeneous MRI. NEUROIMAGE. REPORTS 2024; 4:100195. [PMID: 38370461 PMCID: PMC10871705 DOI: 10.1016/j.ynirp.2024.100195] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
Clinical magnetic resonance images (MRIs) lack a standard intensity scale due to differences in scanner hardware and the pulse sequences used to acquire the images. When MRIs are used for quantification, as in the evaluation of white matter lesions (WMLs) in multiple sclerosis, this lack of intensity standardization becomes a critical problem affecting both the staging and tracking of the disease and its treatment. This paper presents a study of harmonization on WML segmentation consistency, which is evaluated using an object detection classification scheme that incorporates manual delineations from both the original and harmonized MRIs. A cohort of ten people scanned on two different imaging platforms was studied. An expert rater, blinded to the image source, manually delineated WMLs on images from both scanners before and after harmonization. It was found that there is closer agreement in both global and per-lesion WML volume and spatial distribution after harmonization, demonstrating the importance of image harmonization prior to the creation of manual delineations. These results could lead to better truth models in both the development and evaluation of automated lesion segmentation algorithms.
Collapse
|
4
|
Okamoto RJ, Escarcega JD, Alshareef A, Carass A, Prince JL, Johnson CL, Bayly PV. Effect of Direction and Frequency of Skull Motion on Mechanical Vulnerability of the Human Brain. J Biomech Eng 2023; 145:111005. [PMID: 37432674 PMCID: PMC10578077 DOI: 10.1115/1.4062937] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Revised: 06/26/2023] [Accepted: 07/06/2023] [Indexed: 07/12/2023]
Abstract
Strain energy and kinetic energy in the human brain were estimated by magnetic resonance elastography (MRE) during harmonic excitation of the head, and compared to characterize the effect of loading direction and frequency on brain deformation. In brain MRE, shear waves are induced by external vibration of the skull and imaged by a modified MR imaging sequence; the resulting harmonic displacement fields are typically "inverted" to estimate mechanical properties, like stiffness or damping. However, measurements of tissue motion from MRE also illuminate key features of the response of the brain to skull loading. In this study, harmonic excitation was applied in two different directions and at five different frequencies from 20 to 90 Hz. Lateral loading induced primarily left-right head motion and rotation in the axial plane; occipital loading induced anterior-posterior head motion and rotation in the sagittal plane. The ratio of strain energy to kinetic energy (SE/KE) depended strongly on both direction and frequency. The ratio of SE/KE was approximately four times larger for lateral excitation than for occipital excitation and was largest at the lowest excitation frequencies studied. These results are consistent with clinical observations that suggest lateral impacts are more likely to cause injury than occipital or frontal impacts, and also with observations that the brain has low-frequency (∼10 Hz) natural modes of oscillation. The SE/KE ratio from brain MRE is potentially a simple and powerful dimensionless metric of brain vulnerability to deformation and injury.
Collapse
|
5
|
Gao C, Landman BA, Prince JL, Carass A. Reproducibility evaluation of the effects of MRI defacing on brain segmentation. J Med Imaging (Bellingham) 2023; 10:064001. [PMID: 38074632 PMCID: PMC10704191 DOI: 10.1117/1.jmi.10.6.064001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Revised: 09/22/2023] [Accepted: 10/24/2023] [Indexed: 12/20/2023] Open
Abstract
Purpose Recent advances in magnetic resonance (MR) scanner quality and the rapidly improving nature of facial recognition software have necessitated the introduction of MR defacing algorithms to protect patient privacy. As a result, there are a number of MR defacing algorithms available to the neuroimaging community, with several appearing in just the last 5 years. While some qualities of these defacing algorithms, such as patient identifiability, have been explored in the previous works, the potential impact of defacing on neuroimage processing has yet to be explored. Approach We qualitatively evaluate eight MR defacing algorithms on 179 subjects from the OASIS-3 cohort and 21 subjects from the Kirby-21 dataset. We also evaluate the effects of defacing on two neuroimaging pipelines-SLANT and FreeSurfer-by comparing the segmentation consistency between the original and defaced images. Results Defacing can alter brain segmentation and even lead to catastrophic failures, which are more frequent with some algorithms, such as Quickshear, MRI_Deface, and FSL_deface. Compared to FreeSurfer, SLANT is less affected by defacing. On outputs that pass the quality check, the effects of defacing are less pronounced than those of rescanning, as measured by the Dice similarity coefficient. Conclusions The effects of defacing are noticeable and should not be disregarded. Extra attention, in particular, should be paid to the possibility of catastrophic failures. It is crucial to adopt a robust defacing algorithm and perform a thorough quality check before releasing defaced datasets. To improve the reliability of analysis in scenarios involving defaced MRIs, it is encouraged to include multiple brain segmentation pipelines.
Collapse
|
6
|
Wei S, Liu Y, Bian Z, Wang Y, Zuo L, Calabresi PA, Saidha S, Prince JL, Carass A. Recurrent Self Fusion: Iterative Denoising for Consistent Retinal OCT Segmentation. OPHTHALMIC MEDICAL IMAGE ANALYSIS : 10TH INTERNATIONAL WORKSHOP, OMIA 2023, HELD IN CONJUNCTION WITH MICCAI 2023, VANCOUVER, BC, CANADA, OCTOBER 12, 2023, PROCEEDINGS. OMIA (WORKSHOP) (10TH : 2023 : VANCOUVER, B.C. ; ONLINE) 2023; 14096:42-51. [PMID: 38318463 PMCID: PMC10840975 DOI: 10.1007/978-3-031-44013-7_5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/07/2024]
Abstract
Optical coherence tomography (OCT) is a valuable imaging technique in ophthalmology, providing high-resolution, cross-sectional images of the retina for early detection and monitoring of various retinal and neurological diseases. However, discrepancies in retinal layer thickness measurements among different OCT devices pose challenges for data comparison and interpretation, particularly in longitudinal analyses. This work introduces the idea of a recurrent self fusion (RSF) algorithm to address this issue. Our RSF algorithm, built upon the self fusion methodology, iteratively denoises retinal OCT images. A deep learning-based retinal OCT segmentation algorithm is employed for downstream analyses. A large dataset of paired OCT scans acquired on both a Spectralis and Cirrus OCT device are used for validation. The results demonstrate that the RSF algorithm effectively reduces speckle contrast and enhances the consistency of retinal OCT segmentation.
Collapse
|
7
|
Zuo L, Liu Y, Xue Y, Dewey BE, Remedios SW, Hays SP, Bilgel M, Mowry EM, Newsome SD, Calabresi PA, Resnick SM, Prince JL, Carass A. HACA3: A unified approach for multi-site MR image harmonization. Comput Med Imaging Graph 2023; 109:102285. [PMID: 37657151 PMCID: PMC10592042 DOI: 10.1016/j.compmedimag.2023.102285] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2023] [Revised: 07/11/2023] [Accepted: 08/08/2023] [Indexed: 09/03/2023]
Abstract
The lack of standardization and consistency of acquisition is a prominent issue in magnetic resonance (MR) imaging. This often causes undesired contrast variations in the acquired images due to differences in hardware and acquisition parameters. In recent years, image synthesis-based MR harmonization with disentanglement has been proposed to compensate for the undesired contrast variations. The general idea is to disentangle anatomy and contrast information from MR images to achieve cross-site harmonization. Despite the success of existing methods, we argue that major improvements can be made from three aspects. First, most existing methods are built upon the assumption that multi-contrast MR images of the same subject share the same anatomy. This assumption is questionable, since different MR contrasts are specialized to highlight different anatomical features. Second, these methods often require a fixed set of MR contrasts for training (e.g., both T1-weighted and T2-weighted images), limiting their applicability. Lastly, existing methods are generally sensitive to imaging artifacts. In this paper, we present Harmonization with Attention-based Contrast, Anatomy, and Artifact Awareness (HACA3), a novel approach to address these three issues. HACA3 incorporates an anatomy fusion module that accounts for the inherent anatomical differences between MR contrasts. Furthermore, HACA3 can be trained and applied to any combination of MR contrasts and is robust to imaging artifacts. HACA3 is developed and evaluated on diverse MR datasets acquired from 21 sites with varying field strengths, scanner platforms, and acquisition protocols. Experiments show that HACA3 achieves state-of-the-art harmonization performance under multiple image quality metrics. We also demonstrate the versatility and potential clinical impact of HACA3 on downstream tasks including white matter lesion segmentation for people with multiple sclerosis and longitudinal volumetric analyses for normal aging subjects. Code is available at https://github.com/lianruizuo/haca3.
Collapse
|
8
|
Gao C, Landman BA, Prince JL, Carass A. A reproducibility evaluation of the effects of MRI defacing on brain segmentation. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2023:2023.05.15.23289995. [PMID: 37293070 PMCID: PMC10246049 DOI: 10.1101/2023.05.15.23289995] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Purpose Recent advances in magnetic resonance (MR) scanner quality and the rapidly improving nature of facial recognition software have necessitated the introduction of MR defacing algorithms to protect patient privacy. As a result, there are a number of MR defacing algorithms available to the neuroimaging community, with several appearing in just the last five years. While some qualities of these defacing algorithms, such as patient identifiability, have been explored in previous works, the potential impact of defacing on neuroimage processing has yet to be explored. Approach We qualitatively evaluate eight MR defacing algorithms on 179 subjects from the OASIS-3 cohort and the 21 subjects from the Kirby-21 dataset. We also evaluate the effects of defacing on two neuroimaging pipelines-SLANT and FreeSurfer-by comparing the segmentation consistency between the original and defaced images. Results Defacing can alter brain segmentation and even lead to catastrophic failures, which are more frequent with some algorithms such as Quickshear, MRI_Deface, and FSL_deface. Compared to FreeSurfer, SLANT is less affected by defacing. On outputs that pass the quality check, the effects of defacing are less pronounced than those of rescanning, as measured by the Dice similarity coefficient. Conclusions The effects of defacing are noticeable and should not be disregarded. Extra attention, in particular, should be paid to the possibility of catastrophic failures. It is crucial to adopt a robust defacing algorithm and perform a thorough quality check before releasing defaced datasets. To improve the reliability of analysis in scenarios involving defaced MRIs, it's encouraged to include multiple brain segmentation pipelines.
Collapse
|
9
|
He Y, Carass A, Liu Y, Calabresi PA, Saidha S, Prince JL. Longitudinal deep network for consistent OCT layer segmentation. BIOMEDICAL OPTICS EXPRESS 2023; 14:1874-1893. [PMID: 37206119 PMCID: PMC10191669 DOI: 10.1364/boe.487518] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Revised: 03/11/2023] [Accepted: 03/17/2023] [Indexed: 05/21/2023]
Abstract
Retinal layer thickness is an important bio-marker for people with multiple sclerosis (PwMS). In clinical practice, retinal layer thickness changes in optical coherence tomography (OCT) are widely used for monitoring multiple sclerosis (MS) progression. Recent developments in automated retinal layer segmentation algorithms allow cohort-level retina thinning to be observed in a large study of PwMS. However, variability in these results make it difficult to identify patient-level trends; this prevents patient specific disease monitoring and treatment planning using OCT. Deep learning based retinal layer segmentation algorithms have achieved state-of-the-art accuracy, but the segmentation is performed on each individual scan without utilizing longitudinal information, which can be important in reducing segmentation error and reveal subtle changes in retinal layers. In this paper, we propose a longitudinal OCT segmentation network which achieves more accurate and consistent layer thickness measurements for PwMS.
Collapse
|
10
|
Han S, Remedios SW, Schär M, Carass A, Prince JL. ESPRESO: An algorithm to estimate the slice profile of a single magnetic resonance image. Magn Reson Imaging 2023; 98:155-163. [PMID: 36702167 DOI: 10.1016/j.mri.2023.01.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2022] [Accepted: 01/14/2023] [Indexed: 01/25/2023]
Abstract
To reduce scan time, magnetic resonance (MR) images are often acquired using 2D multi-slice protocols with thick slices that may also have gaps between them. The resulting image volumes have lower resolution in the through-plane direction than in the in-plane direction, and the through-plane resolution is in part characterized by the protocol's slice profile which acts as a through-plane point spread function (PSF). Although super-resolution (SR) has been shown to improve the visualization and down-stream processing of 2D multi-slice MR acquisitions, previous algorithms are usually unaware of the true slice profile, which may lead to sub-optimal SR performance. In this work, we present an algorithm to estimate the slice profile of a 2D multi-slice acquisition given only its own image volume without any external training data. We assume that an anatomical image is isotropic in the sense that, after accounting for a correctly estimated slice profile, the image patches along different orientations have the same probability distribution. Our proposed algorithm uses a modified generative adversarial network (GAN) where the generator network estimates the slice profile to reduce the resolution of the in-plane direction, and the discriminator network determines whether a direction is generated or real low resolution. The proposed algorithm, ESPRESO, which stands for "estimating the slice profile for resolution enhancement of a single image only", was tested with a state-of-the-art internally supervised SR algorithm. Specifically, ESPRESO is used to create training data for this SR algorithm, and results show improvements when ESPRESO is used over commonly-used PSFs.
Collapse
|
11
|
Duan P, Xue Y, Han S, Zuo L, Carass A, Bernhard C, Hays S, Calabresi PA, Resnick SM, Duncan JS, Prince JL. RAPID BRAIN MENINGES SURFACE RECONSTRUCTION WITH LAYER TOPOLOGY GUARANTEE. PROCEEDINGS. IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING 2023; 2023:10.1109/isbi53787.2023.10230668. [PMID: 37990735 PMCID: PMC10660710 DOI: 10.1109/isbi53787.2023.10230668] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/23/2023]
Abstract
The meninges, located between the skull and brain, are composed of three membrane layers: the pia, the arachnoid, and the dura. Reconstruction of these layers can aid in studying volume differences between patients with neurodegenerative diseases and normal aging subjects. In this work, we use convolutional neural networks (CNNs) to reconstruct surfaces representing meningeal layer boundaries from magnetic resonance (MR) images. We first use the CNNs to predict the signed distance functions (SDFs) representing these surfaces while preserving their anatomical ordering. The marching cubes algorithm is then used to generate continuous surface representations; both the subarachnoid space (SAS) and the intracranial volume (ICV) are computed from these surfaces. The proposed method is compared to a state-of-the-art deformable model-based reconstruction method, and we show that our method can reconstruct smoother and more accurate surfaces using less computation time. Finally, we conduct experiments with volumetric analysis on both subjects with multiple sclerosis and healthy controls. For healthy and MS subjects, ICVs and SAS volumes are found to be significantly correlated to sex (p<0.01) and age (p ≤ 0.03) changes, respectively.
Collapse
|
12
|
Wang Y, Feng A, Xue Y, Zuo L, Liu Y, Blitz AM, Luciano MG, Carass A, Prince JL. AUTOMATED VENTRICLE PARCELLATION AND EVAN'S RATIO COMPUTATION IN PRE- AND POST-SURGICAL VENTRICULOMEGALY. PROCEEDINGS. IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING 2023; 2023:10.1109/isbi53787.2023.10230729. [PMID: 38013948 PMCID: PMC10679954 DOI: 10.1109/isbi53787.2023.10230729] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/29/2023]
Abstract
Normal pressure hydrocephalus (NPH) is a brain disorder associated with enlarged ventricles and multiple cognitive and motor symptoms. The degree of ventricular enlargement can be measured using magnetic resonance images (MRIs) and characterized quantitatively using the Evan's ratio (ER). Automatic computation of ER is desired to avoid the extra time and variations associated with manual measurements on MRI. Because shunt surgery is often used to treat NPH, it is necessary that this process be robust to image artifacts caused by the shunt and related implants. In this paper, we propose a 3D regions-of-interest aware (ROI-aware) network for segmenting the ventricles. The method achieves state-of-the-art performance on both pre-surgery MRIs and post-surgery MRIs with artifacts. Based on our segmentation results, we also describe an automated approach to compute ER from these results. Experimental results on multiple datasets demonstrate the potential of the proposed method to assist clinicians in the diagnosis and management of NPH.
Collapse
|
13
|
Feng A, Xue Y, Wang Y, Yan C, Bian Z, Shao M, Zhuo J, Gullapalli RP, Carass A, Prince JL. Label Propagation via Random Walk for Training Robust Thalamus Nuclei Parcellation Model from Noisy Annotations. ARXIV 2023:arXiv:2303.17706v1. [PMID: 37033461 PMCID: PMC10081346] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Data-driven thalamic nuclei parcellation depends on high-quality manual annotations. However, the small size and low contrast changes among thalamic nuclei, yield annotations that are often incomplete, noisy, or ambiguously labelled. To train a robust thalamic nuclei parcellation model with noisy annotations, we propose a label propagation algorithm based on random walker to refine the annotations before model training. A two-step model was trained to generate first the whole thalamus and then the nuclei masks. We conducted experiments on a mild traumatic brain injury~(mTBI) dataset with noisy thalamic nuclei annotations. Our model outperforms current state-of-the-art thalamic nuclei parcellations by a clear margin. We believe our method can also facilitate the training of other parcellation models with noisy labels.
Collapse
|
14
|
Shao M, Xing F, Carass A, Liang X, Zhuo J, Stone M, Woo J, Prince JL. Analysis of Tongue Muscle Strain During Speech From Multimodal Magnetic Resonance Imaging. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2023; 66:513-526. [PMID: 36716389 PMCID: PMC10023187 DOI: 10.1044/2022_jslhr-22-00329] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Revised: 09/23/2022] [Accepted: 10/26/2022] [Indexed: 06/18/2023]
Abstract
PURPOSE Muscle groups within the tongue in healthy and diseased populations show different behaviors during speech. Visualizing and quantifying strain patterns of these muscle groups during tongue motion can provide insights into tongue motor control and adaptive behaviors of a patient. METHOD We present a pipeline to estimate the strain along the muscle fiber directions in the deforming tongue during speech production. A deep convolutional network estimates the crossing muscle fiber directions in the tongue using diffusion-weighted magnetic resonance imaging (MRI) data acquired at rest. A phase-based registration algorithm is used to estimate motion of the tongue muscles from tagged MRI acquired during speech. After transforming both muscle fiber directions and motion fields into a common atlas space, strain tensors are computed and projected onto the muscle fiber directions, forming so-called strains in the line of actions (SLAs) throughout the tongue. SLAs are then averaged over individual muscles that have been manually labeled in the atlas space using high-resolution T2-weighted MRI. Data were acquired, and this pipeline was run on a cohort of eight healthy controls and two glossectomy patients. RESULTS The crossing muscle fibers reconstructed by the deep network show orthogonal patterns. The strain analysis results demonstrate consistency of muscle behaviors among some healthy controls during speech production. The patients show irregular muscle patterns, and their tongue muscles tend to show more extension than the healthy controls. CONCLUSIONS The study showed visual evidence of correlation between two muscle groups during speech production. Patients tend to have different strain patterns compared to the controls. Analysis of variations in muscle strains can potentially help develop treatment strategies in oral diseases. SUPPLEMENTAL MATERIAL https://doi.org/10.23641/asha.21957011.
Collapse
|
15
|
Wang Y, Feng A, Xue Y, Shao M, Blitz AM, Luciano MG, Carass A, Prince JL. Investigation of probability maps in deep-learning-based brain ventricle parcellation. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2023; 12464:124642G. [PMID: 38013746 PMCID: PMC10679955 DOI: 10.1117/12.2653999] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/29/2023]
Abstract
Normal Pressure Hydrocephalus (NPH) is a brain disorder associated with ventriculomegaly. Accurate segmentation of the ventricle system into its sub-compartments from magnetic resonance images (MRIs) could help evaluate NPH patients for surgical intervention. In this paper, we modify a 3D U-net utilizing probability maps to perform accurate ventricle parcellation, even with grossly enlarged ventricles and post-surgery shunt artifacts, from MRIs. Our method achieves a mean dice similarity coefficient (DSC) on whole ventricles for healthy controls of 0.864 ± 0.047 and 0.961 ± 0.024 for NPH patients. Furthermore, with the benefit of probability maps, the proposed method provides superior performance on MRI with grossly enlarged ventricles (mean DSC value of 0.965 ± 0.027) or post-surgery shunt artifacts (mean DSC value of 0.964 ± 0.031). Results indicate that our method provides a high robust parcellation tool on the ventricular systems which is comparable to other state-of-the-art methods.
Collapse
|
16
|
Liu Y, Carass A, Zuo L, He Y, Han S, Gregori L, Murray S, Mishra R, Lei J, Calabresi PA, Saidha S, Prince JL. Disentangled Representation Learning for OCTA Vessel Segmentation With Limited Training Data. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:3686-3698. [PMID: 35862335 PMCID: PMC9910788 DOI: 10.1109/tmi.2022.3193029] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Optical coherence tomography angiography (OCTA) is an imaging modality that can be used for analyzing retinal vasculature. Quantitative assessment of en face OCTA images requires accurate segmentation of the capillaries. Using deep learning approaches for this task faces two major challenges. First, acquiring sufficient manual delineations for training can take hundreds of hours. Second, OCTA images suffer from numerous contrast-related artifacts that are currently inherent to the modality and vary dramatically across scanners. We propose to solve both problems by learning a disentanglement of an anatomy component and a local contrast component from paired OCTA scans. With the contrast removed from the anatomy component, a deep learning model that takes the anatomy component as input can learn to segment vessels with a limited portion of the training images being manually labeled. Our method demonstrates state-of-the-art performance for OCTA vessel segmentation.
Collapse
|
17
|
Upadhyay K, Alshareef A, Knutsen AK, Johnson CL, Carass A, Bayly PV, Pham DL, Prince JL, Ramesh KT. Development and validation of subject-specific 3D human head models based on a nonlinear visco-hyperelastic constitutive framework. J R Soc Interface 2022; 19:20220561. [PMCID: PMC9554734 DOI: 10.1098/rsif.2022.0561] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022] Open
Abstract
Computational head models are promising tools for understanding and predicting traumatic brain injuries. Most available head models are developed using inputs (i.e. head geometry, material properties and boundary conditions) from experiments on cadavers or animals and employ hereditary integral-based constitutive models that assume linear viscoelasticity in part of the rate-sensitive material response. This leads to high uncertainty and poor accuracy in capturing the nonlinear brain tissue response. To resolve these issues, a framework for the development of subject-specific three-dimensional head models is proposed, in which all inputs are derived in vivo from the same living human subject: head geometry via magnetic resonance imaging (MRI), brain tissue properties via magnetic resonance elastography (MRE), and full-field strain-response of the brain under rapid head rotation via tagged MRI. A nonlinear, viscous dissipation-based visco-hyperelastic constitutive model is employed to capture brain tissue response. Head models are validated using quantitative metrics that compare spatial strain distribution, temporal strain evolution, and the magnitude of strain maxima, with the corresponding experimental observations from tagged MRI. Results show that our head models accurately capture the strain-response of the brain. Further, employment of the nonlinear visco-hyperelastic constitutive framework provides improvements in the prediction of peak strains and temporal strain evolution over hereditary integral-based models.
Collapse
|
18
|
Xue Y, Dewey BE, Zuo L, Han S, Carass A, Duan P, Remedios SW, Pham DL, Saidha S, Calabresi PA, Prince JL. Bi-directional Synthesis of Pre- and Post-contrast MRI via Guided Feature Disentanglement. SIMULATION AND SYNTHESIS IN MEDICAL IMAGING : ... INTERNATIONAL WORKSHOP, SASHIMI ..., HELD IN CONJUNCTION WITH MICCAI ..., PROCEEDINGS. SASHIMI (WORKSHOP) 2022; 13570:55-65. [PMID: 36326241 PMCID: PMC9623769 DOI: 10.1007/978-3-031-16980-9_6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Magnetic resonance imaging (MRI) with gadolinium contrast is widely used for tissue enhancement and better identification of active lesions and tumors. Recent studies have shown that gadolinium deposition can accumulate in tissues including the brain, which raises safety concerns. Prior works have tried to synthesize post-contrast T1-weighted MRIs from pre-contrast MRIs to avoid the use of gadolinium. However, contrast and image representations are often entangled during the synthesis process, resulting in synthetic post-contrast MRIs with undesirable contrast enhancements. Moreover, the synthesis of pre-contrast MRIs from post-contrast MRIs which can be useful for volumetric analysis is rarely investigated in the literature. To tackle pre- and post- contrast MRI synthesis, we propose a BI-directional Contrast Enhancement Prediction and Synthesis (BICEPS) network that enables disentanglement of contrast and image representations via a bi-directional image-to-image translation(I2I)model. Our proposed model can perform both pre-to-post and post-to-pre contrast synthesis, and provides an interpretable synthesis process by predicting contrast enhancement maps from the learned contrast embedding. Extensive experiments on a multiple sclerosis dataset demonstrate the feasibility of applying our bidirectional synthesis and show that BICEPS outperforms current methods.
Collapse
|
19
|
Upadhyay K, Giovanis DG, Alshareef A, Knutsen AK, Johnson CL, Carass A, Bayly PV, Shields MD, Ramesh K. Data-driven Uncertainty Quantification in Computational Human Head Models. COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING 2022; 398:115108. [PMID: 37994358 PMCID: PMC10664838 DOI: 10.1016/j.cma.2022.115108] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/24/2023]
Abstract
Computational models of the human head are promising tools for estimating the impact-induced response of the brain, and thus play an important role in the prediction of traumatic brain injury. The basic constituents of these models (i.e., model geometry, material properties, and boundary conditions) are often associated with significant uncertainty and variability. As a result, uncertainty quantification (UQ), which involves quantification of the effect of this uncertainty and variability on the simulated response, becomes critical to ensure reliability of model predictions. Modern biofidelic head model simulations are associated with very high computational cost and high-dimensional inputs and outputs, which limits the applicability of traditional UQ methods on these systems. In this study, a two-stage, data-driven manifold learning-based framework is proposed for UQ of computational head models. This framework is demonstrated on a 2D subject-specific head model, where the goal is to quantify uncertainty in the simulated strain fields (i.e., output), given variability in the material properties of different brain substructures (i.e., input). In the first stage, a data-driven method based on multi-dimensional Gaussian kernel-density estimation and diffusion maps is used to generate realizations of the input random vector directly from the available data. Computational simulations of a small number of realizations provide input-output pairs for training data-driven surrogate models in the second stage. The surrogate models employ nonlinear dimensionality reduction using Grassmannian diffusion maps, Gaussian process regression to create a low-cost mapping between the input random vector and the reduced solution space, and geometric harmonics models for mapping between the reduced space and the Grassmann manifold. It is demonstrated that the surrogate models provide highly accurate approximations of the computational model while significantly reducing the computational cost. Monte Carlo simulations of the surrogate models are used for uncertainty propagation. UQ of the strain fields highlights significant spatial variation in model uncertainty, and reveals key differences in uncertainty among commonly used strain-based brain injury predictor variables.
Collapse
|
20
|
Shao M, Zuo L, Carass A, Zhuo J, Gullapalli RP, Prince JL. Evaluating the impact of MR image harmonization on thalamus deep network segmentation. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2022; 12032:120320H. [PMID: 35514535 PMCID: PMC9070007 DOI: 10.1117/12.2613159] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Medical image segmentation is one of the core tasks of medical image analysis. Automatic segmentation of brain magnetic resonance images (MRIs) can be used to visualize and track changes of the brain's anatomical structures that may occur due to normal aging or disease. Machine learning techniques are widely used in automatic structure segmentation. However, the contrast variation between the training and testing data makes it difficult for segmentation algorithms to generate consistent results. To address this problem, an image-to-image translation technique called MR image harmonization can be used to match the contrast between different data sets. It is important for the harmonization to transform image intensity while maintaining the underlying anatomy. In this paper, we present a 3D U-Net algorithm to segment the thalamus from multiple MR image modalities and investigate the impact of harmonization on the segmentation algorithm. Manual delineations of thalamic nuclei on two data sets are available. However, we aim to analyze the thalamus in another large data set where ground truth labels are lacking. We trained two segmentation networks, one with unharmonized images and the other with harmonized images, on one data set with manual labels, and compared their performances on the other data set with manual labels. These two data groups were diagnosed with two brain disorders and were acquired with similar imaging protocols. The harmonization target is the large data set without manual labels, which also has a different imaging protocol. The networks trained on unharmonized and harmonized data showed no significant difference when evaluating on the other data set; demonstrating that image harmonization can maintain the anatomy and does not affect the segmentation task. The two networks were evaluated on the harmonization target data set and the network trained on harmonized data showed significant improvement over the network trained on unharmonized data. Therefore, the network trained on harmonized data provides the potential to process large amounts of data from other sites, even in the absence of site-specific training data.
Collapse
|
21
|
Duan P, Han S, Zuo L, An Y, Liu Y, Alshareef A, Lee J, Carass A, Resnick SM, Prince JL. Cranial Meninges Reconstruction Based on Convolutional Networks and Deformable Models: Applications to Longitudinal Study of Normal Aging. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2022; 12032:1203215. [PMID: 36325254 PMCID: PMC9623767 DOI: 10.1117/12.2613146] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
The cranial meninges are membranes enveloping the brain. The space between these membranes contains mainly cerebrospinal fluid. It is of interest to study how the volumes of this space change with respect to normal aging. In this work, we propose to combine convolutional neural networks (CNNs) with nested topology-preserving geometric deformable models (NTGDMs) to reconstruct meningeal surfaces from magnetic resonance (MR) images. We first use CNNs to predict implicit representations of these surfaces then refine them with NTGDMs to achieve sub-voxel accuracy while maintaining spherical topology and the correct anatomical ordering. MR contrast harmonization is used to match the contrasts between training and testing images. We applied our algorithm to a subset of healthy subjects from the Baltimore Longitudinal Study of Aging for demonstration purposes and conducted longitudinal statistical analysis of the intracranial volume (ICV) and subarachnoid space (SAS) volume. We found a statistically significant decrease in the ICV and an increase in the SAS volume with respect to normal aging.
Collapse
|
22
|
Zuo L, Dewey BE, Liu Y, He Y, Newsome SD, Mowry EM, Resnick SM, Prince JL, Carass A. Unsupervised MR harmonization by learning disentangled representations using information bottleneck theory. Neuroimage 2021; 243:118569. [PMID: 34506916 PMCID: PMC10473284 DOI: 10.1016/j.neuroimage.2021.118569] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2021] [Revised: 08/11/2021] [Accepted: 09/07/2021] [Indexed: 01/19/2023] Open
Abstract
In magnetic resonance (MR) imaging, a lack of standardization in acquisition often causes pulse sequence-based contrast variations in MR images from site to site, which impedes consistent measurements in automatic analyses. In this paper, we propose an unsupervised MR image harmonization approach, CALAMITI (Contrast Anatomy Learning and Analysis for MR Intensity Translation and Integration), which aims to alleviate contrast variations in multi-site MR imaging. Designed using information bottleneck theory, CALAMITI learns a globally disentangled latent space containing both anatomical and contrast information, which permits harmonization. In contrast to supervised harmonization methods, our approach does not need a sample population to be imaged across sites. Unlike traditional unsupervised harmonization approaches which often suffer from geometry shifts, CALAMITI better preserves anatomy by design. The proposed method is also able to adapt to a new testing site with a straightforward fine-tuning process. Experiments on MR images acquired from ten sites show that CALAMITI achieves superior performance compared with other harmonization approaches.
Collapse
|
23
|
Liu X, Xing F, Prince JL, Carass A, Stone M, Fakhri GE, Woo J. DUAL-CYCLE CONSTRAINED BIJECTIVE VAE-GAN FOR TAGGED-TO-CINE MAGNETIC RESONANCE IMAGE SYNTHESIS. PROCEEDINGS. IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING 2021; 2021. [PMID: 34707796 DOI: 10.1109/isbi48211.2021.9433852] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Tagged magnetic resonance imaging (MRI) is a widely used imaging technique for measuring tissue deformation in moving organs. Due to tagged MRI's intrinsic low anatomical resolution, another matching set of cine MRI with higher resolution is sometimes acquired in the same scanning session to facilitate tissue segmentation, thus adding extra time and cost. To mitigate this, in this work, we propose a novel dual-cycle constrained bijective VAE-GAN approach to carry out tagged-to-cine MR image synthesis. Our method is based on a variational autoencoder backbone with cycle reconstruction constrained adversarial training to yield accurate and realistic cine MR images given tagged MR images. Our framework has been trained, validated, and tested using 1,768, 416, and 1,560 subject-independent paired slices of tagged and cine MRI from twenty healthy subjects, respectively, demonstrating superior performance over the comparison methods. Our method can potentially be used to reduce the extra acquisition time and cost, while maintaining the same workflow for further motion analyses.
Collapse
|
24
|
Bayly PV, Alshareef A, Knutsen AK, Upadhyay K, Okamoto RJ, Carass A, Butman JA, Pham DL, Prince JL, Ramesh KT, Johnson CL. MR Imaging of Human Brain Mechanics In Vivo: New Measurements to Facilitate the Development of Computational Models of Brain Injury. Ann Biomed Eng 2021; 49:2677-2692. [PMID: 34212235 PMCID: PMC8516723 DOI: 10.1007/s10439-021-02820-0] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2021] [Accepted: 06/22/2021] [Indexed: 01/04/2023]
Abstract
Computational models of the brain and its biomechanical response to skull accelerations are important tools for understanding and predicting traumatic brain injuries (TBIs). However, most models have been developed using experimental data collected on animal models and cadaveric specimens, both of which differ from the living human brain. Here we describe efforts to noninvasively measure the biomechanical response of the human brain with MRI-at non-injurious strain levels-and generate data that can be used to develop, calibrate, and evaluate computational brain biomechanics models. Specifically, this paper reports on a project supported by the National Institute of Neurological Disorders and Stroke to comprehensively image brain anatomy and geometry, mechanical properties, and brain deformations that arise from impulsive and harmonic skull loadings. The outcome of this work will be a publicly available dataset ( http://www.nitrc.org/projects/bbir ) that includes measurements on both males and females across an age range from adolescence to older adulthood. This article describes the rationale and approach for this study, the data available, and how these data may be used to develop new computational models and augment existing approaches; it will serve as a reference to researchers interested in using these data.
Collapse
|
25
|
Singh M, Pahl E, Wang S, Carass A, Lee J, Prince JL. Accurate Estimation of Total Intracranial Volume in MRI using a Multi-tasked Image-to-Image Translation Network. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2021; 11596. [PMID: 34548736 DOI: 10.1117/12.2582264] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Total intracranial volume (TIV) is the volume enclosed inside the cranium, inclusive of the meninges and the brain. TIV is extensively used to correct variations in inter-subject head size for the evaluation of neurodegenerative diseases. In this work, we present an automatic method to generate a TIV mask from MR images while synthesizing a CT image to be used in subsequent analysis. In addition, we propose an alternative way to obtain ground truth TIV masks using a semi-manual approach, which results in significant time savings. We train a conditional generative adversarial network (cGAN) using 2D MR slices to realize our tasks. The quantitative evaluation showed that the model was able to synthesize CT and generate TIV masks that closely approximate the reference images. This study also provides a comparison of the described method against skull stripping tools that output a mask enclosing the cranial volume, using MRI scan. In particular, highlighting the deficiencies in using such tools to approximate the volume using MRI scan.
Collapse
|