Segmentation of anatomical layers and imaging artifacts in intravascular polarization sensitive optical coherence tomography using attending physician and boundary cardinality losses

Intravascular ultrasound and optical coherence tomography are widely available for assessing coronary stenoses and provide critical information to optimize percutaneous coronary intervention. Intravascular polarization-sensitive optical coherence tomography (PS-OCT) measures the polarization state of the light scattered by the vessel wall in addition to conventional cross-sectional images of subsurface microstructure. This affords reconstruction of tissue polarization properties and reveals improved contrast between the layers of the vessel wall along with insight into collagen and smooth muscle content. Here, we propose a convolutional neural network model, optimized using two new loss terms (Boundary Cardinality and Attending Physician), that takes advantage of the additional polarization contrast and classifies the lumen, intima, and media layers in addition to guidewire and plaque shadows. Our model segments the media boundaries through fibrotic plaques and continues to estimate the outer media boundary behind shadows of lipid-rich plaques. We demonstrate that our multi-class classification model outperforms existing methods that exclusively use conventional OCT data, predominantly segment the lumen, and consider subsurface layers at most in regions of minimal disease. Segmentation of all anatomical layers throughout diseased vessels may facilitate stent sizing and will enable automated characterization of plaque polarization properties for investigation of the natural history and significance of coronary atheromas.

Spatial-Intensity Transforms for Medical Image-to-Image Translation

Image-to-image translation has seen major advances in computer vision but can be difficult to apply to medical images, where imaging artifacts and data scarcity degrade the performance of conditional generative adversarial networks. We develop the spatial-intensity transform (SIT) to improve output image quality while closely matching the target domain. SIT constrains the generator to a smooth spatial transform (diffeomorphism) composed with sparse intensity changes. SIT is a lightweight, modular network component that is effective on various architectures and training schemes. Relative to unconstrained baselines, this technique significantly improves image fidelity, and our models generalize robustly to different scanners. Additionally, SIT provides a disentangled view of anatomical and textural changes for each translation, making it easier to interpret the model's predictions in terms of physiological phenomena. We demonstrate SIT on two tasks: predicting longitudinal brain MRIs in patients with various stages of neurodegeneration, and visualizing changes with age and stroke severity in clinical brain scans of stroke patients. On the first task, our model accurately forecasts brain aging trajectories without supervised training on paired scans. On the second task, it captures associations between ventricle expansion and aging, as well as between white matter hyperintensities and stroke severity. As conditional generative models become increasingly versatile tools for visualization and forecasting, our approach demonstrates a simple and powerful technique for improving robustness, which is critical for translation to clinical settings. Source code is available at github.com/clintonjwang/spatial-intensity-transforms.

Automated segmentation of 3D cine cardiovascular magnetic resonance imaging

Introduction

As the life expectancy of children with congenital heart disease (CHD) is rapidly increasing and the adult population with CHD is growing, there is an unmet need to improve clinical workflow and efficiency of analysis. Cardiovascular magnetic resonance (CMR) is a noninvasive imaging modality for monitoring patients with CHD. CMR exam is based on multiple breath-hold 2-dimensional (2D) cine acquisitions that should be precisely prescribed and is expert and institution dependent. Moreover, 2D cine images have relatively thick slices, which does not allow for isotropic delineation of ventricular structures. Thus, development of an isotropic 3D cine acquisition and automatic segmentation method is worthwhile to make CMR workflow straightforward and efficient, as the present work aims to establish.

Methods

Ninety-nine patients with many types of CHD were imaged using a non-angulated 3D cine CMR sequence covering the whole-heart and great vessels. Automatic supervised and semi-supervised deep-learning-based methods were developed for whole-heart segmentation of 3D cine images to separately delineate the cardiac structures, including both atria, both ventricles, aorta, pulmonary arteries, and superior and inferior vena cavae. The segmentation results derived from the two methods were compared with the manual segmentation in terms of Dice score, a degree of overlap agreement, and atrial and ventricular volume measurements.

Results

The semi-supervised method resulted in a better overlap agreement with the manual segmentation than the supervised method for all 8 structures (Dice score 83.23 ± 16.76% vs. 77.98 ± 19.64%; P-value ≤0.001). The mean difference error in atrial and ventricular volumetric measurements between manual segmentation and semi-supervised method was lower (bias ≤ 5.2 ml) than the supervised method (bias ≤ 10.1 ml).

Discussion

The proposed semi-supervised method is capable of cardiac segmentation and chamber volume quantification in a CHD population with wide anatomical variability. It accurately delineates the heart chambers and great vessels and can be used to accurately calculate ventricular and atrial volumes throughout the cardiac cycle. Such a segmentation method can reduce inter- and intra- observer variability and make CMR exams more standardized and efficient.

Supervision by Denoising

Learning-based image reconstruction models, such as those based on the U-Net, require a large set of labeled images if good generalization is to be guaranteed. In some imaging domains, however, labeled data with pixel- or voxel-level label accuracy are scarce due to the cost of acquiring them. This problem is exacerbated further in domains like medical imaging, where there is no single ground truth label, resulting in large amounts of repeat variability in the labels. Therefore, training reconstruction networks to generalize better by learning from both labeled and unlabeled examples (called semi-supervised learning) is problem of practical and theoretical interest. However, traditional semi-supervised learning methods for image reconstruction often necessitate handcrafting a differentiable regularizer specific to some given imaging problem, which can be extremely time-consuming. In this work, we propose "supervision by denoising" (SUD), a framework to supervise reconstruction models using their own denoised output as labels. SUD unifies stochastic averaging and spatial denoising techniques under a spatio-temporal denoising framework and alternates denoising and model weight update steps in an optimization framework for semi-supervision. As example applications, we apply SUD to two problems from biomedical imaging-anatomical brain reconstruction (3D) and cortical parcellation (2D)-to demonstrate a significant improvement in reconstruction over supervised-only and ensembling baselines. Our code available at https://github.com/seannz/sud.

Accurate Bayesian segmentation of thalamic nuclei using diffusion MRI and an improved histological atlas

The human thalamus is a highly connected brain structure, which is key for the control of numerous functions and is involved in several neurological disorders. Recently, neuroimaging studies have increasingly focused on the volume and connectivity of the specific nuclei comprising this structure, rather than looking at the thalamus as a whole. However, accurate identification of cytoarchitectonically designed histological nuclei on standard in vivo structural MRI is hampered by the lack of image contrast that can be used to distinguish nuclei from each other and from surrounding white matter tracts. While diffusion MRI may offer such contrast, it has lower resolution and lacks some boundaries visible in structural imaging. In this work, we present a Bayesian segmentation algorithm for the thalamus. This algorithm combines prior information from a probabilistic atlas with likelihood models for both structural and diffusion MRI, allowing segmentation of 25 thalamic labels per hemisphere informed by both modalities. We present an improved probabilistic atlas, incorporating thalamic nuclei identified from histology and 45 white matter tracts surrounding the thalamus identified in ultra-high gradient strength diffusion imaging. We present a family of likelihood models for diffusion tensor imaging, ensuring compatibility with the vast majority of neuroimaging datasets that include diffusion MRI data. The use of these diffusion likelihood models greatly improves identification of nuclear groups versus segmentation based solely on structural MRI. Dice comparison of 5 manually identifiable groups of nuclei to ground truth segmentations show improvements of up to 10 percentage points. Additionally, our chosen model shows a high degree of reliability, with median test-retest Dice scores above 0.85 for four out of five nuclei groups, whilst also offering improved detection of differential thalamic involvement in Alzheimer's disease (AUROC 81.98%). The probabilistic atlas and segmentation tool will be made publicly available as part of the neuroimaging package FreeSurfer (https://freesurfer.net/fswiki/ThalamicNucleiDTI).

NeSVoR: Implicit Neural Representation for Slice-to-Volume Reconstruction in MRI

Reconstructing 3D MR volumes from multiple motion-corrupted stacks of 2D slices has shown promise in imaging of moving subjects, e. g., fetal MRI. However, existing slice-to-volume reconstruction methods are time-consuming, especially when a high-resolution volume is desired. Moreover, they are still vulnerable to severe subject motion and when image artifacts are present in acquired slices. In this work, we present NeSVoR, a resolution-agnostic slice-to-volume reconstruction method, which models the underlying volume as a continuous function of spatial coordinates with implicit neural representation. To improve robustness to subject motion and other image artifacts, we adopt a continuous and comprehensive slice acquisition model that takes into account rigid inter-slice motion, point spread function, and bias fields. NeSVoR also estimates pixel-wise and slice-wise variances of image noise and enables removal of outliers during reconstruction and visualization of uncertainty. Extensive experiments are performed on both simulated and in vivo data to evaluate the proposed method. Results show that NeSVoR achieves state-of-the-art reconstruction quality while providing two to ten-fold acceleration in reconstruction times over the state-of-the-art algorithms.

Domain-agnostic segmentation of thalamic nuclei from joint structural and diffusion MRI

The human thalamus is a highly connected subcortical grey-matter structure within the brain. It comprises dozens of nuclei with different function and connectivity, which are affected differently by disease. For this reason, there is growing interest in studying the thalamic nuclei in vivo with MRI. Tools are available to segment the thalamus from 1 mm T1 scans, but the contrast of the lateral and internal boundaries is too faint to produce reliable segmentations. Some tools have attempted to incorporate information from diffusion MRI in the segmentation to refine these boundaries, but do not generalise well across diffusion MRI acquisitions. Here we present the first CNN that can segment thalamic nuclei from T1 and diffusion data of any resolution without retraining or fine tuning. Our method builds on a public histological atlas of the thalamic nuclei and silver standard segmentations on high-quality diffusion data obtained with a recent Bayesian adaptive segmentation tool. We combine these with an approximate degradation model for fast domain randomisation during training. Our CNN produces a segmentation at 0.7 mm isotropic resolution, irrespective of the resolution of the input. Moreover, it uses a parsimonious model of the diffusion signal at each voxel (fractional anisotropy and principal eigenvector) that is compatible with virtually any set of directions and b-values, including huge amounts of legacy data. We show results of our proposed method on three heterogeneous datasets acquired on dozens of different scanners. An implementation of the method is publicly available at https://freesurfer.net/fswiki/ThalamicNucleiDTI.

Fetal development of functional thalamocortical and cortico-cortical connectivity

Measuring and understanding functional fetal brain development in utero is critical for the study of the developmental foundations of our cognitive abilities, possible early detection of disorders, and their prevention. Thalamocortical connections are an intricate component of shaping the cortical layout, but so far, only ex-vivo studies provide evidence of how axons enter the sub-plate and cortex during this highly dynamic phase. Evidence for normal in-utero development of the functional thalamocortical connectome in humans is missing. Here, we modeled fetal functional thalamocortical connectome development using in-utero functional magnetic resonance imaging in fetuses observed from 19th to 40th weeks of gestation (GW). We observed a peak increase of thalamocortical functional connectivity strength between 29th and 31st GW, right before axons establish synapses in the cortex. The cortico-cortical connectivity increases in a similar time window, and exhibits significant functional laterality in temporal-superior, -medial, and -inferior areas. Homologous regions exhibit overall similar mirrored connectivity profiles, but this similarity decreases during gestation giving way to a more diverse cortical interconnectedness. Our results complement the understanding of structural development of the human connectome and may serve as the basis for the investigation of disease and deviations from a normal developmental trajectory of connectivity development.

Radiomics-Derived Brain Age Predicts Functional Outcome After Acute Ischemic Stroke

BACKGROUND AND OBJECTIVES

While chronological age is one of the most influential determinants of poststroke outcomes, little is known of the impact of neuroimaging-derived biological "brain age." We hypothesized that radiomics analyses of T2-FLAIR images texture would provide brain age estimates and that advanced brain age of patients with stroke will be associated with cardiovascular risk factors and worse functional outcomes.

METHODS

We extracted radiomics from T2-FLAIR images acquired during acute stroke clinical evaluation. Brain age was determined from brain parenchyma radiomics using an ElasticNet linear regression model. Subsequently, relative brain age (RBA), which expresses brain age in comparison with chronological age-matched peers, was estimated. Finally, we built a linear regression model of RBA using clinical cardiovascular characteristics as inputs and a logistic regression model of favorable functional outcomes taking RBA as input.

RESULTS

We reviewed 4,163 patients from a large multisite ischemic stroke cohort (mean age = 62.8 years, 42.0% female patients). T2-FLAIR radiomics predicted chronological ages (mean absolute error = 6.9 years, r = 0.81). After adjustment for covariates, RBA was higher and therefore described older-appearing brains in patients with hypertension, diabetes mellitus, a history of smoking, and a history of a prior stroke. In multivariate analyses, age, RBA, NIHSS, and a history of prior stroke were all significantly associated with functional outcome (respective adjusted odds ratios: 0.58, 0.76, 0.48, 0.55; all p-values < 0.001). Moreover, the negative effect of RBA on outcome was especially pronounced in minor strokes.

DISCUSSION

T2-FLAIR radiomics can be used to predict brain age and derive RBA. Older-appearing brains, characterized by a higher RBA, reflect cardiovascular risk factor accumulation and are linked to worse outcomes after stroke.

SynthSR: A public AI tool to turn heterogeneous clinical brain scans into high-resolution T1-weighted images for 3D morphometry

Every year, millions of brain magnetic resonance imaging (MRI) scans are acquired in hospitals across the world. These have the potential to revolutionize our understanding of many neurological diseases, but their morphometric analysis has not yet been possible due to their anisotropic resolution. We present an artificial intelligence technique, "SynthSR," that takes clinical brain MRI scans with any MR contrast (T1, T2, etc.), orientation (axial/coronal/sagittal), and resolution and turns them into high-resolution T1 scans that are usable by virtually all existing human neuroimaging tools. We present results on segmentation, registration, and atlasing of >10,000 scans of controls and patients with brain tumors, strokes, and Alzheimer's disease. SynthSR yields morphometric results that are very highly correlated with what one would have obtained with high-resolution T1 scans. SynthSR allows sample sizes that have the potential to overcome the power limitations of prospective research studies and shed new light on the healthy and diseased human brain.

Cross-Sectional Observational Study of Typical in utero Fetal Movements Using Machine Learning

Early variations of fetal movements are the hallmark of a healthy developing central nervous system. However, there are no automatic methods to quantify the complex 3D motion of the developing fetus in utero. The aim of this prospective study was to use machine learning (ML) on in utero MRI to perform quantitative kinematic analysis of fetal limb movement, assessing the impact of maternal, placental, and fetal factors. In this cross-sectional, observational study, we used 76 sets of fetal (24-40 gestational weeks [GW]) blood oxygenation level-dependent (BOLD) MRI scans of 52 women (18-45 years old) during typical pregnancies. Pregnant women were scanned for 5-10 min while breathing room air (21% O2) and for 5-10 min while breathing 100% FiO2 in supine and/or lateral position. BOLD acquisition time was 20 min in total with effective temporal resolution approximately 3 s. To quantify upper and lower limb kinematics, we used a 3D convolutional neural network previously trained to track fetal key points (wrists, elbows, shoulders, ankles, knees, hips) on similar BOLD time series. Tracking was visually assessed, errors were manually corrected, and the absolute movement time (AMT) for each joint was calculated. To identify variables that had a significant association with AMT, we constructed a mixed-model ANOVA with interaction terms. Fetuses showed significantly longer duration of limb movements during maternal hyperoxia. We also found a significant centrifugal increase of AMT across limbs and significantly longer AMT of upper extremities <31 GW and longer AMT of lower extremities >35 GW. In conclusion, using ML we successfully quantified complex 3D fetal limb motion in utero and across gestation, showing maternal factors (hyperoxia) and fetal factors (gestational age, joint) that impact movement. Quantification of fetal motion on MRI is a potential new biomarker of fetal health and neuromuscular development.

Change in T2* measurements of placenta and fetal organs during Braxton Hicks contractions

Maternal-placental perfusion can be temporarily compromised by Braxton Hicks (BH) uterine contractions. Although prior studies have employed T2* changes to investigate the effect of BH contractions on placental oxygen, the effect of these contractions on the fetus has not been fully characterized. We investigated the effect of BH contractions on quantitative fetal organ T2* across gestation together with the birth information. We observed a slight but significant decrease in fetal brain and liver T2* during contractions.

Association of Stroke Lesion Pattern and White Matter Hyperintensity Burden With Stroke Severity and Outcome

BACKGROUND AND OBJECTIVES

To examine whether high white matter hyperintensity (WMH) burden is associated with greater stroke severity and worse functional outcomes in lesion pattern-specific ways.

METHODS

MR neuroimaging and NIH Stroke Scale data at index stroke and the modified Rankin Scale (mRS) score at 3-6 months after stroke were obtained from the MRI-Genetics Interface Exploration study of patients with acute ischemic stroke (AIS). Individual WMH volume was automatically derived from fluid-attenuated inversion recovery images. Stroke lesions were automatically segmented from diffusion-weighted imaging (DWI) images, parcellated into atlas-defined brain regions and further condensed to 10 lesion patterns via machine learning-based dimensionality reduction. Stroke lesion effects on AIS severity and unfavorable outcomes (mRS score >2) were modeled within purpose-built Bayesian linear and logistic regression frameworks. Interaction effects between stroke lesions and a high vs low WMH burden were integrated via hierarchical model structures. Models were adjusted for age, age2, sex, total DWI lesion and WMH volumes, and comorbidities. Data were split into derivation and validation cohorts.

RESULTS

A total of 928 patients with AIS contributed to acute stroke severity analyses (age: 64.8 [14.5] years, 40% women) and 698 patients to long-term functional outcome analyses (age: 65.9 [14.7] years, 41% women). Stroke severity was mainly explained by lesions focused on bilateral subcortical and left hemispherically pronounced cortical regions across patients with both a high and low WMH burden. Lesions centered on left-hemispheric insular, opercular, and inferior frontal regions and lesions affecting right-hemispheric temporoparietal regions had more pronounced effects on stroke severity in case of high compared with low WMH burden. Unfavorable outcomes were predominantly explained by lesions in bilateral subcortical regions. In difference to the lesion location-specific WMH effects on stroke severity, higher WMH burden increased the odds of unfavorable outcomes independent of lesion location.

DISCUSSION

Higher WMH burden may be associated with an increased stroke severity in case of stroke lesions involving left-hemispheric insular, opercular, and inferior frontal regions (potentially linked to language functions) and right-hemispheric temporoparietal regions (potentially linked to attention). Our findings suggest that patients with specific constellations of WMH burden and lesion locations may have greater benefits from acute recanalization treatments. Future clinical studies are warranted to systematically assess this assumption and guide more tailored treatment decisions.

SVoRT: Iterative Transformer for Slice-to-Volume Registration in Fetal Brain MRI

Volumetric reconstruction of fetal brains from multiple stacks of MR slices, acquired in the presence of almost unpredictable and often severe subject motion, is a challenging task that is highly sensitive to the initialization of slice-to-volume transformations. We propose a novel slice-to-volume registration method using Transformers trained on synthetically transformed data, which model multiple stacks of MR slices as a sequence. With the attention mechanism, our model automatically detects the relevance between slices and predicts the transformation of one slice using information from other slices. We also estimate the underlying 3D volume to assist slice-to-volume registration and update the volume and transformations alternately to improve accuracy. Results on synthetic data show that our method achieves lower registration error and better reconstruction quality compared with existing state-of-the-art methods. Experiments with real-world MRI data are also performed to demonstrate the ability of the proposed model to improve the quality of 3D reconstruction under severe fetal motion.

Learned iterative segmentation of highly variable anatomy from limited data: Applications to whole heart segmentation for congenital heart disease

Training deep learning models that segment an image in one step typically requires a large collection of manually annotated images that captures the anatomical variability in a cohort. This poses challenges when anatomical variability is extreme but training data is limited, as when segmenting cardiac structures in patients with congenital heart disease (CHD). In this paper, we propose an iterative segmentation model and show that it can be accurately learned from a small dataset. Implemented as a recurrent neural network, the model evolves a segmentation over multiple steps, from a single user click until reaching an automatically determined stopping point. We develop a novel loss function that evaluates the entire sequence of output segmentations, and use it to learn model parameters. Segmentations evolve predictably according to growth dynamics encapsulated by training data, which consists of images, partially completed segmentations, and the recommended next step. The user can easily refine the final segmentation by examining those that are earlier or later in the output sequence. Using a dataset of 3D cardiac MR scans from patients with a wide range of CHD types, we show that our iterative model offers better generalization to patients with the most severe heart malformations.

Migraine-Associated Common Genetic Variants Confer Greater Risk of Posterior vs. Anterior Circulation Ischemic Stroke☆

OBJECTIVE

To examine potential genetic relationships between migraine and the two distinct phenotypes posterior circulation ischemic stroke (PCiS) and anterior circulation ischemic stroke (ACiS), we generated migraine polygenic risk scores (PRSs) and compared these between PCiS and ACiS, and separately vs. non-stroke control subjects.

METHODS

Acute ischemic stroke cases were classified as PCiS or ACiS based on lesion location on diffusion-weighted MRI. Exclusion criteria were lesions in both vascular territories or uncertain territory; supratentorial PCiS with ipsilateral fetal posterior cerebral artery; and cases with atrial fibrillation. We generated migraine PRS for three migraine phenotypes (any migraine; migraine without aura; migraine with aura) using publicly available GWAS data and compared mean PRSs separately for PCiS and ACiS vs. non-stroke control subjects, and between each stroke phenotype.

RESULTS

Our primary analyses included 464 PCiS and 1079 ACiS patients with genetic European ancestry. Compared to non-stroke control subjects (n=15396), PRSs of any migraine were associated with increased risk of PCiS (p=0.01-0.03) and decreased risk of ACiS (p=0.010-0.039). Migraine without aura PRSs were significantly associated with PCiS (p=0.008-0.028), but not with ACiS. When comparing PCiS vs. ACiS directly, migraine PRSs were higher in PCiS vs. ACiS for any migraine (p=0.001-0.010) and migraine without aura (p=0.032-0.048). Migraine with aura PRS did not show a differential association in our analyses.

CONCLUSIONS

Our results suggest a stronger genetic overlap between unspecified migraine and migraine without aura with PCiS compared to ACiS. Possible shared mechanisms include dysregulation of cerebral vessel endothelial function.

Joint Frequency and Image Space Learning for MRI Reconstruction and Analysis

We propose neural network layers that explicitly combine frequency and image feature representations and show that they can be used as a versatile building block for reconstruction from frequency space data. Our work is motivated by the challenges arising in MRI acquisition where the signal is a corrupted Fourier transform of the desired image. The proposed joint learning schemes enable both correction of artifacts native to the frequency space and manipulation of image space representations to reconstruct coherent image structures at every layer of the network. This is in contrast to most current deep learning approaches for image reconstruction that treat frequency and image space features separately and often operate exclusively in one of the two spaces. We demonstrate the advantages of joint convolutional learning for a variety of tasks, including motion correction, denoising, reconstruction from undersampled acquisitions, and combined undersampling and motion correction on simulated and real world multicoil MRI data. The joint models produce consistently high quality output images across all tasks and datasets. When integrated into a state of the art unrolled optimization network with physics-inspired data consistency constraints for undersampled reconstruction, the proposed architectures significantly improve the optimization landscape, which yields an order of magnitude reduction of training time. This result suggests that joint representations are particularly well suited for MRI signals in deep learning networks. Our code and pretrained models are publicly available at https://github.com/nalinimsingh/interlacer.

Volumetric Parameterization of the Placenta to a Flattened Template

We present a volumetric mesh-based algorithm for parameterizing the placenta to a flattened template to enable effective visualization of local anatomy and function. MRI shows potential as a research tool as it provides signals directly related to placental function. However, due to the curved and highly variable in vivo shape of the placenta, interpreting and visualizing these images is difficult. We address interpretation challenges by mapping the placenta so that it resembles the familiar ex vivo shape. We formulate the parameterization as an optimization problem for mapping the placental shape represented by a volumetric mesh to a flattened template. We employ the symmetric Dirichlet energy to control local distortion throughout the volume. Local injectivity in the mapping is enforced by a constrained line search during the gradient descent optimization. We validate our method using a research study of 111 placental shapes extracted from BOLD MRI images. Our mapping achieves sub-voxel accuracy in matching the template while maintaining low distortion throughout the volume. We demonstrate how the resulting flattening of the placenta improves visualization of anatomy and function. Our code is freely available at https://github.com/mabulnaga/placenta-flattening.

Abstract WP102: Risk Score Estimation For The Prognostication Of Post-stroke Functional Independence Using Data-driven Score Assignment With Clinical And Imaging Biomarkers

Objective: Accurate prognostication of functional outcomes after an acute ischemic stroke (AIS) is essential for the planning of post-stroke treatments. We sought to provide an improved risk score for the prognostication by leveraging an interpretable machine learning and neuroradiologic biomarker.

Data: We evaluated 913 patients with available 90-day mRS and admission NIHSS from the MRI-GENIE study. Age, sex, hypertension, atrial fibrillation, diabetes, coronary artery disease, smoking and prior stroke were available. We quantified WMH volume (WMHv) on FLAIR images. We divided patients into development and validation sets from multiple sites, and an external validation set from an individual cohort (Figure (a)).

Methods: We measured the unaccounted WMHv (uWMH) by the residual of the log-linear regression model of WMHv regarding the clinical characteristics. Excessive uWMH (eWMH) was defined as present vs. absent based on a uWMH higher than +1 standard deviation. The clinical characteristics, admission NIHSS, and presence of eWMH were used as the inputs of a constrained logistic regression model with variable selection (RiskSLIM) that estimated a risk score for the prediction of post-stroke functional independence (mRS 0-2).

Results: Admission NIHSS, age, sex, diabetes, prior stroke, and eWMH were selected with assigned risk scores (Figure (b)). The estimated risk score outperformed the conventional THRIVE and SPAN100 in the development, validation, and external validation sets regarding the area under curve (AUC) and the brier score (Figure (c)).

Conclusion: This proposed risk score leveraging the interpretable machine learning and imaging biomarkers improved the prognostication of the post-stroke functional independence. Since the proposed risk score system does not require high computational resources, it is expected to be widely used in daily clinical practices for centers with MR imaging capability.

How Machine Learning is Powering Neuroimaging to Improve Brain Health

This report presents an overview of how machine learning is rapidly advancing clinical translational imaging in ways that will aid in the early detection, prediction, and treatment of diseases that threaten brain health. Towards this goal, we aresharing the information presented at a symposium, "Neuroimaging Indicators of Brain Structure and Function - Closing the Gap Between Research and Clinical Application", co-hosted by the McCance Center for Brain Health at Mass General Hospital and the MIT HST Neuroimaging Training Program on February 12, 2021. The symposium focused on the potential for machine learning approaches, applied to increasingly large-scale neuroimaging datasets, to transform healthcare delivery and change the trajectory of brain health by addressing brain care earlier in the lifespan. While not exhaustive, this overview uniquely addresses many of the technical challenges from image formation, to analysis and visualization, to synthesis and incorporation into the clinical workflow. Some of the ethical challenges inherent to this work are also explored, as are some of the regulatory requirements for implementation. We seek to educate, motivate, and inspire graduate students, postdoctoral fellows, and early career investigators to contribute to a future where neuroimaging meaningfully contributes to the maintenance of brain health.

Automated detection and reacquisition of motion-degraded images in fetal HASTE imaging at 3 T

PURPOSE

Fetal brain Magnetic Resonance Imaging suffers from unpredictable and unconstrained fetal motion that causes severe image artifacts even with half-Fourier single-shot fast spin echo (HASTE) readouts. This work presents the implementation of a closed-loop pipeline that automatically detects and reacquires HASTE images that were degraded by fetal motion without any human interaction.

METHODS

A convolutional neural network that performs automatic image quality assessment (IQA) was run on an external GPU-equipped computer that was connected to the internal network of the MRI scanner. The modified HASTE pulse sequence sent each image to the external computer, where the IQA convolutional neural network evaluated it, and then the IQA score was sent back to the sequence. At the end of the HASTE stack, the IQA scores from all the slices were sorted, and only slices with the lowest scores (corresponding to the slices with worst image quality) were reacquired.

RESULTS

The closed-loop HASTE acquisition framework was tested on 10 pregnant mothers, for a total of 73 acquisitions of our modified HASTE sequence. The IQA convolutional neural network, which was successfully employed by our modified sequence in real time, achieved an accuracy of 85.2% and area under the receiver operator characteristic of 0.899.

CONCLUSION

The proposed acquisition/reconstruction pipeline was shown to successfully identify and automatically reacquire only the motion degraded fetal brain HASTE slices in the prescribed stack. This minimizes the overall time spent on HASTE acquisitions by avoiding the need to repeat the entire stack if only few slices in the stack are motion-degraded.

Segmentation of Tricuspid Valve Leaflets From Transthoracic 3D Echocardiograms of Children With Hypoplastic Left Heart Syndrome Using Deep Learning

Hypoplastic left heart syndrome (HLHS) is a severe congenital heart defect in which the right ventricle and associated tricuspid valve (TV) alone support the circulation. TV failure is thus associated with heart failure, and the outcome of TV valve repair are currently poor. 3D echocardiography (3DE) can generate high-quality images of the valve, but segmentation is necessary for precise modeling and quantification. There is currently no robust methodology for rapid TV segmentation, limiting the clinical application of these technologies to this challenging population. We utilized a Fully Convolutional Network (FCN) to segment tricuspid valves from transthoracic 3DE. We trained on 133 3DE image-segmentation pairs and validated on 28 images. We then assessed the effect of varying inputs to the FCN using Mean Boundary Distance (MBD) and Dice Similarity Coefficient (DSC). The FCN with the input of an annular curve achieved a median DSC of 0.86 [IQR: 0.81-0.88] and MBD of 0.35 [0.23-0.4] mm for the merged segmentation and an average DSC of 0.77 [0.73-0.81] and MBD of 0.6 [0.44-0.74] mm for individual TV leaflet segmentation. The addition of commissural landmarks improved individual leaflet segmentation accuracy to an MBD of 0.38 [0.3-0.46] mm. FCN-based segmentation of the tricuspid valve from transthoracic 3DE is feasible and accurate. The addition of an annular curve and commissural landmarks improved the quality of the segmentations with MBD and DSC within the range of human inter-user variability. Fast and accurate FCN-based segmentation of the tricuspid valve in HLHS may enable rapid modeling and quantification, which in the future may inform surgical planning. We are now working to deploy this network for public use.

Excessive White Matter Hyperintensity Increases Susceptibility to Poor Functional Outcomes After Acute Ischemic Stroke

Objective: To personalize the prognostication of post-stroke outcome using MRI-detected cerebrovascular pathology, we sought to investigate the association between the excessive white matter hyperintensity (WMH) burden unaccounted for by the traditional stroke risk profile of individual patients and their long-term functional outcomes after a stroke. Methods: We included 890 patients who survived after an acute ischemic stroke from the MRI-Genetics Interface Exploration (MRI-GENIE) study, for whom data on vascular risk factors (VRFs), including age, sex, atrial fibrillation, diabetes mellitus, hypertension, coronary artery disease, smoking, prior stroke history, as well as acute stroke severity, 3- to-6-month modified Rankin Scale score (mRS), WMH, and brain volumes, were available. We defined the unaccounted WMH (uWMH) burden via modeling of expected WMH burden based on the VRF profile of each individual patient. The association of uWMH and mRS score was analyzed by linear regression analysis. The odds ratios of patients who achieved full functional independence (mRS < 2) in between trichotomized uWMH burden groups were calculated by pair-wise comparisons. Results: The expected WMH volume was estimated with respect to known VRFs. The uWMH burden was associated with a long-term functional outcome (β = 0.104, p < 0.01). Excessive uWMH burden significantly reduced the odds of achieving full functional independence after a stroke compared to the low and average uWMH burden [OR = 0.4, 95% CI: (0.25, 0.63), p < 0.01 and OR = 0.61, 95% CI: (0.42, 0.87), p < 0.01, respectively]. Conclusion: The excessive amount of uWMH burden unaccounted for by the traditional VRF profile was associated with worse post-stroke functional outcomes. Further studies are needed to evaluate a lifetime brain injury reflected in WMH unrelated to the VRF profile of a patient as an important factor for stroke recovery and a plausible indicator of brain health.

STRESS: Super-Resolution for Dynamic Fetal MRI using Self-Supervised Learning

Fetal motion is unpredictable and rapid on the scale of conventional MR scan times. Therefore, dynamic fetal MRI, which aims at capturing fetal motion and dynamics of fetal function, is limited to fast imaging techniques with compromises in image quality and resolution. Super-resolution for dynamic fetal MRI is still a challenge, especially when multi-oriented stacks of image slices for oversampling are not available and high temporal resolution for recording the dynamics of the fetus or placenta is desired. Further, fetal motion makes it difficult to acquire high-resolution images for supervised learning methods. To address this problem, in this work, we propose STRESS (Spatio-Temporal Resolution Enhancement with Simulated Scans), a self-supervised super-resolution framework for dynamic fetal MRI with interleaved slice acquisitions. Our proposed method simulates an interleaved slice acquisition along the high-resolution axis on the originally acquired data to generate pairs of low- and high-resolution images. Then, it trains a super-resolution network by exploiting both spatial and temporal correlations in the MR time series, which is used to enhance the resolution of the original data. Evaluations on both simulated and in utero data show that our proposed method outperforms other self-supervised super-resolution methods and improves image quality, which is beneficial to other downstream tasks and evaluations.

Multimodal Representation Learning via Maximization of Local Mutual Information

We propose and demonstrate a representation learning approach by maximizing the mutual information between local features of images and text. The goal of this approach is to learn useful image representations by taking advantage of the rich information contained in the free text that describes the findings in the image. Our method trains image and text encoders by encouraging the resulting representations to exhibit high local mutual information. We make use of recent advances in mutual information estimation with neural network discriminators. We argue that the sum of local mutual information is typically a lower bound on the global mutual information. Our experimental results in the downstream image classification tasks demonstrate the advantages of using local features for image-text representation learning. Our code is available at: https://github.com/RayRuizhiLiao/mutual_info_img_txt.

Joint super-resolution and synthesis of 1 mm isotropic MP-RAGE volumes from clinical MRI exams with scans of different orientation, resolution and contrast

Most existing algorithms for automatic 3D morphometry of human brain MRI scans are designed for data with near-isotropic voxels at approximately 1 mm resolution, and frequently have contrast constraints as well-typically requiring T1-weighted images (e.g., MP-RAGE scans). This limitation prevents the analysis of millions of MRI scans acquired with large inter-slice spacing in clinical settings every year. In turn, the inability to quantitatively analyze these scans hinders the adoption of quantitative neuro imaging in healthcare, and also precludes research studies that could attain huge sample sizes and hence greatly improve our understanding of the human brain. Recent advances in convolutional neural networks (CNNs) are producing outstanding results in super-resolution and contrast synthesis of MRI. However, these approaches are very sensitive to the specific combination of contrast, resolution and orientation of the input images, and thus do not generalize to diverse clinical acquisition protocols - even within sites. In this article, we present SynthSR, a method to train a CNN that receives one or more scans with spaced slices, acquired with different contrast, resolution and orientation, and produces an isotropic scan of canonical contrast (typically a 1 mm MP-RAGE). The presented method does not require any preprocessing, beyond rigid coregistration of the input scans. Crucially, SynthSR trains on synthetic input images generated from 3D segmentations, and can thus be used to train CNNs for any combination of contrasts, resolutions and orientations without high-resolution real images of the input contrasts. We test the images generated with SynthSR in an array of common downstream analyses, and show that they can be reliably used for subcortical segmentation and volumetry, image registration (e.g., for tensor-based morphometry), and, if some image quality requirements are met, even cortical thickness morphometry. The source code is publicly available at https://github.com/BBillot/SynthSR.

MRI Radiomic Signature of White Matter Hyperintensities Is Associated With Clinical Phenotypes

OBJECTIVE

Neuroimaging measurements of brain structural integrity are thought to be surrogates for brain health, but precise assessments require dedicated advanced image acquisitions. By means of quantitatively describing conventional images, radiomic analyses hold potential for evaluating brain health. We sought to: (1) evaluate radiomics to assess brain structural integrity by predicting white matter hyperintensities burdens (WMH) and (2) uncover associations between predictive radiomic features and clinical phenotypes.

METHODS

We analyzed a multi-site cohort of 4,163 acute ischemic strokes (AIS) patients with T2-FLAIR MR images with total brain and WMH segmentations. Radiomic features were extracted from normal-appearing brain tissue (brain mask-WMH mask). Radiomics-based prediction of personalized WMH burden was done using ElasticNet linear regression. We built a radiomic signature of WMH with stable selected features predictive of WMH burden and then related this signature to clinical variables using canonical correlation analysis (CCA).

RESULTS

Radiomic features were predictive of WMH burden (R 2 = 0.855 ± 0.011). Seven pairs of canonical variates (CV) significantly correlated the radiomics signature of WMH and clinical traits with respective canonical correlations of 0.81, 0.65, 0.42, 0.24, 0.20, 0.15, and 0.15 (FDR-corrected p-values CV 1 - 6 < 0.001, p-value CV 7 = 0.012). The clinical CV1 was mainly influenced by age, CV2 by sex, CV3 by history of smoking and diabetes, CV4 by hypertension, CV5 by atrial fibrillation (AF) and diabetes, CV6 by coronary artery disease (CAD), and CV7 by CAD and diabetes.

CONCLUSION

Radiomics extracted from T2-FLAIR images of AIS patients capture microstructural damage of the cerebral parenchyma and correlate with clinical phenotypes, suggesting different radiographical textural abnormalities per cardiovascular risk profile. Further research could evaluate radiomics to predict the progression of WMH and for the follow-up of stroke patients' brain health.

Abstract P323: Stroke Lesion Pattern-Specific Influence of White Matter Hyperintensities on Stroke Severity in Acute Ischemic Stroke

Introduction: MRI-detected white matter hyperintensity (WMH) burden is linked to the overall brain health and incident stroke outcomes. However, data are limited as to whether specific acute stroke lesion patterns purport greater stroke severity in patients with extensive pre-existing WMH. In this analysis, we sought to investigate lesion pattern-specific WMH effects on AIS severity.

Methods: We analyzed clinical and lesion data from 621 AIS patients enrolled in the multi-site MRI-GENIE study. The acute NIHSS was modelled via Bayesian hierarchical regression. Using ten stroke lesion patterns, that served as input variables of main interest, we introduced a hierarchical level differentiating between patients with higher and lower than median WMH volume (WMHv). Lesion pattern posterior distributions for higher and lower WMHv patients were subtracted to infer substantial differences.

Results: In this AIS cohort [age: 65.3±14.6, 60% male], a higher WMHv was associated with greater stroke severity only when specific left-hemispheric brain regions were infarcted. This “lesion pattern 3” was mainly characterized by left middle and inferior frontal gyrus, insular and opercular cortex, pre- and post-central gyrus, and subcortical basal ganglia regions ( Fig ).

Conclusions: Higher WMH burden appears to enhance the detrimental effect of acute stroke lesions involving left-hemispheric brain regions underlying language and motor functions. This effect might be due to an exacerbated disruption of functional network integrity by the combination of WMH and stroke lesions and could be explored further in functional imaging studies that simultaneously considered information from both lesion types.

Abstract P317: White Matter Hyperintensity Lesion Burden Modulates Functional Outcome After Acute Ischemic Stroke

Introduction: As a radiographic signature of end-stage small vessel disease, white matter hyperintensity (WMH) burden impacts recovery and outcomes after acute ischemic stroke (AIS). In this study, we sought to investigate the effect of WMH volume (WMHv) on stroke severity and functional outcomes independent of the infarct size and topography.

Methods: We analyzed 503 AIS patients with MRI data obtained on admission for index stroke enrolled in the multi-center MRI-GENIE study (cohort 1), followed by validation of the findings in an independent single-site study of 555 AIS patients (cohort 2). Stroke severity (NIHSS score) at index stroke and the long-term outcome (3-6 months mRS score) were modeled via Bayesian linear regression. Models included WMHv, age, sex, a 10-dimensional spatial ischemic lesion representation, acute infarct (DWI) volume, and common vascular risk factors (hypertension, diabetes mellitus, atrial fibrillation, coronary artery disease).

Results: Cohorts did not differ significantly in major clinical characteristics [cohort 1: age: 65.0±14.6, 41% female, NIHSS: 5.5±5.4, mRS: 1(iqr 2); cohort 2: age: 65.0±14.8, 38% female, NIHSS: 5.0±6.0, mRS: 1(iqr 3), p >0.05 for all comparisons]. WMHv did not substantially affect AIS severity ( Fig A ); in contrast, it emerged as an independent predictor of functional outcome in both datasets ( Fig B ).

Conclusions: When accounted for AIS lesion topography and stroke volume, total WMH lesion burden did not appear to modulate initial stroke severity but was associated with worse functional post-stroke outcomes. Future studies are needed to explore potential origins of these detrimental effects of pre-existing WMH burden on recovery after AIS.

Deep Learning to Quantify Pulmonary Edema in Chest Radiographs

Purpose

To develop a machine learning model to classify the severity grades of pulmonary edema on chest radiographs.

Materials and Methods

In this retrospective study, 369 071 chest radiographs and associated radiology reports from 64 581 patients (mean age, 51.71 years; 54.51% women) from the MIMIC-CXR chest radiograph dataset were included. This dataset was split into patients with and without congestive heart failure (CHF). Pulmonary edema severity labels from the associated radiology reports were extracted from patients with CHF as four different ordinal levels: 0, no edema; 1, vascular congestion; 2, interstitial edema; and 3, alveolar edema. Deep learning models were developed using two approaches: a semisupervised model using a variational autoencoder and a pretrained supervised learning model using a dense neural network. Receiver operating characteristic curve analysis was performed on both models.

Results

The area under the receiver operating characteristic curve (AUC) for differentiating alveolar edema from no edema was 0.99 for the semisupervised model and 0.87 for the pretrained models. Performance of the algorithm was inversely related to the difficulty in categorizing milder states of pulmonary edema (shown as AUCs for semisupervised model and pretrained model, respectively): 2 versus 0, 0.88 and 0.81; 1 versus 0, 0.79 and 0.66; 3 versus 1, 0.93 and 0.82; 2 versus 1, 0.69 and 0.73; and 3 versus 2, 0.88 and 0.63.

Conclusion

Deep learning models were trained on a large chest radiograph dataset and could grade the severity of pulmonary edema on chest radiographs with high performance.Supplemental material is available for this article.See also the commentary by Auffermann in this issue.© RSNA, 2021.

PEP: Parameter Ensembling by Perturbation

Ensembling is now recognized as an effective approach for increasing the predictive performance and calibration of deep networks. We introduce a new approach, Parameter Ensembling by Perturbation (PEP), that constructs an ensemble of parameter values as random perturbations of the optimal parameter set from training by a Gaussian with a single variance parameter. The variance is chosen to maximize the log-likelihood of the ensemble average ( L ) on the validation data set. Empirically, and perhaps surprisingly, L has a well-defined maximum as the variance grows from zero (which corresponds to the baseline model). Conveniently, calibration level of predictions also tends to grow favorably until the peak of L is reached. In most experiments, PEP provides a small improvement in performance, and, in some cases, a substantial improvement in empirical calibration. We show that this "PEP effect" (the gain in log-likelihood) is related to the mean curvature of the likelihood function and the empirical Fisher information. Experiments on ImageNet pre-trained networks including ResNet, DenseNet, and Inception showed improved calibration and likelihood. We further observed a mild improvement in classification accuracy on these networks. Experiments on classification benchmarks such as MNIST and CIFAR-10 showed improved calibration and likelihood, as well as the relationship between the PEP effect and overfitting; this demonstrates that PEP can be used to probe the level of overfitting that occurred during training. In general, no special training procedure or network architecture is needed, and in the case of pre-trained networks, no additional training is needed.

Distributed changes of the functional connectome in patients with glioblastoma

Glioblastoma might have widespread effects on the neural organization and cognitive function, and even focal lesions may be associated with distributed functional alterations. However, functional changes do not necessarily follow obvious anatomical patterns and the current understanding of this interrelation is limited. In this study, we used resting-state functional magnetic resonance imaging to evaluate changes in global functional connectivity patterns in 15 patients with glioblastoma. For six patients we followed longitudinal trajectories of their functional connectome and structural tumour evolution using bi-monthly follow-up scans throughout treatment and disease progression. In all patients, unilateral tumour lesions were associated with inter-hemispherically symmetric network alterations, and functional proximity of tumour location was stronger linked to distributed network deterioration than anatomical distance. In the longitudinal subcohort of six patients, we observed patterns of network alterations with initial transient deterioration followed by recovery at first follow-up, and local network deterioration to precede structural tumour recurrence by two months. In summary, the impact of focal glioblastoma lesions on the functional connectome is global and linked to functional proximity rather than anatomical distance to tumour regions. Our findings further suggest a relevance for functional network trajectories as a possible means supporting early detection of tumour recurrence.

Spatial-Intensity Transform GANs for High Fidelity Medical Image-to-Image Translation

Despite recent progress in image-to-image translation, it remains challenging to apply such techniques to clinical quality medical images. We develop a novel parameterization of conditional generative adversarial networks that achieves high image fidelity when trained to transform MRIs conditioned on a patient's age and disease severity. The spatial-intensity transform generative adversarial network (SIT-GAN) constrains the generator to a smooth spatial transform composed with sparse intensity changes. This technique improves image quality and robustness to artifacts, and generalizes to different scanners. We demonstrate SIT-GAN on a large clinical image dataset of stroke patients, where it captures associations between ventricle expansion and aging, as well as between white matter hyperintensities and stroke severity. Additionally, SIT-GAN provides a disentangled view of the variation in shape and appearance across subjects.

Joint Modeling of Chest Radiographs and Radiology Reports for Pulmonary Edema Assessment

We propose and demonstrate a novel machine learning algorithm that assesses pulmonary edema severity from chest radiographs. While large publicly available datasets of chest radiographs and free-text radiology reports exist, only limited numerical edema severity labels can be extracted from radiology reports. This is a significant challenge in learning such models for image classification. To take advantage of the rich information present in the radiology reports, we develop a neural network model that is trained on both images and free-text to assess pulmonary edema severity from chest radiographs at inference time. Our experimental results suggest that the joint image-text representation learning improves the performance of pulmonary edema assessment compared to a supervised model trained on images only. We also show the use of the text for explaining the image classification by the joint model. To the best of our knowledge, our approach is the first to leverage free-text radiology reports for improving the image model performance in this application. Our code is available at: https://github.com/RayRuizhiLiao/joint_chestxray.

Semi-Supervised Learning for Fetal Brain MRI Quality Assessment with ROI consistency

Fetal brain MRI is useful for diagnosing brain abnormalities but is challenged by fetal motion. The current protocol for T2-weighted fetal brain MRI is not robust to motion so image volumes are degraded by inter- and intra-slice motion artifacts. Besides, manual annotation for fetal MR image quality assessment are usually time-consuming. Therefore, in this work, a semi-supervised deep learning method that detects slices with artifacts during the brain volume scan is proposed. Our method is based on the mean teacher model, where we not only enforce consistency between student and teacher models on the whole image, but also adopt an ROI consistency loss to guide the network to focus on the brain region. The proposed method is evaluated on a fetal brain MR dataset with 11,223 labeled images and more than 200,000 unlabeled images. Results show that compared with supervised learning, the proposed method can improve model accuracy by about 6% and outperform other state-of-the-art semi-supervised learning methods. The proposed method is also implemented and evaluated on an MR scanner, which demonstrates the feasibility of online image quality assessment and image reacquisition during fetal MR scans.

Enhanced detection of fetal pose in 3D MRI by Deep Reinforcement Learning with physical structure priors on anatomy

Fetal MRI is heavily constrained by unpredictable and substantial fetal motion that causes image artifacts and limits the set of viable diagnostic image contrasts. Current mitigation of motion artifacts is predominantly performed by fast, single-shot MRI and retrospective motion correction. Estimation of fetal pose in real time during MRI stands to benefit prospective methods to detect and mitigate fetal motion artifacts where inferred fetal motion is combined with online slice prescription with low-latency decision making. Current developments of deep reinforcement learning (DRL), offer a novel approach for fetal landmarks detection. In this task 15 agents are deployed to detect 15 landmarks simultaneously by DRL. The optimization is challenging, and here we propose an improved DRL that incorporates priors on physical structure of the fetal body. First, we use graph communication layers to improve the communication among agents based on a graph where each node represents a fetal-body landmark. Further, additional reward based on the distance between agents and physical structures such as the fetal limbs is used to fully exploit physical structure. Evaluation of this method on a repository of 3-mm resolution in vivo data demonstrates a mean accuracy of landmark estimation within 10 mm of ground truth as 87.3%, and a mean error of 6.9 mm. The proposed DRL for fetal pose landmark search demonstrates a potential clinical utility for online detection of fetal motion that guides real-time mitigation of motion artifacts as well as health diagnosis during MRI of the pregnant mother.

Diffusion-Weighted Imaging, MR Angiography, and Baseline Data in a Systematic Multicenter Analysis of 3,301 MRI Scans of Ischemic Stroke Patients-Neuroradiological Review Within the MRI-GENIE Study

Background: Magnetic resonance imaging (MRI) serves as a cornerstone in defining stroke phenotype and etiological subtype through examination of ischemic stroke lesion appearance and is therefore an essential tool in linking genetic traits and stroke. Building on baseline MRI examinations from the centralized and structured radiological assessments of ischemic stroke patients in the Stroke Genetics Network, the results of the MRI-Genetics Interface Exploration (MRI-GENIE) study are described in this work.

Methods: The MRI-GENIE study included patients with symptoms caused by ischemic stroke (N = 3,301) from 12 international centers. We established and used a structured reporting protocol for all assessments. Two neuroradiologists, using a blinded evaluation protocol, independently reviewed the baseline diffusion-weighted images (DWIs) and magnetic resonance angiography images to determine acute lesion and vascular occlusion characteristics.

Results: In this systematic multicenter radiological analysis of clinical MRI from 3,301 acute ischemic stroke patients according to a structured prespecified protocol, we identified that anterior circulation infarcts were most prevalent (67.4%), that infarcts in the middle cerebral artery (MCA) territory were the most common, and that the majority of large artery occlusions 0 to 48 h from ictus were in the MCA territory. Multiple acute lesions in one or several vascular territories were common (11%). Of 2,238 patients with unilateral DWI lesions, 52.6% had left-sided infarct lateralization (P = 0.013 for χ² test).

Conclusions: This large-scale analysis of a multicenter MRI-based cohort of AIS patients presents a unique imaging framework facilitating the relationship between imaging and genetics for advancing the knowledge of genetic traits linked to ischemic stroke.

White matter hyperintensity burden in acute stroke patients differs by ischemic stroke subtype

OBJECTIVE

To examine etiologic stroke subtypes and vascular risk factor profiles and their association with white matter hyperintensity (WMH) burden in patients hospitalized for acute ischemic stroke (AIS).

METHODS

For the MRI Genetics Interface Exploration (MRI-GENIE) study, we systematically assembled brain imaging and phenotypic data for 3,301 patients with AIS. All cases underwent standardized web tool-based stroke subtyping with the Causative Classification of Ischemic Stroke (CCS). WMH volume (WMHv) was measured on T2 brain MRI scans of 2,529 patients with a fully automated deep-learning trained algorithm. Univariable and multivariable linear mixed-effects modeling was carried out to investigate the relationship of vascular risk factors with WMHv and CCS subtypes.

RESULTS

Patients with AIS with large artery atherosclerosis, major cardioembolic stroke, small artery occlusion (SAO), other, and undetermined causes of AIS differed significantly in their vascular risk factor profile (all p < 0.001). Median WMHv in all patients with AIS was 5.86 cm³ (interquartile range 2.18-14.61 cm³) and differed significantly across CCS subtypes (p < 0.0001). In multivariable analysis, age, hypertension, prior stroke, smoking (all p < 0.001), and diabetes mellitus (p = 0.041) were independent predictors of WMHv. When adjusted for confounders, patients with SAO had significantly higher WMHv compared to those with all other stroke subtypes (p < 0.001).

CONCLUSION

In this international multicenter, hospital-based cohort of patients with AIS, we demonstrate that vascular risk factor profiles and extent of WMH burden differ by CCS subtype, with the highest lesion burden detected in patients with SAO. These findings further support the small vessel hypothesis of WMH lesions detected on brain MRI of patients with ischemic stroke.

A topological encoding convolutional neural network for segmentation of 3D multiphoton images of brain vasculature using persistent homology

The clinical evidence suggests that cognitive disorders are associated with vasculature dysfunction and decreased blood flow in the brain. Hence, a functional understanding of the linkage between brain functionality and the vascular network is essential. However, methods to systematically and quantitatively describe and compare structures as complex as brain blood vessels are lacking. 3D imaging modalities such as multiphoton microscopy enables researchers to capture the network of brain vasculature with high spatial resolutions. Nonetheless, image processing and inference are some of the bottlenecks for biomedical research involving imaging, and any advancement in this area impacts many research groups. Here, we propose a topological encoding convolutional neural network based on persistent homology to segment 3D multiphoton images of brain vasculature. We demonstrate that our model out-performs state-of-the-art models in terms of the Dice coefficient and it is comparable in terms of other metrics such as sensitivity. Additionally, the topological characteristics of our model's segmentation results mimic manual ground truth. Our code and model are open source at https://github.com/mhaft/DeepVess.

Placental MRI: Effect of maternal position and uterine contractions on placental BOLD MRI measurements

INTRODUCTION

Before using blood-oxygen-level-dependent magnetic resonance imaging (BOLD MRI) during maternal hyperoxia as a method to detect individual placental dysfunction, it is necessary to understand spatiotemporal variations that represent normal placental function. We investigated the effect of maternal position and Braxton-Hicks contractions on estimates obtained from BOLD MRI of the placenta during maternal hyperoxia.

METHODS

For 24 uncomplicated singleton pregnancies (gestational age 27-36 weeks), two separate BOLD MRI datasets were acquired, one in the supine and one in the left lateral maternal position. The maternal oxygenation was adjusted as 5 min of room air (21% O₂), followed by 5 min of 100% FiO₂. After datasets were corrected for signal non-uniformities and motion, global and regional BOLD signal changes in R₂* and voxel-wise Time-To-Plateau (TTP) in the placenta were measured. The overall placental and uterine volume changes were determined across time to detect contractions.

RESULTS

In mothers without contractions, increases in global placental R₂* in the supine position were larger compared to the left lateral position with maternal hyperoxia. Maternal position did not alter global TTP but did result in regional changes in TTP. 57% of the subjects had Braxton-Hicks contractions and 58% of these had global placental R₂* decreases during the contraction.

CONCLUSION

Both maternal position and Braxton-Hicks contractions significantly affect global and regional changes in placental R₂* and regional TTP. This suggests that both factors must be taken into account in analyses when comparing placental BOLD signals over time within and between individuals.

Detailed phenotyping of posterior vs. anterior circulation ischemic stroke: a multi-center MRI study

OBJECTIVE

Posterior circulation ischemic stroke (PCiS) constitutes 20-30% of ischemic stroke cases. Detailed information about differences between PCiS and anterior circulation ischemic stroke (ACiS) remains scarce. Such information might guide clinical decision making and prevention strategies. We studied risk factors and ischemic stroke subtypes in PCiS vs. ACiS and lesion location on magnetic resonance imaging (MRI) in PCiS.

METHODS

Out of 3,301 MRIs from 12 sites in the National Institute of Neurological Disorders and Stroke (NINDS) Stroke Genetics Network (SiGN), we included 2,381 cases with acute DWI lesions. The definition of ACiS or PCiS was based on lesion location. We compared the groups using Chi-squared and logistic regression.

RESULTS

PCiS occurred in 718 (30%) patients and ACiS in 1663 (70%). Diabetes and male sex were more common in PCiS vs. ACiS (diabetes 27% vs. 23%, p < 0.05; male sex 68% vs. 58%, p < 0.001). Both were independently associated with PCiS (diabetes, OR = 1.29; 95% CI 1.04-1.61; male sex, OR = 1.46; 95% CI 1.21-1.78). ACiS more commonly had large artery atherosclerosis (25% vs. 20%, p < 0.01) and cardioembolic mechanisms (17% vs. 11%, p < 0.001) compared to PCiS. Small artery occlusion was more common in PCiS vs. ACiS (20% vs. 14%, p < 0.001). Small artery occlusion accounted for 47% of solitary brainstem infarctions.

CONCLUSION

Ischemic stroke subtypes differ between the two phenotypes. Diabetes and male sex have a stronger association with PCiS than ACiS. Definitive MRI-based PCiS diagnosis aids etiological investigation and contributes additional insights into specific risk factors and mechanisms of injury in PCiS.

Keypoint Transfer for Fast Whole-Body Segmentation

We introduce an approach for image segmentation based on sparse correspondences between keypoints in testing and training images. Keypoints represent automatically identified distinctive image locations, where each keypoint correspondence suggests a transformation between images. We use these correspondences to transfer the label maps of entire organs from the training images to the test image. The keypoint transfer algorithm includes three steps: 1) keypoint matching; 2) voting-based keypoint labeling; and 3) keypoint-based probabilistic transfer of organ segmentations. We report segmentation results for abdominal organs in whole-body CT and MRI, as well as in contrast-enhanced CT and MRI. Our method offers a speed-up of about three orders of magnitude in comparison with common multi-atlas segmentation while achieving an accuracy that compares favorably. Moreover, keypoint transfer does not require the registration to an atlas or a training phase. Finally, the method allows for the segmentation of scans with a highly variable field-of-view.

Registration uncertainty quantification via low-dimensional characterization of geometric deformations

This paper presents an efficient approach to quantifying image registration uncertainty based on a low-dimensional representation of geometric deformations. In contrast to previous methods, we develop a Bayesian diffeomorphic registration framework in a bandlimited space, rather than a high-dimensional image space. We show that a dense posterior distribution on deformation fields can be fully characterized by much fewer parameters, which dramatically reduces the computational complexity of model inferences. To further avoid heavy computation loads introduced by random sampling algorithms, we approximate a marginal posterior by using Laplace's method at the optimal solution of log-posterior distribution. Experimental results on both 2D synthetic data and real 3D brain magnetic resonance imaging (MRI) scans demonstrate that our method is significantly faster than the state-of-the-art diffeomorphic registration uncertainty quantification algorithms, while producing comparable results.

Disease Knowledge Transfer across Neurodegenerative Diseases

We introduce Disease Knowledge Transfer (DKT), a novel technique for transferring biomarker information between related neurodegenerative diseases. DKT infers robust multimodal biomarker trajectories in rare neurodegenerative diseases even when only limited, unimodal data is available, by transferring information from larger multimodal datasets from common neurodegenerative diseases. DKT is a joint-disease generative model of biomarker progressions, which exploits biomarker relationships that are shared across diseases. Our proposed method allows, for the first time, the estimation of plausible multimodal biomarker trajectories in Posterior Cortical Atrophy (PCA), a rare neurodegenerative disease where only unimodal MRI data is available. For this we train DKT on a combined dataset containing subjects with two distinct diseases and sizes of data available: 1) a larger, multimodal typical AD (tAD) dataset from the TADPOLE Challenge, and 2) a smaller unimodal Posterior Cortical Atrophy (PCA) dataset from the Dementia Research Centre (DRC), for which only a limited number of Magnetic Resonance Imaging (MRI) scans are available. Although validation is challenging due to lack of data in PCA, we validate DKT on synthetic data and two patient datasets (TADPOLE and PCA cohorts), showing it can estimate the ground truth parameters in the simulation and predict unseen biomarkers on the two patient datasets. While we demonstrated DKT on Alzheimer's variants, we note DKT is generalisable to other forms of related neurodegenerative diseases. Source code for DKT is available online: https://github.com/mrazvan22/dkt.