SynBOLD-DisCo: Synthetic BOLD images for distortion correction of fMRI without additional calibration scans

The blood oxygen level dependent (BOLD) signal from functional magnetic resonance imaging (fMRI) is a noninvasive technique that has been widely used in research to study brain function. However, fMRI suffers from susceptibility-induced off resonance fields which may cause geometric distortions and mismatches with anatomical images. State-of-the-art correction methods require acquiring reverse phase encoded images or additional field maps to enable distortion correction. However, not all imaging protocols include these additional scans and thus cannot take advantage of these susceptibility correction capabilities. As such, in this study we aim to enable state-of-the-art distortion correction with FSL's topup algorithm of historical and/or limited fMRI data that include only a structural image and single phase encoded fMRI. To do this, we use 3D U-net models to synthesize undistorted fMRI BOLD contrast images from the structural image and use this undistorted synthetic image as an anatomical target for distortion correction with topup. We evaluate the efficacy of this approach, named SynBOLD-DisCo (synthetic BOLD images for distortion correction), and show that BOLD images corrected using our approach are geometrically more similar to structural images than the distorted BOLD data and are practically equivalent to state-of-the-art correction methods which require reverse phase encoded data. Future directions include additional validation studies, integration with other preprocessing operations, retraining with broader pathologies, and investigating the effects of spin echo versus gradient echo images for training and distortion correction. In summary, we demonstrate SynBOLD-DisCo corrects distortion of fMRI when reverse phase encoding scans or field maps are not available.

Deep whole brain segmentation of 7T structural MRI

7T magnetic resonance imaging (MRI) has the potential to drive our understanding of human brain function through new contrast and enhanced resolution. Whole brain segmentation is a key neuroimaging technique that allows for region-by-region analysis of the brain. Segmentation is also an important preliminary step that provides spatial and volumetric information for running other neuroimaging pipelines. Spatially localized atlas network tiles (SLANT) is a popular 3D convolutional neural network (CNN) tool that breaks the whole brain segmentation task into localized sub-tasks. Each sub-task involves a specific spatial location handled by an independent 3D convolutional network to provide high resolution whole brain segmentation results. SLANT has been widely used to generate whole brain segmentations from structural scans acquired on 3T MRI. However, the use of SLANT for whole brain segmentation from structural 7T MRI scans has not been successful due to the inhomogeneous image contrast usually seen across the brain in 7T MRI. For instance, we demonstrate the mean percent difference of SLANT label volumes between a 3T scan-rescan is approximately 1.73%, whereas its 3T-7T scan-rescan counterpart has higher differences around 15.13%. Our approach to address this problem is to register the whole brain segmentation performed on 3T MRI to 7T MRI and use this information to finetune SLANT for structural 7T MRI. With the finetuned SLANT pipeline, we observe a lower mean relative difference in the label volumes of ~8.43% acquired from structural 7T MRI data. Dice similarity coefficient between SLANT segmentation on the 3T MRI scan and the after finetuning SLANT segmentation on the 7T MRI increased from 0.79 to 0.83 with p<0.01. These results suggest finetuning of SLANT is a viable solution for improving whole brain segmentation on high resolution 7T structural imaging.

Topological-Preserving Membrane Skeleton Segmentation in Multiplex Immunofluorescence Imaging

Multiplex immunofluorescence (MxIF) is an emerging imaging technology whose downstream molecular analytics highly rely upon the effectiveness of cell segmentation. In practice, multiple membrane markers (e.g., NaKATPase, PanCK and β-catenin) are employed to stain membranes for different cell types, so as to achieve a more comprehensive cell segmentation since no single marker fits all cell types. However, prevalent watershed-based image processing might yield inferior capability for modeling complicated relationships between markers. For example, some markers can be misleading due to questionable stain quality. In this paper, we propose a deep learning based membrane segmentation method to aggregate complementary information that is uniquely provided by large scale MxIF markers. We aim to segment tubular membrane structure in MxIF data using global (membrane markers z-stack projection image) and local (separate individual markers) information to maximize topology preservation with deep learning. Specifically, we investigate the feasibility of four SOTA 2D deep networks and four volumetric-based loss functions. We conducted a comprehensive ablation study to assess the sensitivity of the proposed method with various combinations of input channels. Beyond using adjusted rand index (ARI) as the evaluation metric, which was inspired by the clDice, we propose a novel volumetric metric that is specific for skeletal structure, denoted as c l D i c e S K E L . In total, 80 membrane MxIF images were manually traced for 5-fold cross-validation. Our model outperforms the baseline with a 20.2% and 41.3% increase in c l D i c e S K E L and ARI performance, which is significant (p<0.05) using the Wilcoxon signed rank test. Our work explores a promising direction for advancing MxIF imaging cell segmentation with deep learning membrane segmentation. Tools are available at https://github.com/MASILab/MxIF_Membrane_Segmentation.

Denoising of diffusion MRI in the cervical spinal cord - effects of denoising strategy and acquisition on intra-cord contrast, signal modeling, and feature conspicuity

Quantitative diffusion MRI (dMRI) is a promising technique for evaluating the spinal cord in health and disease. However, low signal-to-noise ratio (SNR) can impede interpretation and quantification of these images. The purpose of this study is to evaluate several dMRI denoising approaches on their ability to improve the quality, reliability, and accuracy of quantitative diffusion MRI of the spinal cord. We evaluate three denoising approaches (Non-Local Means, Marchenko-Pastur PCA, and a newly proposed Patch2Self algorithm) and conduct five experiments to validate the denoising performance on clinical-quality and commonly-acquired dMRI acquisitions: 1) a phantom experiment to assess denoising error and bias; 2) a multi-vendor, multi-acquisition open experiment for both qualitative and quantitative evaluation of noise residuals; 3) a bootstrapping experiment to estimate uncertainty of parametric maps; 4) an assessment of spinal cord lesion conspicuity in a multiple sclerosis group; and 5) an evaluation of denoising for advanced parametric multi-compartment modeling. We find that all methods improve signal-to-noise ratio and conspicuity of MS lesions in individual diffusion weighted images (DWIs), but MPPCA and Patch2Self excel at improving the quality and intra-cord contrast of diffusion weighted images - removing signal fluctuations due to thermal noise while improving precision of estimation of diffusion parameters even with very few DWIs (i.e., 16-32) typical of clinical acquisitions. These denoising approaches hold promise for facilitating reliable diffusion observations and measurements in the spinal cord to investigate biological and pathological processes.

Longitudinal Variability Analysis on Low-dose Abdominal CT with Deep Learning-based Segmentation

Metabolic health is increasingly implicated as a risk factor across conditions from cardiology to neurology, and efficiency assessment of body composition is critical to quantitatively characterizing these relationships. 2D low dose single slice computed tomography (CT) provides a high resolution, quantitative tissue map, albeit with a limited field of view. Although numerous potential analyses have been proposed in quantifying image context, there has been no comprehensive study for low-dose single slice CT longitudinal variability with automated segmentation. We studied a total of 1816 slices from 1469 subjects of Baltimore Longitudinal Study on Aging (BLSA) abdominal dataset using supervised deep learning-based segmentation and unsupervised clustering method. 300 out of 1469 subjects that have two year gap in their first two scans were pick out to evaluate longitudinal variability with measurements including intraclass correlation coefficient (ICC) and coefficient of variation (CV) in terms of tissues/organs size and mean intensity. We showed that our segmentation methods are stable in longitudinal settings with Dice ranged from 0.821 to 0.962 for thirteen target abdominal tissues structures. We observed high variability in most organ with ICC<0.5, low variability in the area of muscle, abdominal wall, fat and body mask with average ICC≥0.8. We found that the variability in organ is highly related to the cross-sectional position of the 2D slice. Our efforts pave quantitative exploration and quality control to reduce uncertainties in longitudinal analysis.

Deep Constrained Spherical Deconvolution for Robust Harmonization

Diffusion weighted magnetic resonance imaging (DW-MRI) captures tissue microarchitecture at millimeter scale. With recent advantages in data sharing, large-scale multi-site DW-MRI datasets are being made available for multi-site studies. However, DW-MRI suffers from measurement variability (e.g., inter- and intra-site variability, hardware performance, and sequence design), which consequently yields inferior performance on multi-site and/or longitudinal diffusion studies. In this study, we propose a novel, deep learning-based method to harmonize DW-MRI signals for a more reproducible and robust estimation of microstructure. Our method introduces a data-driven scanner-invariant regularization scheme to model a more robust fiber orientation distribution function (FODF) estimation. We study the Human Connectome Project (HCP) young adults test-retest group as well as the MASiVar dataset (with inter- and intra-site scan/rescan data). The 8th order spherical harmonics coefficients are employed as data representation. The results show that the proposed harmonization approach maintains higher angular correlation coefficients (ACC) with the ground truth signals (0.954 versus 0.942), while achieves higher consistency of FODF signals for intra-scanner data (0.891 versus 0.826), as compared with the baseline supervised deep learning scheme. Furthermore, the proposed data-driven framework is flexible and potentially applicable to a wider range of data harmonization problems in neuroimaging.

Automatic Preprocessing Pipeline for White Matter Functional Analyses of Large-Scale Databases

Recently, increasing evidence suggests that fMRI signals in white matter (WM), conventionally ignored as nuisance, are robustly detectable using appropriate processing methods and are related to neural activity, while changes in WM with aging and degeneration are also well documented. These findings suggest variations in patterns of BOLD signals in WM should be investigated. However, existing fMRI analysis tools, which were designed for processing gray matter signals, are not well suited for large-scale processing of WM signals in fMRI data. We developed an automatic pipeline for high-performance preprocessing of fMRI images with emphasis on quantifying changes in BOLD signals in WM in an aging population. At the image processing level, the pipeline integrated existing software modules with fine parameter tunings and modifications to better extract weaker WM signals. The preprocessing results primarily included whole-brain time-courses, functional connectivity, maps and tissue masks in a common space. At the job execution level, this pipeline exploited a local XNAT to store datasets and results, while using DAX tool to automatic distribute batch jobs that run on high-performance computing clusters. Through the pipeline, 5,034 fMRI/T1 scans were preprocessed. The intraclass correlation coefficient (ICC) of test-retest experiment based on the preprocessed data is 0.52 - 0.86 (N=1000), indicating a high reliability of our pipeline, comparable to previously reported ICC in gray matter experiments. This preprocessing pipeline highly facilitates our future analyses on WM functional alterations in aging and may be of benefit to a larger community interested in WM fMRI studies.

Unsupervised Registration Refinement for Generating Unbiased Eye Atlas

With the confounding effects of demographics across large-scale imaging surveys, substantial variation is demonstrated with the volumetric structure of orbit and eye anthropometry. Such variability increases the level of difficulty to localize the anatomical features of the eye organs for populational analysis. To adapt the variability of eye organs with stable registration transfer, we propose an unbiased eye atlas template followed by a hierarchical coarse-to-fine approach to provide generalized eye organ context across populations. Furthermore, we retrieved volumetric scans from 1842 healthy patients for generating an eye atlas template with minimal biases. Briefly, we select 20 subject scans and use an iterative approach to generate an initial unbiased template. We then perform metric-based registration to the remaining samples with the unbiased template and generate coarse registered outputs. The coarse registered outputs are further leveraged to train a deep probabilistic network, which aims to refine the organ deformation in unsupervised setting. Computed tomography (CT) scans of 100 de-identified subjects are used to generate and evaluate the unbiased atlas template with the hierarchical pipeline. The refined registration shows the stable transfer of the eye organs, which were well-localized in the high-resolution (0.5 mm³) atlas space and demonstrated a significant improvement of 2.37% Dice for inverse label transfer performance. The subject-wise qualitative representations with surface rendering successfully demonstrate the transfer details of the organ context and showed the applicability of generalizing the morphological variation across patients.

Comparing voxel- and feature-wise harmonization of complex graph measures from multiple sites for structural brain network investigation of aging

Complex graph theory measures of brain structural connectomes derived from diffusion weighted images (DWI) provide insight into the network structure of the brain. Further, as the number of available DWI datasets grows, so does the ability to investigate associations in these measures with major biological factors, like age. However, one key hurdle that remains is the presence of scanner effects that can arise from different DWI datasets and confound multisite analyses. Two common approaches to correct these effects are voxel-wise and feature-wise harmonization. However, it is still unclear how to best leverage them for graph-theory analysis of an aging population. Thus, there is a need to better characterize the impact of each harmonization method and their ability to preserve age related features. We investigate this by characterizing four complex graph theory measures (modularity, characteristic path length, global efficiency, and betweenness centrality) in 48 participants aged 55 to 86 from Baltimore Longitudinal Study of Aging (BLSA) and Vanderbilt Memory and Aging Project (VMAP) before and after voxel- and feature-wise harmonization with the Null Space Deep Network (NSDN) and ComBat, respectively. First, we characterize across dataset coefficients of variation (CoV) and find the combination of NSDN and ComBat causes the greatest reduction in CoV followed by ComBat alone then NSDN alone. Second, we reproduce published associations of modularity with age after correcting for other covariates with linear models. We find that harmonization with ComBat or ComBat and NSDN together improves the significance of existing age effects, reduces model residuals, and qualitatively reduces separation between datasets. These results reinforce the efficiency of statistical harmonization on the feature-level with ComBat and suggest that harmonization on the voxel-level is synergistic but may have reduced effect after running through the multiple layers of the connectomics pipeline. Thus, we conclude that feature-wise harmonization improves statistical results, but the addition of biologically informed voxel-based harmonization offers further improvement.

Characterizing browser-based medical imaging AI with serverless edge computing: towards addressing clinical data security constraints

Artificial intelligence (AI) has been widely introduced to various medical imaging applications ranging from disease visualization to medical decision support. However, data privacy has become an essential concern in clinical practice of deploying the deep learning algorithms through cloud computing. The sensitivity of patient health information (PHI) commonly limits network transfer, installation of bespoke desktop software, and access to computing resources. Serverless edge-computing shed light on privacy preserved model distribution maintaining both high flexibility (as cloud computing) and security (as local deployment). In this paper, we propose a browser-based, cross-platform, and privacy preserved medical imaging AI deployment system working on consumer-level hardware via serverless edge-computing. Briefly we implement this system by deploying a 3D medical image segmentation model for computed tomography (CT) based lung cancer screening. We further curate tradeoffs in model complexity and data size by characterizing the speed, memory usage, and limitations across various operating systems and browsers. Our implementation achieves a deployment with (1) a 3D convolutional neural network (CNN) on CT volumes (256×256×256 resolution), (2) an average runtime of 80 seconds across Firefox v.102.0.1/Chrome v.103.0.5060.114/Microsoft Edge v.103.0.1264.44 and 210 seconds on Safari v.14.1.1, and (3) an average memory usage of 1.5 GB on Microsoft Windows laptops, Linux workstation, and Apple Mac laptops. In conclusion, this work presents a privacy-preserved solution for medical imaging AI applications that minimizes the risk of PHI exposure. We characterize the tools, architectures, and parameters of our framework to facilitate the translation of modern deep learning methods into routine clinical care.

Short superficial white matter and aging: a longitudinal multi-site study of 1293 subjects and 2711 sessions

It is estimated that short association fibers running immediately beneath the cortex may make up as much as 60% of the total white matter volume. However, these have been understudied relative to the long-range association, projection, and commissural fibers of the brain. This is largely because of limitations of diffusion MRI fiber tractography, which is the primary methodology used to non-invasively study the white matter connections. Inspired by recent anatomical considerations and methodological improvements in superficial white matter (SWM) tractography, we aim to characterize changes in these fiber systems in cognitively normal aging, which provide insight into the biological foundation of age-related cognitive changes, and a better understanding of how age-related pathology differs from healthy aging. To do this, we used three large, longitudinal and cross-sectional datasets (N = 1293 subjects, 2711 sessions) to quantify microstructural features and length/volume features of several SWM systems. We find that axial, radial, and mean diffusivities show positive associations with age, while fractional anisotropy has negative associations with age in SWM throughout the entire brain. These associations were most pronounced in the frontal, temporal, and temporoparietal regions. Moreover, measures of SWM volume and length decrease with age in a heterogenous manner across the brain, with different rates of change in inter-gyri and intra-gyri SWM, and at slower rates than well-studied long-range white matter pathways. These features, and their variations with age, provide the background for characterizing normal aging, and, in combination with larger association pathways and gray matter microstructural features, may provide insight into fundamental mechanisms associated with aging and cognition.

Hierarchical particle optimization for cortical shape correspondence in temporal lobe resection

BACKGROUND

Anterior temporal lobe resection is an effective treatment for temporal lobe epilepsy. The post-surgical structural changes could influence the follow-up treatment. Capturing post-surgical changes necessitates a well-established cortical shape correspondence between pre- and post-surgical surfaces. Yet, most cortical surface registration methods are designed for normal neuroanatomy. Surgical changes can introduce wide ranging artifacts in correspondence, for which conventional surface registration methods may not work as intended.

METHODS

In this paper, we propose a novel particle method for one-to-one dense shape correspondence between pre- and post-surgical surfaces with temporal lobe resection. The proposed method can handle partial structural abnormality involving non-rigid changes. Unlike existing particle methods using implicit particle adjacency, we consider explicit particle adjacency to establish a smooth correspondence. Moreover, we propose hierarchical optimization of particles rather than full optimization of all particles at once to avoid trappings of locally optimal particle update.

RESULTS

We evaluate the proposed method on 25 pairs of T1-MRI with pre- and post-simulated resection on the anterior temporal lobe and 25 pairs of patients with actual resection. We show improved accuracy over several cortical regions in terms of ROI boundary Hausdorff distance with 4.29 mm and Dice similarity coefficients with average value 0.841, compared to existing surface registration methods on simulated data. In 25 patients with actual resection of the anterior temporal lobe, our method shows an improved shape correspondence in qualitative and quantitative evaluation on parcellation-off ratio with average value 0.061 and cortical thickness changes. We also show better smoothness of the correspondence without self-intersection, compared with point-wise matching methods which show various degrees of self-intersection.

CONCLUSION

The proposed method establishes a promising one-to-one dense shape correspondence for temporal lobe resection. The resulting correspondence is smooth without self-intersection. The proposed hierarchical optimization strategy could accelerate optimization and improve the optimization accuracy. According to the results on the paired surfaces with temporal lobe resection, the proposed method outperforms the compared methods and is more reliable to capture cortical thickness changes.

Integrating the BIDS Neuroimaging Data Format and Workflow Optimization for Large-Scale Medical Image Analysis

A robust medical image computing infrastructure must host massive multimodal archives, perform extensive analysis pipelines, and execute scalable job management. An emerging data format standard, the Brain Imaging Data Structure (BIDS), introduces complexities for interfacing with XNAT archives. Moreover, workflow integration is combinatorically problematic when matching large amount of processing to large datasets. Historically, workflow engines have been focused on refining workflows themselves instead of actual job generation. However, such an approach is incompatible with data centric architecture that hosts heterogeneous medical image computing. Distributed automation for XNAT toolkit (DAX) provides large-scale image storage and analysis pipelines with an optimized job management tool. Herein, we describe developments for DAX that allows for integration of XNAT and BIDS standards. We also improve DAX's efficiencies of diverse containerized workflows in a high-performance computing (HPC) environment. Briefly, we integrate YAML configuration processor scripts to abstract workflow data inputs, data outputs, commands, and job attributes. Finally, we propose an online database-driven mechanism for DAX to efficiently identify the most recent updated sessions, thereby improving job building efficiency on large projects. We refer the proposed overall DAX development in this work as DAX-1 (DAX version 1). To validate the effectiveness of the new features, we verified (1) the efficiency of converting XNAT data to BIDS format and the correctness of the conversion using a collection of BIDS standard containerized neuroimaging workflows, (2) how YAML-based processor simplified configuration setup via a sequence of application pipelines, and (3) the productivity of DAX-1 on generating actual HPC processing jobs compared with earlier DAX baseline method. The empirical results show that (1) DAX-1 converting XNAT data to BIDS has similar speed as accessing XNAT data only; (2) YAML can integrate to the DAX-1 with shallow learning curve for users, and (3) DAX-1 reduced the job/assessor generation latency by finding recent modified sessions. Herein, we present approaches for efficiently integrating XNAT and modern image formats with a scalable workflow engine for the large-scale dataset access and processing.

Minimal number of sampling directions for robust measures of the spherical mean diffusion weighted signal: Effects of sampling directions, b-value, signal-to-noise ratio, hardware, and fitting strategy

Several recent multi-compartment diffusion MRI investigations and modeling strategies have utilized the orientationally-averaged, or spherical mean, diffusion-weighted signal to study tissue microstructure of the central nervous system. Most experimental designs sample a large number of diffusion weighted directions in order to calculate the spherical mean signal, however, sampling a subset of these directions may increase scanning efficiency and enable either a decrease in scan time or the ability to sample more diffusion weightings. Here, we aim to determine the minimum number of gradient directions needed for a robust measurement of the spherical mean signal. We used computer simulations to characterize the variation of the measured spherical mean signal as a function of the number of gradient directions, while also investigating the effects of diffusion weighting (b-value), signal-to-noise ratio (SNR), available hardware, and spherical mean fitting strategy. We then utilize empirically acquired data in the brain and spinal cord to validate simulations, showing experimental results are in good agreement with simulations. We summarize these results by providing an intuitive lookup table to facilitate the determination of the minimal number of sampling directions needed for robust spherical mean measurements, and give recommendations based on SNR and experimental conditions.

Reducing uncertainty in cancer risk estimation for patients with indeterminate pulmonary nodules using an integrated deep learning model

OBJECTIVE

Patients with indeterminate pulmonary nodules (IPN) with an intermediate to a high probability of lung cancer generally undergo invasive diagnostic procedures. Chest computed tomography image and clinical data have been in estimating the pretest probability of lung cancer. In this study, we apply a deep learning network to integrate multi-modal data from CT images and clinical data (including blood-based biomarkers) to improve lung cancer diagnosis. Our goal is to reduce uncertainty and to avoid morbidity, mortality, over- and undertreatment of patients with IPNs.

METHOD

We use a retrospective study design with cross-validation and external-validation from four different sites. We introduce a deep learning framework with a two-path structure to learn from CT images and clinical data. The proposed model can learn and predict with single modality if the multi-modal data is not complete. We use 1284 patients in the learning cohort for model development. Three external sites (with 155, 136 and 96 patients, respectively) provided patient data for external validation. We compare our model to widely applied clinical prediction models (Mayo and Brock models) and image-only methods (e.g., Liao et al. model).

RESULTS

Our co-learning model improves upon the performance of clinical-factor-only (Mayo and Brock models) and image-only (Liao et al.) models in both cross-validation of learning cohort (e.g.

, AUC

0.787 (ours) vs. 0.707-0.719 (baselines), results reported in validation fold and external-validation using three datasets from University of Pittsburgh Medical Center (e.g., 0.918 (ours) vs. 0.828-0.886 (baselines)), Detection of Early Cancer Among Military Personnel (e.g., 0.712 (ours) vs. 0.576-0.709 (baselines)), and University of Colorado Denver (e.g., 0.847 (ours) vs. 0.679-0.746 (baselines)). In addition, our model achieves better re-classification performance (cNRI 0.04 to 0.20) in all cross- and external-validation sets compared to the Mayo model.

CONCLUSIONS

Lung cancer risk estimation in patients with IPNs can benefit from the co-learning of CT image and clinical data. Learning from more subjects, even though those only have a single modality, can improve the prediction accuracy. An integrated deep learning model can achieve reasonable discrimination and re-classification performance.

Contrastive semi-supervised harmonization of single-shell to multi-shell diffusion MRI

Diffusion weighted MRI (DW-MRI) harmonization is necessary for multi-site or multi-acquisition studies. Current statistical methods address the need to harmonize from one site to another, but do not simultaneously consider the use of multiple datasets which are comprised of multiple sites, acquisitions protocols, and age demographics. This work explores deep learning methods which can generalize across these variations through semi-supervised and unsupervised learning while also learning to estimate multi-shell data from single-shell data using the Multi-shell Diffusion MRI Harmonization Challenge (MUSHAC) and Baltimore Longitudinal Study on Aging (BLSA) datasets. We compare disentanglement harmonization models, which seek to encode anatomy and acquisition in separate latent spaces, and a CycleGAN harmonization model, which uses generative adversarial networks (GAN) to perform style transfer between sites, to the baseline preprocessing and to SHORE interpolation. We find that the disentanglement models achieve superior performance in harmonizing all data while at the same transforming the input data to a single target space across several diffusion metrics (fractional anisotropy, mean diffusivity, mean kurtosis, primary eigenvector).

Behavioral and brain anatomical analysis of Foxg1 heterozygous mice

FOXG1 Syndrome (FS) is a devastating neurodevelopmental disorder that is caused by a heterozygous loss-of-function (LOF) mutation of the FOXG1 gene, which encodes a transcriptional regulator important for telencephalic brain development. People with FS have marked developmental delays, impaired ambulation, movement disorders, seizures, and behavior abnormalities including autistic features. Current therapeutic approaches are entirely symptomatic, however the ability to rescue phenotypes in mouse models of other genetic neurodevelopmental disorders such as Rett syndrome, Angelman syndrome, and Phelan-McDermid syndrome by postnatal expression of gene products has led to hope that similar approaches could help modify the disease course in other neurodevelopmental disorders such as FS. While FoxG1 protein function plays a critical role in embryonic brain development, the ongoing adult expression of FoxG1 and behavioral phenotypes that present when FoxG1 function is removed postnatally provides support for opportunity for improvement with postnatal treatment. Here we generated a new mouse allele of Foxg1 that disrupts protein expression and characterized the behavioral and structural brain phenotypes in heterozygous mutant animals. These mutant animals display changes in locomotor behavior, gait, anxiety, social interaction, aggression, and learning and memory compared to littermate controls. Additionally, they have structural brain abnormalities reminiscent of people with FS. This information provides a framework for future studies to evaluate the potential for post-natal expression of FoxG1 to modify the disease course in this severe neurodevelopmental disorder.

Label efficient segmentation of single slice thigh CT with two-stage pseudo labels

Purpose: Muscle, bone, and fat segmentation from thigh images is essential for quantifying body composition. Voxelwise image segmentation enables quantification of tissue properties including area, intensity, and texture. Deep learning approaches have had substantial success in medical image segmentation, but they typically require a significant amount of data. Due to the high cost of manual annotation, training deep learning models with limited human label data is desirable, but it is a challenging problem. Approach: Inspired by transfer learning, we proposed a two-stage deep learning pipeline to address the thigh and lower leg segmentation issue. We studied three datasets, 3022 thigh slices and 8939 lower leg slices from the BLSA dataset and 121 thigh slices from the GESTALT study. First, we generated pseudo labels for thigh based on approximate handcrafted approaches using CT intensity and anatomical morphology. Then, those pseudo labels were fed into deep neural networks to train models from scratch. Finally, the first stage model was loaded as the initialization and fine-tuned with a more limited set of expert human labels of the thigh. Results: We evaluated the performance of this framework on 73 thigh CT images and obtained an average Dice similarity coefficient (DSC) of 0.927 across muscle, internal bone, cortical bone, subcutaneous fat, and intermuscular fat. To test the generalizability of the proposed framework, we applied the model on lower leg images and obtained an average DSC of 0.823. Conclusions: Approximated handcrafted pseudo labels can build a good initialization for deep neural networks, which can help to reduce the need for, and make full use of, human expert labeled data.

Special Section Guest Editorial: Advances in High-Dimensional Medical Image Processing

Guest Editors Ivana Išgum, Bennett A. Landman, and Tomaž Vrtovec introduce the JMI Special Section on Advances in High-Dimensional Medical Image Processing.

Structural MRI-Based Measures of Accelerated Brain Aging do not Moderate the Acute Antidepressant Response in Late-Life Depression

OBJECTIVE

Late-life depression (LLD) is characterized by accelerated biological aging. Accelerated brain aging, estimated from structural magnetic resonance imaging (sMRI) data by a machine learning algorithm, is associated with LLD diagnosis, poorer cognitive performance, and disability. We hypothesized that accelerated brain aging moderates the antidepressant response.

DESIGN AND INTERVENTIONS

Following MRI, participants entered an 8-week randomized, controlled trial of escitalopram. Nonremitting participants then entered an open-label 8-week trial of bupropion.

PARTICIPANTS

Ninety-five individuals with LLD.

MEASUREMENTS

A machine learning algorithm estimated each participant's brain age from sMRI data. This was used to calculate the brain-age gap (BAG), or how estimated age differed from chronological age. Secondary sMRI measures of aging pathology included white matter hyperintensity (WMH) volumes and hippocampal volumes. Mixed models examined the relationship between sMRI measures and change in depression severity. Initial analyses tested for a moderating effect of MRI measures on change in depression severity with escitalopram. Subsequent analyses tested for the effect of MRI measures on change in depression severity over time across trials.

RESULTS

In the blinded initial phase, BAG was not significantly associated with a differential response to escitalopram over time. BAG was also not associated with a change in depression severity over time across both arms in the blinded phase or in the subsequent open-label bupropion phase. We similarly did not observe effects of WMH volume or hippocampal volume on change in depression severity over time.

CONCLUSION

sMRI markers of accelerated brain aging were not associated with treatment response in this sequential antidepressant trial.

Cross-scale Attention Guided Multi-instance Learning for Crohn's Disease Diagnosis with Pathological Images

Multi-instance learning (MIL) is widely used in the computer-aided interpretation of pathological Whole Slide Images (WSIs) to solve the lack of pixel-wise or patch-wise annotations. Often, this approach directly applies "natural image driven" MIL algorithms which overlook the multi-scale (i.e. pyramidal) nature of WSIs. Off-the-shelf MIL algorithms are typically deployed on a single-scale of WSIs (e.g., 20× magnification), while human pathologists usually aggregate the global and local patterns in a multi-scale manner (e.g., by zooming in and out between different magnifications). In this study, we propose a novel cross-scale attention mechanism to explicitly aggregate inter-scale interactions into a single MIL network for Crohn's Disease (CD), which is a form of inflammatory bowel disease. The contribution of this paper is two-fold: (1) a cross-scale attention mechanism is proposed to aggregate features from different resolutions with multi-scale interaction; and (2) differential multi-scale attention visualizations are generated to localize explainable lesion patterns. By training ~250,000 H&E-stained Ascending Colon (AC) patches from 20 CD patient and 30 healthy control samples at different scales, our approach achieved a superior Area under the Curve (AUC) score of 0.8924 compared with baseline models. The official implementation is publicly available at https://github.com/hrlblab/CS-MIL.

Anomalous and heterogeneous characteristics of the BOLD hemodynamic response function in white matter

Detailed knowledge of the BOLD hemodynamic response function (HRF) is crucial for accurate analyses and interpretation of functional MRI data. Considerable efforts have been made to characterize the HRF in gray matter (GM), but much less attention has been paid to BOLD effects in white matter (WM). However, several recent reports have demonstrated reliable detection and analyses of WM BOLD signals both after stimulation and in a resting state. WM and GM differ in composition, energy requirements, and blood flow, so their neurovascular couplings also may well be different. We aimed to derive a comprehensive characterization of the HRF in WM across a population, including accurate measurements of its shape and its variation along and between WM pathways, using resting-state fMRI acquisitions. Our results show that the HRF is significantly different between WM and GM. Features of the HRF, such as a prominent initial dip, show strong relationships with features of the tissue microstructure derived from diffusion imaging, and these relationships differ between WM and GM, consistent with BOLD signal fluctuations reflecting different energy demands and neurovascular couplings in tissues of different composition and function. We also show that the HRF varies in shape significantly along WM pathways and is different between different WM pathways, suggesting the temporal evolution of BOLD signals after an event vary in different parts of the WM. These features of the HRF in WM are especially relevant for interpretation of the biophysical basis of BOLD effects in WM.