Faster family-wise error control for neuroimaging with a parametric bootstrap

Evaluation of resampling-based inference for topological features of neuroimages

Many recent studies have demonstrated the inflated type 1 error rate of the original Gaussian random field (GRF) methods for inference of neuroimages and identified resampling (permutation and bootstrapping) methods that have better performance. There has been no evaluation of resampling procedures when using robust (sandwich) statistical images with different topological features (TF) used for neuroimaging inference. Here, we consider estimation of distributions TFs of a statistical image and evaluate resampling procedures that can be used when exchangeability is violated. We compare the methods using realistic simulations and study sex differences in life-span age-related changes in gray matter volume in the Nathan Kline Institute Rockland sample. We find that our proposed wild bootstrap and the commonly used permutation procedure perform well in sample sizes above 50 under realistic simulations with heteroskedasticity. The Rademacher wild bootstrap has fewer assumptions than the permutation and performs similarly in samples of 100 or more, so is valid in a broader range of conditions. We also evaluate the GRF-based pTFCE method and show that it has inflated error rates in samples less than 200. Our R package, pbj , is available on Github and allows the user to reproducibly implement various resampling-based group level neuroimage analyses.

Exploring concomitant neuroimaging and genetic alterations in patients with and patients without auditory verbal hallucinations: A pilot study and mini review

Objective

To explore concomitant neuroimaging and genetic alterations in patients with schizophrenia with or without auditory verbal hallucinations (AVHs), and to discuss the use of pattern recognition techniques in the development of an objective index that may improve diagnostic accuracy and treatment outcomes for schizophrenia.

Methods

The pilot study included patients with schizophrenia with AVHs (SCH-AVH group) and without AVHs (SCH-no AVH group). High throughput sequencing (HTS) was performed to explore RNA networks. Global functional connectivity density (gFCD) analysis was performed to assess functional connectivity (FC) alterations of the default mode network (DMN). Quantitative long noncoding (lnc) RNA and mRNA expression data were related to peak T values of gFCDs using Pearson’s correlation coefficient analysis.

Results

Compared with the SCH-no AVH group (n = 5), patients in the SCH-AVH group (n = 5) exhibited differences in RNA expression in RNA networks that were related to AVH severity, and displayed alterations in FC (reflected by gFCD differences) within the DMN (posterior cingulate and dorsal-medial prefrontal cortex), and in the right parietal lobe, left occipital lobe, and left temporal lobe. Peak lncRNA expression values were significantly related to peak gFCD T values within the DMN.

Conclusion

Among patients with schizophrenia, there are concomitant FC and genetic expression alterations associated with AVHs. Data from pattern recognition studies may inform the development of an objective index aimed at improving early diagnostic accuracy and treatment planning for patients with schizophrenia with and without AVHs.

Improving the replicability of neuroimaging findings by thresholding effect sizes instead of p-values

The classical approach for testing statistical images using spatial extent inference (SEI) thresholds the statistical image based on the p‐value. This approach has an unfortunate consequence on the replicability of neuroimaging findings because the targeted brain regions are affected by the sample size—larger studies have more power to detect smaller effects. Here, we use simulations based on the preprocessed Autism Brain Imaging Data Exchange (ABIDE) to show that thresholding statistical images by effect sizes has more consistent estimates of activated regions across studies than thresholding by p‐values. Using a constant effect size threshold means that the p‐value threshold naturally scales with the sample size to ensure that the target set is similar across repetitions of the study that use different sample sizes. As a consequence of thresholding by the effect size, the type 1 and type 2 error rates go to zero as the sample size gets larger. We use a newly proposed robust effect size index that is defined for an arbitrary statistical image so that effect size thresholding can be used regardless of the test statistic or model.

Multiple comparison correction methods for whole-body magnetic resonance imaging

Purpose: Voxel-level hypothesis testing on images suffers from test multiplicity. Numerous correction methods exist, mainly applied and evaluated on neuroimaging and synthetic datasets. However, newly developed approaches like Imiomics, using different data and less common analysis types, also require multiplicity correction for more reliable inference. To handle the multiple comparisons in Imiomics, we aim to evaluate correction methods on whole-body MRI and correlation analyses, and to develop techniques specifically suited for the given analyses.

Approach: We evaluate the most common familywise error rate (FWER) limiting procedures on whole-body correlation analyses via standard (synthetic no-activation) nominal error rate estimation as well as smaller prior-knowledge based stringency analysis. Their performance is compared to our anatomy-based method extensions.

Results: Results show that nonparametric methods behave better for the given analyses. The proposed prior-knowledge based evaluation shows that the devised extensions including anatomical priors can achieve the same power while keeping the FWER closer to the desired rate.

Conclusions: Permutation-based approaches perform adequately and can be used within Imiomics. They can be improved by including information on image structure. We expect such method extensions to become even more relevant with new applications and larger datasets.

A local group differences test for subject-level multivariate density neuroimaging outcomes

A great deal of neuroimaging research focuses on voxel-wise analysis or segmentation of damaged tissue, yet many diseases are characterized by diffuse or non-regional neuropathology. In simple cases, these processes can be quantified using summary statistics of voxel intensities. However, the manifestation of a disease process in imaging data is often unknown, or appears as a complex and nonlinear relationship between the voxel intensities on various modalities. When the relevant pattern is unknown, summary statistics are often unable to capture differences between disease groups, and their use may encourage post hoc searches for the optimal summary measure. In this study, we introduce the multi-modal density testing (MMDT) framework for the naive discovery of group differences in voxel intensity profiles. MMDT operationalizes multi-modal magnetic resonance imaging (MRI) data as multivariate subject-level densities of voxel intensities and utilizes kernel density estimation to develop a local two-sample test for individual points within the density space. Through simulations, we show that this method controls type I error and recovers relevant differences when applied to a specified point. Additionally, we demonstrate the ability to maintain power while controlling the family-wise error rate and false discovery rate when applying the test over a grid of points within the density space. Finally, we apply this method to a study of subjects with either multiple sclerosis (MS) or conditions that tend to mimic MS on MRI, and find significant differences between the two groups in their voxel intensity profiles within the thalamus.

Robust spatial extent inference with a semiparametric bootstrap joint inference procedure

Spatial extent inference (SEI) is widely used across neuroimaging modalities to adjust for multiple comparisons when studying brain-phenotype associations that inform our understanding of disease. Recent studies have shown that Gaussian random field (GRF)-based tools can have inflated family-wise error rates (FWERs). This has led to substantial controversy as to which processing choices are necessary to control the FWER using GRF-based SEI. The failure of GRF-based methods is due to unrealistic assumptions about the spatial covariance function of the imaging data. A permutation procedure is the most robust SEI tool because it estimates the spatial covariance function from the imaging data. However, the permutation procedure can fail because its assumption of exchangeability is violated in many imaging modalities. Here, we propose the (semi-) parametric bootstrap joint (PBJ; sPBJ) testing procedures that are designed for SEI of multilevel imaging data. The sPBJ procedure uses a robust estimate of the spatial covariance function, which yields consistent estimates of standard errors, even if the covariance model is misspecified. We use the methods to study the association between performance and executive functioning in a working memory functional magnetic resonance imaging study. The sPBJ has similar or greater power to the PBJ and permutation procedures while maintaining the nominal type 1 error rate in reasonable sample sizes. We provide an R package to perform inference using the PBJ and sPBJ procedures.