Neuroimaging standards for research into small vessel disease and its contribution to ageing and neurodegeneration

Cerebral small vessel disease (SVD) is a common accompaniment of ageing. Features seen on neuroimaging include recent small subcortical infarcts, lacunes, white matter hyperintensities, perivascular spaces, microbleeds, and brain atrophy. SVD can present as a stroke or cognitive decline, or can have few or no symptoms. SVD frequently coexists with neurodegenerative disease, and can exacerbate cognitive deficits, physical disabilities, and other symptoms of neurodegeneration. Terminology and definitions for imaging the features of SVD vary widely, which is also true for protocols for image acquisition and image analysis. This lack of consistency hampers progress in identifying the contribution of SVD to the pathophysiology and clinical features of common neurodegenerative diseases. We are an international working group from the Centres of Excellence in Neurodegeneration. We completed a structured process to develop definitions and imaging standards for markers and consequences of SVD. We aimed to achieve the following: first, to provide a common advisory about terms and definitions for features visible on MRI; second, to suggest minimum standards for image acquisition and analysis; third, to agree on standards for scientific reporting of changes related to SVD on neuroimaging; and fourth, to review emerging imaging methods for detection and quantification of preclinical manifestations of SVD. Our findings and recommendations apply to research studies, and can be used in the clinical setting to standardise image interpretation, acquisition, and reporting. This Position Paper summarises the main outcomes of this international effort to provide the STandards for ReportIng Vascular changes on nEuroimaging (STRIVE).

The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)

In this paper we report the set-up and results of the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) organized in conjunction with the MICCAI 2012 and 2013 conferences. Twenty state-of-the-art tumor segmentation algorithms were applied to a set of 65 multi-contrast MR scans of low- and high-grade glioma patients-manually annotated by up to four raters-and to 65 comparable scans generated using tumor image simulation software. Quantitative evaluations revealed considerable disagreement between the human raters in segmenting various tumor sub-regions (Dice scores in the range 74%-85%), illustrating the difficulty of this task. We found that different algorithms worked best for different sub-regions (reaching performance comparable to human inter-rater variability), but that no single algorithm ranked in the top for all sub-regions simultaneously. Fusing several good algorithms using a hierarchical majority vote yielded segmentations that consistently ranked above all individual algorithms, indicating remaining opportunities for further methodological improvements. The BRATS image data and manual annotations continue to be publicly available through an online evaluation system as an ongoing benchmarking resource.

Image processing and Quality Control for the first 10,000 brain imaging datasets from UK Biobank

UK Biobank is a large-scale prospective epidemiological study with all data accessible to researchers worldwide. It is currently in the process of bringing back 100,000 of the original participants for brain, heart and body MRI, carotid ultrasound and low-dose bone/fat x-ray. The brain imaging component covers 6 modalities (T1, T2 FLAIR, susceptibility weighted MRI, Resting fMRI, Task fMRI and Diffusion MRI). Raw and processed data from the first 10,000 imaged subjects has recently been released for general research access. To help convert this data into useful summary information we have developed an automated processing and QC (Quality Control) pipeline that is available for use by other researchers. In this paper we describe the pipeline in detail, following a brief overview of UK Biobank brain imaging and the acquisition protocol. We also describe several quantitative investigations carried out as part of the development of both the imaging protocol and the processing pipeline.

Ten simple rules for neuroimaging meta-analysis

Neuroimaging has evolved into a widely used method to investigate the functional neuroanatomy, brain-behaviour relationships, and pathophysiology of brain disorders, yielding a literature of more than 30,000 papers. With such an explosion of data, it is increasingly difficult to sift through the literature and distinguish spurious from replicable findings. Furthermore, due to the large number of studies, it is challenging to keep track of the wealth of findings. A variety of meta-analytical methods (coordinate-based and image-based) have been developed to help summarise and integrate the vast amount of data arising from neuroimaging studies. However, the field lacks specific guidelines for the conduct of such meta-analyses. Based on our combined experience, we propose best-practice recommendations that researchers from multiple disciplines may find helpful. In addition, we provide specific guidelines and a checklist that will hopefully improve the transparency, traceability, replicability and reporting of meta-analytical results of neuroimaging data.

Consensus recommendations for a standardized Brain Tumor Imaging Protocol in clinical trials

A recent joint meeting was held on January 30, 2014, with the US Food and Drug Administration (FDA), National Cancer Institute (NCI), clinical scientists, imaging experts, pharmaceutical and biotech companies, clinical trials cooperative groups, and patient advocate groups to discuss imaging endpoints for clinical trials in glioblastoma. This workshop developed a set of priorities and action items including the creation of a standardized MRI protocol for multicenter studies. The current document outlines consensus recommendations for a standardized Brain Tumor Imaging Protocol (BTIP), along with the scientific and practical justifications for these recommendations, resulting from a series of discussions between various experts involved in aspects of neuro-oncology neuroimaging for clinical trials. The minimum recommended sequences include: (i) parameter-matched precontrast and postcontrast inversion recovery-prepared, isotropic 3D T1-weighted gradient-recalled echo; (ii) axial 2D T2-weighted turbo spin-echo acquired after contrast injection and before postcontrast 3D T1-weighted images to control timing of images after contrast administration; (iii) precontrast, axial 2D T2-weighted fluid-attenuated inversion recovery; and (iv) precontrast, axial 2D, 3-directional diffusion-weighted images. Recommended ranges of sequence parameters are provided for both 1.5 T and 3 T MR systems.

Harmonization of large MRI datasets for the analysis of brain imaging patterns throughout the lifespan

As medical imaging enters its information era and presents rapidly increasing needs for big data analytics, robust pooling and harmonization of imaging data across diverse cohorts with varying acquisition protocols have become critical. We describe a comprehensive effort that merges and harmonizes a large-scale dataset of 10,477 structural brain MRI scans from participants without a known neurological or psychiatric disorder from 18 different studies that represent geographic diversity. We use this dataset and multi-atlas-based image processing methods to obtain a hierarchical partition of the brain from larger anatomical regions to individual cortical and deep structures and derive age trends of brain structure through the lifespan (3-96 years old). Critically, we present and validate a methodology for harmonizing this pooled dataset in the presence of nonlinear age trends. We provide a web-based visualization interface to generate and present the resulting age trends, enabling future studies of brain structure to compare their data with this reference of brain development and aging, and to examine deviations from ranges, potentially related to disease.

Complex diffusion-weighted image estimation via matrix recovery under general noise models

We propose a patch-based singular value shrinkage method for diffusion magnetic resonance image estimation targeted at low signal to noise ratio and accelerated acquisitions. It operates on the complex data resulting from a sensitivity encoding reconstruction, where asymptotically optimal signal recovery guarantees can be attained by modeling the noise propagation in the reconstruction and subsequently simulating or calculating the limit singular value spectrum. Simple strategies are presented to deal with phase inconsistencies and optimize patch construction. The pertinence of our contributions is quantitatively validated on synthetic data, an in vivo adult example, and challenging neonatal and fetal cohorts. Our methodology is compared with related approaches, which generally operate on magnitude-only data and use data-based noise level estimation and singular value truncation. Visual examples are provided to illustrate effectiveness in generating denoised and debiased diffusion estimates with well preserved spatial and diffusion detail.

Definitions and classification of malformations of cortical development: practical guidelines

Malformations of cortical development are a group of rare disorders commonly manifesting with developmental delay, cerebral palsy or seizures. The neurological outcome is extremely variable depending on the type, extent and severity of the malformation and the involved genetic pathways of brain development. Neuroimaging plays an essential role in the diagnosis of these malformations, but several issues regarding malformations of cortical development definitions and classification remain unclear. The purpose of this consensus statement is to provide standardized malformations of cortical development terminology and classification for neuroradiological pattern interpretation. A committee of international experts in paediatric neuroradiology prepared systematic literature reviews and formulated neuroimaging recommendations in collaboration with geneticists, paediatric neurologists and pathologists during consensus meetings in the context of the European Network Neuro-MIG initiative on Brain Malformations (https://www.neuro-mig.org/). Malformations of cortical development neuroimaging features and practical recommendations are provided to aid both expert and non-expert radiologists and neurologists who may encounter patients with malformations of cortical development in their practice, with the aim of improving malformations of cortical development diagnosis and imaging interpretation worldwide.

The impact of quality assurance assessment on diffusion tensor imaging outcomes in a large-scale population-based cohort

BACKGROUND

Diffusion tensor imaging (DTI) is applied in investigation of brain biomarkers for neurodevelopmental and neurodegenerative disorders. However, the quality of DTI measurements, like other neuroimaging techniques, is susceptible to several confounding factors (e.g., motion, eddy currents), which have only recently come under scrutiny. These confounds are especially relevant in adolescent samples where data quality may be compromised in ways that confound interpretation of maturation parameters. The current study aims to leverage DTI data from the Philadelphia Neurodevelopmental Cohort (PNC), a sample of 1601 youths with ages of 8-21 who underwent neuroimaging, to: 1) establish quality assurance (QA) metrics for the automatic identification of poor DTI image quality; 2) examine the performance of these QA measures in an external validation sample; 3) document the influence of data quality on developmental patterns of typical DTI metrics.

METHODS

All diffusion-weighted images were acquired on the same scanner. Visual QA was performed on all subjects completing DTI; images were manually categorized as Poor, Good, or Excellent. Four image quality metrics were automatically computed and used to predict manual QA status: Mean voxel intensity outlier count (MEANVOX), Maximum voxel intensity outlier count (MAXVOX), mean relative motion (MOTION) and temporal signal-to-noise ratio (TSNR). Classification accuracy for each metric was calculated as the area under the receiver-operating characteristic curve (AUC). A threshold was generated for each measure that best differentiated visual QA status and applied in a validation sample. The effects of data quality on sensitivity to expected age effects in this developmental sample were then investigated using the traditional MRI diffusion metrics: fractional anisotropy (FA) and mean diffusivity (MD). Finally, our method of QA is compared with DTIPrep.

RESULTS

TSNR (AUC=0.94) best differentiated Poor data from Good and Excellent data. MAXVOX (AUC=0.88) best differentiated Good from Excellent DTI data. At the optimal threshold, 88% of Poor data and 91% Good/Excellent data were correctly identified. Use of these thresholds on a validation dataset (n=374) indicated high accuracy. In the validation sample 83% of Poor data and 94% of Excellent data was identified using thresholds derived from the training sample. Both FA and MD were affected by the inclusion of poor data in an analysis of an age, sex and race matched comparison sample. In addition, we show that the inclusion of poor data results in significant attenuation of the correlation between diffusion metrics (FA and MD) and age during a critical neurodevelopmental period. We find higher correspondence between our QA method and DTIPrep for Poor data, but we find our method to be more robust for apparently high-quality images.

CONCLUSION

Automated QA of DTI can facilitate large-scale, high-throughput quality assurance by reliably identifying both scanner and subject induced imaging artifacts. The results present a practical example of the confounding effects of artifacts on DTI analysis in a large population-based sample, and suggest that estimates of data quality should not only be reported but also accounted for in data analysis, especially in studies of development.

Evaluation of the accuracy and precision of the diffusion parameter EStImation with Gibbs and NoisE removal pipeline

This work evaluates the accuracy and precision of the Diffusion parameter EStImation with Gibbs and NoisE Removal (DESIGNER) pipeline, developed to identify and minimize common sources of methodological variability including: thermal noise, Gibbs ringing artifacts, Rician bias, EPI and eddy current induced spatial distortions, and motion-related artifacts. Following this processing pipeline, iterative parameter estimation techniques were used to derive diffusion parameters of interest based on the diffusion tensor and kurtosis tensor. We evaluated accuracy using a software phantom based on 36 diffusion datasets from the Human Connectome project and tested the precision by analyzing data from 30 healthy volunteers scanned three times within one week. Preprocessing with both DESIGNER or a standard pipeline based on smoothing (instead of noise removal) improved parameter precision by up to a factor of 2 compared to preprocessing with motion correction alone. When evaluating accuracy, we report average decreases in bias (deviation from simulated parameters) over all included regions for fractional anisotropy, mean diffusivity, mean kurtosis, and axonal water fraction of 9.7%, 8.7%, 4.2%, and 7.6% using DESIGNER compared to the standard pipeline, demonstrating that preprocessing with DESIGNER improves accuracy compared to other processing methods.

Key clinical benefits of neuroimaging at 7T

The growing interest in ultra-high field MRI, with more than 35.000 MR examinations already performed at 7T, is related to improved clinical results with regard to morphological as well as functional and metabolic capabilities. Since the signal-to-noise ratio increases with the field strength of the MR scanner, the most evident application at 7T is to gain higher spatial resolution in the brain compared to 3T. Of specific clinical interest for neuro applications is the cerebral cortex at 7T, for the detection of changes in cortical structure, like the visualization of cortical microinfarcts and cortical plaques in Multiple Sclerosis. In imaging of the hippocampus, even subfields of the internal hippocampal anatomy and pathology may be visualized with excellent spatial resolution. Using Susceptibility Weighted Imaging, the plaque-vessel relationship and iron accumulations in Multiple Sclerosis can be visualized, which may provide a prognostic factor of disease. Vascular imaging is a highly promising field for 7T which is dealt with in a separate dedicated article in this special issue. The static and dynamic blood oxygenation level-dependent contrast also increases with the field strength, which significantly improves the accuracy of pre-surgical evaluation of vital brain areas before tumor removal. Improvement in acquisition and hardware technology have also resulted in an increasing number of MR spectroscopic imaging studies in patients at 7T. More recent parallel imaging and short-TR acquisition approaches have overcome the limitations of scan time and spatial resolution, thereby allowing imaging matrix sizes of up to 128×128. The benefits of these acquisition approaches for investigation of brain tumors and Multiple Sclerosis have been shown recently. Together, these possibilities demonstrate the feasibility and advantages of conducting routine diagnostic imaging and clinical research at 7T.

A Practical Guide for Improving Transparency and Reproducibility in Neuroimaging Research

Recent years have seen an increase in alarming signals regarding the lack of replicability in neuroscience, psychology, and other related fields. To avoid a widespread crisis in neuroimaging research and consequent loss of credibility in the public eye, we need to improve how we do science. This article aims to be a practical guide for researchers at any stage of their careers that will help them make their research more reproducible and transparent while minimizing the additional effort that this might require. The guide covers three major topics in open science (data, code, and publications) and offers practical advice as well as highlighting advantages of adopting more open research practices that go beyond improved transparency and reproducibility.

Acute Stroke Imaging Research Roadmap III Imaging Selection and Outcomes in Acute Stroke Reperfusion Clinical Trials: Consensus Recommendations and Further Research Priorities

BACKGROUND AND PURPOSE

The Stroke Imaging Research (STIR) group, the Imaging Working Group of StrokeNet, the American Society of Neuroradiology, and the Foundation of the American Society of Neuroradiology sponsored an imaging session and workshop during the Stroke Treatment Academy Industry Roundtable (STAIR) IX on October 5 to 6, 2015 in Washington, DC. The purpose of this roadmap was to focus on the role of imaging in future research and clinical trials.

METHODS

This forum brought together stroke neurologists, neuroradiologists, neuroimaging research scientists, members of the National Institute of Neurological Disorders and Stroke (NINDS), industry representatives, and members of the US Food and Drug Administration to discuss STIR priorities in the light of an unprecedented series of positive acute stroke endovascular therapy clinical trials.

RESULTS

The imaging session summarized and compared the imaging components of the recent positive endovascular trials and proposed opportunities for pooled analyses. The imaging workshop developed consensus recommendations for optimal imaging methods for the acquisition and analysis of core, mismatch, and collaterals across multiple modalities, and also a standardized approach for measuring the final infarct volume in prospective clinical trials.

CONCLUSIONS

Recent positive acute stroke endovascular clinical trials have demonstrated the added value of neurovascular imaging. The optimal imaging profile for endovascular treatment includes large vessel occlusion, smaller core, good collaterals, and large penumbra. However, equivalent definitions for the imaging profile parameters across modalities are needed, and a standardization effort is warranted, potentially leveraging the pooled data resulting from the recent positive endovascular trials.

Comparing fully automated state-of-the-art cerebellum parcellation from magnetic resonance images

The human cerebellum plays an essential role in motor control, is involved in cognitive function (i.e., attention, working memory, and language), and helps to regulate emotional responses. Quantitative in-vivo assessment of the cerebellum is important in the study of several neurological diseases including cerebellar ataxia, autism, and schizophrenia. Different structural subdivisions of the cerebellum have been shown to correlate with differing pathologies. To further understand these pathologies, it is helpful to automatically parcellate the cerebellum at the highest fidelity possible. In this paper, we coordinated with colleagues around the world to evaluate automated cerebellum parcellation algorithms on two clinical cohorts showing that the cerebellum can be parcellated to a high accuracy by newer methods. We characterize these various methods at four hierarchical levels: coarse (i.e., whole cerebellum and gross structures), lobe, subdivisions of the vermis, and the lobules. Due to the number of labels, the hierarchy of labels, the number of algorithms, and the two cohorts, we have restricted our analyses to the Dice measure of overlap. Under these conditions, machine learning based methods provide a collection of strategies that are efficient and deliver parcellations of a high standard across both cohorts, surpassing previous work in the area. In conjunction with the rank-sum computation, we identified an overall winning method.

Spinal cord MRI at 7T

Magnetic resonance imaging (MRI) of the human spinal cord at 7T has been demonstrated by a handful of research sites worldwide, and the spinal cord remains one of the areas in which higher fields and resolution could have high impact. The small diameter of the cord (∼1 cm) necessitates high spatial resolution to minimize partial volume effects between gray and white matter, and so MRI of the cord can greatly benefit from increased signal-to-noise ratio and contrasts at ultra-high field (UHF). Herein we review the current state of UHF spinal cord imaging. Technical challenges to successful UHF spinal cord MRI include radiofrequency (B1) nonuniformities and a general lack of optimized radiofrequency coils, amplified physiological noise, and an absence of methods for robust B0 shimming along the cord to mitigate image distortions and signal losses. Numerous solutions to address these challenges have been and are continuing to be explored, and include novel approaches for signal excitation and acquisition, dynamic shimming and specialized shim coils, and acquisitions with increased coverage or optimal slice angulations.

The quandary of covarying: A brief review and empirical examination of covariate use in structural neuroimaging studies on psychological variables

Although covarying for potential confounds or nuisance variables is common in psychological research, relatively little is known about how the inclusion of covariates may influence the relations between psychological variables and indices of brain structure. In Part 1 of the current study, we conducted a descriptive review of relevant articles from the past two years of NeuroImage in order to identify the most commonly used covariates in work of this nature. Age, sex, and intracranial volume were found to be the most commonly used covariates, although the number of covariates used ranged from 0 to 14, with 37 different covariate sets across the 68 models tested. In Part 2, we used data from the Human Connectome Project to investigate the degree to which the addition of common covariates altered the relations between individual difference variables (i.e., personality traits, psychopathology, cognitive tasks) and regional gray matter volume (GMV), as well as the statistical significance of values associated with these effect sizes. Using traditional and random sampling approaches, our results varied widely, such that some covariate sets influenced the relations between the individual difference variables and GMV very little, while the addition of other covariate sets resulted in a substantially different pattern of results compared to models with no covariates. In sum, these results suggest that the use of covariates should be critically examined and discussed as part of the conversation on replicability in structural neuroimaging. We conclude by recommending that researchers pre-register their analytic strategy and present information on how relations differ based on the inclusion of covariates.

Response assessment in diffuse intrinsic pontine glioma: recommendations from the Response Assessment in Pediatric Neuro-Oncology (RAPNO) working group

Optimising the conduct of clinical trials for diffuse intrinsic pontine glioma involves use of consistent, objective disease assessments and standardised response criteria. The Response Assessment in Pediatric Neuro-Oncology working group, consisting of an international panel of paediatric and adult neuro-oncologists, clinicians, radiologists, radiation oncologists, and neurosurgeons, was established to address issues and unique challenges in assessing response in children with CNS tumours. A working group was formed specifically to address response assessment in children and young adults with diffuse intrinsic pontine glioma and to develop a consensus on recommendations for response assessment. Response should be assessed using MRI of brain and spine, neurological examination, and anti-inflammatory or antiangiogenic drugs. Clinical imaging standards are defined. As with previous consensus recommendations, these recommendations will need to be validated in prospective clinical trials.

Physical and numerical phantoms for the validation of brain microstructural MRI: A cookbook

Phantoms, both numerical (software) and physical (hardware), can serve as a gold standard for the validation of MRI methods probing the brain microstructure. This review aims to provide guidelines on how to build, implement, or choose the right phantom for a particular application, along with an overview of the current state-of-the-art of phantoms dedicated to study brain microstructure with MRI. For physical phantoms, we discuss the essential requirements and relevant characteristics of both the (NMR visible) liquid and (NMR invisible) phantom materials that induce relevant microstructural features detectable via MRI, based on diffusion, intra-voxel incoherent motion, magnetization transfer or magnetic susceptibility weighted contrast. In particular, for diffusion MRI, many useful phantoms have been proposed, ranging from simple liquids to advanced biomimetic phantoms consisting of hollow or plain microfibers and capillaries. For numerical phantoms, the focus is on Monte Carlo simulations of random walk, for which the basic principles, along with useful criteria to check and potential pitfalls are reviewed, in addition to a literature overview highlighting recent advances. While many phantoms exist already, the current review aims to stimulate further research in the field and to address remaining needs.

Diagnostic accuracy of dopaminergic imaging in prodromal dementia with Lewy bodies

BACKGROUND

Dopaminergic imaging has high diagnostic accuracy for dementia with Lewy bodies (DLB) at the dementia stage. We report the first investigation of dopaminergic imaging at the prodromal stage.

METHODS

We recruited 75 patients over 60 with mild cognitive impairment (MCI), 33 with probable MCI with Lewy body disease (MCI-LB), 15 with possible MCI-LB and 27 with MCI with Alzheimer's disease. All underwent detailed clinical, neurological and neuropsychological assessments and FP-CIT [123I-N-fluoropropyl-2β-carbomethoxy-3β-(4-iodophenyl)] dopaminergic imaging. FP-CIT scans were blindly rated by a consensus panel and classified as normal or abnormal.

RESULTS

The sensitivity of visually rated FP-CIT imaging to detect combined possible or probable MCI-LB was 54.2% [95% confidence interval (CI) 39.2-68.6], with a specificity of 89.0% (95% CI 70.8-97.6) and a likelihood ratio for MCI-LB of 4.9, indicating that FP-CIT may be a clinically important test in MCI where any characteristic symptoms of Lewy body (LB) disease are present. The sensitivity in probable MCI-LB was 61.0% (95% CI 42.5-77.4) and in possible MCI-LB was 40.0% (95% CI 16.4-67.7).

CONCLUSIONS

Dopaminergic imaging had high specificity at the pre-dementia stage and gave a clinically important increase in diagnostic confidence and so should be considered in all patients with MCI who have any of the diagnostic symptoms of DLB. As expected, the sensitivity was lower in MCI-LB than in established DLB, although over 50% still had an abnormal scan. Accurate diagnosis of LB disease is important to enable early optimal treatment for LB symptoms.

MarkVCID cerebral small vessel consortium: II. Neuroimaging protocols

The MarkVCID consortium was formed under cooperative agreements with the National Institute of Neurologic Diseases and Stroke (NINDS) and National Institute on Aging (NIA) in 2016 with the goals of developing and validating biomarkers for the cerebral small vessel diseases associated with the vascular contributions to cognitive impairment and dementia (VCID). Rigorously validated biomarkers have consistently been identified as crucial for multicenter studies to identify effective strategies to prevent and treat VCID, specifically to detect increased VCID risk, diagnose the presence of small vessel disease and its subtypes, assess prognosis for disease progression or response to treatment, demonstrate target engagement or mechanism of action for candidate interventions, and monitor disease progression during treatment. The seven project sites and central coordinating center comprising MarkVCID, working with NINDS and NIA, identified a panel of 11 candidate fluid- and neuroimaging-based biomarker kits and established harmonized multicenter study protocols (see companion paper "MarkVCID cerebral small vessel consortium: I. Enrollment, clinical, fluid protocols" for full details). Here we describe the MarkVCID neuroimaging protocols with specific focus on validating their application to future multicenter trials. MarkVCID procedures for participant enrollment; clinical and cognitive evaluation; and collection, handling, and instrumental validation of fluid samples are described in detail in a companion paper. Magnetic resonance imaging (MRI) has long served as the neuroimaging modality of choice for cerebral small vessel disease and VCID because of its sensitivity to a wide range of brain properties, including small structural lesions, connectivity, and cerebrovascular physiology. Despite MRI's widespread use in the VCID field, there have been relatively scant data validating the repeatability and reproducibility of MRI-based biomarkers across raters, scanner types, and time intervals (collectively defined as instrumental validity). The MRI protocols described here address the core MRI sequences for assessing cerebral small vessel disease in future research studies, specific sequence parameters for use across various research scanner types, and rigorous procedures for determining instrumental validity. Another candidate neuroimaging modality considered by MarkVCID is optical coherence tomography angiography (OCTA), a non-invasive technique for directly visualizing retinal capillaries as a marker of the cerebral capillaries. OCTA has theoretical promise as a unique opportunity to visualize small vessels derived from the cerebral circulation, but at a considerably earlier stage of development than MRI. The additional OCTA protocols described here address procedures for determining OCTA instrumental validity, evaluating sources of variability such as pupil dilation, and handling data to maintain participant privacy. MRI protocol and instrumental validation The core sequences selected for the MarkVCID MRI protocol are three-dimensional T1-weighted multi-echo magnetization-prepared rapid-acquisition-of-gradient-echo (ME-MPRAGE), three-dimensional T2-weighted fast spin echo fluid-attenuated-inversion-recovery (FLAIR), two-dimensional diffusion-weighted spin-echo echo-planar imaging (DWI), three-dimensional T2*-weighted multi-echo gradient echo (3D-GRE), three-dimensional T2 -weighted fast spin-echo imaging (T2w), and two-dimensional T2*-weighted gradient echo echo-planar blood-oxygenation-level-dependent imaging with brief periods of CO2 inhalation (BOLD-CVR). Harmonized parameters for each of these core sequences were developed for four 3 Tesla MRI scanner models in widespread use at academic medical centers. MarkVCID project sites are trained and certified for their instantiation of the consortium MRI protocols. Sites are required to perform image quality checks every 2 months using the Alzheimer's Disease Neuroimaging Initiative phantom. Instrumental validation for MarkVCID MRI-based biomarkers is operationally defined as inter-rater reliability, test-retest repeatability, and inter-scanner reproducibility. Assessments of these instrumental properties are performed on individuals representing a range of cerebral small vessel disease from mild to severe. Inter-rater reliability is determined by distribution of an independent dataset of MRI scans to each analysis site. Test-retest repeatability is determined by repeat MRI scans performed on individual participants on a single MRI scanner after a short (1- to 14-day) interval. Inter-scanner reproducibility is determined by repeat MRI scans performed on individuals performed across four MRI scanner models. OCTA protocol and instrumental validation The MarkVCID OCTA protocol uses a commercially available, Food and Drug Administration-approved OCTA apparatus. Imaging is performed on one dilated and one undilated eye to assess the need for dilation. Scans are performed in quadruplicate. MarkVCID project sites participating in OCTA validation are trained and certified by this biomarker's lead investigator. Inter-rater reliability for OCTA is assessed by distribution of OCTA datasets to each analysis site. Test-retest repeatability is assessed by repeat OCTA imaging on individuals on the same day as their baseline OCTA and a different-day repeat session after a short (1- to 14-day) interval. Methods were developed to allow the OCTA data to be de-identified by the sites before transmission to the central data management system. The MarkVCID neuroimaging protocols, like the other MarkVCID procedures, are designed to allow translation to multicenter trials and as a template for outside groups to generate directly comparable neuroimaging data. The MarkVCID neuroimaging protocols are available to the biomedical community and intended to be shared. In addition to the instrumental validation procedures described here, each of the neuroimaging MarkVCID kits will undergo biological validation to determine its ability to measure important aspects of VCID such as cognitive function. The analytic methods for the neuroimaging-based kits and the results of these validation studies will be published separately. The results will ultimately determine the neuroimaging kits' potential usefulness for multicenter interventional trials in small vessel disease-related VCID.

Using Machine Learning and Structural Neuroimaging to Detect First Episode Psychosis: Reconsidering the Evidence

Despite the high level of interest in the use of machine learning (ML) and neuroimaging to detect psychosis at the individual level, the reliability of the findings is unclear due to potential methodological issues that may have inflated the existing literature. This study aimed to elucidate the extent to which the application of ML to neuroanatomical data allows detection of first episode psychosis (FEP), while putting in place methodological precautions to avoid overoptimistic results. We tested both traditional ML and an emerging approach known as deep learning (DL) using 3 feature sets of interest: (1) surface-based regional volumes and cortical thickness, (2) voxel-based gray matter volume (GMV) and (3) voxel-based cortical thickness (VBCT). To assess the reliability of the findings, we repeated all analyses in 5 independent datasets, totaling 956 participants (514 FEP and 444 within-site matched controls). The performance was assessed via nested cross-validation (CV) and cross-site CV. Accuracies ranged from 50% to 70% for surfaced-based features; from 50% to 63% for GMV; and from 51% to 68% for VBCT. The best accuracies (70%) were achieved when DL was applied to surface-based features; however, these models generalized poorly to other sites. Findings from this study suggest that, when methodological precautions are adopted to avoid overoptimistic results, detection of individuals in the early stages of psychosis is more challenging than originally thought. In light of this, we argue that the current evidence for the diagnostic value of ML and structural neuroimaging should be reconsidered toward a more cautious interpretation.

Towards Precision Medicine in Psychosis: Benefits and Challenges of Multimodal Multicenter Studies-PSYSCAN: Translating Neuroimaging Findings From Research into Clinical Practice

In the last 2 decades, several neuroimaging studies investigated brain abnormalities associated with the early stages of psychosis in the hope that these could aid the prediction of onset and clinical outcome. Despite advancements in the field, neuroimaging has yet to deliver. This is in part explained by the use of univariate analytical techniques, small samples and lack of statistical power, lack of external validation of potential biomarkers, and lack of integration of nonimaging measures (eg, genetic, clinical, cognitive data). PSYSCAN is an international, longitudinal, multicenter study on the early stages of psychosis which uses machine learning techniques to analyze imaging, clinical, cognitive, and biological data with the aim of facilitating the prediction of psychosis onset and outcome. In this article, we provide an overview of the PSYSCAN protocol and we discuss benefits and methodological challenges of large multicenter studies that employ neuroimaging measures.