Hands-On Neuroinformatics Education at the Crossroads of Online and In-Person: Lessons Learned from NeuroHackademy

NeuroHackademy ( https://neurohackademy.org ) is a two-week event designed to train early-career neuroscience researchers in data science methods and their application to neuroimaging. The event seeks to bridge the big data skills gap by introducing participants to data science methods and skills that are often ignored in traditional curricula. Such skills are needed for the analysis and interpretation of the kinds of large and complex datasets that have become increasingly important to neuroimaging research due to concerted data collection efforts. In 2020, the event rapidly pivoted from an in-person event to an online event that included hundreds of participants from all over the world. This experience and those of the participants substantially changed our valuation of large online-accessible events. In subsequent events held in 2022 and 2023, we have developed a "hybrid" format that includes both online and in-person participants. We discuss the technical and sociotechnical elements of hybrid events and discuss some of the lessons we have learned while organizing them. We emphasize in particular the role that these events can play in creating a global and inclusive community of practice in the intersection of neuroimaging and data science.

Differences in educational opportunity predict white matter development

Coarse measures of socioeconomic status, such as parental income or parental education, have been linked to differences in white matter development. However, these measures do not provide insight into specific aspects of an individual's environment and how they relate to brain development. On the other hand, educational intervention studies have shown that changes in an individual's educational context can drive measurable changes in their white matter. These studies, however, rarely consider socioeconomic factors in their results. In the present study, we examined the unique relationship between educational opportunity and white matter development, when controlling other known socioeconomic factors. To explore this question, we leveraged the rich demographic and neuroimaging data available in the ABCD study, as well the unique data-crosswalk between ABCD and the Stanford Education Data Archive (SEDA). We find that educational opportunity is related to accelerated white matter development, even when accounting for other socioeconomic factors, and that this relationship is most pronounced in white matter tracts associated with academic skills. These results suggest that the school a child attends has a measurable relationship with brain development for years to come.

Convolutional neural network-based classification of glaucoma using optic radiation tissue properties

BACKGROUND

Sensory changes due to aging or disease can impact brain tissue. This study aims to investigate the link between glaucoma, a leading cause of blindness, and alterations in brain connections.

METHODS

We analyzed diffusion MRI measurements of white matter tissue in a large group, consisting of 905 glaucoma patients (aged 49-80) and 5292 healthy individuals (aged 45-80) from the UK Biobank. Confounds due to group differences were mitigated by matching a sub-sample of controls to glaucoma subjects. We compared classification of glaucoma using convolutional neural networks (CNNs) focusing on the optic radiations, which are the primary visual connection to the cortex, against those analyzing non-visual brain connections. As a control, we evaluated the performance of regularized linear regression models.

RESULTS

We showed that CNNs using information from the optic radiations exhibited higher accuracy in classifying subjects with glaucoma when contrasted with CNNs relying on information from non-visual brain connections. Regularized linear regression models were also tested, and showed significantly weaker classification performance. Additionally, the CNN was unable to generalize to the classification of age-group or of age-related macular degeneration.

CONCLUSIONS

Our findings indicate a distinct and potentially non-linear signature of glaucoma in the tissue properties of optic radiations. This study enhances our understanding of how glaucoma affects brain tissue and opens avenues for further research into how diseases that affect sensory input may also affect brain aging.

Explainable machine learning predictions of perceptual sensitivity for retinal prostheses

Objective.Retinal prostheses evoke visual precepts by electrically stimulating functioning cells in the retina. Despite high variance in perceptual thresholds across subjects, among electrodes within a subject, and over time, retinal prosthesis users must undergo 'system fitting', a process performed to calibrate stimulation parameters according to the subject's perceptual thresholds. Although previous work has identified electrode-retina distance and impedance as key factors affecting thresholds, an accurate predictive model is still lacking.Approach.To address these challenges, we (1) fitted machine learning models to a large longitudinal dataset with the goal of predicting individual electrode thresholds and deactivation as a function of stimulus, electrode, and clinical parameters ('predictors') and (2) leveraged explainable artificial intelligence (XAI) to reveal which of these predictors were most important.Main results.Our models accounted for up to 76% of the perceptual threshold response variance and enabled predictions of whether an electrode was deactivated in a given trial with F1 and area under the ROC curve scores of up to 0.732 and 0.911, respectively. Our models identified novel predictors of perceptual sensitivity, including subject age, time since blindness onset, and electrode-fovea distance.Significance.Our results demonstrate that routinely collected clinical measures and a single session of system fitting might be sufficient to inform an XAI-based threshold prediction strategy, which has the potential to transform clinical practice in predicting visual outcomes.

Development of the Alpha Rhythm Is Linked to Visual White Matter Pathways and Visual Detection Performance

Alpha is the strongest electrophysiological rhythm in awake humans at rest. Despite its predominance in the EEG signal, large variations can be observed in alpha properties during development, with an increase in alpha frequency over childhood and adulthood. Here, we tested the hypothesis that these changes in alpha rhythm are related to the maturation of visual white matter pathways. We capitalized on a large diffusion MRI (dMRI)-EEG dataset (dMRI n = 2,747, EEG n = 2,561) of children and adolescents of either sex (age range, 5-21 years old) and showed that maturation of the optic radiation specifically accounts for developmental changes of alpha frequency. Behavioral analyses also confirmed that variations of alpha frequency are related to maturational changes in visual perception. The present findings demonstrate the close link between developmental variations in white matter tissue properties, electrophysiological responses, and behavior.

Diffusion MRI head motion correction methods are highly accurate but impacted by denoising and sampling scheme

Head motion correction is particularly challenging in diffusion-weighted MRI (dMRI) scans due to the dramatic changes in image contrast at different gradient strengths and directions. Head motion correction is typically performed using a Gaussian Process model implemented in FSL's Eddy. Recently, the 3dSHORE-based SHORELine method was introduced that does not require shell-based acquisitions, but it has not been previously benchmarked. Here we perform a comprehensive evaluation of both methods on realistic simulations of a software fiber phantom that provides known ground-truth head motion. We demonstrate that both methods perform remarkably well, but that performance can be impacted by sampling scheme and the extent of head motion and the denoising strategy applied before head motion correction. Furthermore, we find Eddy benefits from denoising the data first with MP-PCA. In sum, we provide the most extensive known benchmarking of dMRI head motion correction, together with extensive simulation data and a reproducible workflow. PRACTITIONER POINTS: Both Eddy and SHORELine head motion correction methods performed quite well on a large variety of simulated data. Denoising with MP-PCA can improve head motion correction performance when Eddy is used. SHORELine effectively corrects motion in non-shelled diffusion spectrum imaging data.

White matter and literacy: A dynamic system in flux

Cross-sectional studies have linked differences in white matter tissue properties to reading skills. However, past studies have reported a range of, sometimes conflicting, results. Some studies suggest that white matter properties act as individual-level traits predictive of reading skill, whereas others suggest that reading skill and white matter develop as a function of an individual's educational experience. In the present study, we tested two hypotheses: a) that diffusion properties of the white matter reflect stable brain characteristics that relate to stable individual differences in reading ability or b) that white matter is a dynamic system, linked with learning over time. To answer these questions, we examined the relationship between white matter and reading in a five-year longitudinal dataset and a series of large-scale, single-observation, cross-sectional datasets (N = 14,249 total participants). We find that gains in reading skill correspond to longitudinal changes in the white matter. However, in the cross-sectional datasets, we find no evidence for the hypothesis that individual differences in white matter predict reading skill. These findings highlight the link between dynamic processes in the white matter and learning.

The Past, Present, and Future of the Brain Imaging Data Structure (BIDS)

The Brain Imaging Data Structure (BIDS) is a community-driven standard for the organization of data and metadata from a growing range of neuroscience modalities. This paper is meant as a history of how the standard has developed and grown over time. We outline the principles behind the project, the mechanisms by which it has been extended, and some of the challenges being addressed as it evolves. We also discuss the lessons learned through the project, with the aim of enabling researchers in other domains to learn from the success of BIDS.

Contributed Session I: The perceptual experience of optogenetic vision

Optogenetic therapy for retinal degenerative diseases aims to elicit light response in remaining retinal cells (bipolar and/or ganglion cells). Animal models suggest that these proteins have lower sensitivity, and slower kinetics compared to neurotypical vision. Here we describe a framework for simulating 'virtual patients' to quantify the predicted perceptual experience of optogenetic vision. We simulated the neural responses of rd1 mouse retina expressing 4xBGAG12,460:SNAP-mGluR2 (Holt et al., 2022) and used this simulation to generate virtual patients: sighted participants viewing the visual stimulus filtered through our simulations. We measured the visual performance of these virtual patients (n=6) using temporal contrast sensitivity functions. Virtual patients had a 10x fold loss of sensitivity, which was exacerbated at higher temporal frequencies, corresponding to a loss of Snellen acuity from ~20/40 at low temporal frequencies to ~20/100-20/200 at high temporal frequencies. We predict that the ability to process fast-moving objects may be impaired in optogenetic vision, and patients with uncontrollable nystagmus may be poor candidates for optogenetic treatments with sluggish kinetics. Our virtual patient framework can easily be extended to simulate any optogenetic protein, and thereby provides a way to quantify and compare the expected perceptual performance of different opto-proteins based on in vitro retinal data.

Contributed Session I: Specific and non-linear effects of glaucoma on optic radiation tissue properties

Changes in sensory input with aging and disease affect brain tissue properties. To establish the link between glaucoma, the most prevalent cause of irreversible blindness, and changes in major brain connections, we characterized white matter tissue properties in diffusion MRI measurements in a large sample of subjects with glaucoma (N=905; age 49-80) and healthy controls (N=5,292; age 45-80) from the UK Biobank. Confounds due to group differences were mitigated by matching a sub-sample of controls to glaucoma subjects. A convolutional neural network (CNN) accurately classified whether a subject has glaucoma using information from the primary visual connection to cortex (the optic radiations, OR), but not from non-visual brain connections. On the other hand, regularized linear regression could not classify glaucoma, and the CNN did not generalize to classification of age-group or of age-related macular degeneration. This suggests a unique non-linear signature of glaucoma in OR tissue properties.

Human white matter myelinates faster in utero than ex utero

The formation of myelin, the fatty sheath that insulates nerve fibers, is critical for healthy brain function. A fundamental open question is what impact being born has on myelin growth. To address this, we evaluated a large (n = 300) cross-sectional sample of newborns from the Developing Human Connectome Project (dHCP). First, we developed software for the automated identification of 20 white matter bundles in individual newborns that is well suited for large samples. Next, we fit linear models that quantify how T1w/T2w (a myelin-sensitive imaging contrast) changes over time at each point along the bundles. We found faster growth of T1w/T2w along the lengths of all bundles before birth than right after birth. Further, in a separate longitudinal sample of preterm infants (N = 34), we found lower T1w/T2w than in full-term peers measured at the same age. By applying the linear models fit on the cross-section sample to the longitudinal sample of preterm infants, we find that their delay in T1w/T2w growth is well explained by the amount of time they spent developing in utero and ex utero. These results suggest that white matter myelinates faster in utero than ex utero. The reduced rate of myelin growth after birth, in turn, explains lower myelin content in individuals born preterm and could account for long-term cognitive, neurological, and developmental consequences of preterm birth. We hypothesize that closely matching the environment of infants born preterm to what they would have experienced in the womb may reduce delays in myelin growth and hence improve developmental outcomes.

Optic radiations representing different eccentricities age differently

The neural pathways that carry information from the foveal, macular, and peripheral visual fields have distinct biological properties. The optic radiations (OR) carry foveal and peripheral information from the thalamus to the primary visual cortex (V1) through adjacent but separate pathways in the white matter. Here, we perform white matter tractometry using pyAFQ on a large sample of diffusion MRI (dMRI) data from subjects with healthy vision in the U.K. Biobank dataset (UKBB; N = 5382; age 45-81). We use pyAFQ to characterize white matter tissue properties in parts of the OR that transmit information about the foveal, macular, and peripheral visual fields, and to characterize the changes in these tissue properties with age. We find that (1) independent of age there is higher fractional anisotropy, lower mean diffusivity, and higher mean kurtosis in the foveal and macular OR than in peripheral OR, consistent with denser, more organized nerve fiber populations in foveal/parafoveal pathways, and (2) age is associated with increased diffusivity and decreased anisotropy and kurtosis, consistent with decreased density and tissue organization with aging. However, anisotropy in foveal OR decreases faster with age than in peripheral OR, while diffusivity increases faster in peripheral OR, suggesting foveal/peri-foveal OR and peripheral OR differ in how they age.

Explainable Machine Learning Predictions of Perceptual Sensitivity for Retinal Prostheses

To provide appropriate levels of stimulation, retinal prostheses must be calibrated to an individual's perceptual thresholds ('system fitting'), despite thresholds varying drastically across subjects, across electrodes within a subject, and over time. Although previous work has identified electrode-retina distance and impedance as key factors affecting thresholds, an accurate predictive model is still lacking. To address these challenges, we 1) fitted machine learning (ML) models to a large longitudinal dataset with the goal of predicting individual electrode thresholds and deactivation as a function of stimulus, electrode, and clinical parameters ('predictors') and 2) leveraged explainable artificial intelligence (XAI) to reveal which of these predictors were most important. Our models accounted for up to 77% of the perceptual threshold response variance and enabled predictions of whether an electrode was deactivated in a given trial with F1 and AUC scores of up to 0.740 and 0.913, respectively. Deactivation and threshold models identified novel predictors of perceptual sensitivity, including subject age, time since blindness onset, and electrode-fovea distance. Our results demonstrate that routinely collected clinical measures and a single session of system fitting might be sufficient to inform an XAI-based threshold prediction strategy, which may transform clinical practice in predicting visual outcomes.

An analysis-ready and quality controlled resource for pediatric brain white-matter research

We created a set of resources to enable research based on openly-available diffusion MRI (dMRI) data from the Healthy Brain Network (HBN) study. First, we curated the HBN dMRI data (N = 2747) into the Brain Imaging Data Structure and preprocessed it according to best-practices, including denoising and correcting for motion effects, susceptibility-related distortions, and eddy currents. Preprocessed, analysis-ready data was made openly available. Data quality plays a key role in the analysis of dMRI. To optimize QC and scale it to this large dataset, we trained a neural network through the combination of a small data subset scored by experts and a larger set scored by community scientists. The network performs QC highly concordant with that of experts on a held out set (ROC-AUC = 0.947). A further analysis of the neural network demonstrates that it relies on image features with relevance to QC. Altogether, this work both delivers resources to advance transdiagnostic research in brain connectivity and pediatric mental health, and establishes a novel paradigm for automated QC of large datasets.

Factors affecting two-point discrimination in Argus II patients

Two of the main obstacles to the development of epiretinal prosthesis technology are electrodes that require current amplitudes above safety limits to reliably elicit percepts, and a failure to consistently elicit pattern vision. Here, we explored the causes of high current amplitude thresholds and poor spatial resolution within the Argus II epiretinal implant. We measured current amplitude thresholds and two-point discrimination (the ability to determine whether one or two electrodes had been stimulated) in 3 blind participants implanted with Argus II devices. Our data and simulations show that axonal stimulation, lift and retinal damage all play a role in reducing performance in the Argus 2, by either limiting sensitivity and/or reducing spatial resolution. Understanding the relative role of these various factors will be critical for developing and surgically implanting devices that can successfully subserve pattern vision.

What limits the spatial resolution of artificial vision in epiretinal implant patients?

INTRODUCTION

Retinal implants provide artificial vision to blind individuals through electrically stimulating remaining non-photoreceptor retinal cells. For epiretinal implants, placed over the ganglion cell layer, individual electrodes produce elongated 'streaks' due to the unselective stimulation of underlying ganglion axons (Beyeler, 2019). Here, to examine whether these axonal streaks explain the poor spatial acuity of prosthetic patients, we measured two-point discrimination performance in three patients implanted with an Argus 2 epiretinal implant (Second Sight Medical Products Inc).

METHODS

On each trial two electrodes were simultaneously stimulated (0.45 um pulse width, 6-20 Hz pulse train, 250-500ms duration, current amplitude 2x threshold). Participants verbally reported the number of distinct percepts they saw.

RESULTS

A regression analysis found that current amplitude, physical distance, distance along the axon, and distance between axons all played a significant role in determining whether participants saw one or two percepts.

CONCLUSIONS

Participants were less likely to see two distinct percepts when electrodes were physically close or lay close to the same axon bundle. Electrodes with high stimulation thresholds were also less likely to produce distinct percepts. Thus electrode pairs can merge into a single percept when (1) current fields overlap, (2) their current fields stimulate the same axonal bundle, or (3) the elongated percepts overlap.

Bifurcated Topological Optimization for IVIM

In this work, we shed light on the issue of estimating Intravoxel Incoherent Motion (IVIM) for diffusion and perfusion estimation by characterizing the objective function using simplicial homology tools. We provide a robust solution via topological optimization of this model so that the estimates are more reliable and accurate. Estimating the tissue microstructure from diffusion MRI is in itself an ill-posed and a non-linear inverse problem. Using variable projection functional (VarPro) to fit the standard bi-exponential IVIM model we perform the optimization using simplicial homology based global optimization to better understand the topology of objective function surface. We theoretically show how the proposed methodology can recover the model parameters more accurately and consistently by casting it in a reduced subspace given by VarPro. Additionally we demonstrate that the IVIM model parameters cannot be accurately reconstructed using conventional numerical optimization methods due to the presence of infinite solutions in subspaces. The proposed method helps uncover multiple global minima by analyzing the local geometry of the model enabling the generation of reliable estimates of model parameters.

Development of the visual white matter pathways mediates development of electrophysiological responses in visual cortex

The latency of neural responses in the visual cortex changes systematically across the lifespan. Here, we test the hypothesis that development of visual white matter pathways mediates maturational changes in the latency of visual signals. Thirty-eight children participated in a cross-sectional study including diffusion magnetic resonance imaging (MRI) and magnetoencephalography (MEG) sessions. During the MEG acquisition, participants performed a lexical decision and a fixation task on words presented at varying levels of contrast and noise. For all stimuli and tasks, early evoked fields were observed around 100 ms after stimulus onset (M100), with slower and lower amplitude responses for low as compared to high contrast stimuli. The optic radiations and optic tracts were identified in each individual's brain based on diffusion MRI tractography. The diffusion properties of the optic radiations predicted M100 responses, especially for high contrast stimuli. Higher optic radiation fractional anisotropy (FA) values were associated with faster and larger M100 responses. Over this developmental window, the M100 responses to high contrast stimuli became faster with age and the optic radiation FA mediated this effect. These findings suggest that the maturation of the optic radiations over childhood accounts for individual variations observed in the developmental trajectory of visual cortex responses.

Numerical uncertainty in analytical pipelines lead to impactful variability in brain networks

The analysis of brain-imaging data requires complex processing pipelines to support findings on brain function or pathologies. Recent work has shown that variability in analytical decisions, small amounts of noise, or computational environments can lead to substantial differences in the results, endangering the trust in conclusions. We explored the instability of results by instrumenting a structural connectome estimation pipeline with Monte Carlo Arithmetic to introduce random noise throughout. We evaluated the reliability of the connectomes, the robustness of their features, and the eventual impact on analysis. The stability of results was found to range from perfectly stable (i.e. all digits of data significant) to highly unstable (i.e. 0 - 1 significant digits). This paper highlights the potential of leveraging induced variance in estimates of brain connectivity to reduce the bias in networks without compromising reliability, alongside increasing the robustness and potential upper-bound of their applications in the classification of individual differences. We demonstrate that stability evaluations are necessary for understanding error inherent to brain imaging experiments, and how numerical analysis can be applied to typical analytical workflows both in brain imaging and other domains of computational sciences, as the techniques used were data and context agnostic and globally relevant. Overall, while the extreme variability in results due to analytical instabilities could severely hamper our understanding of brain organization, it also affords us the opportunity to increase the robustness of findings.

Automated Detection of Glaucoma With Interpretable Machine Learning Using Clinical Data and Multimodal Retinal Images

PURPOSE

To develop a multimodal model to automate glaucoma detection DESIGN: Development of a machine-learning glaucoma detection model METHODS: We selected a study cohort from the UK Biobank data set with 1193 eyes of 863 healthy subjects and 1283 eyes of 771 subjects with glaucoma. We trained a multimodal model that combines multiple deep neural nets, trained on macular optical coherence tomography volumes and color fundus photographs, with demographic and clinical data. We performed an interpretability analysis to identify features the model relied on to detect glaucoma. We determined the importance of different features in detecting glaucoma using interpretable machine learning methods. We also evaluated the model on subjects who did not have a diagnosis of glaucoma on the day of imaging but were later diagnosed (progress-to-glaucoma [PTG]).

RESULTS

Results show that a multimodal model that combines imaging with demographic and clinical features is highly accurate (area under the curve 0.97). Interpretation of this model highlights biological features known to be related to the disease, such as age, intraocular pressure, and optic disc morphology. Our model also points to previously unknown or disputed features, such as pulmonary function and retinal outer layers. Accurate prediction in PTG highlights variables that change with progression to glaucoma-age and pulmonary function.

CONCLUSIONS

The accuracy of our model suggests distinct sources of information in each imaging modality and in the different clinical and demographic variables. Interpretable machine learning methods elucidate subject-level prediction and help uncover the factors that lead to accurate predictions, pointing to potential disease mechanisms or variables related to the disease.

On the generalizability of diffusion MRI signal representations across acquisition parameters, sequences and tissue types: Chronicles of the MEMENTO challenge

Diffusion MRI (dMRI) has become an invaluable tool to assess the microstructural organization of brain tissue. Depending on the specific acquisition settings, the dMRI signal encodes specific properties of the underlying diffusion process. In the last two decades, several signal representations have been proposed to fit the dMRI signal and decode such properties. Most methods, however, are tested and developed on a limited amount of data, and their applicability to other acquisition schemes remains unknown. With this work, we aimed to shed light on the generalizability of existing dMRI signal representations to different diffusion encoding parameters and brain tissue types. To this end, we organized a community challenge - named MEMENTO, making available the same datasets for fair comparisons across algorithms and techniques. We considered two state-of-the-art diffusion datasets, including single-diffusion-encoding (SDE) spin-echo data from a human brain with over 3820 unique diffusion weightings (the MASSIVE dataset), and double (oscillating) diffusion encoding data (DDE/DODE) of a mouse brain including over 2520 unique data points. A subset of the data sampled in 5 different voxels was openly distributed, and the challenge participants were asked to predict the remaining part of the data. After one year, eight participant teams submitted a total of 80 signal fits. For each submission, we evaluated the mean squared error, the variance of the prediction error and the Bayesian information criteria. The received submissions predicted either multi-shell SDE data (37%) or DODE data (22%), followed by cartesian SDE data (19%) and DDE (18%). Most submissions predicted the signals measured with SDE remarkably well, with the exception of low and very strong diffusion weightings. The prediction of DDE and DODE data seemed more challenging, likely because none of the submissions explicitly accounted for diffusion time and frequency. Next to the choice of the model, decisions on fit procedure and hyperparameters play a major role in the prediction performance, highlighting the importance of optimizing and reporting such choices. This work is a community effort to highlight strength and limitations of the field at representing dMRI acquired with trending encoding schemes, gaining insights into how different models generalize to different tissue types and fiber configurations over a large range of diffusion encodings.

Centering inclusivity in the design of online conferences-An OHBM-Open Science perspective

As the global health crisis unfolded, many academic conferences moved online in 2020. This move has been hailed as a positive step towards inclusivity in its attenuation of economic, physical, and legal barriers and effectively enabled many individuals from groups that have traditionally been underrepresented to join and participate. A number of studies have outlined how moving online made it possible to gather a more global community and has increased opportunities for individuals with various constraints, e.g., caregiving responsibilities. Yet, the mere existence of online conferences is no guarantee that everyone can attend and participate meaningfully. In fact, many elements of an online conference are still significant barriers to truly diverse participation: the tools used can be inaccessible for some individuals; the scheduling choices can favour some geographical locations; the set-up of the conference can provide more visibility to well-established researchers and reduce opportunities for early-career researchers. While acknowledging the benefits of an online setting, especially for individuals who have traditionally been underrepresented or excluded, we recognize that fostering social justice requires inclusivity to actively be centered in every aspect of online conference design. Here, we draw from the literature and from our own experiences to identify practices that purposefully encourage a diverse community to attend, participate in, and lead online conferences. Reflecting on how to design more inclusive online events is especially important as multiple scientific organizations have announced that they will continue offering an online version of their event when in-person conferences can resume.

Diffusional Kurtosis Imaging in the Diffusion Imaging in Python Project

Diffusion-weighted magnetic resonance imaging (dMRI) measurements and models provide information about brain connectivity and are sensitive to the physical properties of tissue microstructure. Diffusional Kurtosis Imaging (DKI) quantifies the degree of non-Gaussian diffusion in biological tissue from dMRI. These estimates are of interest because they were shown to be more sensitive to microstructural alterations in health and diseases than measures based on the total anisotropy of diffusion which are highly confounded by tissue dispersion and fiber crossings. In this work, we implemented DKI in the Diffusion in Python (DIPY) project-a large collaborative open-source project which aims to provide well-tested, well-documented and comprehensive implementation of different dMRI techniques. We demonstrate the functionality of our methods in numerical simulations with known ground truth parameters and in openly available datasets. A particular strength of our DKI implementations is that it pursues several extensions of the model that connect it explicitly with microstructural models and the reconstruction of 3D white matter fiber bundles (tractography). For instance, our implementations include DKI-based microstructural models that allow the estimation of biophysical parameters, such as axonal water fraction. Moreover, we illustrate how DKI provides more general characterization of non-Gaussian diffusion compatible with complex white matter fiber architectures and gray matter, and we include a novel mean kurtosis index that is invariant to the confounding effects due to tissue dispersion. In summary, DKI in DIPY provides a well-tested, well-documented and comprehensive reference implementation for DKI. It provides a platform for wider use of DKI in research on brain disorders and in cognitive neuroscience.

QSIPrep: an integrative platform for preprocessing and reconstructing diffusion MRI data

Diffusion-weighted magnetic resonance imaging (dMRI) is the primary method for noninvasively studying the organization of white matter in the human brain. Here we introduce QSIPrep, an integrative software platform for the processing of diffusion images that is compatible with nearly all dMRI sampling schemes. Drawing on a diverse set of software suites to capitalize on their complementary strengths, QSIPrep facilitates the implementation of best practices for processing of diffusion images.

Multidimensional analysis and detection of informative features in human brain white matter

The white matter contains long-range connections between different brain regions and the organization of these connections holds important implications for brain function in health and disease. Tractometry uses diffusion-weighted magnetic resonance imaging (dMRI) to quantify tissue properties along the trajectories of these connections. Statistical inference from tractometry usually either averages these quantities along the length of each fiber bundle or computes regression models separately for each point along every one of the bundles. These approaches are limited in their sensitivity, in the former case, or in their statistical power, in the latter. We developed a method based on the sparse group lasso (SGL) that takes into account tissue properties along all of the bundles and selects informative features by enforcing both global and bundle-level sparsity. We demonstrate the performance of the method in two settings: i) in a classification setting, patients with amyotrophic lateral sclerosis (ALS) are accurately distinguished from matched controls. Furthermore, SGL identifies the corticospinal tract as important for this classification, correctly finding the parts of the white matter known to be affected by the disease. ii) In a regression setting, SGL accurately predicts "brain age." In this case, the weights are distributed throughout the white matter indicating that many different regions of the white matter change over the lifespan. Thus, SGL leverages the multivariate relationships between diffusion properties in multiple bundles to make accurate phenotypic predictions while simultaneously discovering the most relevant features of the white matter.

Brainhack: Developing a culture of open, inclusive, community-driven neuroscience

Brainhack is an innovative meeting format that promotes scientific collaboration and education in an open, inclusive environment. This NeuroView describes the myriad benefits for participants and the research community and how Brainhacks complement conventional formats to augment scientific progress.

Groupyr: Sparse Group Lasso in Python

For high-dimensional supervised learning, it is often beneficial to use domain-specific knowledge to improve the performance of statistical learning models. When the problem contains covariates which form groups, researchers can include this grouping information to find parsimonious representations of the relationship between covariates and targets. These groups may arise artificially, as from the polynomial expansion of a smaller feature space, or naturally, as from the anatomical grouping of different brain regions or the geographical grouping of different cities. When the number of features is large compared to the number of observations, one seeks a subset of the features which is sparse at both the group and global level.

Evaluating the Reliability of Human Brain White Matter Tractometry

The validity of research results depends on the reliability of analysis methods. In recent years, there have been concerns about the validity of research that uses diffusion-weighted MRI (dMRI) to understand human brain white matter connections in vivo, in part based on the reliability of analysis methods used in this field. We defined and assessed three dimensions of reliability in dMRI-based tractometry, an analysis technique that assesses the physical properties of white matter pathways: (1) reproducibility, (2) test-retest reliability, and (3) robustness. To facilitate reproducibility, we provide software that automates tractometry (https://yeatmanlab.github.io/pyAFQ). In measurements from the Human Connectome Project, as well as clinical-grade measurements, we find that tractometry has high test-retest reliability that is comparable to most standardized clinical assessment tools. We find that tractometry is also robust: showing high reliability with different choices of analysis algorithms. Taken together, our results suggest that tractometry is a reliable approach to analysis of white matter connections. The overall approach taken here both demonstrates the specific trustworthiness of tractometry analysis and outlines what researchers can do to establish the reliability of computational analysis pipelines in neuroimaging.

Fractional ridge regression: a fast, interpretable reparameterization of ridge regression

BACKGROUND

Ridge regression is a regularization technique that penalizes the L2-norm of the coefficients in linear regression. One of the challenges of using ridge regression is the need to set a hyperparameter (α) that controls the amount of regularization. Cross-validation is typically used to select the best α from a set of candidates. However, efficient and appropriate selection of α can be challenging. This becomes prohibitive when large amounts of data are analyzed. Because the selected α depends on the scale of the data and correlations across predictors, it is also not straightforwardly interpretable.

RESULTS

The present work addresses these challenges through a novel approach to ridge regression. We propose to reparameterize ridge regression in terms of the ratio γ between the L2-norms of the regularized and unregularized coefficients. We provide an algorithm that efficiently implements this approach, called fractional ridge regression, as well as open-source software implementations in Python and matlab (https://github.com/nrdg/fracridge). We show that the proposed method is fast and scalable for large-scale data problems. In brain imaging data, we demonstrate that this approach delivers results that are straightforward to interpret and compare across models and datasets.

CONCLUSION

Fractional ridge regression has several benefits: the solutions obtained for different γ are guaranteed to vary, guarding against wasted calculations; and automatically span the relevant range of regularization, avoiding the need for arduous manual exploration. These properties make fractional ridge regression particularly suitable for analysis of large complex datasets.

Bundle analytics, a computational framework for investigating the shapes and profiles of brain pathways across populations

Tractography has created new horizons for researchers to study brain connectivity in vivo. However, tractography is an advanced and challenging method that has not been used so far for medical data analysis at a large scale in comparison to other traditional brain imaging methods. This work allows tractography to be used for large scale and high-quality medical analytics. BUndle ANalytics (BUAN) is a fast, robust, and flexible computational framework for real-world tractometric studies. BUAN combines tractography and anatomical information to analyze the challenging datasets and identifies significant group differences in specific locations of the white matter bundles. Additionally, BUAN takes the shape of the bundles into consideration for the analysis. BUAN compares the shapes of the bundles using a metric called bundle adjacency which calculates shape similarity between two given bundles. BUAN builds networks of bundle shape similarities that can be paramount for automating quality control. BUAN is freely available in DIPY. Results are presented using publicly available Parkinson's Progression Markers Initiative data.

Model-Based Recommendations for Optimal Surgical Placement of Epiretinal Implants

A major limitation of current electronic retinal implants is that in addition to stimulating the intended retinal ganglion cells, they also stimulate passing axon fibers, producing perceptual 'streaks' that limit the quality of the generated visual experience. Recent evidence suggests a dependence between the shape of the elicited visual percept and the retinal location of the stimulating electrode. However, this knowledge has yet to be incorporated into the surgical placement of retinal implants. Here we systematically explored the space of possible implant configurations to make recommendations for optimal intraocular positioning of the electrode array. Using a psychophysically validated computational model, we demonstrate that better implant placement has the potential to reduce the spatial extent of axonal activation in existing implant users by up to ~55%. Importantly, the best implant location, as inferred from a population of simulated virtual patients, is both surgically feasible and is relatively stable across individuals. This study is a first step towards the use of computer simulations in patient-specific planning of retinal implant surgery.

Slow Endogenous Fluctuations in Cortical fMRI Signals Correlate with Reduced Performance in a Visual Detection Task and Are Suppressed by Spatial Attention

Spatial attention improves performance on visual tasks, increases neural responses to attended stimuli, and reduces correlated noise in visual cortical neurons. In addition to being visually responsive, many retinotopic visual cortical areas exhibit very slow (<0.1 Hz) endogenous fluctuations in functional magnetic resonance imaging signals. To test whether these fluctuations degrade stimulus representations, thereby impairing visual detection, we recorded functional magnetic resonance imaging responses while human participants performed a target detection task that required them to allocate spatial attention to either a rotating wedge stimulus or a central fixation point. We then measured the effects of spatial attention on response amplitude at the frequency of wedge rotation and on the amplitude of endogenous fluctuations at nonstimulus frequencies. We found that, in addition to enhancing stimulus-evoked responses, attending to the wedge also suppressed slow endogenous fluctuations that were unrelated to the visual stimulus in topographically defined areas in early visual cortex, posterior parietal cortex, and lateral occipital cortex, but not in a nonvisual cortical control region. Moreover, attentional enhancement of response amplitude and suppression of endogenous fluctuations were dissociable across cortical areas and across time. Finally, we found that the amplitude of the stimulus-evoked response was not correlated with a perceptual measure of visual target detection. Instead, perceptual performance was accounted for by the amount of suppression of slow endogenous fluctuations. Our results indicate that the amplitude of slow fluctuations of cortical activity is influenced by spatial attention and suggest that these endogenous fluctuations may impair perceptual processing in topographically organized visual cortical areas.

Evaluating arcuate fasciculus laterality measurements across dataset and tractography pipelines

The arcuate fasciculi are white-matter pathways that connect frontal and temporal lobes in each hemisphere. The arcuate plays a key role in the language network and is believed to be left-lateralized, in line with left hemisphere dominance for language. Measuring the arcuate in vivo requires diffusion magnetic resonance imaging-based tractography, but asymmetry of the in vivo arcuate is not always reliably detected in previous studies. It is unknown how the choice of tractography algorithm, with each method's freedoms, constraints, and vulnerabilities to false-positive and -negative errors, impacts findings of arcuate asymmetry. Here, we identify the arcuate in two independent datasets using a number of tractography strategies and methodological constraints, and assess their impact on estimates of arcuate laterality. We test three tractography methods: a deterministic, a probabilistic, and a tractography-evaluation (LiFE) algorithm. We extract the arcuate from the whole-brain tractogram, and compare it to an arcuate bundle constrained even further by selecting only those streamlines that connect to anatomically relevant cortical regions. We test arcuate macrostructure laterality, and also evaluate microstructure profiles for properties such as fractional anisotropy and quantitative R1. We find that both tractography choice and implementing the cortical constraints substantially impact estimates of all indices of arcuate laterality. Together, these results emphasize the effect of the tractography pipeline on estimates of arcuate laterality in both macrostructure and microstructure.

Combining Citizen Science and Deep Learning to Amplify Expertise in Neuroimaging

Big Data promises to advance science through data-driven discovery. However, many standard lab protocols rely on manual examination, which is not feasible for large-scale datasets. Meanwhile, automated approaches lack the accuracy of expert examination. We propose to (1) start with expertly labeled data, (2) amplify labels through web applications that engage citizen scientists, and (3) train machine learning on amplified labels, to emulate the experts. Demonstrating this, we developed a system to quality control brain magnetic resonance images. Expert-labeled data were amplified by citizen scientists through a simple web interface. A deep learning algorithm was then trained to predict data quality, based on citizen scientist labels. Deep learning performed as well as specialized algorithms for quality control (AUC = 0.99). Combining citizen science and deep learning can generalize and scale expert decision making; this is particularly important in disciplines where specialized, automated tools do not yet exist.

Applying microstructural models to understand the role of white matter in cognitive development

Diffusion MRI (dMRI) holds great promise for illuminating the biological changes that underpin cognitive development. The diffusion of water molecules probes the cellular structure of brain tissue, and biophysical modeling of the diffusion signal can be used to make inferences about specific tissue properties that vary over development or predict cognitive performance. However, applying these models to study development requires that the parameters can be reliably estimated given the constraints of data collection with children. Here we collect repeated scans using a typical multi-shell diffusion MRI protocol in a group of children (ages 7-12) and use two popular modeling techniques to examine individual differences in white matter structure. We first assess scan-rescan reliability of model parameters and show that axon water faction can be reliably estimated from a relatively fast acquisition, without applying spatial smoothing or de-noising. We then investigate developmental changes in the white matter, and individual differences that correlate with reading skill. Specifically, we test the hypothesis that previously reported correlations between reading skill and diffusion anisotropy in the corpus callosum reflect increased axon water fraction in poor readers. Both models support this interpretation, highlighting the utility of these approaches for testing specific hypotheses about cognitive development.

Generalized diffusion spectrum magnetic resonance imaging (GDSI) for model-free reconstruction of the ensemble average propagator

Diffusion spectrum MRI (DSI) provides model-free estimation of the diffusion ensemble average propagator (EAP) and orientation distribution function (ODF) but requires the diffusion data to be acquired on a Cartesian q-space grid. Multi-shell diffusion acquisitions are more flexible and more commonly acquired but have, thus far, only been compatible with model-based analysis methods. Here, we propose a generalized DSI (GDSI) framework to recover the EAP from multi-shell diffusion MRI data. The proposed GDSI approach corrects for q-space sampling density non-uniformity using a fast geometrical approach. The EAP is directly calculated in a preferable coordinate system by multiplying the sampling density corrected q-space signals by a discrete Fourier transform matrix, without any need for gridding. The EAP is demonstrated as a way to map diffusion patterns in brain regions such as the thalamus, cortex and brainstem where the tissue microstructure is not as well characterized as in white matter. Scalar metrics such as the zero displacement probability and displacement distances at different fractions of the zero displacement probability were computed from the recovered EAP to characterize the diffusion pattern within each voxel. The probability averaged across directions at a specific displacement distance provides a diffusion property based image contrast that clearly differentiates tissue types. The displacement distance at the first zero crossing of the EAP averaged across directions orthogonal to the primary fiber orientation in the corpus callosum is found to be larger in the body (5.65 ± 0.09 μm) than in the genu (5.55 ± 0.15 μm) and splenium (5.4 ± 0.15 μm) of the corpus callosum, which corresponds well to prior histological studies. The EAP also provides model-free representations of angular structure such as the diffusion ODF, which allows estimation and comparison of fiber orientations from both the model-free and model-based methods on the same multi-shell data. For the model-free methods, detection of crossing fibers is found to be strongly dependent on the maximum b-value and less sensitive compared to the model-based methods. In conclusion, our study provides a generalized DSI approach that allows flexible reconstruction of the diffusion EAP and ODF from multi-shell diffusion data and data acquired with other sampling patterns.

diff_classifier: Parallelization of multi-particle tracking video analyses

The diff_classifier package seeks to address the issue of scale-up in multi-particle tracking (MPT) analyses via a parallelization approach. MPT is a powerful analytical tool that has been used in fields ranging from aeronautics to oceanography (Pulford, 2005) allowing researchers to collect spatial and velocity information of moving objects from video datasets. Examples include: Tracking tracers in ocean currents to study fluid flowTracking molecular motors (e.g., myosin, kinesin) to assess motile activityMeasuring intracellular trafficking by tracking membrane vesiclesAssessing microrheological properties by tracking nanoparticle movement.

A browser-based tool for visualization and analysis of diffusion MRI data

Human neuroscience research faces several challenges with regards to reproducibility. While scientists are generally aware that data sharing is important, it is not always clear how to share data in a manner that allows other labs to understand and reproduce published findings. Here we report a new open source tool, AFQ-Browser, that builds an interactive website as a companion to a diffusion MRI study. Because AFQ-Browser is portable-it runs in any web-browser-it can facilitate transparency and data sharing. Moreover, by leveraging new web-visualization technologies to create linked views between different dimensions of the dataset (anatomy, diffusion metrics, subject metadata), AFQ-Browser facilitates exploratory data analysis, fueling new discoveries based on previously published datasets. In an era where Big Data is playing an increasingly prominent role in scientific discovery, so will browser-based tools for exploring high-dimensional datasets, communicating scientific discoveries, aggregating data across labs, and publishing data alongside manuscripts.

Journal of Open Source Software (JOSS): design and first-year review

This article describes the motivation, design, and progress of the Journal of Open Source Software (JOSS). JOSS is a free and open-access journal that publishes articles describing research software. It has the dual goals of improving the quality of the software submitted and providing a mechanism for research software developers to receive credit. While designed to work within the current merit system of science, JOSS addresses the dearth of rewards for key contributions to science made in the form of software. JOSS publishes articles that encapsulate scholarship contained in the software itself, and its rigorous peer review targets the software components: functionality, documentation, tests, continuous integration, and the license. A JOSS article contains an abstract describing the purpose and functionality of the software, references, and a link to the software archive. The article is the entry point of a JOSS submission, which encompasses the full set of software artifacts. Submission and review proceed in the open, on GitHub. Editors, reviewers, and authors work collaboratively and openly. Unlike other journals, JOSS does not reject articles requiring major revision; while not yet accepted, articles remain visible and under review until the authors make adequate changes (or withdraw, if unable to meet requirements). Once an article is accepted, JOSS gives it a digital object identifier (DOI), deposits its metadata in Crossref, and the article can begin collecting citations on indexers like Google Scholar and other services. Authors retain copyright of their JOSS article, releasing it under a Creative Commons Attribution 4.0 International License. In its first year, starting in May 2016, JOSS published 111 articles, with more than 40 additional articles under review. JOSS is a sponsored project of the nonprofit organization NumFOCUS and is an affiliate of the Open Source Initiative (OSI).

Fully automated, deep learning segmentation of oxygen-induced retinopathy images

Oxygen-induced retinopathy (OIR) is a widely used model to study ischemia-driven neovascularization (NV) in the retina and to serve in proof-of-concept studies in evaluating antiangiogenic drugs for ocular, as well as nonocular, diseases. The primary parameters that are analyzed in this mouse model include the percentage of retina with vaso-obliteration (VO) and NV areas. However, quantification of these two key variables comes with a great challenge due to the requirement of human experts to read the images. Human readers are costly, time-consuming, and subject to bias. Using recent advances in machine learning and computer vision, we trained deep learning neural networks using over a thousand segmentations to fully automate segmentation in OIR images. While determining the percentage area of VO, our algorithm achieved a similar range of correlation coefficients to that of expert inter-human correlation coefficients. In addition, our algorithm achieved a higher range of correlation coefficients compared with inter-expert correlation coefficients for quantification of the percentage area of neovascular tufts. In summary, we have created an open-source, fully automated pipeline for the quantification of key values of OIR images using deep learning neural networks.

Mapping genetic variations to three-dimensional protein structures to enhance variant interpretation: a proposed framework

The translation of personal genomics to precision medicine depends on the accurate interpretation of the multitude of genetic variants observed for each individual. However, even when genetic variants are predicted to modify a protein, their functional implications may be unclear. Many diseases are caused by genetic variants affecting important protein features, such as enzyme active sites or interaction interfaces. The scientific community has catalogued millions of genetic variants in genomic databases and thousands of protein structures in the Protein Data Bank. Mapping mutations onto three-dimensional (3D) structures enables atomic-level analyses of protein positions that may be important for the stability or formation of interactions; these may explain the effect of mutations and in some cases even open a path for targeted drug development. To accelerate progress in the integration of these data types, we held a two-day Gene Variation to 3D (GVto3D) workshop to report on the latest advances and to discuss unmet needs. The overarching goal of the workshop was to address the question: what can be done together as a community to advance the integration of genetic variants and 3D protein structures that could not be done by a single investigator or laboratory? Here we describe the workshop outcomes, review the state of the field, and propose the development of a framework with which to promote progress in this arena. The framework will include a set of standard formats, common ontologies, a common application programming interface to enable interoperation of the resources, and a Tool Registry to make it easy to find and apply the tools to specific analysis problems. Interoperability will enable integration of diverse data sources and tools and collaborative development of variant effect prediction methods.