Neuroadaptive Bayesian Optimization and Hypothesis Testing

Neuroadaptive Bayesian optimisation to study individual differences in infants' engagement with social cues

Infants' motivation to engage with the social world depends on the interplay between individual brain's characteristics and previous exposure to social cues such as the parent's smile or eye contact. Different hypotheses about why specific combinations of emotional expressions and gaze direction engage children have been tested with group-level approaches rather than focusing on individual differences in the social brain development. Here, a novel Artificial Intelligence-enhanced brain-imaging approach, Neuroadaptive Bayesian Optimisation (NBO), was applied to infant electro-encephalography (EEG) to understand how selected neural signals encode social cues in individual infants. EEG data from 42 6- to 9-month-old infants looking at images of their parent's face were analysed in real-time and used by a Bayesian Optimisation algorithm to identify which combination of the parent's gaze/head direction and emotional expression produces the strongest brain activation in the child. This individualised approach supported the theory that the infant's brain is maximally engaged by communicative cues with a negative valence (angry faces with direct gaze). Infants attending preferentially to faces with direct gaze had increased positive affectivity and decreased negative affectivity. This work confirmed that infants' attentional preferences for social cues are heterogeneous and shows the NBO's potential to study diversity in neurodevelopmental trajectories.

A generative model of electrophysiological brain responses to stimulation

Each brain response to a stimulus is, to a large extent, unique. However this variability, our perceptual experience feels stable. Standard decoding models, which utilise information across several areas to tap into stimuli representation and processing, are fundamentally based on averages. Therefore, they can focus precisely on the features that are most stable across stimulus presentations. But which are these features exactly is difficult to address in the absence of a generative model of the signal. Here, I introduce genephys, a generative model of brain responses to stimulation publicly available as a Python package that, when confronted with a decoding algorithm, can reproduce the structured patterns of decoding accuracy that we observe in real data. Using this approach, I characterise how these patterns may be brought about by the different aspects of the signal, which in turn may translate into distinct putative neural mechanisms. In particular, the model shows that the features in the data that support successful decoding-and, therefore, likely reflect stable mechanisms of stimulus representation-have an oscillatory component that spans multiple channels, frequencies, and latencies of response; and an additive, slower response with a specific (cross-frequency) relation to the phase of the oscillatory component. At the individual trial level, still, responses are found to be highly variable, which can be due to various factors including phase noise and probabilistic activations.

Advanced techniques in automated high-resolution scanning transmission electron microscopy

Scanning transmission electron microscopy is a common tool used to study the atomic structure of materials. It is an inherently multimodal tool allowing for the simultaneous acquisition of multiple information channels. Despite its versatility, however, experimental workflows currently rely heavily on experienced human operators and can only acquire data from small regions of a sample at a time. Here, we demonstrate a flexible pipeline-based system for high-throughput acquisition of atomic-resolution structural data using an all-piezo sample stage applied to large-scale imaging of nanoparticles and multimodal data acquisition. The system is available as part of the user program of the Molecular Foundry at Lawrence Berkeley National Laboratory.

Real-time monitoring of infant theta power during naturalistic social experiences

Infant-directed speech and direct gaze are important social cues that shape infant's attention to their parents. Traditional methods for probing their effect on infant attention involve a small number of pre-selected screen-based stimuli, which do not capture the complexity of real-world interactions. Here, we used neuroadaptive Bayesian Optimization (NBO) to search a large 'space' of different naturalistic social experiences that systematically varied in their visual (gaze direct to averted) and auditory properties (infant directed speech to nonvocal sounds). We measured oscillatory brain responses (relative theta power) during episodes of naturalistic social experiences in 57 typically developing 6- to 12-month-old infants. Relative theta power was used as input to the NBO algorithm to identify the naturalistic social context that maximally elicited attention in each individual infant. Results showed that individual infants were heterogeneous in the stimulus that elicited maximal theta with no overall stronger attention for direct gaze or infant-directed speech; however, individual differences in attention towards averted gaze were related to interpersonal skills and greater likelihood of preferring speech and direct gaze was observed in infants whose parents showed more positive affect. Our work indicates NBO may be a fruitful method for probing the role of distinct social cues in eliciting attention in naturalistic social contexts at the individual level.

Closing the loop between brain and electrical stimulation: towards precision neuromodulation treatments

One of the most critical challenges in using noninvasive brain stimulation (NIBS) techniques for the treatment of psychiatric and neurologic disorders is inter- and intra-individual variability in response to NIBS. Response variations in previous findings suggest that the one-size-fits-all approach does not seem the most appropriate option for enhancing stimulation outcomes. While there is a growing body of evidence for the feasibility and effectiveness of individualized NIBS approaches, the optimal way to achieve this is yet to be determined. Transcranial electrical stimulation (tES) is one of the NIBS techniques showing promising results in modulating treatment outcomes in several psychiatric and neurologic disorders, but it faces the same challenge for individual optimization. With new computational and methodological advances, tES can be integrated with real-time functional magnetic resonance imaging (rtfMRI) to establish closed-loop tES-fMRI for individually optimized neuromodulation. Closed-loop tES-fMRI systems aim to optimize stimulation parameters based on minimizing differences between the model of the current brain state and the desired value to maximize the expected clinical outcome. The methodological space to optimize closed-loop tES fMRI for clinical applications includes (1) stimulation vs. data acquisition timing, (2) fMRI context (task-based or resting-state), (3) inherent brain oscillations, (4) dose-response function, (5) brain target trait and state and (6) optimization algorithm. Closed-loop tES-fMRI technology has several advantages over non-individualized or open-loop systems to reshape the future of neuromodulation with objective optimization in a clinically relevant context such as drug cue reactivity for substance use disorder considering both inter and intra-individual variations. Using multi-level brain and behavior measures as input and desired outcomes to individualize stimulation parameters provides a framework for designing personalized tES protocols in precision psychiatry.

Double-Blind, Sham-Controlled Randomized Trial Testing the Efficacy of fMRI Neurofeedback on Clinical and Cognitive Measures in Children With ADHD

OBJECTIVE

Functional MRI neurofeedback (fMRI-NF) could potentially be a novel, safe nonpharmacological treatment for attention deficit hyperactivity disorder (ADHD). A proof-of-concept randomized controlled trial of fMRI-NF of the right inferior frontal cortex (rIFC), compared to an active control condition, showed promising improvement of ADHD symptoms (albeit in both groups) and in brain function. However, comparison with a placebo condition in a larger trial is required to test efficacy.

METHODS

This double-blind, sham-controlled randomized controlled trial tested the effectiveness and efficacy of fMRI-NF of the rIFC on symptoms and executive functions in 88 boys with ADHD (44 each in the active and sham arms). To investigate treatment-related changes, groups were compared at the posttreatment and 6-month follow-up assessments, controlling for baseline scores, age, and medication status. The primary outcome measure was posttreatment score on the ADHD Rating Scale (ADHD-RS).

RESULTS

No significant group differences were found on the ADHD-RS. Both groups showed similar decreases in other clinical and cognitive measures, except for a significantly greater decrease in irritability and improvement in motor inhibition in sham relative to active fMRI-NF at the posttreatment assessment, covarying for baseline. There were no significant side effects or adverse events. The active relative to the sham fMRI-NF group showed enhanced activation in rIFC and other frontal and temporo-occipital-cerebellar self-regulation areas. However, there was no progressive rIFC upregulation, correlation with ADHD-RS scores, or transfer of learning.

CONCLUSIONS

Contrary to the hypothesis, the study findings do not suggest that fMRI-NF of the rIFC is effective in improving clinical symptoms or cognition in boys with ADHD.

Unifying framework for cognitive training interventions in brain aging

Cognitive training is a promising tool for slowing or preventing cognitive decline in older adults at-risk for dementia. Its success, however, has been limited by a lack of evidence showing that it reliably causes broad training effects: improvements in cognition across a range of domains that lead to real-world benefits. Here, we propose a framework for enhancing the effect of cognitive training interventions in brain aging. The focus is on (A) developing cognitive training task paradigms that are informed by population-level cognitive characteristics and pathophysiology, and (B) personalizing how these sets are presented to participants during training via feedback loops that aim to optimize "mismatch" between participant capacity and training demands using both adaptation and random variability. In this way, cognitive training can better alter whole-brain topology in a manner that supports broad training effects in the context of brain aging.

A guided multiverse study of neuroimaging analyses

For most neuroimaging questions the range of possible analytic choices makes it unclear how to evaluate conclusions from any single analytic method. One possible way to address this issue is to evaluate all possible analyses using a multiverse approach, however, this can be computationally challenging and sequential analyses on the same data can compromise predictive power. Here, we establish how active learning on a low-dimensional space capturing the inter-relationships between pipelines can efficiently approximate the full spectrum of analyses. This approach balances the benefits of a multiverse analysis without incurring the cost on computational and predictive power. We illustrate this approach with two functional MRI datasets (predicting brain age and autism diagnosis) demonstrating how a multiverse of analyses can be efficiently navigated and mapped out using active learning. Furthermore, our presented approach not only identifies the subset of analysis techniques that are best able to predict age or classify individuals with autism spectrum disorder and healthy controls, but it also allows the relationships between analyses to be quantified.

Behavioral Studies Using Large-Scale Brain Networks – Methods and Validations

Mapping human behaviors to brain activity has become a key focus in modern cognitive neuroscience. As methods such as functional MRI (fMRI) advance cognitive scientists show an increasing interest in investigating neural activity in terms of functional connectivity and brain networks, rather than activation in a single brain region. Due to the noisy nature of neural activity, determining how behaviors are associated with specific neural signals is not well-established. Previous research has suggested graph theory techniques as a solution. Graph theory provides an opportunity to interpret human behaviors in terms of the topological organization of brain network architecture. Graph theory-based approaches, however, only scratch the surface of what neural connections relate to human behavior. Recently, the development of data-driven methods, e.g., machine learning and deep learning approaches, provide a new perspective to study the relationship between brain networks and human behaviors across the whole brain, expanding upon past literatures. In this review, we sought to revisit these data-driven approaches to facilitate our understanding of neural mechanisms and build models of human behaviors. We start with the popular graph theory approach and then discuss other data-driven approaches such as connectome-based predictive modeling, multivariate pattern analysis, network dynamic modeling, and deep learning techniques that quantify meaningful networks and connectivity related to cognition and behaviors. Importantly, for each topic, we discuss the pros and cons of the methods in addition to providing examples using our own data for each technique to describe how these methods can be applied to real-world neuroimaging data.

Enhancing Cortical Network-level Participation Coefficient as a Potential Mechanism for Transfer in Cognitive Training in aMCI

Effective cognitive training must improve cognition beyond the trained domain (show a transfer effect) and be applicable to dementia-risk populations, e.g., amnesic mild cognitive impairment (aMCI). Theories suggest training should target processes that 1) show robust engagement, 2) are domain-general, and 3) reflect long-lasting changes in brain organization. Brain regions that connect to many different networks (i.e., show high participation coefficient; PC) are known to support integration. This capacity is 1) relatively preserved in aMCI, 2) required across a wide range of cognitive domains, and 3) trait-like. In 49 individuals with aMCI that completed a 6-week visual speed of processing training (VSOP) and 28 active controls, enhancement in PC was significantly more related to transfer to working memory at global and network levels in VSOP compared to controls, particularly in networks with many high-PC nodes. This suggests that enhancing brain integration may provide a target for developing effective cognitive training.

Handling EEG artifacts and searching individually optimal experimental parameter in real time: a system development and demonstration

Objective.Neuroadaptive paradigms that systematically assess event-related potential (ERP) features across many different experimental parameters have the potential to improve the generalizability of ERP findings and may help to accelerate ERP-based biomarker discovery by identifying the exact experimental conditions for which ERPs differ most for a certain clinical population. Obtaining robust and reliable ERPs online is a prerequisite for ERP-based neuroadaptive research. One of the key steps involved is to correctly isolate electroencephalography artifacts in real time because they contribute a large amount of variance that, if not removed, will greatly distort the ERP obtained. Another key factor of concern is the computational cost of the online artifact handling method. This work aims to develop and validate a cost-efficient system to support ERP-based neuroadaptive research.Approach.We developed a simple online artifact handling method, single trial PCA-based artifact removal (SPA), based on variance distribution dichotomies to distinguish between artifacts and neural activity. We then applied this method in an ERP-based neuroadaptive paradigm in which Bayesian optimization was used to search individually optimal inter-stimulus-interval (ISI) that generates ERP with the highest signal-to-noise ratio.Main results.SPA was compared to other offline and online algorithms. The results showed that SPA exhibited good performance in both computational efficiency and preservation of ERP pattern. Based on SPA, the Bayesian optimization procedure was able to quickly find individually optimal ISI.Significance.The current work presents a simple yet highly cost-efficient method that has been validated in its ability to extract ERP, preserve ERP effects, and better support ERP-based neuroadaptive paradigm.

Rapid processing and quantitative evaluation of structural brain scans for adaptive multimodal imaging

Current neuroimaging acquisition and processing approaches tend to be optimised for quality rather than speed. However, rapid acquisition and processing of neuroimaging data can lead to novel neuroimaging paradigms, such as adaptive acquisition, where rapidly processed data is used to inform subsequent image acquisition steps. Here we first evaluate the impact of several processing steps on the processing time and quality of registration of manually labelled T₁ -weighted MRI scans. Subsequently, we apply the selected rapid processing pipeline both to rapidly acquired multicontrast EPImix scans of 95 participants (which include T₁ -FLAIR, T₂ , T₂ *, T₂ -FLAIR, DWI and ADC contrasts, acquired in ~1 min), as well as to slower, more standard single-contrast T₁ -weighted scans of a subset of 66 participants. We quantify the correspondence between EPImix T₁ -FLAIR and single-contrast T₁ -weighted scans, using correlations between voxels and regions of interest across participants, measures of within- and between-participant identifiability as well as regional structural covariance networks. Furthermore, we explore the use of EPImix for the rapid construction of morphometric similarity networks. Finally, we quantify the reliability of EPImix-derived data using test-retest scans of 10 participants. Our results demonstrate that quantitative information can be derived from a neuroimaging scan acquired and processed within minutes, which could further be used to implement adaptive multimodal imaging and tailor neuroimaging examinations to individual patients.

A Bayesian optimization approach for rapidly mapping residual network function in stroke

Post-stroke cognitive and linguistic impairments are debilitating conditions, with limited therapeutic options. Domain-general brain networks play an important role in stroke recovery and characterizing their residual function with functional MRI has the potential to yield biomarkers capable of guiding patient-specific rehabilitation. However, this is challenging as such detailed characterization requires testing patients on multitudes of cognitive tasks in the scanner, rendering experimental sessions unfeasibly lengthy. Thus, the current status quo in clinical neuroimaging research involves testing patients on a very limited number of tasks, in the hope that it will reveal a useful neuroimaging biomarker for the whole cohort. Given the great heterogeneity among stroke patients and the volume of possible tasks this approach is unsustainable. Advancing task-based functional MRI biomarker discovery requires a paradigm shift in order to be able to swiftly characterize residual network activity in individual patients using a diverse range of cognitive tasks. Here, we overcome this problem by leveraging neuroadaptive Bayesian optimization, an approach combining real-time functional MRI with machine-learning, by intelligently searching across many tasks, this approach rapidly maps out patient-specific profiles of residual domain-general network function. We used this technique in a cross-sectional study with 11 left-hemispheric stroke patients with chronic aphasia (four female, age ± standard deviation: 59 ± 10.9 years) and 14 healthy, age-matched control subjects (eight female, age ± standard deviation: 55.6 ± 6.8 years). To assess intra-subject reliability of the functional profiles obtained, we conducted two independent runs per subject, for which the algorithm was entirely reinitialized. Our results demonstrate that this technique is both feasible and robust, yielding reliable patient-specific functional profiles. Moreover, we show that group-level results are not representative of patient-specific results. Whereas controls have highly similar profiles, patients show idiosyncratic profiles of network abnormalities that are associated with behavioural performance. In summary, our study highlights the importance of moving beyond traditional 'one-size-fits-all' approaches where patients are treated as one group and single tasks are used. Our approach can be extended to diverse brain networks and combined with brain stimulation or other therapeutics, thereby opening new avenues for precision medicine targeting a diverse range of neurological and psychiatric conditions.

Power contours: Optimising sample size and precision in experimental psychology and human neuroscience

When designing experimental studies with human participants, experimenters must decide how many trials each participant will complete, as well as how many participants to test. Most discussion of statistical power (the ability of a study design to detect an effect) has focused on sample size, and assumed sufficient trials. Here we explore the influence of both factors on statistical power, represented as a 2-dimensional plot on which iso-power contours can be visualized. We demonstrate the conditions under which the number of trials is particularly important, that is, when the within-participant variance is large relative to the between-participants variance. We then derive power contour plots using existing data sets for 8 experimental paradigms and methodologies (including reaction times, sensory thresholds, fMRI, MEG, and EEG), and provide example code to calculate estimates of the within- and between-participants variance for each method. In all cases, the within-participant variance was larger than the between-participants variance, meaning that the number of trials has a meaningful influence on statistical power in commonly used paradigms. An online tool is provided (https://shiny.york.ac.uk/powercontours/) for generating power contours, from which the optimal combination of trials and participants can be calculated when designing future studies. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

When we can trust computers (and when we can't)

With the relentless rise of computer power, there is a widespread expectation that computers can solve the most pressing problems of science, and even more besides. We explore the limits of computational modelling and conclude that, in the domains of science and engineering which are relatively simple and firmly grounded in theory, these methods are indeed powerful. Even so, the availability of code, data and documentation, along with a range of techniques for validation, verification and uncertainty quantification, are essential for building trust in computer-generated findings. When it comes to complex systems in domains of science that are less firmly grounded in theory, notably biology and medicine, to say nothing of the social sciences and humanities, computers can create the illusion of objectivity, not least because the rise of big data and machine-learning pose new challenges to reproducibility, while lacking true explanatory power. We also discuss important aspects of the natural world which cannot be solved by digital means. In the long term, renewed emphasis on analogue methods will be necessary to temper the excessive faith currently placed in digital computation. This article is part of the theme issue 'Reliability and reproducibility in computational science: implementing verification, validation and uncertainty quantification in silico'.

Shaping the slow waves of sleep: A systematic and integrative review of sleep slow wave modulation in humans using non-invasive brain stimulation

The experimental study of electroencephalographic slow wave sleep (SWS) stretches over more than half a century and has corroborated its importance for basic physiological processes, such as brain plasticity, metabolism and immune system functioning. Alterations of SWS in aging or pathological conditions suggest that modulating SWS might constitute a window for clinically relevant interventions. This work provides a systematic and integrative review of SWS modulation through non-invasive brain stimulation in humans. A literature search using PubMed, conducted in May 2020, identified 3220 studies, of which 82 fulfilled inclusion criteria. Three approaches have been adopted to modulate the macro- and microstructure of SWS, namely auditory, transcranial electrical and transcranial magnetic stimulation. Our current knowledge about the modulatory mechanisms, the space of stimulation parameters and the physiological and behavioral effects are reported and evaluated. The integration of findings suggests that sleep slow wave modulation bears the potential to promote our understanding of the functions of SWS and to develop new treatments for conditions of disrupted SWS.

Resolving heterogeneity in transcranial electrical stimulation efficacy for attention deficit hyperactivity disorder

While the treatment of Attention Deficit Hyperactivity Disorder (ADHD) is dominated by pharmacological agents, transcranial electrical stimulation (tES) is gaining attention as an alternative method for treatment. Most current meta-analyses have suggested that tES can improve cognitive functions that are otherwise impaired in ADHD, such as inhibition and working memory, as well as alleviated clinical symptoms. Here we review some of the promising findings in the field of tES. At the same time, we highlight two factors, which hinder the effective application of tES in treating ADHD: 1) the heterogeneity of tES protocols used in different studies; 2) patient profiles influencing responses to tES. We highlight potential solutions for overcoming such limitations, including the use of active machine learning, and provide simulated data to demonstrate how these solutions could also improve the understanding, diagnosis, and treatment of ADHD.

Can We Ditch Feature Engineering? End-to-End Deep Learning for Affect Recognition from Physiological Sensor Data

To further extend the applicability of wearable sensors in various domains such as mobile health systems and the automotive industry, new methods for accurately extracting subtle physiological information from these wearable sensors are required. However, the extraction of valuable information from physiological signals is still challenging—smartphones can count steps and compute heart rate, but they cannot recognize emotions and related affective states. This study analyzes the possibility of using end-to-end multimodal deep learning (DL) methods for affect recognition. Ten end-to-end DL architectures are compared on four different datasets with diverse raw physiological signals used for affect recognition, including emotional and stress states. The DL architectures specialized for time-series classification were enhanced to simultaneously facilitate learning from multiple sensors, each having their own sampling frequency. To enable fair comparison among the different DL architectures, Bayesian optimization was used for hyperparameter tuning. The experimental results showed that the performance of the models depends on the intensity of the physiological response induced by the affective stimuli, i.e., the DL models recognize stress induced by the Trier Social Stress Test more successfully than they recognize emotional changes induced by watching affective content, e.g., funny videos. Additionally, the results showed that the CNN-based architectures might be more suitable than LSTM-based architectures for affect recognition from physiological sensors.

Discrete sampling in perception via neuronal oscillations-Evidence from rhythmic, non-invasive brain stimulation

A variety of perceptual phenomena suggest that, in contrast to our everyday experience, our perception may be discrete rather than continuous. The possibility of such discrete sampling processes inevitably prompts the question of how such discretization is implemented in the brain. Evidence from neurophysiological measurements suggest that neural oscillations, particularly in the lower frequencies, may provide a mechanism by which such discretization can be implemented. It is hypothesized that cortical excitability is rhythmically enhanced or reduced along the positive and negative half-cycle of such oscillations. In recent years, rhythmic non-invasive brain stimulation approaches such as rhythmic transcranial magnetic stimulation (rTMS) and transcranial alternating current stimulation (tACS) are increasingly used to test this hypothesis. Both methods are thought to entrain endogenous brain oscillations, allowing them to alter their power, frequency, and phase in order to study their roles in perception. After a brief introduction to the core mechanisms of both methods, we will provide an overview of rTMS and tACS studies probing the role of brain oscillations for discretized perception in different domains and will contrast these results with unsuccessful attempts. Further, we will discuss methodological pitfalls and challenges associated with the methods.

Dynamic modulation of frontal theta power predicts cognitive ability in infancy

Cognitive ability is a key factor that contributes to individual differences in life trajectories. Identifying early neural indicators of later cognitive ability may enable us to better elucidate the mechanisms that shape individual differences, eventually aiding identification of infants with an elevated likelihood of less optimal outcomes. A previous study associated a measure of neural activity (theta EEG) recorded at 12-months with non-verbal cognitive ability at ages two, three and seven in individuals with older siblings with autism (Jones et al., 2020). In a pre-registered study (https://osf.io/v5xrw/), we replicate and extend this finding in a younger, low-risk infant sample. EEG was recorded during presentation of a non-social video to a cohort of 6-month-old infants and behavioural data was collected at 6- and 9-months-old. Initial analyses replicated the finding that frontal theta power increases over the course of video viewing, extending this to 6-month-olds. Further, individual differences in the magnitude of this change significantly predicted non-verbal cognitive ability measured at 9-months, but not early executive function. Theta change at 6-months-old may therefore be an early indicator of later cognitive ability. This could have important implications for identification of, and interventions for, children at risk of poor cognitive outcomes.

Social attention: What is it, how can we measure it, and what can it tell us about autism and ADHD?

Neurodevelopmental disorders like autism spectrum disorder (ASD) and attention deficit hyperactivity disorder (ADHD) affect 2-10% of children worldwide but are still poorly understood. Prospective studies of infants with an elevated familial likelihood of ASD or ADHD can provide insight into early mechanisms that canalize development down a typical or atypical course. Such work holds potential for earlier identification and intervention to support optimal outcomes in individuals with neurodevelopmental disorders. Disrupted attention may be involved in developmental trajectories to ASD and ADHD. Specifically, altered attention to social stimuli has been suggested as a possible endophenotype of ASD, lying between genetic factors impacting brain development and later symptoms. Similarly, changes in domain-general aspects of attention are commonly seen in ADHD and emerging evidence suggests these may begin in infancy. Could these patterns point to a common risk factor for both disorders? Or does social attention reflect the activity of a particular network of brain systems that is distinct to those underpinning general attention skills? One challenge to addressing such questions is our lack of understanding of the relation between social and general attention. In this chapter we review evidence from infants with later ASD and ADHD that illuminates this question.

BrainIAK tutorials: User-friendly learning materials for advanced fMRI analysis

Advanced brain imaging analysis methods, including multivariate pattern analysis (MVPA), functional connectivity, and functional alignment, have become powerful tools in cognitive neuroscience over the past decade. These tools are implemented in custom code and separate packages, often requiring different software and language proficiencies. Although usable by expert researchers, novice users face a steep learning curve. These difficulties stem from the use of new programming languages (e.g., Python), learning how to apply machine-learning methods to high-dimensional fMRI data, and minimal documentation and training materials. Furthermore, most standard fMRI analysis packages (e.g., AFNI, FSL, SPM) focus on preprocessing and univariate analyses, leaving a gap in how to integrate with advanced tools. To address these needs, we developed BrainIAK (brainiak.org), an open-source Python software package that seamlessly integrates several cutting-edge, computationally efficient techniques with other Python packages (e.g., Nilearn, Scikit-learn) for file handling, visualization, and machine learning. To disseminate these powerful tools, we developed user-friendly tutorials (in Jupyter format; https://brainiak.org/tutorials/) for learning BrainIAK and advanced fMRI analysis in Python more generally. These materials cover techniques including: MVPA (pattern classification and representational similarity analysis); parallelized searchlight analysis; background connectivity; full correlation matrix analysis; inter-subject correlation; inter-subject functional connectivity; shared response modeling; event segmentation using hidden Markov models; and real-time fMRI. For long-running jobs or large memory needs we provide detailed guidance on high-performance computing clusters. These notebooks were successfully tested at multiple sites, including as problem sets for courses at Yale and Princeton universities and at various workshops and hackathons. These materials are freely shared, with the hope that they become part of a pool of open-source software and educational materials for large-scale, reproducible fMRI analysis and accelerated discovery.

The analysis of brain activity, as measured using functional magnetic resonance imaging (fMRI), has led to significant discoveries about how the brain processes information and how this is affected by disease. However, exhaustive multivariate analyses in space and time, run across a large number of subjects, can be complex and computationally intensive, creating a high barrier for entry into this field. Furthermore, the materials available to learn these methods do not encompass all the methods used, work is often published with no publicly available code, and the analyses are often difficult to run on large datasets without cluster computing. We have created interactive software tutorials that make it easy to understand and execute advanced analyses on fMRI data using the BrainIAK package—an open-source package built in Python. We have released these tutorials freely to the public and have significantly reduced computational roadblocks for users by making it possible to run the tutorials with a web browser and internet connection. We hope that this facilitated access and the usability of the underlying code—a compendium for how to program and optimize the latest fMRI analyses—will accelerate training, reproducibility, and discovery in cognitive neuroscience.

Active Acquisition for multimodal neuroimaging

In many clinical and scientific situations the optimal neuroimaging sequence may not be known prior to scanning and may differ for each individual being scanned, depending on the exact nature and location of abnormalities. Despite this, the standard approach to data acquisition, in such situations, is to specify the sequence of neuroimaging scans prior to data acquisition and to apply the same scans to all individuals. In this paper, we propose and illustrate an alternative approach, in which data would be analysed as it is acquired and used to choose the future scanning sequence: Active Acquisition. We propose three Active Acquisition scenarios based around multiple MRI modalities. In Scenario 1, we propose a simple use of near-real time analysis to decide whether to acquire more or higher resolution data, or acquire data with a different field -of -view. In Scenario 2, we simulate how multimodal MR data could be actively acquired and combined with a decision tree to classify a known outcome variable (in the simple example here, age). In Scenario 3, we simulate using Bayesian optimisation to actively search across multiple MRI modalities to find those which are most abnormal. These simulations suggest that by actively acquiring data, the scanning sequence can be adapted to each individual. We also consider the many outstanding practical and technical challenges involving normative data acquisition, MR physics, statistical modelling and clinical relevance. Despite these, we argue that Active Acquisition allows for potentially far more powerful, sensitive or rapid data acquisition, and may open up different perspectives on individual differences, clinical conditions, and biomarker discovery.

Efficiently searching through large tACS parameter spaces using closed-loop Bayesian optimization

Background

Selecting optimal stimulation parameters from numerous possibilities is a major obstacle for assessing the efficacy of non-invasive brain stimulation.

Objective

We demonstrate that Bayesian optimization can rapidly search through large parameter spaces and identify subject-level stimulation parameters in real-time.

Methods

To validate the method, Bayesian optimization was employed using participants’ binary judgements about the intensity of phosphenes elicited through tACS.

Results

We demonstrate the efficiency of Bayesian optimization in identifying parameters that maximize phosphene intensity in a short timeframe (5 min for >190 possibilities). Our results replicate frequency-dependent effects across three montages and show phase-dependent effects of phosphene perception. Computational modelling explains that these phase effects result from constructive/destructive interference of the current reaching the retinas. Simulation analyses demonstrate the method's versatility for complex response functions, even when accounting for noisy observations.

Conclusion

Alongside subjective ratings, this method can be used to optimize tACS parameters based on behavioral and neural measures and has the potential to be used for tailoring stimulation protocols to individuals.

Individual differences in rate of acquiring stable neural representations of tasks in fMRI

Task-related functional magnetic resonance imaging (fMRI) is a widely-used tool for studying the neural processing correlates of human behavior in both healthy and clinical populations. There is growing interest in mapping individual differences in fMRI task behavior and neural responses. By utilizing neuroadaptive task designs accounting for such individual differences, task durations can be personalized to potentially optimize neuroimaging study outcomes (e.g., classification of task-related brain states). To test this hypothesis, we first retrospectively tracked the volume-by-volume changes of beta weights generated from general linear models (GLM) for 67 adult subjects performing a stop-signal task (SST). We then modeled the convergence of the volume-by-volume changes of beta weights according to their exponential decay (ED) in units of half-life. Our results showed significant differences in beta weight convergence estimates of optimal stopping times (OSTs) between go following successful stop trials and failed stop trials for both cocaine dependent (CD) and control group (Con), and between go following successful stop trials and go following failed stop trials for Con group. Further, we implemented support vector machine (SVM) classification for 67 CD/Con labeled subjects and compared the classification accuracies of fMRI-based features derived from (1) the full fMRI task versus (2) the fMRI task truncated to multiples of the unit of half-life. Among the computed binary classification accuracies, two types of task durations based on 2 half-lives significantly outperformed the accuracies using fully acquired trials, supporting this length as the OST for the SST. In conclusion, we demonstrate the potential of a neuroadaptive task design that can be widely applied to personalizing other task-based fMRI experiments in either dynamic real-time fMRI applications or within fMRI preprocessing pipelines.

Active Acquisition for multimodal neuroimaging

In many clinical and scientific situations the optimal neuroimaging sequence may not be known prior to scanning and may differ for each individual being scanned, depending on the exact nature and location of abnormalities. Despite this, the standard approach to data acquisition, in such situations, is to specify the sequence of neuroimaging scans prior to data acquisition and to apply the same scans to all individuals. In this paper, we propose and illustrate an alternative approach, in which data would be analysed as it is acquired and used to choose the future scanning sequence: Active Acquisition. We propose three Active Acquisition scenarios based around multiple MRI modalities. In Scenario 1, we propose a simple use of near-real time analysis to decide whether to acquire more or higher resolution data, or acquire data with a different field -of -view. In Scenario 2, we simulate how multimodal MR data could be actively acquired and combined with a decision tree to classify a known outcome variable (in the simple example here, age). In Scenario 3, we simulate using Bayesian optimisation to actively search across multiple MRI modalities to find those which are most abnormal. These simulations suggest that by actively acquiring data, the scanning sequence can be adapted to each individual. We also consider the many outstanding practical and technical challenges involving normative data acquisition, MR physics, statistical modelling and clinical relevance. Despite these, we argue that  Active Acquisition allows for potentially far more powerful, sensitive or rapid data acquisition, and may open up different perspectives on individual differences, clinical conditions, and biomarker discovery.

May the power be with you: are there highly powered studies in neuroscience, and how can we get more of them?

Statistical power is essential for robust science and replicability, but a meta-analysis by Button et al. in 2013 diagnosed a “power failure” for neuroscience. In contrast, Nord et al. ( J Neurosci 37: 8051–8061, 2017) reanalyzed these data and suggested that some studies feature high power. We illustrate how publication and researcher bias might have inflated power estimates, and review recently introduced techniques that can improve analysis pipelines and increase power in neuroscience studies.

Dissociating frontoparietal brain networks with neuroadaptive Bayesian optimization

Understanding the unique contributions of frontoparietal networks (FPN) in cognition is challenging because they overlap spatially and are co-activated by diverse tasks. Characterizing these networks therefore involves studying their activation across many different cognitive tasks, which previously was only possible with meta-analyses. Here, we use neuroadaptive Bayesian optimization, an approach combining real-time analysis of functional neuroimaging data with machine-learning, to discover cognitive tasks that segregate ventral and dorsal FPN activity. We identify and subsequently refine two cognitive tasks, Deductive Reasoning and Tower of London, which maximally dissociate the dorsal from ventral FPN. We subsequently investigate these two FPNs in the context of a wider range of FPNs and demonstrate the importance of studying the whole activity profile across tasks to uniquely differentiate any FPN. Our findings deviate from previous meta-analyses and hypothesized functional labels for these FPNs. Taken together the results form the starting point for a neurobiologically-derived cognitive taxonomy.

Bayesian Optimization for Neuroimaging Pre-processing in Brain Age Classification and Prediction

Neuroimaging-based age prediction using machine learning is proposed as a biomarker of brain aging, relating to cognitive performance, health outcomes and progression of neurodegenerative disease. However, even leading age-prediction algorithms contain measurement error, motivating efforts to improve experimental pipelines. T1-weighted MRI is commonly used for age prediction, and the pre-processing of these scans involves normalization to a common template and resampling to a common voxel size, followed by spatial smoothing. Resampling parameters are often selected arbitrarily. Here, we sought to improve brain-age prediction accuracy by optimizing resampling parameters using Bayesian optimization. Using data on N = 2003 healthy individuals (aged 16-90 years) we trained support vector machines to (i) distinguish between young (<22 years) and old (>50 years) brains (classification) and (ii) predict chronological age (regression). We also evaluated generalisability of the age-regression model to an independent dataset (CamCAN, N = 648, aged 18-88 years). Bayesian optimization was used to identify optimal voxel size and smoothing kernel size for each task. This procedure adaptively samples the parameter space to evaluate accuracy across a range of possible parameters, using independent sub-samples to iteratively assess different parameter combinations to arrive at optimal values. When distinguishing between young and old brains a classification accuracy of 88.1% was achieved, (optimal voxel size = 11.5 mm³, smoothing kernel = 2.3 mm). For predicting chronological age, a mean absolute error (MAE) of 5.08 years was achieved, (optimal voxel size = 3.73 mm³, smoothing kernel = 3.68 mm). This was compared to performance using default values of 1.5 mm³ and 4mm respectively, resulting in MAE = 5.48 years, though this 7.3% improvement was not statistically significant. When assessing generalisability, best performance was achieved when applying the entire Bayesian optimization framework to the new dataset, out-performing the parameters optimized for the initial training dataset. Our study outlines the proof-of-principle that neuroimaging models for brain-age prediction can use Bayesian optimization to derive case-specific pre-processing parameters. Our results suggest that different pre-processing parameters are selected when optimization is conducted in specific contexts. This potentially motivates use of optimization techniques at many different points during the experimental process, which may improve statistical sensitivity and reduce opportunities for experimenter-led bias.

When Null Hypothesis Significance Testing Is Unsuitable for Research: A Reassessment

Null hypothesis significance testing (NHST) has several shortcomings that are likely contributing factors behind the widely debated replication crisis of (cognitive) neuroscience, psychology, and biomedical science in general. We review these shortcomings and suggest that, after sustained negative experience, NHST should no longer be the default, dominant statistical practice of all biomedical and psychological research. If theoretical predictions are weak we should not rely on all or nothing hypothesis tests. Different inferential methods may be most suitable for different types of research questions. Whenever researchers use NHST they should justify its use, and publish pre-study power calculations and effect sizes, including negative findings. Hypothesis-testing studies should be pre-registered and optimally raw data published. The current statistics lite educational approach for students that has sustained the widespread, spurious use of NHST should be phased out.

Decoding Time-Varying Functional Connectivity Networks via Linear Graph Embedding Methods

An exciting avenue of neuroscientific research involves quantifying the time-varying properties of functional connectivity networks. As a result, many methods have been proposed to estimate the dynamic properties of such networks. However, one of the challenges associated with such methods involves the interpretation and visualization of high-dimensional, dynamic networks. In this work, we employ graph embedding algorithms to provide low-dimensional vector representations of networks, thus facilitating traditional objectives such as visualization, interpretation and classification. We focus on linear graph embedding methods based on principal component analysis and regularized linear discriminant analysis. The proposed graph embedding methods are validated through a series of simulations and applied to fMRI data from the Human Connectome Project.