Learning to Synchronize: Midfrontal Theta Dynamics during Rule Switching

Neural basis of cognitive control signals in anterior cingulate cortex during delay discounting

Cognitive control involves allocating cognitive effort according to internal needs and task demands and the Anterior Cingulate Cortex (ACC) is hypothesized to play a central role in this process. We investigated the neural basis of cognitive control in the ACC of rats performing an adjusting-amount delay discounting task. Decision-making in this this task can be guided by using either a lever-value tracking strategy, requiring a 'resource-based' form of cognitive effort or a lever-biased strategy requiring a 'resistance-based' form of cognitive effort. We found that ACC ensembles always tightly tracked lever value on each trial, indicative of a resource-based control signal. These signals were prevalent in the neural recordings and were influenced by the delay. A shorter delay was associated with devaluing of the immediate option and a longer delay was associated with overvaluing of the immediate option. In addition, ACC theta (6-12Hz) oscillations were observed at the choice point of rats exhibiting a resistance-based strategy. These data provide candidates of neural activity patterns in the ACC that underlie the use of 'resource-based' and 'resistance-based' cognitive effort. Furthermore, these data illustrate how strategies can be engaged under different conditions in individual subjects.

Slow-wave brain connectivity predicts executive functioning and group belonging in socially vulnerable individuals

Important efforts have been made to describe the neural and cognitive features of healthy and clinical populations. However, the neural and cognitive features of socially vulnerable individuals remain largely unexplored, despite their proneness to developing neurocognitive disorders. Socially vulnerable individuals can be characterised as socially deprived, having a low socioeconomic status, suffering from chronic social stress, and exhibiting poor social adaptation. While it is known that such individuals are likely to perform worse than their peers on executive function tasks, studies on healthy but socially vulnerable groups are lacking. In the current study, we explore whether neural power and connectivity signatures can characterise executive function performance in healthy but socially vulnerable individuals, shedding light on the impairing effects that chronic stress and social disadvantages have on cognition. We measured resting-state electroencephalography and executive functioning in 38 socially vulnerable participants and 38 matched control participants. Our findings indicate that while neural power was uninformative, lower delta and theta phase synchrony are associated with worse executive function performance in all participants, whereas delta phase synchrony is higher in the socially vulnerable group compared to the control group. Finally, we found that delta phase synchrony and years of schooling are the best predictors for belonging to the socially vulnerable group. Overall, these findings suggest that exposure to chronic stress due to socioeconomic factors and a lack of education are associated with changes in slow-wave neural connectivity and executive functioning.

How much data do we need to estimate computational models of decision-making? The COMPASS toolbox

How much data are needed to obtain useful parameter estimations from a computational model? The standard approach to address this question is to carry out a goodness-of-recovery study. Here, the correlation between individual-participant true and estimated parameter values determines when a sample size is large enough. However, depending on one's research question, this approach may be suboptimal, potentially leading to sample sizes that are either too small (underpowered) or too large (overcostly or unfeasible). In this paper, we formulate a generalized concept of statistical power and use this to propose a novel approach toward determining how much data is needed to obtain useful parameter estimates from a computational model. We describe a Python-based toolbox (COMPASS) that allows one to determine how many participants are needed to fit one specific computational model, namely the Rescorla-Wagner model of learning and decision-making. Simulations revealed that a high number of trials per person (more than the number of persons) are a prerequisite for high-powered studies in this particular setting.

The parietal cortex has a causal role in ambiguity computations in humans

Humans often face the challenge of making decisions between ambiguous options. The level of ambiguity in decision-making has been linked to activity in the parietal cortex, but its exact computational role remains elusive. To test the hypothesis that the parietal cortex plays a causal role in computing ambiguous probabilities, we conducted consecutive fMRI and TMS-EEG studies. We found that participants assigned unknown probabilities to objective probabilities, elevating the uncertainty of their decisions. Parietal cortex activity correlated with the objective degree of ambiguity and with a process that underestimates the uncertainty during decision-making. Conversely, the midcingulate cortex (MCC) encodes prediction errors and increases its connectivity with the parietal cortex during outcome processing. Disruption of the parietal activity increased the uncertainty evaluation of the options, decreasing cingulate cortex oscillations during outcome evaluation and lateral frontal oscillations related to value ambiguous probability. These results provide evidence for a causal role of the parietal cortex in computing uncertainty during ambiguous decisions made by humans.

Changes in brain rhythms and connectivity tracking fear acquisition and reversal

Fear conditioning is used to investigate the neural bases of threat and anxiety, and to understand their flexible modifications when the environment changes. This study aims to examine the temporal evolution of brain rhythms using electroencephalographic signals recorded in healthy volunteers during a protocol of Pavlovian fear conditioning and reversal. Power changes and Granger connectivity in theta, alpha, and gamma bands are investigated from neuroelectrical activity reconstructed on the cortex. Results show a significant increase in theta power in the left (contralateral to electrical shock) portion of the midcingulate cortex during fear acquisition, and a significant decrease in alpha power in a broad network over the left posterior-frontal and parietal cortex. These changes occur since the initial trials for theta power, but require more trials (3/4) to develop for alpha, and are also present during reversal, despite being less pronounced. In both bands, relevant changes in connectivity are mainly evident in the last block of reversal, just when power differences attenuate. No significant changes in the gamma band were detected. We conclude that the increased theta rhythm in the cingulate cortex subserves fear acquisition and is transmitted to other cortical regions via increased functional connectivity allowing a fast theta synchronization, whereas the decrease in alpha power can represent a partial activation of motor and somatosensory areas contralateral to the shock side in the presence of a dangerous stimulus. In addition, connectivity changes at the end of reversal may reflect long-term alterations in synapses necessary to reverse the previously acquired contingencies.

Modeling brain dynamics and gaze behavior: Starting point bias and drift rate relate to frontal midline theta oscillations

Frontal midline theta oscillatory dynamics have been implicated as an important neural signature of inhibitory control. However, most proactive cognitive control studies rely on behavioral tasks where individual differences are inferred through button presses. We applied computational modeling to further refine our understanding of theta dynamics in a cued anti-saccade task with gaze-contingent eye tracking. Using a drift diffusion model, increased frontal midline theta power during high-conflict, relative to low-conflict, trials predicted a more conservative style of responding through the starting point (bias). During both high- and low-conflict trials, increases in frontal midline theta also predicted improvements in response efficiency (drift rate). Regression analyses provided support for the importance of the starting point bias, which was associated with frontal midline theta over the course of the task above-and-beyond both drift rate and mean reaction time. Our findings provide a more thorough understanding of proactive gaze control by linking trial-by-trial increases of frontal midline theta to a shift in starting point bias facilitating a more neutral style of responding.

The neural mechanism of non-phase-locked EEG activity in task switching

Flexible switching between different tasks is an important cognitive ability for humans and it is often studied using the task-switching paradigm. Although the neural mechanisms of task switching have been extensively explored in previous studies using event-related potentials techniques, the activity and process mechanisms of non-phase-locked electroencephalography (EEG) have rarely been revealed. For this reason, this paper discusses the processing of non-phase-locked EEG oscillations in task switching based on frequency-band delineation. First, the roles of each frequency band in local brain regions were summarized. In particular, during the proactive control process (the cue-stimulus interval), delta, theta, and alpha oscillations played more roles in the switch condition while beta played more roles in repeat task. In the reactive control process (post-target), delta, alpha, and beta are all related to sensorimotor function. Then, utilizing the functional connectivity (FC) method, delta connections in the frontotemporal regions and theta connections located in the parietal-to-occipital sites are involved in the preparatory period before task switching, while alpha connections located in the sensorimotor areas and beta connections located in the frontal-parietal cortex are involved in response inhibition. Finally, cross-frequency coupling (CFC) play an important role in working memory among different band oscillation. The present study shows that in addition to the processing mechanisms specific to each frequency band, there are some shared and interactive neural mechanism in task switching by using different analysis techniques.

Modulating hierarchical learning by high-definition transcranial alternating current stimulation at theta frequency

Considerable evidence highlights the dorsolateral prefrontal cortex (DLPFC) as a key region for hierarchical (i.e. multilevel) learning. In a previous electroencephalography (EEG) study, we found that the low-level prediction errors were encoded by frontal theta oscillations (4-7 Hz), centered on right DLPFC (rDLPFC). However, the causal relationship between frontal theta oscillations and hierarchical learning remains poorly understood. To investigate this question, in the current study, participants received theta (6 Hz) and sham high-definition transcranial alternating current stimulation (HD-tACS) over the rDLPFC while performing the probabilistic reversal learning task. Behaviorally, theta tACS induced a significant reduction in accuracy for the stable environment, but not for the volatile environment, relative to the sham condition. Computationally, we implemented a combination of a hierarchical Bayesian learning and a decision model. Theta tACS induced a significant increase in low-level (i.e. probability-level) learning rate and uncertainty of low-level estimation relative to sham condition. Instead, the temperature parameter of the decision model, which represents (inverse) decision noise, was not significantly altered due to theta stimulation. These results indicate that theta frequency may modulate the (low-level) learning rate. Furthermore, environmental features (e.g. its stability) may determine whether learning is optimized as a result.

Theta-phase connectivity between medial prefrontal and posterior areas underlies novel instructions implementation

Implementing novel instructions is a complex and uniquely human cognitive ability, that requires the rapid and flexible conversion of symbolic content into a format that enables the execution of the instructed behavior. Preparing to implement novel instructions, as opposed to their mere maintenance, involves the activation of the instructed motor plans, and the binding of the action information to the specific context in which this should be executed. Recent evidence and prominent computational models suggest that this efficient configuration of the system might involve a central role of frontal theta oscillations in establishing top-down long-range synchronization between distant and task-relevant brain areas. In the present EEG study (human subjects, 30 females, 4 males), we demonstrate that proactively preparing for the implementation of novels instructions, as opposed to their maintenance, involves a strengthened degree of connectivity in the theta frequency range between medial prefrontal and motor/visual areas. Moreover, we replicated previous results showing oscillatory features associated specifically with implementation demands, and extended on them demonstrating the role of theta oscillations in mediating the effect of task demands on behavioral performance. Taken together, these findings support our hypothesis that the modulation of connectivity patterns between frontal and task-relevant posterior brain areas is a core factor in the emergence of a behavior-guiding format from novel instructions.Significance statementEveryday life requires the use and manipulation of currently available information to guide behavior and reach specific goals. In the present study we investigate how the same instructed content elicits different neural activity depending on the task being performed. Crucially, connectivity between medial prefrontal cortex and posterior brain areas is strengthened when novel instructions have to be implemented, rather than simply maintained. This finding suggests that theta oscillations play a role in setting up a dynamic and flexible network of task-relevant regions optimized for the execution of the instructed behavior.

Long-range cortical synchronization supports abrupt visual learning

Visual plasticity declines sharply after the critical period, yet we easily learn to recognize new faces and places, even as adults. Such learning is often characterized by a "moment of insight," an abrupt and dramatic improvement in recognition. The mechanisms that support abrupt learning are unknown, but one hypothesis is that they involve changes in synchronization between brain regions. To test this hypothesis, we used a behavioral task in which non-human primates rapidly learned to recognize novel images and to associate them with specific responses. Simultaneous recordings from inferotemporal and prefrontal cortices revealed a transient synchronization of neural activity between these areas that peaked around the moment of insight. Synchronization was strongest between inferotemporal sites that encoded images and reward-sensitive prefrontal sites. Moreover, its magnitude intensified gradually over image exposures, suggesting that abrupt learning is the culmination of a search for informative signals within a circuit linking sensory information to task demands.

Using top-down modulation to optimally balance shared versus separated task representations

Human adaptive behavior requires continually learning and performing a wide variety of tasks, often with very little practice. To accomplish this, it is crucial to separate neural representations of different tasks in order to avoid interference. At the same time, sharing neural representations supports generalization and allows faster learning. Therefore, a crucial challenge is to find an optimal balance between shared versus separated representations. Typically, models of human cognition employ top-down modulatory signals to separate task representations, but there exist surprisingly little systematic computational investigations of how such modulation is best implemented. We identify and systematically evaluate two crucial features of modulatory signals. First, top-down input can be processed in an additive or multiplicative manner. Second, the modulatory signals can be adaptive (learned) or non-adaptive (random). We cross these two features, resulting in four modulation networks which are tested on a variety of input datasets and tasks with different degrees of stimulus-action mapping overlap. The multiplicative adaptive modulation network outperforms all other networks in terms of accuracy. Moreover, this network develops hidden units that optimally share representations between tasks. Specifically, different than the binary approach of currently popular latent state models, it exploits partial overlap between tasks.

Electrophysiological Signatures of Hierarchical Learning

Human perception and learning is thought to rely on a hierarchical generative model that is continuously updated via precision-weighted prediction errors (pwPEs). However, the neural basis of such cognitive process and how it unfolds during decision-making remain poorly understood. To investigate this question, we combined a hierarchical Bayesian model (i.e., Hierarchical Gaussian Filter [HGF]) with electroencephalography (EEG), while participants performed a probabilistic reversal learning task in alternatingly stable and volatile environments. Behaviorally, the HGF fitted significantly better than two control, nonhierarchical, models. Neurally, low-level and high-level pwPEs were independently encoded by the P300 component. Low-level pwPEs were reflected in the theta (4-8 Hz) frequency band, but high-level pwPEs were not. Furthermore, the expressions of high-level pwPEs were stronger for participants with better HGF fit. These results indicate that the brain employs hierarchical learning and encodes both low- and high-level learning signals separately and adaptively.

Event-related synchronization/desynchronization and functional neuroanatomical regions associated with fatigue effects on cognitive flexibility

Cognitive flexibility is an essential prerequisite for goal-directed behavior, and daily observations already show that it deteriorates when one is engaged in a task for a (too) long time. Yet, the neural mechanisms underlying such fatigability effect in cognitive flexibility are poorly understood. We examined how theta, alpha, and beta frequency event-related synchronization and desynchronization processes during cued memory-based task switching are modulated by time-on-task effects. We put special emphasis on the examination of functional neuroanatomical regions being associated with these modulations, using EEG beamforming. We show clear declines in task switching performance (increased switch costs) with time on task. For processes occurring before rule switching or repetition processes, we show that anticipatory attentional sampling and selection mechanisms associated with fronto-parietal structures are modulated by time-on-task effects but sensory areas (occipital cortex) also show fatigability-dependent modulations. After target stimulus presentation, the allocation of processing resources for response selection as reflected by theta-related activity in parietal cortices is compromised with time on task and similarly a concomitant increase in alpha and beta band-related attentional processing or gating mechanisms in frontal and occipital regions. Yet, considering the behavioral data showing an apparent decline in performance, this probably compensatory increase is still insufficient to allow reasonable performance. The same is likely the case for processes occurring before rule switching or repetition processes. Comparative analyses show that modulations of alpha band activity are as strongly modulated by fatigability as theta band activity. Implications of these findings for theoretical concepts on fatigability are discussed.NEW & NOTEWORTHY We examine the neurophysiological and functional neuroanatomical basis of fatigability in cognitive flexibility. We show that alpha and theta modulations in fronto-parietal and primary sensory areas are central for the understanding of fatigability effects in cognitive flexibility.