Behavioral shifts and action valuation in the anterior cingulate cortex

Frontostriatal salience network expansion in individuals in depression

Decades of neuroimaging studies have shown modest differences in brain structure and connectivity in depression, hindering mechanistic insights or the identification of risk factors for disease onset1. Furthermore, whereas depression is episodic, few longitudinal neuroimaging studies exist, limiting understanding of mechanisms that drive mood-state transitions. The emerging field of precision functional mapping has used densely sampled longitudinal neuroimaging data to show behaviourally meaningful differences in brain network topography and connectivity between and in healthy individuals2-4, but this approach has not been applied in depression. Here, using precision functional mapping and several samples of deeply sampled individuals, we found that the frontostriatal salience network is expanded nearly twofold in the cortex of most individuals with depression. This effect was replicable in several samples and caused primarily by network border shifts, with three distinct modes of encroachment occurring in different individuals. Salience network expansion was stable over time, unaffected by mood state and detectable in children before the onset of depression later in adolescence. Longitudinal analyses of individuals scanned up to 62 times over 1.5 years identified connectivity changes in frontostriatal circuits that tracked fluctuations in specific symptoms and predicted future anhedonia symptoms. Together, these findings identify a trait-like brain network topology that may confer risk for depression and mood-state-dependent connectivity changes in frontostriatal circuits that predict the emergence and remission of depressive symptoms over time.

Understanding the human conflict processing network: A review of the literature on direct neural recordings during performance of a modified stroop task

The Stroop Task is a well-known neuropsychological task developed to investigate conflict processing in the human brain. Our group has utilized direct intracranial neural recordings in various brain regions during performance of a modified color-word Stroop Task to gain a mechanistic understanding of non-emotional human conflict processing. The purpose of this review article is to: 1) synthesize our own studies into a model of human conflict processing, 2) review the current literature on the Stroop Task and other conflict tasks to put our research in context, and 3) describe how these studies define a network in conflict processing. The figures presented are reprinted from our prior publications and key publications referenced in the manuscript. We summarize all studies to date that employ invasive intracranial recordings in humans during performance of conflict-inducing tasks. For our own studies, we analyzed local field potentials (LFPs) from patients with implanted stereotactic electroencephalography (SEEG) electrodes, and we observed intracortical oscillation patterns as well as intercortical temporal relationships in the hippocampus, amygdala, and orbitofrontal cortex (OFC) during the cue-processing phase of a modified Stroop Task. Our findings suggest that non-emotional human conflict processing involves modulation across multiple frequency bands within and between brain structures.

Prediction-error signals in anterior cingulate cortex drive task-switching

Task-switching is a fundamental cognitive ability that allows animals to update their knowledge of current rules or contexts. Detecting discrepancies between predicted and observed events is essential for this process. However, little is known about how the brain computes cognitive prediction-errors and whether neural prediction-error signals are causally related to task-switching behaviours. Here we trained mice to use a prediction-error to switch, in a single trial, between responding to the same stimuli using two distinct rules. Optogenetic silencing and un-silencing, together with widefield and two-photon calcium imaging revealed that the anterior cingulate cortex (ACC) was specifically required for this rapid task-switching, but only when it exhibited neural prediction-error signals. These prediction-error signals were projection-target dependent and were larger preceding successful behavioural transitions. An all-optical approach revealed a disinhibitory interneuron circuit required for successful prediction-error computation. These results reveal a circuit mechanism for computing prediction-errors and transitioning between distinct cognitive states.

Flexible gating between subspaces in a neural network model of internally guided task switching

Behavioral flexibility relies on the brain's ability to switch rapidly between multiple tasks, even when the task rule is not explicitly cued but must be inferred through trial and error. The underlying neural circuit mechanism remains poorly understood. We investigated recurrent neural networks (RNNs) trained to perform an analog of the classic Wisconsin Card Sorting Test. The networks consist of two modules responsible for rule representation and sensorimotor mapping, respectively, where each module is comprised of a circuit with excitatory neurons and three major types of inhibitory neurons. We found that rule representation by self-sustained persistent activity across trials, error monitoring and gated sensorimotor mapping emerged from training. Systematic dissection of trained RNNs revealed a detailed circuit mechanism that is consistent across networks trained with different hyperparameters. The networks' dynamical trajectories for different rules resided in separate subspaces of population activity; the subspaces collapsed and performance was reduced to chance level when dendrite-targeting somatostatin-expressing interneurons were silenced, illustrating how a phenomenological description of representational subspaces is explained by a specific circuit mechanism.

Flexible gating between subspaces in a neural network model of internally guided task switching

Behavioral flexibility relies on the brain's ability to switch rapidly between multiple tasks, even when the task rule is not explicitly cued but must be inferred through trial and error. The underlying neural circuit mechanism remains poorly understood. We investigated recurrent neural networks (RNNs) trained to perform an analog of the classic Wisconsin Card Sorting Test. The networks consist of two modules responsible for rule representation and sensorimotor mapping, respectively, where each module is comprised of a circuit with excitatory neurons and three major types of inhibitory neurons. We found that rule representation by self-sustained persistent activity across trials, error monitoring and gated sensorimotor mapping emerged from training. Systematic dissection of trained RNNs revealed a detailed circuit mechanism that is consistent across networks trained with different hyperparameters. The networks' dynamical trajectories for different rules resided in separate subspaces of population activity; the subspaces collapsed and performance was reduced to chance level when dendrite-targeting somatostatin-expressing interneurons were silenced, illustrating how a phenomenological description of representational subspaces is explained by a specific circuit mechanism.

General mechanisms of task engagement in the primate frontal cortex

Staying engaged is necessary to maintain goal-directed behaviors. Despite this, engagement exhibits continuous, intrinsic fluctuations. Even in experimental settings, animals, unlike most humans, repeatedly and spontaneously move between periods of complete task engagement and disengagement. We, therefore, looked at behavior in male macaques (macaca mulatta) in four tasks while recording fMRI signals. We identified consistent autocorrelation in task disengagement. This made it possible to build models capturing task-independent engagement. We identified task general patterns of neural activity linked to impending sudden task disengagement in mid-cingulate gyrus. By contrast, activity centered in perigenual anterior cingulate cortex (pgACC) was associated with maintenance of performance across tasks. Importantly, we carefully controlled for task-specific factors such as the reward history and other motivational effects, such as response vigor, in our analyses. Moreover, we showed pgACC activity had a causal link to task engagement: transcranial ultrasound stimulation of pgACC changed task engagement patterns.

Mutual inclusivity improves decision-making by smoothing out choice's competitive edge

Decisions form a central bottleneck to most tasks, one that people often experience as costly. Past work proposes mitigating those costs by lowering one's threshold for deciding. Here, we test an alternative solution, one that targets the basis for most choice costs: that choosing one option sacrifices others (mutual exclusivity). Across 5 studies (N = 462), we test whether this tension can be relieved by framing choices as inclusive (allowing selection of more than one option, as in buffets). We find that inclusivity makes choices more efficient, by selectively reducing competition between potential responses as participants accumulate information for each of their options. Inclusivity also made participants feel less conflicted, especially when they couldn't decide which good option to keep or which bad option to get rid of. These inclusivity benefits were also distinguishable from the effects of manipulating decision threshold (increased urgency), which improved choices but not experiences thereof.

Differential functional organization of amygdala-medial prefrontal cortex networks in macaque and human

Over the course of evolution, the amygdala (AMG) and medial frontal cortex (mPFC) network, involved in behavioral adaptation, underwent structural changes in the old-world monkey and human lineages. Yet, whether and how the functional organization of this network differs remains poorly understood. Using resting-state functional magnetic resonance imagery, we show that the functional connectivity (FC) between AMG nuclei and mPFC regions differs between humans and awake macaques. In humans, the AMG-mPFC FC displays U-shaped pattern along the corpus callosum: a positive FC with the ventromedial prefrontal (vmPFC) and anterior cingulate cortex (ACC), a negative FC with the anterior mid-cingulate cortex (MCC), and a positive FC with the posterior MCC. Conversely, in macaques, the negative FC shifted more ventrally at the junction between the vmPFC and the ACC. The functional organization divergence of AMG-mPFC network between humans and macaques might help understanding behavioral adaptation abilities differences in their respective socio-ecological niches.

Curiosity: primate neural circuits for novelty and information seeking

For many years, neuroscientists have investigated the behavioural, computational and neurobiological mechanisms that support value-based decisions, revealing how humans and animals make choices to obtain rewards. However, many decisions are influenced by factors other than the value of physical rewards or second-order reinforcers (such as money). For instance, animals (including humans) frequently explore novel objects that have no intrinsic value solely because they are novel and they exhibit the desire to gain information to reduce their uncertainties about the future, even if this information cannot lead to reward or assist them in accomplishing upcoming tasks. In this Review, I discuss how circuits in the primate brain responsible for detecting, predicting and assessing novelty and uncertainty regulate behaviour and give rise to these behavioural components of curiosity. I also briefly discuss how curiosity-related behaviours arise during postnatal development and point out some important reasons for the persistence of curiosity across generations.

A stress-sensitive frontostriatal circuit supporting effortful reward-seeking behavior

Effort valuation-a process for selecting actions based on the anticipated value of rewarding outcomes and expectations about the work required to obtain them-plays a fundamental role in decision-making. Effort valuation is disrupted in chronic stress states and is supported by the anterior cingulate cortex (ACC), but the circuit-level mechanisms by which the ACC regulates effort-based decision-making are unclear. Here, we show that ACC neurons projecting to the nucleus accumbens (ACC-NAc) play a critical role in effort valuation behavior in mice. Activity in ACC-NAc cells integrates both reward- and effort-related information, encoding a reward-related signal that scales with effort requirements and is necessary for supporting future effortful decisions. Chronic corticosterone exposure reduces motivation, suppresses effortful reward-seeking, and disrupts ACC-NAc signals. Together, our results delineate a stress-sensitive ACC-NAc circuit that supports effortful reward-seeking behavior by integrating reward and effort signals and reinforcing effort allocation in the service of maximizing reward.

Neurons in the monkey frontopolar cortex encode learning stage and goal during a fast learning task

The frontopolar cortex (FPC) is, to date, one of the least understood regions of the prefrontal cortex. The current understanding of its function suggests that it plays a role in the control of exploratory behaviors by coordinating the activities of other prefrontal cortex areas involved in decision-making and exploiting actions based on their outcomes. Based on this hypothesis, FPC would drive fast-learning processes through a valuation of the different alternatives. In our study, we used a modified version of a well-known paradigm, the object-in-place (OIP) task, to test this hypothesis in electrophysiology. This paradigm is designed to maximize learning, enabling monkeys to learn in one trial, which is an ability specifically impaired after a lesion of the FPC. We showed that FPC neurons presented an extremely specific pattern of activity by representing the learning stage, exploration versus exploitation, and the goal of the action. However, our results do not support the hypothesis that neurons in the frontal pole compute an evaluation of different alternatives. Indeed, the position of the chosen target was strongly encoded at its acquisition, but the position of the unchosen target was not. Once learned, this representation was also found at the problem presentation, suggesting a monitoring activity of the synthetic goal preceding its acquisition. Our results highlight important features of FPC neurons in fast-learning processes without confirming their role in the disengagement of cognitive control from the current goals.

Inferring neural activity before plasticity as a foundation for learning beyond backpropagation

For both humans and machines, the essence of learning is to pinpoint which components in its information processing pipeline are responsible for an error in its output, a challenge that is known as 'credit assignment'. It has long been assumed that credit assignment is best solved by backpropagation, which is also the foundation of modern machine learning. Here, we set out a fundamentally different principle on credit assignment called 'prospective configuration'. In prospective configuration, the network first infers the pattern of neural activity that should result from learning, and then the synaptic weights are modified to consolidate the change in neural activity. We demonstrate that this distinct mechanism, in contrast to backpropagation, (1) underlies learning in a well-established family of models of cortical circuits, (2) enables learning that is more efficient and effective in many contexts faced by biological organisms and (3) reproduces surprising patterns of neural activity and behavior observed in diverse human and rat learning experiments.

Asymmetric coding of reward prediction errors in human insula and dorsomedial prefrontal cortex

The signed value and unsigned salience of reward prediction errors (RPEs) are critical to understanding reinforcement learning (RL) and cognitive control. Dorsomedial prefrontal cortex (dMPFC) and insula (INS) are key regions for integrating reward and surprise information, but conflicting evidence for both signed and unsigned activity has led to multiple proposals for the nature of RPE representations in these brain areas. Recently developed RL models allow neurons to respond differently to positive and negative RPEs. Here, we use intracranially recorded high frequency activity (HFA) to test whether this flexible asymmetric coding strategy captures RPE coding diversity in human INS and dMPFC. At the region level, we found a bias towards positive RPEs in both areas which paralleled behavioral adaptation. At the local level, we found spatially interleaved neural populations responding to unsigned RPE salience and valence-specific positive and negative RPEs. Furthermore, directional connectivity estimates revealed a leading role of INS in communicating positive and unsigned RPEs to dMPFC. These findings support asymmetric coding across distinct but intermingled neural populations as a core principle of RPE processing and inform theories of the role of dMPFC and INS in RL and cognitive control.

ACC neural ensemble dynamics are structured by strategy prevalence

Medial frontal cortical areas are thought to play a critical role in the brain's ability to flexibly deploy strategies that are effective in complex settings, yet the underlying circuit computations remain unclear. Here, by examining neural ensemble activity in male rats that sample different strategies in a self-guided search for latent task structure, we observe robust tracking during strategy execution of a summary statistic for that strategy in recent behavioral history by the anterior cingulate cortex (ACC), especially by an area homologous to primate area 32D. Using the simplest summary statistic - strategy prevalence in the last 20 choices - we find that its encoding in the ACC during strategy execution is wide-scale, independent of reward delivery, and persists through a substantial ensemble reorganization that accompanies changes in global context. We further demonstrate that the tracking of reward by the ACC ensemble is also strategy-specific, but that reward prevalence is insufficient to explain the observed activity modulation during strategy execution. Our findings argue that ACC ensemble dynamics is structured by a summary statistic of recent behavioral choices, raising the possibility that ACC plays a role in estimating - through statistical learning - which actions promote the occurrence of events in the environment.

Multiple routes of communication within the amygdala-mPFC network: A comparative approach in humans and macaques

The network formed by the amygdala (AMG) and the medial Prefrontal Cortex (mPFC), at the interface between our internal and external environment, has been shown to support some important aspects of behavioral adaptation. Whether and how the anatomo-functional organization of this network evolved across primates remains unclear. Here, we compared AMG nuclei morphological characteristics and their functional connectivity with the mPFC in humans and macaques to identify potential homologies and differences between these species. Based on selected studies, we highlight two subsystems within the AMG-mPFC circuits, likely involved in distinct temporal dynamics of integration during behavioral adaptation. We also show that whereas the mPFC displays a large expansion but a preserved intrinsic anatomo-functional organization, the AMG displays a volume reduction and morphological changes related to specific nuclei. We discuss potential commonalities and differences in the dialogue between AMG nuclei and mPFC in humans and macaques based on available data.

Distributed processing for value-based choice by prelimbic circuits targeting anterior-posterior dorsal striatal subregions in male mice

Fronto-striatal circuits have been implicated in cognitive control of behavioral output for social and appetitive rewards. The functional diversity of prefrontal cortical populations is strongly dependent on their synaptic targets, with control of motor output mediated by connectivity to dorsal striatum. Despite evidence for functional diversity along the anterior-posterior striatal axis, it is unclear how distinct fronto-striatal sub-circuits support value-based choice. Here we found segregated prefrontal populations defined by anterior/posterior dorsomedial striatal target. During a feedback-based 2-alternative choice task, single-photon imaging revealed circuit-specific representations of task-relevant information with prelimbic neurons targeting anterior DMS (PL::A-DMS) robustly modulated during choices and negative outcomes, while prelimbic neurons targeting posterior DMS (PL::P-DMS) encoded internal representations of value and positive outcomes contingent on prior choice. Consistent with this distributed coding, optogenetic inhibition of PL::A-DMS circuits strongly impacted choice monitoring and responses to negative outcomes while inhibition of PL::P-DMS impaired task engagement and strategies following positive outcomes. Together our data uncover PL populations engaged in distributed processing for value-based choice.

A neural substrate of sex-dependent modulation of motivation

While there is emerging evidence of sex differences in decision-making behavior, the neural substrates that underlie such differences remain largely unknown. Here we demonstrate that in mice performing a value-based decision-making task, while choices are similar between the sexes, motivation to engage in the task is modulated by action value more strongly in females than in males. Inhibition of activity in anterior cingulate cortex (ACC) neurons that project to the dorsomedial striatum (DMS) preferentially disrupts this relationship between value and motivation in females, without affecting choice in either sex. In line with these effects, in females compared to males, ACC-DMS neurons have stronger representations of negative outcomes and more neurons are active when the value of the chosen option is low. By contrast, the representation of each choice is similar between the sexes. Thus, we identify a neural substrate that contributes to sex-specific modulation of motivation by value.

Neural responses in macaque prefrontal cortex are linked to strategic exploration

Humans have been shown to strategically explore. They can identify situations in which gathering information about distant and uncertain options is beneficial for the future. Because primates rely on scarce resources when they forage, they are also thought to strategically explore, but whether they use the same strategies as humans and the neural bases of strategic exploration in monkeys are largely unknown. We designed a sequential choice task to investigate whether monkeys mobilize strategic exploration based on whether information can improve subsequent choice, but also to ask the novel question about whether monkeys adjust their exploratory choices based on the contingency between choice and information, by sometimes providing the counterfactual feedback about the unchosen option. We show that monkeys decreased their reliance on expected value when exploration could be beneficial, but this was not mediated by changes in the effect of uncertainty on choices. We found strategic exploratory signals in anterior and mid-cingulate cortex (ACC/MCC) and dorsolateral prefrontal cortex (dlPFC). This network was most active when a low value option was chosen, which suggests a role in counteracting expected value signals, when exploration away from value should to be considered. Such strategic exploration was abolished when the counterfactual feedback was available. Learning from counterfactual outcome was associated with the recruitment of a different circuit centered on the medial orbitofrontal cortex (OFC), where we showed that monkeys represent chosen and unchosen reward prediction errors. Overall, our study shows how ACC/MCC-dlPFC and OFC circuits together could support exploitation of available information to the fullest and drive behavior towards finding more information through exploration when it is beneficial.

Neural Correlates of Impaired Cognitive Control in Individuals with Methamphetamine Dependence: An fMRI Study

Impaired cognitive and behavioral control has often been observed in people who use methamphetamine (MA). However, a comprehensive understanding of the neural substrates underlying these impairments is still lacking. The goal of the present study was to study the neural correlates of impaired cognitive control in individuals with MA dependence according to DSM-IV criteria. Eighteen individuals with MA dependence and 21 healthy controls were investigated using Stroop task, fMRI, and an impulsivity questionnaire. Overall, patients were found to have significantly poorer accuracy on the Stroop task and higher self-rated impulsivity. Comparing brain activations during the task, decreased activation in the dorsolateral prefrontal cortex (DLPFC), anterior midcingulate cortex (aMCC), and dorsal striatum was observed in individuals with MA dependence, compared to healthy controls. Altered fMRI signal in DLPFC and aMCC significantly correlated with impaired behavioral task performance in individuals with MA dependence. Furthermore, significantly lower and pronounced brain activations in the MA group were additionally detected in several sensory cortical regions, i.e., in the visual, auditory, and somatosensory cortices. The results of the current study provide evidence for the negative impact of chronic crystal meth consumption on the proper functioning of the fronto-cingulate and striatal brain regions, presumably underlying the often-observed deficits in executive functions in individuals with MA use disorder. As a new finding, we also revealed abnormal activation in several sensory brain regions, suggesting the negative effect of MA use on the proper neural activity of these regions. This blunted activation could be the cause of the observed deficits in executive functions and the associated altered brain activation in higher-level brain networks.

Altered functional connectivity during performance feedback processing in multiple sclerosis

Effective learning from performance feedback is vital for adaptive behavior regulation necessary for successful cognitive performance. Yet, how this learning operates in clinical groups that experience cognitive dysfunction is not well understood. Multiple sclerosis (MS) is an autoimmune, degenerative disease of the central nervous system characterized by physical and cognitive dysfunction. A highly prevalent impairment in MS is cognitive fatigue (CF). CF is associated with altered functioning within cortico-striatal regions that also facilitate feedback-based learning in neurotypical (NT) individuals. Despite this cortico-striatal overlap, research about feedback-based learning in MS, its associated neural underpinnings, and its sensitivity to CF, are all lacking. The present study investigated feedback-based learning ability in MS, as well as associated cortico-striatal function and connectivity. MS and NT participants completed a functional magnetic resonance imaging (fMRI) paired-word association task during which they received trial-by-trial monetary, non-monetary, and uninformative performance feedback. Despite reporting greater CF throughout the task, MS participants displayed comparable task performance to NTs, suggesting preserved feedback-based learning ability in the MS group. Both groups recruited the ventral striatum (VS), caudate nucleus, and ventromedial prefrontal cortex in response to the receipt of performance feedback, suggesting that people with MS also recruit cortico-striatal regions during feedback-based learning. However, compared to NT participants, MS participants also displayed stronger functional connectivity between the VS and task-relevant regions, including the left angular gyrus and right superior temporal gyrus, in response to feedback receipt. Results indicate that CF may not interfere with feedback-based learning in MS. Nonetheless, people with MS may recruit alternative connections with the striatum to assist with this form of learning. These findings have implications for cognitive rehabilitation treatments that incorporate performance feedback to remediate cognitive dysfunction in clinical populations.

Anterior cingulate cortex causally supports flexible learning under motivationally challenging and cognitively demanding conditions

Anterior cingulate cortex (ACC) and striatum (STR) contain neurons encoding not only the expected values of actions, but also the value of stimulus features irrespective of actions. Values about stimulus features in ACC or STR might contribute to adaptive behavior by guiding fixational information sampling and biasing choices toward relevant objects, but they might also have indirect motivational functions by enabling subjects to estimate the value of putting effort into choosing objects. Here, we tested these possibilities by modulating neuronal activity in ACC and STR of nonhuman primates using transcranial ultrasound stimulation while subjects learned the relevance of objects in situations with varying motivational and cognitive demands. Motivational demand was indexed by varying gains and losses during learning, while cognitive demand was varied by increasing the uncertainty about which object features could be relevant during learning. We found that ultrasound stimulation of the ACC, but not the STR, reduced learning efficiency and prolonged information sampling when the task required averting losses and motivational demands were high. Reduced learning efficiency was particularly evident at higher cognitive demands and when subjects experienced loss of already attained tokens. These results suggest that the ACC supports flexible learning of feature values when loss experiences impose a motivational challenge and when uncertainty about the relevance of objects is high. Taken together, these findings provide causal evidence that the ACC facilitates resource allocation and improves visual information sampling during adaptive behavior.

Neural signals implicated in the processing of appetitive and aversive events in social and non-social contexts

In 2014, we participated in a special issue of Frontiers examining the neural processing of appetitive and aversive events. Specifically, we reviewed brain areas that contribute to the encoding of prediction errors and value versus salience, attention and motivation. Further, we described how we disambiguated these cognitive processes and their neural substrates by using paradigms that incorporate both appetitive and aversive stimuli. We described a circuit in which the orbitofrontal cortex (OFC) signals expected value and the basolateral amygdala (BLA) encodes the salience and valence of both appetitive and aversive events. This information is integrated by the nucleus accumbens (NAc) and dopaminergic (DA) signaling in order to generate prediction and prediction error signals, which guide decision-making and learning via the dorsal striatum (DS). Lastly, the anterior cingulate cortex (ACC) is monitoring actions and outcomes, and signals the need to engage attentional control in order to optimize behavioral output. Here, we expand upon this framework, and review our recent work in which within-task manipulations of both appetitive and aversive stimuli allow us to uncover the neural processes that contribute to the detection of outcomes delivered to a conspecific and behaviors in social contexts. Specifically, we discuss the involvement of single-unit firing in the ACC and DA signals in the NAc during the processing of appetitive and aversive events in both social and non-social contexts.

Inhibitory control of frontal metastability sets the temporal signature of cognition

Cortical dynamics are organized over multiple anatomical and temporal scales. The mechanistic origin of the temporal organization and its contribution to cognition remain unknown. Here we demonstrate the cause of this organization by studying a specific temporal signature (time constant and latency) of neural activity. In monkey frontal areas, recorded during flexible decisions, temporal signatures display specific area-dependent ranges, as well as anatomical and cell-type distributions. Moreover, temporal signatures are functionally adapted to behaviorally relevant timescales. Fine-grained biophysical network models, constrained to account for experimentally observed temporal signatures, reveal that after-hyperpolarization potassium and inhibitory GABA-B conductances critically determine areas' specificity. They mechanistically account for temporal signatures by organizing activity into metastable states, with inhibition controlling state stability and transitions. As predicted by models, state durations non-linearly scale with temporal signatures in monkey, matching behavioral timescales. Thus, local inhibitory-controlled metastability constitutes the dynamical core specifying the temporal organization of cognitive functions in frontal areas.

Layer-specific pyramidal neuron properties underlie diverse anterior cingulate cortical motor and limbic networks

The laminar cellular and circuit mechanisms by which the anterior cingulate cortex (ACC) exerts flexible control of motor and affective information for goal-directed behavior have not been elucidated. Using multimodal tract-tracing, in vitro patch-clamp recording and computational approaches in rhesus monkeys (M. mulatta), we provide evidence that specialized motor and affective network dynamics can be conferred by layer-specific biophysical and structural properties of ACC pyramidal neurons targeting two key downstream structures -the dorsal premotor cortex (PMd) and the amygdala (AMY). AMY-targeting neurons exhibited significant laminar differences, with L5 more excitable (higher input resistance and action potential firing rates) than L3 neurons. Between-pathway differences were found within L5, with AMY-targeting neurons exhibiting greater excitability, apical dendritic complexity, spine densities, and diversity of inhibitory inputs than PMd-targeting neurons. Simulations using a pyramidal-interneuron network model predict that these layer- and pathway-specific single-cell differences contribute to distinct network oscillatory dynamics. L5 AMY-targeting networks are more tuned to slow oscillations well-suited for affective and contextual processing timescales, while PMd-targeting networks showed strong beta/gamma synchrony implicated in rapid sensorimotor processing. These findings are fundamental to our broad understanding of how layer-specific cellular and circuit properties can drive diverse laminar activity found in flexible behavior.

Functional lateralization of the medial temporal lobe in novel associative processing during creativity evaluation

Although hemispheric lateralization of creativity has been a longstanding topic of debate, the underlying neurocognitive mechanism remains poorly understood. Here we designed 2 types of novel stimuli-"novel useful and novel useless," adapted from "familiar useful" designs taken from daily life-to demonstrate how the left and right medial temporal lobe (MTL) respond to novel designs of different usefulness. Taking the "familiar useful" design as a baseline, we found that the right MTL showed increased activation in response to "novel useful" designs, followed by "novel useless" ones, while the left MTL only showed increased activation in response to "novel useful" designs. Calculating an asymmetry index suggests that usefulness processing is predominant in the left MTL, whereas the right MTL is predominantly involved in novelty processing. Moreover, the left parahippocampal gyrus (PHG) showed stronger functional connectivity with the anterior cingulate cortex when responding to "novel useless" designs. In contrast, the right PHG showed stronger connectivity with the amygdala, midbrain, and hippocampus. Critically, multivoxel representational similarity analyses revealed that the left MTL was more effective than the right MTL at distinguishing the usefulness differences in novel stimuli, while representational patterns in the left PHG positively predicted the post-behavior evaluation of "truly creative" products. These findings suggest an apparent dissociation of the left and right MTL in integrating the novelty and usefulness information and novel associative processing during creativity evaluation, respectively. Our results provide novel insights into a longstanding and controversial question in creativity research by demonstrating functional lateralization of the MTL in processing novel associations.

Muscarinic Acetylcholine Receptor Localization on Distinct Excitatory and Inhibitory Neurons Within the ACC and LPFC of the Rhesus Monkey

Acetylcholine (ACh) can act on pre- and post-synaptic muscarinic receptors (mAChR) in the cortex to influence a myriad of cognitive processes. Two functionally-distinct regions of the prefrontal cortex-the lateral prefrontal cortex (LPFC) and the anterior cingulate cortex (ACC)-are differentially innervated by ascending cholinergic pathways yet, the nature and organization of prefrontal-cholinergic circuitry in primates are not well understood. Using multi-channel immunohistochemical labeling and high-resolution microscopy, we found regional and laminar differences in the subcellular localization and the densities of excitatory and inhibitory subpopulations expressing m1 and m2 muscarinic receptors, the two predominant cortical mAChR subtypes, in the supragranular layers of LPFC and ACC in rhesus monkeys (Macaca mulatta). The subset of m1+/m2+ expressing SMI-32+ pyramidal neurons labeled in layer 3 (L3) was denser in LPFC than in ACC, while m1+/m2+ SMI-32+ neurons co-expressing the calcium-binding protein, calbindin (CB) was greater in ACC. Further, we found between-area differences in laminar m1+ dendritic expression, and m2+ presynaptic localization on cortico-cortical (VGLUT1+) and sub-cortical inputs (VGLUT2+), suggesting differential cholinergic modulation of top-down vs. bottom-up inputs in the two areas. While almost all inhibitory interneurons-identified by their expression of parvalbumin (PV+), CB+, and calretinin (CR+)-expressed m1+, the localization of m2+ differed by subtype and area. The ACC exhibited a greater proportion of m2+ inhibitory neurons compared to the LPFC and had a greater density of presynaptic m2+ localized on inhibitory (VGAT+) inputs targeting proximal somatodendritic compartments and axon initial segments of L3 pyramidal neurons. These data suggest a greater capacity for m2+-mediated cholinergic suppression of inhibition in the ACC compared to the LPFC. The anatomical localization of muscarinic receptors on ACC and LPFC micro-circuits shown here contributes to our understanding of diverse cholinergic neuromodulation of functionally-distinct prefrontal areas involved in goal-directed behavior, and how these interactions maybe disrupted in neuropsychiatric and neurological conditions.

Different types of uncertainty distinguished by monkey prefrontal neurons

To adapt one's behavior, in a timely manner, to an environment that changes in many different aspects, one must be sensitive to uncertainty about each aspect of the environment. Although the medial prefrontal cortex has been implicated in the representation and reduction of a variety of uncertainties, it is unknown whether different types of uncertainty are distinguished by distinct neuronal populations. To investigate how the prefrontal cortex distinguishes between different types of uncertainty, we recorded neuronal activities from the medial and lateral prefrontal cortices of monkeys performing a visual feedback-based action-learning task in which uncertainty of coming feedback and that of context change varied asynchronously. We found that the activities of two groups of prefrontal cells represented the two different types of uncertainty. These results suggest that different types of uncertainty are represented by distinct neural populations in the prefrontal cortex.

Reinforcement-learning in fronto-striatal circuits

We review the current state of knowledge on the computational and neural mechanisms of reinforcement-learning with a particular focus on fronto-striatal circuits. We divide the literature in this area into five broad research themes: the target of the learning-whether it be learning about the value of stimuli or about the value of actions; the nature and complexity of the algorithm used to drive the learning and inference process; how learned values get converted into choices and associated actions; the nature of state representations, and of other cognitive machinery that support the implementation of various reinforcement-learning operations. An emerging fifth area focuses on how the brain allocates or arbitrates control over different reinforcement-learning sub-systems or "experts". We will outline what is known about the role of the prefrontal cortex and striatum in implementing each of these functions. We then conclude by arguing that it will be necessary to build bridges from algorithmic level descriptions of computational reinforcement-learning to implementational level models to better understand how reinforcement-learning emerges from multiple distributed neural networks in the brain.

Interactions between ventrolateral prefrontal and anterior cingulate cortex during learning and behavioural change

Hypotheses and beliefs guide credit assignment - the process of determining which previous events or actions caused an outcome. Adaptive hypothesis formation and testing are crucial in uncertain and changing environments in which associations and meanings are volatile. Despite primates' abilities to form and test hypotheses, establishing what is causally responsible for the occurrence of particular outcomes remains a fundamental challenge for credit assignment and learning. Hypotheses about what surprises are due to stochasticity inherent in an environment as opposed to real, systematic changes are necessary for identifying the environment's predictive features, but are often hard to test. We review evidence that two highly interconnected frontal cortical regions, anterior cingulate cortex and ventrolateral prefrontal area 47/12o, provide a biological substrate for linking two crucial components of hypothesis-formation and testing: the control of information seeking and credit assignment. Neuroimaging, targeted disruptions, and neurophysiological studies link an anterior cingulate - 47/12o circuit to generation of exploratory behaviour, non-instrumental information seeking, and interpretation of subsequent feedback in the service of credit assignment. Our observations support the idea that information seeking and credit assignment are linked at the level of neural circuits and explain why this circuit is important for ensuring behaviour is flexible and adaptive.

Foraging with the frontal cortex: A cross-species evaluation of reward-guided behavior

Efficient foraging is essential to survival and depends on frontal cortex in mammals. Because of its role in psychiatric disorders, frontal cortex and its contributions to reward procurement have been studied extensively in both rodents and non-human primates. How frontal cortex of these animal models compares is a source of intense debate. Here we argue that translating findings from rodents to non-human primates requires an appreciation of both the niche in which each animal forages as well as the similarities in frontal cortex anatomy and function. Consequently, we highlight similarities and differences in behavior and anatomy, before focusing on points of convergence in how parts of frontal cortex contribute to distinct aspects of foraging in rats and macaques, more specifically. In doing so, our aim is to emphasize where translation of frontal cortex function between species is clearer, where there is divergence, and where future work should focus. We finish by highlighting aspects of foraging for which have received less attention but we believe are critical to uncovering how frontal cortex promotes survival in each species.

Computational models of adaptive behavior and prefrontal cortex

The real world is uncertain, and while ever changing, it constantly presents itself in terms of new sets of behavioral options. To attain the flexibility required to tackle these challenges successfully, most mammalian brains are equipped with certain computational abilities that rely on the prefrontal cortex (PFC). By examining learning in terms of internal models associating stimuli, actions, and outcomes, we argue here that adaptive behavior relies on specific interactions between multiple systems including: (1) selective models learning stimulus-action associations through rewards; (2) predictive models learning stimulus- and/or action-outcome associations through statistical inferences anticipating behavioral outcomes; and (3) contextual models learning external cues associated with latent states of the environment. Critically, the PFC combines these internal models by forming task sets to drive behavior and, moreover, constantly evaluates the reliability of actor task sets in predicting external contingencies to switch between task sets or create new ones. We review different models of adaptive behavior to demonstrate how their components map onto this unifying framework and specific PFC regions. Finally, we discuss how our framework may help to better understand the neural computations and the cognitive architecture of PFC regions guiding adaptive behavior.

Frontal Cortical Functional Connectivity Is Impacted by Anaesthesia in Macaques

A critical aspect of neuroscience is to establish whether and how brain networks evolved across primates. To date, most comparative studies have used resting-state functional magnetic resonance imaging (rs-fMRI) in anaesthetized nonhuman primates and in awake humans. However, anaesthesia strongly affects rs-fMRI signals. The present study investigated the impact of the awareness state (anaesthesia vs. awake) within the same group of macaque monkeys on the rs-fMRI functional connectivity organization of a well-characterized network in the human brain, the cingulo-frontal lateral network. Results in awake macaques show that rostral seeds in the cingulate sulcus exhibited stronger correlation strength with rostral compared to caudal lateral frontal cortical areas, while more caudal seeds displayed stronger correlation strength with caudal compared to anterior lateral frontal cortical areas. Critically, this inverse rostro-caudal functional gradient was abolished under anaesthesia. This study demonstrated a similar functional connectivity (FC) organization of the cingulo-frontal cortical network in awake macaque to that previously uncovered in the human brain pointing toward a preserved FC organization from macaque to human. However, it can only be observed in awake state suggesting that this network is sensitive to anaesthesia and warranting significant caution when comparing FC patterns across species under different states.

Multi-Parameter Physiological State Monitoring in Target Detection Under Real-World Settings

Mental state changes induced by stimuli under experimental settings or by daily events in real life affect task performance and are entwined with physical and mental health. In this study, we developed a physiological state indicator with five parameters that reflect the subject's real-time physiological states based on online EEG signal processing. These five parameters are attention, fatigue, stress, and the brain activity shifts of the left and right hemispheres. We designed a target detection experiment modified by a cognitive attention network test for validating the effectiveness of the proposed indicator, as such conditions would better approximate a real chaotic environment. Results demonstrated that attention levels while performing the target detection task were significantly higher than during rest periods, but also exhibited a decay over time. In contrast, the fatigue level increased gradually and plateaued by the third rest period. Similar to attention levels, the stress level decreased as the experiment proceeded. These parameters are therefore shown to be highly correlated to different stages of the experiment, suggesting their usage as primary factors in passive brain-computer interfaces (BCI). In addition, the left and right brain activity indexes reveal the EEG neural modulations of the corresponding hemispheres, which set a feasible reference of activation for an active BCI control system, such as one executing motor imagery tasks. The proposed indicator is applicable to potential passive and active BCI applications for monitoring the subject's physiological state change in real-time, along with providing a means of evaluating the associated signal quality to enhance the BCI performance.

Brain oscillatory correlates of visuomotor adaptive learning

Sensorimotor adaptation involves the recalibration of the mapping between motor command and sensory feedback in response to movement errors. Although adaptation operates within individual movements on a trial-to-trial basis, it can also undergo learning when adaptive responses improve over the course of many trials. Brain oscillatory activities related to these "adaptation" and "learning" processes remain unclear. The main reason for this is that previous studies principally focused on the beta band, which confined the outcome message to trial-to-trial adaptation. To provide a wider understanding of adaptive learning, we decoded visuomotor tasks with constant, random or no perturbation from EEG recordings in different bandwidths and brain regions using a multiple kernel learning approach. These different experimental tasks were intended to separate trial-to-trial adaptation from the formation of the new visuomotor mapping across trials. We found changes in EEG power in the post-movement period during the course of the visuomotor-constant rotation task, in particular an increased (i) theta power in prefrontal region, (ii) beta power in supplementary motor area, and (iii) gamma power in motor regions. Classifying the visuomotor task with constant rotation versus those with random or no rotation, we were able to relate power changes in beta band mainly to trial-to-trial adaptation to error while changes in theta band would relate rather to the learning of the new mapping. Altogether, this suggested that there is a tight relationship between modulation of the synchronization of low (theta) and higher (essentially beta) frequency oscillations in prefrontal and sensorimotor regions, respectively, and adaptive learning.

Medial Frontal Cortex Activity Predicts Information Sampling in Economic Choice

Decision-making not only requires agents to decide what to choose but also how much information to sample before committing to a choice. Previously established frameworks for economic choice argue for a deliberative process of evidence accumulation across time. These tacitly acknowledge a role of information sampling in that decisions are only made once sufficient evidence is acquired, yet few experiments have explicitly placed information sampling under the participant's control. Here, we use fMRI to investigate the neural basis of information sampling in economic choice by allowing participants (n = 30, sex not recorded) to actively sample information in a multistep decision task. We show that medial frontal cortex (MFC) activity is predictive of further information sampling before choice. Choice difficulty (inverse value difference, keeping sensory difficulty constant) was also encoded in MFC, but this effect was explained away by the inclusion of information sampling as a coregressor in the general linear model. A distributed network of regions across the prefrontal cortex encoded key features of the sampled information at the time it was presented. We propose that MFC is an important controller of the extent to which information is gathered before committing to an economic choice. This role may explain why MFC activity has been associated with evidence accumulation in previous studies in which information sampling was an implicit rather than explicit feature of the decision.SIGNIFICANCE STATEMENT The decisions we make are determined by the information we have sampled before committing to a choice. Accumulator frameworks of decision-making tacitly acknowledge the need to sample further information during the evidence accumulation process until a decision boundary is reached. However, relatively few studies explicitly place this decision to sample further information under the participant's control. In this fMRI study, we find that MFC activity is related to information sampling decisions in a multistep economic choice task. This suggests that an important role of evidence representations within MFC may be to guide adaptive sequential decisions to sample further information before committing to a final decision.

Joint contributions of metacognition and self-beliefs to uncertainty-guided checking behavior

Checking behavior is a natural and adaptive strategy for resolving uncertainty in everyday situations. Here, we aimed at investigating the psychological drivers of checking and its regulation by uncertainty, in non-clinical participants and controlled experimental settings. We found that the sensitivity of participants' explicit confidence judgments to actual performance (explicit metacognition) predicted the extent to which their checking strategy was regulated by uncertainty. Yet, a more implicit measure of metacognition (derived from asking participants to opt between trials) did not contribute to the regulation of checking behavior. Meanwhile, how participants scaled on questionnaires eliciting self-beliefs such as self-confidence and self-reported obsessive-compulsive symptoms also predicted participants' uncertainty-guided checking tendencies. Altogether, these findings demonstrate that checking behavior is likely the outcome of a core explicit metacognitive process operating at the scale of single decisions, while remaining influenced by general self-beliefs. Our findings are thus consistent with two mechanisms (micro vs. macro) through which this otherwise adaptive behavior could go awry in certain psychiatric disorders such as obsessive-compulsive disorder.

The contributions of entorhinal cortex and hippocampus to error driven learning

Computational models proposed that the medial temporal lobe (MTL) contributes importantly to error-driven learning, though little direct in-vivo evidence for this hypothesis exists. To test this, we recorded in the entorhinal cortex (EC) and hippocampus (HPC) as macaques performed an associative learning task using an error-driven learning strategy, defined as better performance after error relative to correct trials. Error-detection signals were more prominent in the EC relative to HPC. Early in learning hippocampal but not EC neurons signaled error-driven learning by increasing their population stimulus-selectivity following error trials. This same pattern was not seen in another task where error-driven learning was not used. After learning, different populations of cells in both the EC and HPC signaled long-term memory of newly learned associations with enhanced stimulus-selective responses. These results suggest prominent but differential contributions of EC and HPC to learning from errors and a particularly important role of the EC in error-detection.

Ku et al. recorded in the entorhinal cortex (EC) and hippocampus (HPC) of macaques during associative learning tasks in order to test the computational model prediction that they contribute to error-driven learning. They demonstrate that the EC and HPC have prominent but differential contributions to learning from errors, with the EC having a particularly prominent role in error-detection.

Neuronal Representation of Locomotion During Motivated Behavior in the Mouse Anterior Cingulate Cortex

The anterior cingulate cortex (ACC) is located within the dorsomedial prefrontal cortex (PFC), and processes and facilitates goal-directed behaviors relating to emotion, reward, and motor control. However, it is unclear how ACC neurons dynamically encode motivated behavior during locomotion. In this study, we examined how information for locomotion and behavioral outcomes is temporally represented by individual and ensembles of ACC neurons in mice during a self-paced locomotor reward-based task. By recording and analyzing the activity of ACC neurons with a microdrive tetrode array while the mouse performed the locomotor task, we found that more than two-fifths of the neurons showed phasic activity relating to locomotion or the reward behavior. Some of these neurons showed significant differences in their firing rate depending on the behavioral outcome. Furthermore, by applying a demixed principal component analysis, the ACC population activity was decomposed into components representing locomotion and the previous/future outcome. These results indicated that ACC neurons dynamically integrate motor and behavioral inputs during goal-directed behaviors.

The anterior cingulate cortex directs exploration of alternative strategies

The ability to adjust one's behavioral strategy in complex environments is at the core of cognition. Doing so efficiently requires monitoring the reliability of the ongoing strategy and, when appropriate, switching away from it to evaluate alternatives. Studies in humans and non-human primates have uncovered signals in the anterior cingulate cortex (ACC) that reflect the pressure to switch away from the ongoing strategy, whereas other ACC signals relate to the pursuit of alternatives. However, whether these signals underlie computations that actually underpin strategy switching or merely reflect tracking of related variables remains unclear. Here we provide causal evidence that the rodent ACC actively arbitrates between persisting with the ongoing behavioral strategy and temporarily switching away to re-evaluate alternatives. Furthermore, by individually perturbing distinct output pathways, we establish that the two associated computations-determining whether to switch strategy and committing to the pursuit of a specific alternative-are segregated in the ACC microcircuitry.

The Potential Role of Dopamine in Mediating Motor Function and Interpersonal Synchrony

Motor functions in general and motor planning in particular are crucial for our ability to synchronize our movements with those of others. To date, these co-occurring functions have been studied separately, and as yet it is unclear whether they share a common biological mechanism. Here, we synthesize disparate recent findings on motor functioning and interpersonal synchrony and propose that these two functions share a common neurobiological mechanism and adhere to the same principles of predictive coding. Critically, we describe the pivotal role of the dopaminergic system in modulating these two distinct functions. We present attention deficit hyperactivity disorder (ADHD) as an example of a disorder that involves the dopaminergic system and describe deficits in motor and interpersonal synchrony. Finally, we suggest possible directions for future studies emphasizing the role of dopamine modulation as a link between social and motor functioning.

Chemogenetics Reveal an Anterior Cingulate-Thalamic Pathway for Attending to Task-Relevant Information

In a changing environment, organisms need to decide when to select items that resemble previously rewarded stimuli and when it is best to switch to other stimulus types. Here, we used chemogenetic techniques to provide causal evidence that activity in the rodent anterior cingulate cortex and its efferents to the anterior thalamic nuclei modulate the ability to attend to reliable predictors of important outcomes. Rats completed an attentional set-shifting paradigm that first measures the ability to master serial discriminations involving a constant stimulus dimension that reliably predicts reinforcement (intradimensional-shift), followed by the ability to shift attention to a previously irrelevant class of stimuli when reinforcement contingencies change (extradimensional-shift). Chemogenetic disruption of the anterior cingulate cortex (Experiment 1) as well as selective disruption of anterior cingulate efferents to the anterior thalamic nuclei (Experiment 2) impaired intradimensional learning but facilitated 2 sets of extradimensional-shifts. This pattern of results signals the loss of a corticothalamic system for cognitive control that preferentially processes stimuli resembling those previously associated with reward. Previous studies highlight a separate medial prefrontal system that promotes the converse pattern, that is, switching to hitherto inconsistent predictors of reward when contingencies change. Competition between these 2 systems regulates cognitive flexibility and choice.

Distribution and overlap of entorhinal, premotor, and amygdalar connections in the monkey anterior cingulate cortex

The anterior cingulate cortex (ACC) is important for decision-making as it integrates motor plans with affective and contextual limbic information. Disruptions in these networks have been observed in depression, bipolar disorder, and post-traumatic stress disorder. Yet, overlap of limbic and motor connections within subdivisions of the ACC is not well understood. Hence, we administered a combination of retrograde and anterograde tracers into structures important for contextual memories (entorhinal cortex), affective processing (amygdala), and motor planning (dorsal premotor cortex) to assess overlap of labeled projection neurons from (outputs) and axon terminals to (inputs) the ACC of adult rhesus monkeys (Macaca mulatta). Our data show that entorhinal and dorsal premotor cortical (dPMC) connections are segregated across ventral (A25, A24a) and dorsal (A24b,c) subregions of the ACC, while amygdalar connections are more evenly distributed across subregions. Among all areas, the rostral ACC (A32) had the lowest relative density of connections with all three regions. In the ventral ACC, entorhinal and amygdalar connections strongly overlap across all layers, especially in A25. In the dorsal ACC, outputs to dPMC and the amygdala strongly overlap in deep layers. However, dPMC input to the dorsal ACC was densest in deep layers, while amygdalar inputs predominantly localized in upper layers. These connection patterns are consistent with diverse roles of the dorsal ACC in motor evaluation and the ventral ACC in affective and contextual memory. Further, distinct laminar circuits suggest unique interactions within specific ACC compartments that are likely important for the temporal integration of motor and limbic information during flexible goal-directed behavior.

Dissociable roles of cortical excitation-inhibition balance during patch-leaving versus value-guided decisions

In a dynamic world, it is essential to decide when to leave an exploited resource. Such patch-leaving decisions involve balancing the cost of moving against the gain expected from the alternative patch. This contrasts with value-guided decisions that typically involve maximizing reward by selecting the current best option. Patterns of neuronal activity pertaining to patch-leaving decisions have been reported in dorsal anterior cingulate cortex (dACC), whereas competition via mutual inhibition in ventromedial prefrontal cortex (vmPFC) is thought to underlie value-guided choice. Here, we show that the balance between cortical excitation and inhibition (E/I balance), measured by the ratio of GABA and glutamate concentrations, plays a dissociable role for the two kinds of decisions. Patch-leaving decision behaviour relates to E/I balance in dACC. In contrast, value-guided decision-making relates to E/I balance in vmPFC. These results support mechanistic accounts of value-guided choice and provide evidence for a role of dACC E/I balance in patch-leaving decisions.

The midcingulate cortex and temporal integration

The ability to integrate information across time at multiple timescales is a vital element of adaptive behavior, because it provides the capacity to link events separated in time, extract useful information from previous events and actions, and to construct plans for behavior over time. Here we make the argument that this information integration capacity is a central function of the midcingulate cortex (MCC), by reviewing the anatomical, intrinsic network, neurophysiological, and behavioral properties of MCC. The MCC is the region of the medial wall situated dorsal to the corpus callosum and sometimes referred to as dACC. It is positioned within the densely connected core network of the primate brain, with a rich diversity of cognitive, somatomotor and autonomic connections. Furthermore, the MCC shows strong local network inhibition which appears to control the metastability of the region-an established feature of many cortical networks in which the neural dynamics move through a series of quasi-stationary states. We propose that the strong local inhibition in MCC leads to particularly long dynamic state durations, and so less frequent transitions. Apparently as a result of these anatomical features and synaptic and ionic determinants, the MCC cells display the longest neuronal timescales among a range of recorded cortical areas. We conclude that the anatomical position, intrinsic properties, and local network interactions of MCC make it a uniquely positioned cortical area to perform the integration of diverse information over time that is necessary for behavioral adaptation.

Anterior cingulate cortex and adaptive control of brain and behavior

Research examining the functional underpinnings of anterior cingulate cortex (ACC) and its relationship to cognitive control have been described as "perennially controversial" and a "Rorschach Test" for modern neuroscience. Although there is near universal agreement that ACC is important for the adaptation of behavior, debate, despite decades of work, stems from the exact manner in which ACC goes about doing this. This chapter provides a brief overview of the various past and present theoretical arguments and research surrounding ACC function, and highlights an emerging literature of single unit ACC recordings from several species that support these theories. We will finish the chapter by focusing on our work examining the firing of single neurons in rat dorsal medial striatum (DMS) and ACC, and examining DMS's dependency on ACC to accurately signal adaptive behavioral output. Ultimately, we will conclude that ACC carries a myriad of signals (error detection, reinforcement/feedback, value, response conflict, etc.) necessary for the modulation of attention and task-relevant/irrelevant signals so that difficult decisions can be made and action plans adapted when necessary.

Anterior Cingulate Cortex and the Control of Dynamic Behavior in Primates

The brain mechanism for controlling continuous behavior in dynamic contexts must mediate action selection and learning across many timescales, responding differentially to the level of environmental uncertainty and volatility. In this review, we argue that a part of the frontal cortex known as the anterior cingulate cortex (ACC) is particularly well suited for this function. First, the ACC is interconnected with prefrontal, parietal, and subcortical regions involved in valuation and action selection. Second, the ACC integrates diverse, behaviorally relevant information across multiple timescales, producing output signals that temporally encapsulate decision and learning processes and encode high-dimensional information about the value and uncertainty of future outcomes and subsequent behaviors. Third, the ACC signals behaviorally relevant information flexibly, displaying the capacity to represent information about current and future states in a valence-, context-, task- and action-specific manner. Fourth, the ACC dynamically controls instrumental- and non-instrumental information seeking behaviors to resolve uncertainty about future outcomes. We review electrophysiological and circuit disruption studies in primates to develop this point, discuss its relationship to novel therapeutics for neuropsychiatric disorders in humans, and conclude by relating ongoing research in primates to studies of medial frontal cortical regions in rodents.

Rules warp feature encoding in decision-making circuits

We have the capacity to follow arbitrary stimulus-response rules, meaning simple policies that guide our behavior. Rule identity is broadly encoded across decision-making circuits, but there are less data on how rules shape the computations that lead to choices. One idea is that rules could simplify these computations. When we follow a rule, there is no need to encode or compute information that is irrelevant to the current rule, which could reduce the metabolic or energetic demands of decision-making. However, it is not clear if the brain can actually take advantage of this computational simplicity. To test this idea, we recorded from neurons in 3 regions linked to decision-making, the orbitofrontal cortex (OFC), ventral striatum (VS), and dorsal striatum (DS), while macaques performed a rule-based decision-making task. Rule-based decisions were identified via modeling rules as the latent causes of decisions. This left us with a set of physically identical choices that maximized reward and information, but could not be explained by simple stimulus-response rules. Contrasting rule-based choices with these residual choices revealed that following rules (1) decreased the energetic cost of decision-making; and (2) expanded rule-relevant coding dimensions and compressed rule-irrelevant ones. Together, these results suggest that we use rules, in part, because they reduce the costs of decision-making through a distributed representational warping in decision-making circuits.

Preferential Representation of Past Outcome Information and Future Choice Behavior by Putative Inhibitory Interneurons Rather Than Putative Pyramidal Neurons in the Primate Dorsal Anterior Cingulate Cortex

The dorsal anterior cingulate cortex (dACC) plays crucial roles in monitoring the outcome of a choice and adjusting a subsequent choice behavior based on the outcome information. In the present study, we investigated how different types of dACC neurons, that is, putative pyramidal neurons and putative inhibitory interneurons, contribute to these processes. We analyzed single-unit database obtained from the dACC in monkeys performing a reversal learning task. The monkey was required to adjust choice behavior from past outcome experiences. Depending on their action potential waveforms, the recorded neurons were classified into putative pyramidal neurons and putative inhibitory interneurons. We found that these neurons do not equally contribute to outcome monitoring and behavioral adjustment. Although both neuron types evenly responded to the current outcome, a larger proportion of putative inhibitory interneurons than putative pyramidal neurons stored the information about the past outcome. The putative inhibitory interneurons further represented choice-related signals more frequently, such as whether the monkey would shift the last choice to an alternative at the next choice opportunity. Our findings suggest that putative inhibitory interneurons, which are thought not to project to brain areas outside the dACC, preferentially transmit signals that would adjust choice behavior based on past outcome experiences.

Polarity of uncertainty representation during exploration and exploitation in ventromedial prefrontal cortex

Environments furnish multiple information sources for making predictions about future events. Here we use behavioural modelling and functional magnetic resonance imaging to describe how humans select predictors that might be most relevant. First, during early encounters with potential predictors, participants' selections were explorative and directed towards subjectively uncertain predictors (positive uncertainty effect). This was particularly the case when many future opportunities remained to exploit knowledge gained. Then, preferences for accurate predictors increased over time, while uncertain predictors were avoided (negative uncertainty effect). The behavioural transition from positive to negative uncertainty-driven selections was accompanied by changes in the representations of belief uncertainty in ventromedial prefrontal cortex (vmPFC). The polarity of uncertainty representations (positive or negative encoding of uncertainty) changed between exploration and exploitation periods. Moreover, the two periods were separated by a third transitional period in which beliefs about predictors' accuracy predominated. The vmPFC signals a multiplicity of decision variables, the strength and polarity of which vary with behavioural context.