Performance monitoring local field potentials in the medial frontal cortex of primates: anterior cingulate cortex

Unravelling the origin of reward positivity: a human intracranial event-related brain potential study

Reward positivity (RewP) is an event-related brain potential component that emerges ∼250-350 ms after receiving reward-related feedback stimuli and is believed to be important for reinforcement learning and reward processing. Although numerous localization studies have indicated that the anterior cingulate cortex (ACC) is the neural generator of this component, other studies have identified sources outside of the ACC, fuelling a debate about its origin. Because the results of EEG and magnetoencephalography source-localization studies are severely limited by the inverse problem, we addressed this question by leveraging the high spatial and temporal resolution of intracranial EEG. We predicted that we would identify a neural generator of rthe RewP in the caudal ACC. We recorded intracranial EEG in 19 patients with refractory epilepsy who underwent invasive video-EEG monitoring at Ghent University Hospital, Belgium. Participants engaged in the virtual T-maze task, a trial-and-error task known to elicit a canonical RewP, while scalp and intracranial EEG were recorded simultaneously. The RewP was identified using a difference wave approach for both scalp and intracranial EEG. The data were aggregated across participants to create a virtual 'meta-participant' that contained all the recorded intracranial event-related brain potentials with respect to their intracranial contact locations. We used both hypothesis-driven (focused on ACC) and exploratory (whole-brain analysis) approaches to segment the brain into regions of interest. For each region of interest, we evaluated the degree to which the time course of the absolute current density (ACD) activity mirrored the time course of the RewP, and we confirmed the statistical significance of the results using permutation analysis. The grand average waveform of the scalp data revealed a RewP at 309 ms after reward feedback with a frontocentral scalp distribution, consistent with the identification of this component as the RewP. The meta-participant contained intracranial event-related brain potentials recorded from 582 intracranial contacts in total. The ACD activity of the aggregated intracranial event-related brain potentials was most similar to the RewP in the left caudal ACC, left dorsolateral prefrontal cortex, left frontomedial cortex and left white matter, with the highest score attributed to caudal ACC, as predicted. To our knowledge, this is the first study to use intracranial EEG aggregated across multiple human epilepsy patients and current source density analysis to identify the neural generator(s) of the RewP. These results provide direct evidence that the ACC is a neural generator of the RewP.

Cognitive Control

Humans and other primates have a remarkable ability to perform a wide range of tasks and behaviors, even novel ones, in order to achieve their goals. Further, they are able to shift flexibly among these behaviors as the contexts demand. Cognitive control is the function at the base of this remarkable behavioral generativity and flexibility. The present review provides a survey of current research on cognitive control focusing on two of its primary features within a control systems framework: (a) the ability to select new behaviors based on context and (b) the ability to monitor ongoing behavior and adjust accordingly. Throughout, the review places an emphasis on how differences in the content and structure of task representations affect these core features of cognitive control.

Recording Neural Reward Signals in a Naturalistic Operant Task Using Mobile-EEG and Augmented Reality

The electrophysiological response to rewards recorded during laboratory tasks has been well documented, yet little is known about the neural response patterns in a more naturalistic setting. Here, we combined a mobile-EEG system with an augmented reality headset to record event-related brain potentials (ERPs) while participants engaged in a naturalistic operant task to find rewards. Twenty-five participants were asked to navigate toward a west or east goal location marked by floating orbs, and once participants reached the goal location, the orb would then signify a reward (5 cents) or no-reward (0 cents) outcome. Following the outcome, participants returned to a start location marked by floating purple rings, and once standing in the middle, a 3 s counter signaled the next trial, for a total of 200 trials. Consistent with previous research, reward feedback evoked the reward positivity, an ERP component believed to index the sensitivity of the anterior cingulate cortex to reward prediction error signals. The reward positivity peaked ∼230 ms with a maximal at channel FCz (M = -0.695 μV, ±0.23) and was significantly different than zero (p < 0.01). Participants took ∼3.38 s to reach the goal location and exhibited a general lose-shift (68.3% ±3.5) response strategy and posterror slowing. Overall, these novel findings provide support for the idea that combining mobile-EEG with augmented reality technology is a feasible solution to enhance the ecological validity of human electrophysiological studies of goal-directed behavior and a step toward a new era of human cognitive neuroscience research that blurs the line between laboratory and reality.

Prefrontal-subthalamic theta signaling mediates delayed responses during conflict processing

While medial frontal cortex (MFC) and subthalamic nucleus (STN) have been implicated in conflict monitoring and action inhibition, respectively, an integrated understanding of the spatiotemporal and spectral interaction of these nodes and how they interact with motor cortex (M1) to definitively modify motor behavior during conflict is lacking. We recorded neural signals intracranially across presupplementary motor area (preSMA), M1, STN, and globus pallidus internus (GPi), during a flanker task in 20 patients undergoing deep brain stimulation implantation surgery for Parkinson disease or dystonia. Conflict is associated with sequential and causal increases in local theta power from preSMA to STN to M1 with movement delays directly correlated with increased STN theta power, indicating preSMA is the MFC locus that monitors conflict and signals STN to implement a 'break.' Transmission of theta from STN-to-M1 subsequently results in a transient increase in M1-to-GPi beta flow immediately prior to movement, modulating the motor network to actuate the conflict-related action inhibition (i.e., delayed response). Action regulation during conflict relies on two distinct circuits, the conflict-related theta and movement-related beta networks, that are separated spatially, spectrally, and temporally, but which interact dynamically to mediate motor performance, highlighting complex parallel yet interacting networks regulating movement.

Agranular frontal cortical microcircuit underlying cognitive control in macaques

The error-related negativity and an N2-component recorded over medial frontal cortex index core functions of cognitive control. While they are known to originate from agranular frontal areas, the underlying microcircuit mechanisms remain elusive. Most insights about microcircuit function have been derived from variations of the so-called canonical microcircuit model. These microcircuit architectures are based extensively on studies from granular sensory cortical areas in monkeys, cats, and rodents. However, evidence has shown striking cytoarchitectonic differences across species and differences in the functional relationships across cortical layers in agranular compared to granular sensory areas. In this minireview, we outline a tentative microcircuit model underlying cognitive control in the agranular frontal cortex of primates. The model incorporates the main GABAergic interneuron subclasses with specific laminar arrangements and target regions on pyramidal cells. We emphasize the role of layer 5 pyramidal cells in error and conflict detection. We offer several specific questions necessary for creating a specific intrinsic microcircuit model of the agranular frontal cortex.

Conflict detection and resolution in macaque frontal eye fields

Stimulus-induced conflicts in decision-making tasks produce both behavioral and neuronal congruency effects. However, how and when conflicts are detected and resolved at the neuronal level remains largely unclear. To address these issues, we recorded from single neurons in the frontal eye fields of two macaques performing a conflict task. Although the temporal dynamics of the neuronal congruency effects are independent of the specific task rules, they are substantially different in target- and distractor-encoding neurons. Conflicts were detected ~100 ms after the conflict-inducing cue (20-30 ms after the visual response), which is much faster than predicted based on human EEG results. This suggests that conflict detection relies on a fast mechanism in frontal eye fields. Resolving the conflict at the neuronal level, however, requires between <400 ms to ~1000 ms, and shows profound interindividual differences and depends on task rules, indicating that it is a more complex and top-down driven process. Our findings illuminate the neuronal mechanisms underlying decision-making when a conflict is present, a crucial cognitive process playing a role in basic survival and high-level cognitive functions.

Cortical origin of theta error signals

A multi-scale approach elucidated the origin of the error-related-negativity (ERN), with its associated theta-rhythm, and the post-error-positivity (Pe) in macaque supplementary eye field (SEF). Using biophysical modeling, synaptic inputs to a subpopulation of layer-3 (L3) and layer-5 (L5) pyramidal cells (PCs) were optimized to reproduce error-related spiking modulation and inter-spike intervals. The intrinsic dynamics of dendrites in L5 but not L3 error PCs generate theta rhythmicity with random phases. Saccades synchronized the phases of the theta-rhythm, which was magnified on errors. Contributions from error PCs to the laminar current source density (CSD) observed in SEF were negligible and could not explain the observed association between error-related spiking modulation in L3 PCs and scalp-EEG. CSD from recorded laminar field potentials in SEF was comprised of multipolar components, with monopoles indicating strong electro-diffusion, dendritic/axonal electrotonic current leakage outside SEF, or violations of the model assumptions. Our results also demonstrate the involvement of secondary cortical regions, in addition to SEF, particularly for the later Pe component. The dipolar component from the observed CSD paralleled the ERN dynamics, while the quadrupolar component paralleled the Pe. These results provide the most advanced explanation to date of the cellular mechanisms generating the ERN.

Recording neural reward signals in the real-world using mobile-EEG and augmented reality

The electrophysiological response to rewards recorded during laboratory-based tasks has been well documented over the past two decades, yet little is known about the neural response patterns in 'real-world' settings. To address this issue, we combined a mobile-EEG system with an augmented reality headset (which blends high definition "holograms" within the real-world) to record event-related brain potentials (ERP) while participants navigated an operant chamber to find rewards. 25 participants (age = 18-43, Male=6, Female=19) were asked to choose between two floating holograms marking a west or east goal-location in a large room, and once participants reached the goal location, the hologram would turn into a reward (5 cents) or no-reward (0 cents) cue. Following the feedback cue, participants were required to return to a hologram marking the start location, and once standing in it, a 3 second counter hologram would initiate the next trial. This sequence was repeated until participants completed 200 trials. Consistent with previous research, reward feedback evoked the reward positivity, an ERP component believed to index the sensitivity of the anterior cingulate cortex to reward prediction error signals. The reward positivity peaked around 235ms post-feedback with a maximal at channel FCz (M=-2.60μV, SD=1.73μV) and was significantly different than zero (p < 0.01). At a behavioral level, participants took approximately 3.38 seconds to reach the goal-location and exhibited a general lose-shift (68.3% ± 3.5) response strategy and were slightly slower to return to the start location following negative feedback (2.43 sec) compared to positive feedback (2.38 sec), evidence of post-error slowing. Overall, these findings provide the first evidence that combining mobile-EEG with augmented reality technology is a feasible solution to enhance the ecological validity of human electrophysiological studies of goal-directed behavior and a step towards a new era of human cognitive neuroscience research that blurs the line between laboratory and reality.

Neurophysiological mechanisms of error monitoring in human and non-human primates

Performance monitoring is an important executive function that allows us to gain insight into our own behaviour. This remarkable ability relies on the frontal cortex, and its impairment is an aspect of many psychiatric diseases. In recent years, recordings from the macaque and human medial frontal cortex have offered a detailed understanding of the neurophysiological substrate that underlies performance monitoring. Here we review the discovery of single-neuron correlates of error monitoring, a key aspect of performance monitoring, in both species. These neurons are the generators of the error-related negativity, which is a non-invasive biomarker that indexes error detection. We evaluate a set of tasks that allows the synergistic elucidation of the mechanisms of cognitive control across the two species, consider differences in brain anatomy and testing conditions across species, and describe the clinical relevance of these findings for understanding psychopathology. Last, we integrate the body of experimental facts into a theoretical framework that offers a new perspective on how error signals are computed in both species and makes novel, testable predictions.

Sign-tracking modulates reward-related neural activation to reward cues, but not reward feedback

Research shows cognitive and neurobiological overlap between sign-tracking [value-modulated attentional capture (VMAC) by response-irrelevant, discrete cues] and maladaptive behaviour (e.g. substance abuse). We investigated the neural correlates of sign-tracking in 20 adults using an additional singleton task (AST) and functional magnetic resonance imaging (fMRI). Participants responded to a target to win monetary reward, the amount of which was signalled by singleton type (reward cue: high value vs. low value). Singleton responses resulted in monetary deductions. Sign-tracking-greater distraction by high-value vs. low-value singletons (H > L)-was observed, with high-value singletons producing slower responses to the target than low-value singletons. Controlling for age and sex, analyses revealed no differential brain activity across H > L singletons. Including sign-tracking as a regressor of interest revealed increased activity (H > L singletons) in cortico-subcortical loops, regions associated with Pavlovian conditioning, reward processing, attention shifts and relative value coding. Further analyses investigated responses to reward feedback (H > L). Controlling for age and sex, increased activity (H > L reward feedback) was found in regions associated with reward anticipation, attentional control, success monitoring and emotion regulation. Including sign-tracking as a regressor of interest revealed increased activity in the temporal pole, a region related to value discrimination. Results suggest sign-tracking is associated with activation of the 'attention and salience network' in response to reward cues but not reward feedback, suggesting parcellation between the two at the level of the brain. Results add to the literature showing considerable overlap in neural systems implicated in reward processing, learning, habit formation, emotion regulation and substance craving.

On the Comparison Between the Nc/CRN and the Ne/ERN

After the Error Negativity (Ne or ERN) has been described on full-blown errors and on partial error, a smaller Error Negativity-like wave (CRN or Nc) has also been evidenced on correct trials, first in patients with schizophrenia and, later on, in healthy subjects. The functional significance of the Nc as compared to the Ne is of critical importance since most models accounting for the genesis of the Ne on errors and partial errors cannot account for the existence of the Nc if this Nc simply corresponds to a small Ne. On the contrary, if the Nc and the Ne are two completely distinct components, then the existence of a Nc poses no constraint to the existing models. To this end, we examine in the present review the similarities and the differences existing between the Ne and the Nc regarding their functional properties and their anatomical origin.

Live agent preference and social action monitoring in the macaque mid-superior temporal sulcus region

During live social interactions, there is increased demand for mentalizing about others to cope with otherwise unpredictable manifestations of their behavior. Anatomically, the middle superior temporal sulcus (mid-STS) region is hypothesized to be the macaque homologue of the human temporoparietal junction (TPJ), a key node in the mentalizing network. However, whether the macaque mid-STS is the functional homologue of the human TPJ is unknown. Here, we provide single-neuron evidence that the two areas share similar properties in social cognitive functions despite differences in anatomical landmarks. Our findings demonstrate that mid-STS neurons have a preference for task performance with live over video-recorded partners and encode errors in the prediction of partners’ actions, both aspects being cardinal features of the human TPJ.

Mentalizing, the ability to infer the mental states of others, is a cornerstone of adaptive social intelligence. While functional brain mapping of human mentalizing has progressed considerably, its evolutionary signature in nonhuman primates remains debated. The discovery that the middle part of the macaque superior temporal sulcus (mid-STS) region has a connectional fingerprint most similar to the human temporoparietal junction (TPJ)—a crucial node in the mentalizing network—raises the possibility that these cortical areas may also share basic functional properties associated with mentalizing. Here, we show that this is the case in aspects of a preference for live social interactions and in a theoretical framework of predictive coding. Macaque monkeys were trained to perform a turn-taking choice task with another real monkey partner sitting directly face-to-face or a filmed partner appearing in prerecorded videos. We found that about three-fourths of task-related mid-STS neurons exhibited agent-dependent activity, most responding selectively or preferentially to the partner’s action. At the population level, activities of these partner-type neurons were significantly greater under live-partner compared to video-recorded–partner task conditions. Furthermore, a subset of the partner-type neurons responded proactively when predictions about the partner’s action were violated. This prediction error coding was specific to the action domain; almost none of the neurons signaled error in the prediction of reward. The present findings highlight unique roles of the macaque mid-STS at the single-neuron level and further delineate its functional parallels with the human TPJ in social cognitive processes associated with mentalizing.

Frontal midline theta differentiates separate cognitive control strategies while still generalizing the need for cognitive control

Cognitive control processes encompass many distinct components, including response inhibition (stopping a prepotent response), proactive control (using prior information to enact control), reactive control (last-minute changing of a prepotent response), and conflict monitoring (choosing between two competing responses). While frontal midline theta activity is theorized to be a general marker of the need for cognitive control, a stringent test of this hypothesis would require a quantitative, within-subject comparison of the neural activation patterns indexing many different cognitive control strategies, an experiment lacking in the current literature. We recorded EEG from 176 participants as they performed tasks that tested inhibitory control (Go/Nogo Task), proactive and reactive control (AX-Continuous Performance Task), and resolving response conflict (Global/Local Task-modified Flanker Task). As activity in the theta (4-8 Hz) frequency band is thought to be a common signature of cognitive control, we assessed frontal midline theta activation underlying each cognitive control strategy. In all strategies, we found higher frontal midline theta power for trials that required more cognitive control (target conditions) versus control conditions. Additionally, reactive control and inhibitory control had higher theta power than proactive control and response conflict, and proactive control had higher theta power than response conflict. Using decoding analyses, we were able to successfully decode control from target trials using classifiers trained exclusively on each of the other strategies, thus firmly demonstrating that theta representations of cognitive control generalize across multiple cognitive control strategies. Our results confirm that frontal midline theta-band activity is a common mechanism for initiating and executing cognitive control, but theta power also differentiates between cognitive control mechanisms. As theta activation reliably differs depending on the cognitive control strategy employed, future work will need to focus on the differential role of theta in differing cognitive control strategies.

Null effects of levodopa on reward- and error-based motor adaptation, savings, and anterograde interference

Dopamine signaling is thought to mediate reward-based learning. We tested for a role of dopamine in motor adaptation by administering the dopamine precursor levodopa to healthy participants in two experiments involving reaching movements. Levodopa has been shown to impair reward-based learning in cognitive tasks. Thus, we hypothesized that levodopa would selectively impair aspects of motor adaptation that depend on the reinforcement of rewarding actions. In the first experiment, participants performed two separate tasks in which adaptation was driven either by visual error-based feedback of the hand position or binary reward feedback. We used EEG to measure event-related potentials evoked by task feedback. We hypothesized that levodopa would specifically diminish adaptation and the neural responses to feedback in the reward learning task. However, levodopa did not affect motor adaptation in either task nor did it diminish event-related potentials elicited by reward outcomes. In the second experiment, participants learned to compensate for mechanical force field perturbations applied to the hand during reaching. Previous exposure to a particular force field can result in savings during subsequent adaptation to the same force field or interference during adaptation to an opposite force field. We hypothesized that levodopa would diminish savings and anterograde interference, as previous work suggests that these phenomena result from a reinforcement learning process. However, we found no reliable effects of levodopa. These results suggest that reward-based motor adaptation, savings, and interference may not depend on the same dopaminergic mechanisms that have been shown to be disrupted by levodopa during various cognitive tasks.NEW & NOTEWORTHY Motor adaptation relies on multiple processes including reinforcement of successful actions. Cognitive reinforcement learning is impaired by levodopa-induced disruption of dopamine function. We administered levodopa to healthy adults who participated in multiple motor adaptation tasks. We found no effects of levodopa on any component of motor adaptation. This suggests that motor adaptation may not depend on the same dopaminergic mechanisms as cognitive forms or reinforcement learning that have been shown to be impaired by levodopa.

Medial frontal negativities predict performance improvements during motor sequence but not motor adaptation learning

Alterations in our environment require us to learn or alter motor skills to remain efficient. Also, damage or injury may require the relearning of motor skills. Two types have been identified: movement adaptation and motor sequence learning. Doyonet al. (2003, Distinct contribution of the cortico-striatal and cortico-cerebellar systems to motor skill learning. Neuropsychologia, 41(3), 252-262) proposed a model to explain the neural mechanisms related to adaptation (cortico-cerebellar) and motor sequence learning (cortico-striatum) tasks. We hypothesized that medial frontal negativities (MFNs), event-related electrocortical responses including the error-related negativity (ERN) and correct-response-related negativity (CRN), would be trait biomarkers for skill in motor sequence learning due to their relationship with striatal neural generators in a network involving the anterior cingulate and possibly the supplementary motor area. We examined 36 participants' improvement in a motor adaptation and a motor sequence learning task and measured MFNs elicited in a separate Spatial Stroop (conflict) task. We found both ERN and CRN strongly predicted performance improvement in the sequential motor task but not in the adaptation task, supporting this aspect of the Doyon model. Interestingly, the CRN accounted for additional unique variance over the variance shared with the ERN suggesting an expansion of the model.

EEG correlates of physical effort and reward processing during reinforcement learning

Effort-based decision making is often modeled using subjective value, a function of reward discounted by effort. We asked whether EEG event-related potential (ERP) correlates of reward processing are also modulated by physical effort. Human participants performed a task in which they were required to accurately produce target levels of muscle activation to receive rewards. Quadriceps muscle activation was recorded with electromyography (EMG) during isometric knee extension. On a given trial, the target muscle activation required either low or high effort. The effort was determined probabilistically according to a binary choice, such that the responses were associated with 20% and 80% probability of high effort. This contingency could only be learned through experience, and it reversed periodically. Binary reinforcement feedback depended on accurately producing the target muscle activity. Participants adaptively avoided effort by switching responses more frequently after choices that resulted in hard effort. Feedback after participants' choices that revealed the resulting effort requirement did not elicit modulation of the feedback-related negativity/reward positivity (FRN/RP). However, the neural response to reinforcement outcome after effort production was increased by preceding physical effort. Source decomposition revealed separable early and late positive deflections contributing to the ERP. The main effect of reward outcome, characteristic of the FRN/RP, loaded onto the earlier component, whereas the reward × effort interaction was observed only in the later positivity, which resembled the P300. Thus, retrospective effort modulates reward processing. This may explain paradoxical behavioral findings whereby rewards requiring more effort to obtain can become more powerful reinforcers.NEW & NOTEWORTHY Choices probabilistically determined the physical effort requirements for a subsequent task, and reward depended on task performance. Feedback revealing whether choices resulted in easy or hard effort did not elicit reinforcement learning signals. However, the neural responses to reinforcement were modulated by preceding effort. Thus, effort itself was not treated as loss or punishment, but it affected the responses to subsequent reinforcement outcomes. This may explain how effort can enhance the motivational effect of reward.

Single Neurons in Anterior Cingulate Cortex Signal the Need to Change Action During Performance of a Stop-change Task that Induces Response Competition

Several human imaging studies have suggested that anterior cingulate cortex (ACC) is highly active when participants receive competing inputs, and that these signals may be important for influencing the downstream planning of actions. Despite increasing evidence from several neuroimaging studies, no study has examined ACC activity at the level of the single neuron in rodents performing similar tasks. To fill this gap, we recorded from single neurons in ACC while rats performed a stop-change task. We found higher firing on trials with competing inputs (STOP trials), and that firing rates were positively correlated with accuracy and movement speed, suggesting that when ACC was engaged, rats tended to slow down and perform better. Finally, firing was the strongest when STOP trials were preceded by GO trials and was reduced when rats adapted their behavior on trials subsequent to a STOP trial. These data provide the first evidence that activity of single neurons in ACC is elevated when 2 responses are in competition with each other when there is a need to change the course of action to obtain reward.

Performance Monitoring during Visual Priming

Repetitive performance of single-feature (efficient or pop-out) visual search improves RTs and accuracy. This phenomenon, known as priming of pop-out, has been demonstrated in both humans and macaque monkeys. We investigated the relationship between performance monitoring and priming of pop-out. Neuronal activity in the supplementary eye field (SEF) contributes to performance monitoring and to the generation of performance monitoring signals in the EEG. To determine whether priming depends on performance monitoring, we investigated spiking activity in SEF as well as the concurrent EEG of two monkeys performing a priming of pop-out task. We found that SEF spiking did not modulate with priming. Surprisingly, concurrent EEG did covary with priming. Together, these results suggest that performance monitoring contributes to priming of pop-out. However, this performance monitoring seems not mediated by SEF. This dissociation suggests that EEG indices of performance monitoring arise from multiple, functionally distinct neural generators.

Cortical microcircuitry of performance monitoring

Medial frontal cortex enables performance monitoring, indexed by the error-related negativity (ERN) and manifest by performance adaptations. In monkeys performing a saccade countermanding (stop signal) task, we recorded EEG over and neural spiking across all layers of the supplementary eye field (SEF), an agranular cortical area. Neurons signaling error production, feedback predicting reward gain or loss, and delivery of fluid reward had different spike widths and were concentrated differently across layers. Neurons signaling error or loss of reward were more common in layers 2 and 3 (L2/3), while neurons signaling gain of reward were more common in layers 5 and 6 (L5/6). Variation of error- and reinforcement-related spike rates in L2/3 but not L5/6 predicted response time adaptation. Variation in error-related spike rate in L2/3 but not L5/6 predicted ERN magnitude. These findings reveal novel features of cortical microcircuitry supporting performance monitoring and confirm one cortical source of the ERN.

Single-Neuron Correlates of Error Monitoring and Post-Error Adjustments in Human Medial Frontal Cortex

Humans can self-monitor errors without explicit feedback, resulting in behavioral adjustments on subsequent trials such as post-error slowing (PES). The error-related negativity (ERN) is a well-established macroscopic scalp EEG correlate of error self-monitoring, but its neural origins and relationship to PES remain unknown. We recorded in the frontal cortex of patients performing a Stroop task and found neurons that track self-monitored errors and error history in dorsal anterior cingulate cortex (dACC) and pre-supplementary motor area (pre-SMA). Both the intracranial ERN (iERN) and error neuron responses appeared first in pre-SMA, and ∼50 ms later in dACC. Error neuron responses were correlated with iERN amplitude on individual trials. In dACC, such error neuron-iERN synchrony and responses of error-history neurons predicted the magnitude of PES. These data reveal a human single-neuron correlate of the ERN and suggest that dACC synthesizes error information to recruit behavioral control through coordinated neural activity.

Local field potentials in dorsal anterior cingulate sulcus reflect rewards but not travel time costs during foraging

To maximise long-term reward rates, foragers deciding when to leave a patch must compute a decision variable that reflects both the immediately available reward and the time costs associated with travelling to the next patch. Identifying the mechanisms that mediate this computation is central to understanding how brains implement foraging decisions. We previously showed that firing rates of dorsal anterior cingulate sulcus neurons incorporate both variables. This result does not provide information about whether integration of information reflected in dorsal anterior cingulate sulcus spiking activity arises locally or whether it is inherited from upstream structures. Here, we examined local field potentials gathered simultaneously with our earlier recordings. In the majority of recording sites, local field potential spectral bands - specifically theta, beta, and gamma frequency ranges - encoded immediately available rewards but not time costs. The disjunction between information contained in spiking and local field potentials can constrain models of foraging-related processing. In particular, given the proposed link between local field potentials and inputs to a brain area, it raises the possibility that local processing within dorsal anterior cingulate sulcus serves to more fully bind immediate reward and time costs into a single decision variable.

Performance monitoring in the medial frontal cortex and related neural networks: From monitoring self actions to understanding others' actions

Action is a key channel for interacting with the outer world. As such, the ability to monitor actions and their consequences - regardless as to whether they are self-generated or other-generated - is of crucial importance for adaptive behavior. The medial frontal cortex (MFC) has long been studied as a critical node for performance monitoring in nonsocial contexts. Accumulating evidence suggests that the MFC is involved in a wide range of functions necessary for one's own performance monitoring, including error detection, and monitoring and resolving response conflicts. Recent studies, however, have also pointed to the importance of the MFC in performance monitoring under social conditions, ranging from monitoring and understanding others' actions to reading others' mental states, such as their beliefs and intentions (i.e., mentalizing). Here we review the functional roles of the MFC and related neural networks in performance monitoring in both nonsocial and social contexts, with an emphasis on the emerging field of a social systems neuroscience approach using macaque monkeys as a model system. Future work should determine the way in which the MFC exerts its monitoring function via interactions with other brain regions, such as the superior temporal sulcus in the mentalizing system and the ventral premotor cortex in the mirror system.

Distinct Roles for the Anterior Cingulate and Dorsolateral Prefrontal Cortices During Conflict Between Abstract Rules

Distinct patterns of activity within the anterior cingulate cortex (ACC) and dorsolateral prefrontal cortex (dlPFC) reported in neuroimaging studies during tasks involving conflict between competing responses have often been cited as evidence for their key contributions to conflict-monitoring and behavioral adaptation, respectively. However, supporting evidence from neuropsychological patients has been scarce and contradictory. We administered a well-studied analog of the Wisconsin Card Sorting Test, designed to elicit conflict between 2 abstract rules, to a cohort of 6 patients with damage to ACC or dlPFC. Patients who had sustained more significant damage to the ACC were not impaired either on a measure of "conflict cost" nor on measures of "conflict-induced behavioral adaptation." In contrast, damage to dlPFC did not affect the conflict cost measure but abolished the patients' ability to adapt their behavior following exposure to conflict, compared with controls. This pattern of results complements the findings from nonhuman primates with more circumscribed lesions to ACC or dlPFC on the same task and provides converging evidence that ACC is not necessary for performance when conflict is elicited between 2 abstract rules, whereas dlPFC plays a fundamental role in behavioral adaptation.

Cognitive Phenotypes for Biomarker Identification in Mental Illness: Forward and Reverse Translation

Psychiatric illness has been acknowledged for as long as people were able to describe behavioral abnormalities in the general population. In modern times, these descriptions have been codified and continuously updated into manuals by which clinicians can diagnose patients. None of these diagnostic manuals have attempted to tie abnormalities to neural dysfunction however, nor do they necessitate the quantification of cognitive function despite common knowledge of its ties to functional outcome. In fact, in recent years the National Institute of Mental Health released a novel transdiagnostic classification, the Research Domain Criteria (RDoC), which utilizes quantifiable behavioral abnormalities linked to neurophysiological processes. This reclassification highlights the utility of RDoC constructs as potential cognitive biomarkers of disease state. In addition, with RDoC and cognitive biomarkers, the onus of researchers utilizing animal models no longer necessitates the recreation of an entire disease state, but distinct processes. Here, we describe the utilization of constructs from the RDoC initiative to forward animal research on these cognitive and behavioral processes, agnostic of disease. By linking neural processes to these constructs, identifying putative abnormalities in diseased patients, more targeted therapeutics can be developed.

Correlation of cue-locked FRN and feedback-locked FRN in the auditory monetary incentive delay task

Reflecting the discrepancy between received and predicted outcomes, the reward prediction error (RPE) plays an important role in learning in a dynamic environment. A number of studies suggested that the feedback-related negativity (FRN) component of an event-related potential, known to be associated with unexpected outcomes, encodes RPEs. While FRN was clearly shown to be sensitive to the probability of outcomes, the effect of outcome magnitude on FRN remains to be further clarified. In studies on the neural underpinnings of reward anticipation and outcome evaluation, a monetary incentive delay (MID) task proved to be particularly useful. We investigated whether feedback-locked FRN and cue-locked dN200 responses recorded during an auditory MID task were sensitive to the probability and magnitude of outcomes. The cue-locked dN200 is associated with the update of information about the magnitude of prospective outcomes. Overall, we showed that feedback-locked FRN was modulated by both the magnitude and the probability of outcomes during an auditory version of MID task, whereas no such effect was found for cue-locked dN200. Furthermore, the cue-locked dN200, which is associated with the update of information about the magnitude of prospective outcomes, correlated with the standard feedback-locked FRN, which is associated with a negative RPE. These results further expand our knowledge on the interplay between the processing of predictive cues that forecast future outcomes and the subsequent revision of these predictions during outcome delivery.

A stop-signal task for sheep: introduction and validation of a direct measure for the stop-signal reaction time

Huntington's disease (HD) patients show reduced flexibility in inhibiting an already-started response. This can be quantified by the stop-signal task. The aim of this study was to develop and validate a sheep version of the stop-signal task that would be suitable for monitoring the progression of cognitive decline in a transgenic sheep model of HD. Using a semi-automated operant system, sheep were trained to perform in a two-choice discrimination task. In 22% of the trials, a stop-signal was presented. Upon the stop-signal presentation, the sheep had to inhibit their already-started response. The stopping behaviour was captured using an accelerometer mounted on the back of the sheep. This set-up provided a direct read-out of the individual stop-signal reaction time (SSRT). We also estimated the SSRT using the conventional approach of subtracting the stop-signal delay (i.e., time after which the stop-signal is presented) from the ranked reaction time during a trial without a stop-signal. We found that all sheep could inhibit an already-started response in 91% of the stop-trials. The directly measured SSRT (0.974 ± 0.04 s) was not significantly different from the estimated SSRT (0.938 ± 0.04 s). The sheep version of the stop-signal task adds to the repertoire of tests suitable for investigating both cognitive dysfunction and efficacy of therapeutic agents in sheep models of neurodegenerative disease such as HD, as well as neurological conditions such as attention deficit hyperactivity disorder.

Value, search, persistence and model updating in anterior cingulate cortex

Dorsal anterior cingulate cortex (dACC) carries a wealth of value-related information necessary for regulating behavioral flexibility and persistence. It signals error and reward events informing decisions about switching or staying with current behavior. During decision-making, it encodes the average value of exploring alternative choices (search value), even after controlling for response selection difficulty, and during learning, it encodes the degree to which internal models of the environment and current task must be updated. dACC value signals are derived in part from the history of recent reward integrated simultaneously over multiple time scales, thereby enabling comparison of experience over the recent and extended past. Such ACC signals may instigate attentionally demanding and difficult processes such as behavioral change via interactions with prefrontal cortex. However, the signal in dACC that instigates behavioral change need not itself be a conflict or difficulty signal.

Comparing the error-related negativity across groups: The impact of error- and trial-number differences

The error-related negativity (ERN or Ne) is increasingly being investigated as a marker discriminating interindividual factors and moves toward a surrogate marker for disorders or interventions. Although reproducibility and validity of neuroscientific and psychological research has been criticized, clear data on how different quantification methods of the ERN and their relation to available trial numbers affect within- and across-participant studies is sparse. Within a large sample of 863 healthy human participants, we demonstrate that, across participants, the number of errors correlates with the amplitude of the ERN independently of the number of errors included in ERN quantification per participant, constituting a possible confound when such variance is unaccounted for. Additionally, we find that ERN amplitudes reach high consistency within participants at lower trial numbers, yet when comparisons between groups of participants are desired, increasing error-trial numbers lead to higher statistical power. We derive concrete suggestions for specific types of analyses, which may help researchers to more effectively design studies and analyze error-related EEG data with the most appropriate measurement technique for the question at hand and trial number available.

Neural representation of cost-benefit selections in rat anterior cingulate cortex in self-paced decision making

The anterior cingulate cortex (ACC) is crucial for decision making which involves the processing of cost-benefit information. Our previous study has shown that ACC is essential for self-paced decision making. However, it is unclear how ACC neurons represent cost-benefit selections during the decision-making process. In the present study, we trained rats on the same "Do More Get More" (DMGM) task as in our previous work. In each trial, the animals stand upright and perform a sustained nosepoke of their own will to earn a water reward, with the amount of reward positively correlated to the duration of the nosepoke (i.e., longer nosepokes earn larger rewards). We then recorded ACC neuronal activity on well-trained rats while they were performing the DMGM task. Our results show that (1) approximately 3/5 ACC neurons (296/496, 59.7%) exhibited changes in firing frequency that were temporally locked with the main events of the DMGM task; (2) about 1/5 ACC neurons (101/496, 20.4%) or 1/3 of the event-modulated neurons (101/296, 34.1%) showed differential firing rate changes for different cost-benefit selections; and (3) many ACC neurons exhibited linear encoding of the cost-benefit selections in the DMGM task events. These results suggest that ACC neurons are engaged in encoding cost-benefit information, thus represent the selections in self-paced decision making.

The Feedback-related Negativity Reflects the Combination of Instantaneous and Long-term Values of Decision Outcomes

Hundreds of ERP studies have reported a midfrontal negative-going amplitude shift following negative compared with positive action outcomes. This feedback-related negativity (FRN) effect is typically thought to reflect an early and binary mechanism of action evaluation in the posterior midcingulate cortex. However, in prior research on the FRN effect, the instantaneous value and the long-term value of action outcomes have been perfectly confounded. That is, instantaneously positive outcomes were generally consistent with task goals, whereas instantaneously negative outcomes were inconsistent with task goals. In this study, we disentangled these two outcome aspects in two experiments. Our results reveal an interaction of instantaneous and long-term outcome values. More precisely, our findings strongly suggest that the FRN effect is mainly driven by a reward positivity, which is evoked only by outcomes that possess an instantaneously positive value and also help the organism to reach its long-term goals. These findings add to a recent literature according to which the posterior midcingulate cortex acts as a hierarchical reinforcement learning system and suggest that this system integrates instant and long-term action-outcome values. This, in turn, might be crucial for learning optimal behavioral strategies in a given setting.

Changes in Effective Connectivity of the Superior Parietal Lobe during Inhibition and Redirection of Eye Movements

Executive control is the ability to flexibly control behavior and is frequently studied with saccadic eye movements. Contrary to frontal oculomotor areas, the role of the superior parietal lobe (SPL) in the executive control of saccades remains unknown. To explore the role of SPL networks in saccade control, we performed a saccadic search-step task while acquiring functional magnetic resonance imaging data for 41 participants. Psychophysiological interaction analyses assessed task-related differences in the effective connectivity of SPL with other brain regions during the inhibition and redirection of saccades. Results indicate an increased coupling of SPL with frontal, posterior, and striatal oculomotor areas for redirected saccades versus visually guided saccades. Saccade inhibition versus unsuccessful inhibition revealed an increased coupling of SPL with dorsolateral prefrontal cortex and anterior cingulate cortex. We discuss how these findings relate to ongoing debates about the implementation of executive control and conclude that early attentional control and rapid updating of saccade goals are important signals for executive control.

Corticostriatal Field Potentials Are Modulated at Delta and Theta Frequencies during Interval-Timing Task in Rodents

Organizing movements in time is a critical and highly conserved feature of mammalian behavior. Temporal control of action requires corticostriatal networks. We investigate these networks in rodents using a two-interval timing task while recording LFPs in medial frontal cortex (MFC) or dorsomedial striatum. Consistent with prior work, we found cue-triggered delta (1–4 Hz) and theta activity (4–8 Hz) primarily in rodent MFC. We observed delta activity across temporal intervals in MFC and dorsomedial striatum. Rewarded responses were associated with increased delta activity in MFC. Activity in theta bands in MFC and delta bands in the striatum was linked with the timing of responses. These data suggest both delta and theta activity in frontostriatal networks are modulated during interval timing and that activity in these bands may be involved in the temporal control of action.

Reward Sensitivity of ACC as an Intermediate Phenotype between DRD4-521T and Substance Misuse

The development and expression of the midbrain dopamine system is determined in part by genetic factors that vary across individuals such that dopamine-related genes are partly responsible for addiction vulnerability. However, a complete account of how dopamine-related genes predispose individuals to drug addiction remains to be developed. Adopting an intermediate phenotype approach, we investigated whether reward-related electrophysiological activity of ACC—a cortical region said to utilize dopamine reward signals to learn the value of extended, context-specific sequences of goal-directed behaviors—mediates the influence of multiple dopamine-related functional polymorphisms over substance use. We used structural equation modeling to examine whether two related electrophysiological phenomena associated with the control and reinforcement learning functions of ACC—theta power and the reward positivity—mediated the relationship between the degree of substance misuse and genetic polymorphisms that regulate dopamine processing in frontal cortex. Substance use data were collected from 812 undergraduate students. One hundred ninety-six returned on a subsequent day to participate in an electrophysiological experiment and to provide saliva samples for DNA analysis. We found that these electrophysiological signals mediated a relationship between the DRD4-521T dopamine receptor genotype and substance misuse. Our results provide a theoretical framework that bridges the gap between genes and behavior in drug addiction and illustrate how future interventions might be individually tailored for specific genetic and neurocognitive profiles.

Prenatal Nicotine Exposure Impairs Executive Control Signals in Medial Prefrontal Cortex

Prenatal nicotine exposure (PNE) is linked to numerous psychiatric disorders including attention deficit hyperactivity disorder (ADHD). Current literature suggests that core deficits observed in ADHD reflect abnormal inhibitory control governed by the prefrontal cortex. Yet, it is unclear how neural activity in the medial prefrontal cortex (mPFC) is modulated during tasks that assess response inhibition or if these neural correlates, along with behavior, are affected by PNE. To address this issue, we recorded from single mPFC neurons in control and PNE rats as they performed a stop-signal task. We found that PNE rats were faster for all trial-types, made more premature responses, and were less likely to inhibit behavior on 'STOP' trials during which rats had to inhibit an already initiated response. Activity in mPFC was modulated by response direction and was positively correlated with accuracy and movement time in control but not PNE rats. Although the number of single neurons correlated with response direction was significantly reduced by PNE, neural activity observed on general STOP trials was largely unaffected. However, dramatic behavioral deficits on STOP trials immediately following non-conflicting (GO) trials in the PNE group appear to be mediated by the loss of conflict monitoring signals in mPFC. We conclude that prenatal nicotine exposure makes rats impulsive and disrupts firing of mPFC neurons that carry signals related to response direction and conflict monitoring.

The Monitoring and Control of Task Sequences in Human and Non-Human Primates

Our ability to plan and execute a series of tasks leading to a desired goal requires remarkable coordination between sensory, motor, and decision-related systems. Prefrontal cortex (PFC) is thought to play a central role in this coordination, especially when actions must be assembled extemporaneously and cannot be programmed as a rote series of movements. A central component of this flexible behavior is the moment-by-moment allocation of working memory and attention. The ubiquity of sequence planning in our everyday lives belies the neural complexity that supports this capacity, and little is known about how frontal cortical regions orchestrate the monitoring and control of sequential behaviors. For example, it remains unclear if and how sensory cortical areas, which provide essential driving inputs for behavior, are modulated by the frontal cortex during these tasks. Here, we review what is known about moment-to-moment monitoring as it relates to visually guided, rule-driven behaviors that change over time. We highlight recent human work that shows how the rostrolateral prefrontal cortex (RLPFC) participates in monitoring during task sequences. Neurophysiological data from monkeys suggests that monitoring may be accomplished by neurons that respond to items within the sequence and may in turn influence the tuning properties of neurons in posterior sensory areas. Understanding the interplay between proceduralized or habitual acts and supervised control of sequences is key to our understanding of sequential task execution. A crucial bridge will be the use of experimental protocols that allow for the examination of the functional homology between monkeys and humans. We illustrate how task sequences may be parceled into components and examined experimentally, thereby opening future avenues of investigation into the neural basis of sequential monitoring and control.

Uncovering a missing link in anterior cingulate research

Research on human anterior cingulate cortex has long indicated a role in detecting conflict. However, efforts to find parallel effects in non-human primates were surprisingly unsuccessful. Here, Ebitz and Platt (2015) break the resulting impasse by uncovering what appear to be conflict-related signals in monkey cingulate cortex.

Response inhibition and response monitoring in a saccadic double-step task in schizophrenia

BACKGROUND

Cognitive control impairments are linked to functional outcome in schizophrenia. The goal of the current study was to investigate precise abnormalities in two aspects of cognitive control: reactively changing a prepared response, and monitoring performance and adjusting behavior accordingly. We adapted an oculomotor task from neurophysiological studies of the cellular basis of cognitive control in nonhuman primates.

METHODS

16 medicated outpatients with schizophrenia (SZ) and 18 demographically-matched healthy controls performed the modified double-step task. In this task, participants were required to make a saccade to a visual target. Infrequently, the target jumped to a new location and participants were instructed to rapidly inhibit and change their response. A race model provided an estimate of the time needed to cancel a planned movement. Response monitoring was assessed by measuring reaction time (RT) adjustments based on trial history.

RESULTS

SZ patients had normal visually-guided saccadic RTs but required more time to switch the response to the new target location. Additionally, the estimated latency of inhibition was longer in patients and related to employment. Finally, although both groups slowed down on trials that required inhibiting and changing a response, patients showed exaggerated performance-based adjustments in RTs, which was correlated with positive symptom severity.

CONCLUSIONS

SZ patients have impairments in rapidly inhibiting eye movements and show idiosyncratic response monitoring. These results are consistent with functional abnormalities in a network involving cortical oculomotor regions, the superior colliculus, and basal ganglia, as described in neurophysiological studies of non-human primates using an identical paradigm, and provide a translational bridge for understanding cognitive symptoms of SZ.

Electrophysiological Correlates of a Versatile Executive Control System in the Monkey Anterior Cingulate Cortex

When a subject faces conflicting situations, decision-making becomes uncertain. The human dorsal anterior cingulate cortex (dACC) has been repeatedly implicated in the monitoring of such situations, and its neural activity is thought to be involved in behavioral adjustment. However, this hypothesis is mainly based on neuroimaging results and is challenged by animal studies that failed to report any neuronal correlates of conflict monitoring. This discrepancy is thought be due either to methodological or more fundamental cross-species differences. In this study, we eliminated methodological biases and recorded single-neuron activity in monkeys performing a Stroop-like task. We found specific changes in dACC activity during incongruent trials but only in a small subpopulation of cells. Critically, these changes were not related to reaction time and were absent before any incorrect action was taken. A larger fraction of neurons exhibited sustained activity during the whole decision period, whereas another subpopulation of neurons was modulated by reaction time, with a gradual increase in their firing rate that peaked at movement onset. Most of the neurons found in these subpopulations exhibited activity after the delivery of an external negative feedback stimulus that indicated an error had been made. These findings, which are consistent with an executive control role, reconcile various theories of prefrontal cortex function and support the homology between human and monkey cognitive architectures.

Mistakes were made: neural mechanisms for the adaptive control of action initiation by the medial prefrontal cortex

Studies in rats, monkeys and humans have established that the medial prefrontal cortex is crucial for the ability to exert adaptive control over behavior. Here, we review studies on the role of the rat medial prefrontal cortex in adaptive control, with a focus on simple reaction time tasks that can be easily used across species and have clinical relevance. The performance of these tasks is associated with neural activity in the medial prefrontal cortex that reflects stimulus detection, action timing, and outcome monitoring. We describe rhythmic neural activity that occurs when animals initiate a temporally extended action. Such rhythmic activity is coterminous with major changes in population spike activity. Testing animals over a series of sessions with varying pre-stimulus intervals showed that the signals adapt to the current temporal demands of the task. Disruptions of rhythmic neural activity occur on error trials (premature responding) and lead to a persistent encoding of the error and a subsequent change in behavioral performance (i.e. post-error slowing). Analysis of simultaneously recorded spike activity suggests that the presence of strong theta rhythms is coterminous with altered network dynamics, and might serve as a mechanism for adaptive control. Computational modeling suggests that these signals may enable learning from errors. Together, our findings contribute to an emerging literature and provide a new perspective on the neuronal mechanisms for the adaptive control of action.

Surprise signals in the supplementary eye field: rectified prediction errors drive exploration-exploitation transitions

Visual search is coordinated adaptively by monitoring and predicting the environment. The supplementary eye field (SEF) plays a role in oculomotor control and outcome evaluation. However, it is not clear whether the SEF is involved in adjusting behavioral modes based on preceding feedback. We hypothesized that the SEF drives exploration-exploitation transitions by generating "surprise signals" or rectified prediction errors, which reflect differences between predicted and actual outcomes. To test this hypothesis, we introduced an oculomotor two-target search task in which monkeys were required to find two valid targets among four identical stimuli. After they detected the valid targets, they exploited their knowledge of target locations to obtain a reward by choosing the two valid targets alternately. Behavioral analysis revealed two distinct types of oculomotor search patterns: exploration and exploitation. We found that two types of SEF neurons represented the surprise signals. The error-surprise neurons showed enhanced activity when the monkey received the first error feedback after the target pair change, and this activity was followed by an exploratory oculomotor search pattern. The correct-surprise neurons showed enhanced activity when the monkey received the first correct feedback after an error trial, and this increased activity was followed by an exploitative, fixed-type search pattern. Our findings suggest that error-surprise neurons are involved in the transition from exploitation to exploration and that correct-surprise neurons are involved in the transition from exploration to exploitation.

Separable responses to error, ambiguity, and reaction time in cingulo-opercular task control regions

The dorsal anterior cingulate (dACC), along with the closely affiliated anterior insula/frontal operculum, have been demonstrated to show three types of task control signals across a wide variety of tasks. One of these signals, a transient signal that is thought to represent performance feedback, shows greater activity to error than correct trials. Other work has found similar effects for uncertainty/ambiguity or conflict, though some argue that dACC activity is, instead, modulated primarily by other processes more reflected in reaction time. Here, we demonstrate that, rather than a single explanation, multiple information processing operations are crucial to characterizing the function of these brain regions, by comparing operations within a single paradigm. Participants performed two tasks in an fMRI experimental session: (1) deciding whether or not visually presented word pairs rhyme, and (2) rating auditorily presented single words as abstract or concrete. A pilot was used to identify ambiguous stimuli for both tasks (e.g., word pair: BASS/GRACE; single word: CHANGE). We found greater cingulo-opercular activity for errors and ambiguous trials than clear/correct trials, with a robust effect of reaction time. The effects of error and ambiguity remained when reaction time was regressed out, although the differences decreased. Further stepwise regression of response consensus (agreement across participants for each stimulus; a proxy for ambiguity) decreased differences between ambiguous and clear trials, but left error-related differences almost completely intact. These observations suggest that trial-wise responses in cingulo-opercular regions monitor multiple performance indices, including accuracy, ambiguity, and reaction time.

Feedback-related negativity observed in rodent anterior cingulate cortex

The feedback-related negativity (FRN) refers to a difference in the human event-related potential (ERP) elicited by feedback indicating success versus failure: the difference appears negative when subtracting the success ERP from the failure ERP (Miltner et al., 1997). Although source localization techniques (e.g., BESA) suggest that the FRN is produced in the ACC, the inverse problem (that any given scalp distribution can be produced by an infinite number of possible dipole configurations) limits the certainty of this conclusion. The inverse problem can be circumvented by directly recording from the ACC in animal models. Although a non-human primate homologue of the FRN has been observed in the macaque monkey (e.g. Emeric et al., 2008), a homologue of the FRN has yet to be identified in rodents. We recorded local field potentials (LFPs) directly from the ACC in 6 rodents in a task based on the FRN paradigm. The animals were trained to poke their nose into a lighted port and received a feedback smell indicating whether or not a reward pellet would drop 1.5s later. We observed a FRN-like effect time-locked to the feedback scent whereby the LFP to feedback predicting no-reward was significantly more negative than the LFP to feedback predicting reward. This deflection began on average 130ms before behavioral changes in response to the feedback. Thus, we provide the first evidence of the existence of a rodent homologue of the FRN.

An information theory account of cognitive control

Our ability to efficiently process information and generate appropriate responses depends on the processes collectively called cognitive control. Despite a considerable focus in the literature on the cognitive control of information processing, neural mechanisms underlying control are still unclear, and have not been characterized by considering the quantity of information to be processed. A novel and comprehensive account of cognitive control is proposed using concepts from information theory, which is concerned with communication system analysis and the quantification of information. This account treats the brain as an information-processing entity where cognitive control and its underlying brain networks play a pivotal role in dealing with conditions of uncertainty. This hypothesis and theory article justifies the validity and properties of such an account and relates experimental findings to the frontoparietal network under the framework of information theory.

Action monitoring and medial frontal cortex: leading role of supplementary motor area

The capacity to evaluate the outcomes of our actions is fundamental for adapting and optimizing behavior and depends on an action-monitoring system that assesses ongoing actions and detects errors. The neuronal network underlying this executive function, classically attributed to the rostral cingulate zone, is poorly characterized in humans, owing to the limited number of direct neurophysiological data. Using intracerebral recordings, we show that the leading role is played by the supplementary motor area (SMA), which rapidly evaluates successful and erroneous actions. The rostral part of medial prefrontal cortex, driven by the SMA, was activated later and exclusively in the case of errors. This suggests a hierarchical organization of the different frontal regions involved in implementation of action monitoring and error processing.

Neurophysiology of performance monitoring and adaptive behavior

Successful goal-directed behavior requires not only correct action selection, planning, and execution but also the ability to flexibly adapt behavior when performance problems occur or the environment changes. A prerequisite for determining the necessity, type, and magnitude of adjustments is to continuously monitor the course and outcome of one's actions. Feedback-control loops correcting deviations from intended states constitute a basic functional principle of adaptation at all levels of the nervous system. Here, we review the neurophysiology of evaluating action course and outcome with respect to their valence, i.e., reward and punishment, and initiating short- and long-term adaptations, learning, and decisions. Based on studies in humans and other mammals, we outline the physiological principles of performance monitoring and subsequent cognitive, motivational, autonomic, and behavioral adaptation and link them to the underlying neuroanatomy, neurochemistry, psychological theories, and computational models. We provide an overview of invasive and noninvasive systemic measures, such as electrophysiological, neuroimaging, and lesion data. We describe how a wide network of brain areas encompassing frontal cortices, basal ganglia, thalamus, and monoaminergic brain stem nuclei detects and evaluates deviations of actual from predicted states indicating changed action costs or outcomes. This information is used to learn and update stimulus and action values, guide action selection, and recruit adaptive mechanisms that compensate errors and optimize goal achievement.