Cortical delta activity reflects reward prediction error and related behavioral adjustments, but at different times

Beyond peaks and troughs: Multiplexed performance monitoring signals in the EEG

With the discovery of event-related potentials elicited by errors more than 30 years ago, a new avenue of research on performance monitoring, cognitive control, and decision making emerged. Since then, the field has developed and expanded fulminantly. After a brief overview on the EEG correlates of performance monitoring, this article reviews recent advancements based on single-trial analyses using independent component analysis, multiple regression, and multivariate pattern classification. Given the close interconnection between performance monitoring and reinforcement learning, computational modeling and model-based EEG analyses have made a particularly strong impact. The reviewed findings demonstrate that error- and feedback-related EEG dynamics represent variables reflecting how performance-monitoring signals are weighted and transformed into an adaptation signal that guides future decisions and actions. The model-based single-trial analysis approach goes far beyond conventional peak-and-trough analyses of event-related potentials and enables testing mechanistic theories of performance monitoring, cognitive control, and decision making.

Attenuated neural activity in processing decision-making feedback in uncertain conditions in patients with mild cognitive impairment

The present study aimed to explore the potential neural correlates during feedback evaluation during decision-making under risk and ambiguity in MCI. Nineteen individuals with MCI and twenty age-matched HCs were enrolled. Decision-making performance under risk and ambiguity was examined with the modified game of dice task (GDT) and an Iowa gambling task (IGT). Using task-related EEG data, reward positivity (RewP) and feedback P3 (fb-P3) were used to characterize participants' motivation and allocation of cognitive resources. Also, response time and event-related oscillation (ERO) were used to evaluate information processing speed, and the potent of post-feedback information integration and behavioral modulation. MCI patients had lower RewP (p = 0.022) and fb-P3 (p = 0.045) amplitudes in the GDT than HCs. Moreover, the amount and valence of feedback modulated the RewP (p = 0.008; p = 0.017) and fb-P3 (p < 0.001; p < 0.001). In the IGT, in addition to the significantly reduced fb-P3 observed in MCI patients (p = 0.010), the amount and valence of feedback modulated the RewP (p = 0.002; p = 0.020). Furthermore, MCI patients took longer to make decisions (t = 2.15, p = 0.041). The ERO analysis revealed that delta power was reduced in MCI (GDT: p = 0.045; p = 0.011). The findings suggest that, during feedback evaluation when making risky and ambiguous decisions, motivation, allocation of cognitive resources, information processing and neuronal excitability were attenuated in MCI. It implies that neural activity related to decision making was compromised in MCI.

A dissociation between the effects of expectations and attention in selective visual processing

It is often claimed that probabilistic expectations affect visual perception directly, without mediation by selective attention. However, these claims have been disputed, as effects of expectation and attention are notoriously hard to dissociate experimentally. In this study, we used a new approach to separate expectations from attention. In four experiments (N = 60), participants searched for a target in a rapid serial visual presentation (RSVP) stream and had to identify a digit or a letter defined by a low-level cue (colour or shape). Expectations about the target's alphanumeric category were probabilistically manipulated. Since category membership is a high-level feature and since the target was embedded among many distractors that shared its category, targets from the expected category should not attract attention more than targets from the unexpected category. In the first experiment, these targets were more likely to be identified relative to targets from the unexpected category. Importantly, in the following experiments, we also included behavioural and electrophysiological indices of attentional guidance and engagement. This allowed us to examine whether expectations also modulated these or earlier attentional processes. Results showed that category-based expectations had no modulatory effects on attention, and only affected processing at later encoding-related stages. Alternative interpretation of expectation effects in terms of repetition priming or response bias were also ruled out. These observations provide new evidence for direct attention-independent expectation effects on perception. We suggest that expectations can adjust the threshold required for encoding expectations-congruent information, thereby affecting the speed with which target objects are encoded in working memory.

Risk-Taking Is Associated with Decreased Subjective Value Signals and Increased Prediction Error Signals in the Hot Columbia Card Task

It remains a pressing concern to understand how neural computations relate to risky decisions. However, most observations of brain-behavior relationships in the risk-taking domain lack a rigorous computational basis or fail to emulate of the dynamic, sequential nature of real-life risky decision-making. Recent advances emphasize the role of neural prediction error (PE) signals. We modeled, according to prospect theory, the choices of n = 43 human participants (33 females, 10 males) performing an EEG version of the hot Columbia Card Task, featuring rounds of sequential decisions between stopping (safe option) and continuing with increasing odds of a high loss (risky option). Single-trial regression EEG analyses yielded a subjective value signal at centroparietal (300-700 ms) and frontocentral (>800 ms) electrodes and in the delta band, as well as PE signals tied to the feedback-related negativity, P3a, and P3b, and in the theta band. Higher risk preference (total number of risky choices) was linked to attenuated subjective value signals but increased PE signals. Higher P3-like activity associated with the most positive PE in each round predicted stopping in the present round but not risk-taking in the subsequent round. Our findings indicate that decreased representation of decision values and increased sensitivity to winning despite low odds (positive PE) facilitate risky choices at the subject level. Strong neural responses when gains are least expected (the most positive PE on each round) adaptively contribute to safer choices at the trial-by-trial level but do not affect risky choice at the round-by-round level.

Dysfunctional feedback processing in male methamphetamine abusers: Evidence from neurophysiological and computational approaches

Methamphetamine use disorder (MUD) as a major public health risk is associated with dysfunctional neural feedback processing. Although dysfunctional feedback processing in people who are substance dependent has been explored in several behavioral, computational, and electrocortical studies, this mechanism in MUDs requires to be well understood. Furthermore, the current understanding of latent components of their behavior such as learning speed and exploration-exploitation dilemma is still limited. In addition, the association between the latent cognitive components and the related neural mechanisms also needs to be explored. Therefore, in this study, the underlying neurocognitive mechanisms of feedback processing of such impairment, and age/gender-matched healthy controls are evaluated within a probabilistic learning task with rewards and punishments. Mathematical modeling results based on the Q-learning paradigm suggested that MUDs show less sensitivity in distinguishing optimal options. Additionally, it may be worth noting that MUDs exhibited a slight decrease in their ability to learn from negative feedback compared to healthy controls. Also through the lens of underlying neural mechanisms, MUDs showed lower theta power at the medial-frontal areas while responding to negative feedback. However, other EEG measures of reinforcement learning including feedback-related negativity, parietal-P300, and activity flow from the medial frontal to lateral prefrontal regions, remained intact in MUDs. On the other hand, the elimination of the linkage between value sensitivity and medial-frontal theta activity in MUDs was observed. The observed dysfunction could be due to the adverse effects of methamphetamine on the cortico-striatal dopamine circuit, which is reflected in the anterior cingulate cortex activity as the most likely region responsible for efficient behavior adjustment. These findings could help us to pave the way toward tailored therapeutic approaches.

Behavioral Interventions Can Improve Brain Injury-Induced Deficits in Behavioral Flexibility and Impulsivity Linked to Impaired Reward-Feedback Beta Oscillations

Traumatic brain injury (TBI) affects a large population, resulting in severe cognitive impairments. Although cognitive rehabilitation is an accepted treatment for some deficits, studies in patients are limited in ability to probe physiological and behavioral mechanisms. Therefore, animal models are needed to optimize strategies. Frontal TBI in a rat model results in robust and replicable cognitive deficits, making this an ideal candidate for investigating various behavioral interventions. In this study, we report three distinct frontal TBI experiments assessing behavior well into the chronic post-injury period using male Long-Evans rats. First, we evaluated the impact of frontal injury on local field potentials recorded simultaneously from 12 brain regions during a probabilistic reversal learning (PbR) task. Next, a set of rats were tested on a similar PbR task or an impulsivity task (differential reinforcement of low-rate behavior [DRL]) and half received salient cues associated with reinforcement contingencies to encourage engagement in the target behavior. After intervention on the PbR task, brains were stained for markers of activity. On the DRL task, cue relevance was decoupled from outcomes to determine if beneficial effects persisted on impulsive behavior. TBI decreased the ability to detect reinforced outcomes; this was evident in task performance and reward-feedback signals occurring at beta frequencies in lateral orbitofrontal cortex (OFC) and associated frontostriatal regions. The behavioral intervention improved flexibility and increased OFC activity. Intervention also reduced impulsivity, even after cues were decoupled, which was partially mediated by improvements in timing behavior. The current study established a platform to begin investigating cognitive rehabilitation in rats and identified a strong role for dysfunctional OFC signaling in probabilistic learning after frontal TBI.

The neural correlates of reinforcement sensitivity theory: A systematic review of the frontal asymmetry and spectral power literature

The original Reinforcement Sensitivity Theory (oRST) proposes two systems of approach (BAS) and avoidance (BIS) motivation to underpin personality and behavior. The revised-RST (rRST) model separates avoidance motivation into passive (BIS; anxiety) and active (FFFS; fear) systems. Prior research has attempted to map RST onto lateralized frontal asymmetry to provide a neurophysiological marker of RST. The main aim is to examine the relationships of the o/rRST scales with trait (baseline) and state (manipulated through experimental paradigms) frontal asymmetry. A systematic review was conducted, resulting in 158 studies designated to neuroimaging research. In total, 54 studies were included in this review using either frontal asymmetry or spectral power. The results were split into three main categories: resting frontal alpha asymmetry (N = 23), emotional induction and state-related frontal alpha asymmetry (N = 20), and spectral analysis (N = 16). Findings indicated that BAS was associated with enhanced left frontal asymmetry at baseline and during state-related paradigms. Findings for BIS were more inconsistent, especially at rest, suggesting that BIS, in particular, may require active engagement with the environment. Only 9 of the 54 papers included used the revised RST model, highlighting the need for more rRST research.

A meta-analysis of electrophysiological biomarkers of reward and error monitoring in substance misuse

Substance use disorders are characterized by marked changes in reward and error processing. The primary objective of this meta-analysis was to estimate effect sizes for the reward positivity (RewP) and error-related negativity (ERN), two event-related potential indicators of outcome monitoring, in substance users compared to controls. The secondary objective was to test for moderation by demographic, substance type, and EEG experiment parameters. Final PubMed searches were performed in August 2023. Inclusion criteria were substance use disorder/dependence or validated self-report of substance misuse, RewP/ERN means available, healthy control comparison group, non-acute drug study, peer-reviewed journal, English language, and human participants. Selection bias was tested through modified Egger's regression and exploratory 3-parameter selection model tests. The RewP results (19 studies, 1641 participants) did not support an overall effect (Hedges' g = 0.07, 95% CI [-0.44, 0.58], p = .777) and nor effect of any moderators. The ERN results (20 studies, 1022 participants) indicated no significant overall effect (g = 0.41, 95%CI [-0.05, 0.88]). Subgroup analyses indicated that cocaine users had a blunted ERN compared to controls (g = 1.12, 95%CI [0.77, 1.47]). There was limited evidence for publication/small study bias. Although the results indicate a potential dissociation between substance types, this meta-analysis revealed the need for additional research on the RewP/ERN in substance using populations and for better designed experiments that adequately address research questions.

Prediction-error-dependent processing of immediate and delayed positive feedback

Learning often involves trial-and-error, i.e. repeating behaviours that lead to desired outcomes, and adjusting behaviour when outcomes do not meet our expectations and thus lead to prediction errors (PEs). PEs have been shown to be reflected in the reward positivity (RewP), an event-related potential (ERP) component between 200 and 350 ms after performance feedback which is linked to striatal processing and assessed via electroencephalography (EEG). Here we show that this is also true for delayed feedback processing, for which a critical role of the hippocampus has been suggested. We found a general reduction of the RewP for delayed feedback, but the PE was similarly reflected in the RewP and the later P300 for immediate and delayed positive feedback, while no effect was found for negative feedback. Our results suggest that, despite processing differences between immediate and delayed feedback, positive PEs drive feedback processing and learning irrespective of delay.

Hypoactivation of ventromedial frontal cortex in major depressive disorder: an MEG study of the Reward Positivity

Background

The Reward Positivity (RewP) is sensitive and specific electrophysiological marker of reward receipt. These characteristics make it a compelling candidate marker of dysfunctional reward processing in major depressive disorder. We previously proposed that the RewP is a nexus of multiple aspects of reward variance, and that a diminished RewP in depression might only reflect a deficit in some of this variance. Specifically, we predicted a diminished ventromedial contribution in depression in the context of maintained reward learning.

Methods

Here we collected magnetoencephalographic (MEG) recordings of reward receipt in 43 individuals with major depressive disorder (MDD group) and 38 healthy controls (CTL group). MEG allows effective source estimation due to the absence of volume conduction that compromises electroencephalographic recordings.

Results

The MEG RewP analogue was generated by a broad set of cortical areas, yet only right ventromedial and right ventral temporal areas were diminished in MDD. These areas correlated with a principal component of anhedonia derived from multiple questionnaires. Compellingly, BA25 was the frontal region with the largest representation in both of these effects.

Conclusions

These findings not only advance our understanding underlying the computation of the RewP, but they also dovetail with convergent findings from other types of functional source imaging in depression, as well as from deep brain stimulation treatments. Together, these discoveries suggest that the RewP may be a valuable marker for objective assessment of reward affect and its disruption in major depression.

Same allocation proposed by an individual or a group elicits distinct responses: Evidence from event-related potentials and neural oscillation

People tend to perceive the same information differently depending on whether it is expressed in an individual or a group frame. It has also been found that the individual (vs. group) frame of expression tends to lead to more charitable giving and greater tolerance of wealth inequality. However, little is known about whether the same resource allocation in social interactions elicits distinct responses depending on proposer type. Using the second-party punishment task, this study examined whether the same allocation from different proposers (individual vs. group) leads to differences in recipient behavior and the neural mechanisms. Behavioral results showed that reaction times were longer in the unfair (vs. fair) condition, and this difference was more pronounced when the proposer was the individual (vs. group). Neural results showed that proposer type (individual vs. group) influenced early automatic processing (indicated by AN1, P2, and central alpha band), middle processing (indicated by MFN and right frontal theta band), and late elaborative processing (indicated by P3 and parietal alpha band) of fairness in resource allocation. These results revealed more attentional resources were captured by the group proposer in the early stage of fairness processing, and more cognitive resources were consumed by processing group-proposed unfair allocations in the late stage, possibly because group proposers are less identifiable than individual proposers. The findings provide behavioral and neural evidence for the effects of "individual/group" framing leading to cognitive differences. They also deliver insights into social governance issues, such as punishing individual and/or group violations.

Social and Monetary Reward Processing in Youth with Early Emerging Personality Pathology: An RDoC-Informed Study

Very little is known about the mechanisms underlying the development of personality disorders, hindering efforts to address early risk for these costly and stigmatized disorders. In this study, we examined associations between social and monetary reward processing, measured at the neurophysiological level, and personality pathology, operationalized through the Level of Personality Functioning (LPF), in a sample of early adolescent females (Mage = 12.21 years old, SD = 1.21). Female youth with (n = 80) and without (n = 30) a mental health history completed laboratory tasks assessing social and monetary reward responsiveness using electroencephalogram (EEG) and completed ratings of personality pathology. Commonly co-occurring psychopathology, including depression, anxiety, attention-deficit/hyperactivity disorder (ADHD), oppositional defiant disorder (ODD), and conduct disorder (CD) were also assessed. At the bivariate level, significant associations did not emerge between psychopathology and reward processing variables. When covarying symptoms of depression, anxiety, ADHD, ODD, and CD, an enhanced reward positivity (RewP) component to social reward feedback (accounting for response to social rejection) was associated with higher levels of personality impairment. Results were specific to social rather than monetary reward processing. Depression, anxiety, and ODD also explained unique variance in LPF. These findings suggest that alterations in social reward processing may be a key marker for early emerging personality pathology. Future work examining the role of social reward processing on the development of LPF across adolescence may guide efforts to prevent the profound social dysfunction associated with personality pathology.

Depth recordings of the mouse homologue of the Reward Positivity

We recently advanced a rodent homologue for the reward-specific, event-related potential component observed in humans known as the Reward Positivity. We sought to determine the cortical source of this signal in mice to further test the nature of this homology. While similar reward-related cortical signals have been identified in rats, these recordings were all performed in cingulate gyrus. Given the value-dependent nature of this event, we hypothesized that more ventral prelimbic and infralimbic areas also contribute important variance to this signal. Depth probes assessed local field activity in 29 mice (15 males) while they completed multiple sessions of a probabilistic reinforcement learning task. Using a priori regions of interest, we demonstrated that the depth of recording in the cortical midline significantly correlated with the size of reward-evoked delta band spectral activity as well as the single trial correlation between delta power and reward prediction error. These findings provide important verification of the validity of this translational biomarker of reward responsiveness, learning, and valuation.

Agranular frontal cortical microcircuit underlying cognitive control in macaques

The error-related negativity and an N2-component recorded over medial frontal cortex index core functions of cognitive control. While they are known to originate from agranular frontal areas, the underlying microcircuit mechanisms remain elusive. Most insights about microcircuit function have been derived from variations of the so-called canonical microcircuit model. These microcircuit architectures are based extensively on studies from granular sensory cortical areas in monkeys, cats, and rodents. However, evidence has shown striking cytoarchitectonic differences across species and differences in the functional relationships across cortical layers in agranular compared to granular sensory areas. In this minireview, we outline a tentative microcircuit model underlying cognitive control in the agranular frontal cortex of primates. The model incorporates the main GABAergic interneuron subclasses with specific laminar arrangements and target regions on pyramidal cells. We emphasize the role of layer 5 pyramidal cells in error and conflict detection. We offer several specific questions necessary for creating a specific intrinsic microcircuit model of the agranular frontal cortex.

Feedback-related brain activity in individual decision: evidence from a gambling EEG study

In this study, based on scalp electroencephalogram (EEG), we conducted cortical source localization and functional network analyses to investigate the underlying mechanism explaining the decision processes when individuals anticipate maximizing gambling benefits, particularly in situations where the decision outcomes are inconsistent with the profit goals. The findings shed light on the feedback monitoring process, wherein incongruity between outcomes and gambling goals triggers a more pronounced medial frontal negativity and activates the frontal lobe. Moreover, long-range theta connectivity is implicated in processing surprise and uncertainty caused by inconsistent feedback conditions, while middle-range delta coupling reflects a more intricate evaluation of feedback outcomes, which subsequently modifies individual decision-making for optimizing future rewards. Collectively, these findings deepen our comprehension of decision-making under circumstances where the profit goals are compromised by decision outcomes and provide electrophysiological evidence supporting adaptive adjustments in individual decision strategies to achieve maximum benefit.

Prefrontal signals precede striatal signals for biased credit assignment in motivational learning biases

Actions are biased by the outcomes they can produce: Humans are more likely to show action under reward prospect, but hold back under punishment prospect. Such motivational biases derive not only from biased response selection, but also from biased learning: humans tend to attribute rewards to their own actions, but are reluctant to attribute punishments to having held back. The neural origin of these biases is unclear. Specifically, it remains open whether motivational biases arise primarily from the architecture of subcortical regions or also reflect cortical influences, the latter being typically associated with increased behavioral flexibility and control beyond stereotyped behaviors. Simultaneous EEG-fMRI allowed us to track which regions encoded biased prediction errors in which order. Biased prediction errors occurred in cortical regions (dorsal anterior and posterior cingulate cortices) before subcortical regions (striatum). These results highlight that biased learning is not a mere feature of the basal ganglia, but arises through prefrontal cortical contributions, revealing motivational biases to be a potentially flexible, sophisticated mechanism.

Dissociable neural after-effects of cognitive and physical effort expenditure during reward evaluation

The reward after-effect of effort expenditure refers to the phenomenon that previous effort investment changes the subjective value of rewards when obtained. However, the neural mechanisms underlying the after-effects of effort exertion are still not fully understood. We investigated the modulation of reward after-effects by effort type (cognitive vs. physical) through the lens of neural dynamics. Thirty-two participants performed a physically or cognitively demanding task during an effort phase and then played a simple gambling game during a subsequent reward phase to earn monetary rewards while their electroencephalogram (EEG) was recorded. We found that previous effort expenditure decreased electrocortical activity during feedback evaluation. Importantly, this effort effect occurred in a domain-general manner during the early stage (as indexed by the reward positivity) but in a domain-specific manner during the later and more elaborative stage (as indexed by the P3 and delta oscillation) of reward evaluation. Additionally, effort expenditure enhanced P3 sensitivity to feedback valence regardless of effort type. Our findings suggest that cognitive and physical effort, although bearing some surface resemblance to each other, may have dissociable neural influences on the reward after-effects.

Human thalamic low-frequency oscillations correlate with expected value and outcomes during reinforcement learning

Reinforcement-based adaptive decision-making is believed to recruit fronto-striatal circuits. A critical node of the fronto-striatal circuit is the thalamus. However, direct evidence of its involvement in human reinforcement learning is lacking. We address this gap by analyzing intra-thalamic electrophysiological recordings from eight participants while they performed a reinforcement learning task. We found that in both the anterior thalamus (ATN) and dorsomedial thalamus (DMTN), low frequency oscillations (LFO, 4-12 Hz) correlated positively with expected value estimated from computational modeling during reward-based learning (after outcome delivery) or punishment-based learning (during the choice process). Furthermore, LFO recorded from ATN/DMTN were also negatively correlated with outcomes so that both components of reward prediction errors were signaled in the human thalamus. The observed differences in the prediction signals between rewarding and punishing conditions shed light on the neural mechanisms underlying action inhibition in punishment avoidance learning. Our results provide insight into the role of thalamus in reinforcement-based decision-making in humans.

Mothers exhibit higher neural activity in gaining rewards for their children than for themselves

Are people willing to exert greater effort to obtain rewards for their children than they are for themselves? Although previous studies have demonstrated that social distance influences neural responses to altruistic reward processing, the distinction between winning rewards for oneself and winning them for one's child is unclear. In the present study, a group of 31 mothers performed a monetary incentive delay task in which cue-induced reward anticipations of winning a reward for themselves, their children and donation to a charity program were manipulated trial-wise, followed by performance-contingent feedback. Behaviorally, the anticipation of winning a reward for their children accelerated participants' responses. Importantly, the electroencephalogram results revealed that across the reward anticipation and consumption phases, the child condition elicited comparable or higher brain responses of participants than the self condition did. The source localization results showed that participants' reward anticipations for their children were associated with more activation in the social brain regions, compared to winning a reward for themselves or a charity donation. Overall, these findings advance our understanding of the neural mechanisms of altruistic reward processing and suggest that the priority of winning a reward for one's child may transcend the limits of the self-advantage effect in reward processing.

Affective imagery boosts the reward related delta power in hazardous drinkers

The Reward Positivity (RewP) is an event-related potential component with a delta band spectral representation that is elicited by reward receipt. Evidence suggests that RewP is modulated by both reward probability as well as affective valuation ("liking"). Here we determined whether RewP is a marker of enhanced hedonic salience of alcohol images in hazardous drinkers. We recruited 54 participants (Hazardous Drinkers = 28, Control = 26) who completed a reinforcement learning task with affective versus alcohol imagery during feedback. The learning task used images of puppies vs. alcohol paired with reinforcing feedback. Both groups rated categories of affective images (puppies, scenery, babies, neutral) similarly, but the hazardous drinking group rated alcohol significantly higher. There were no group differences in performance or in RewP amplitudes, even as a function of alcohol imagery. Contrary to prior findings, we did not observe a significant correlation between alcohol image rating and alcohol-specific RewP amplitude, although we did observe this relationship with the alcohol-specific delta band spectral representation of RewP. Within hazardous drinking group, there was significant correlation between hazardous drinking (AUDIT score) and alcohol-specific RewP indicating an inter-individual influence of drinking habits on affect specific RewP. These findings suggest a domain-specific enhancement of reward responsiveness in hazardous drinkers.

EEG Phase Can Be Predicted with Similar Accuracy across Cognitive States after Accounting for Power and Signal-to-Noise Ratio

EEG phase is increasingly used in cognitive neuroscience, brain-computer interfaces, and closed-loop stimulation devices. However, it is unknown how accurate EEG phase prediction is across cognitive states. We determined the EEG phase prediction accuracy of parieto-occipital alpha waves across rest and task states in 484 participants over 11 public datasets. We were able to track EEG phase accurately across various cognitive conditions and datasets, especially during periods of high instantaneous alpha power and signal-to-noise ratio (SNR). Although resting states generally have higher accuracies than task states, absolute accuracy differences were small, with most of these differences attributable to EEG power and SNR. These results suggest that experiments and technologies using EEG phase should focus more on minimizing external noise and waiting for periods of high power rather than inducing a particular cognitive state.

Dissociated modulations of intranasal vasopressin on prosocial learning between reward-seeking and punishment-avoidance

BACKGROUND

As an integral ingredient of human sociality, prosocial behavior requires learning what acts can benefit or harm others. However, it remains unknown how individuals adjust prosocial learning to avoid punishment or to pursue reward. Given that arginine vasopressin (AVP) is a neuropeptide that has been involved in modulating various social behaviors in mammals, it could be a crucial neurochemical facilitator that supports prosocial learning.

METHODS

In 50 placebo controls and 54 participants with AVP administration, we examined the modulation of AVP on the prosocial learning characterized by reward and punishment framework, as well as its underlying neurocomputational mechanisms combining computational modeling, event-related potentials and oscillations.

RESULTS

We found a self-bias that individuals learn to avoid punishment asymmetrically more severely than reward-seeking. Importantly, AVP increased behavioral performances and learning rates when making decisions to avoid losses for others and to obtain gains for self. These behavioral effects were underpinned by larger responses of stimulus-preceding negativity (SPN) to anticipation, as well as higher punishment-related feedback-related negativity (FRN) for prosocial learning and reward-related P300 for proself benefits, while FRN and P300 neural processes were integrated into theta (4-7 Hz) oscillation at the outcome evaluation stage.

CONCLUSIONS

These results suggest that AVP context-dependently up-regulates altruism for concerning others' losses and reward-seeking for self-oriented benefits. Our findings provide insight into the selectively modulatory roles of AVP in prosocial behaviors depending on learning contexts between proself reward-seeking and prosocial punishment-avoidance.

Neural dissociation between reward and salience prediction errors through the lens of optimistic bias

The question of how the brain represents reward prediction errors is central to reinforcement learning and adaptive, goal-directed behavior. Previous studies have revealed prediction error representations in multiple electrophysiological signatures, but it remains elusive whether these electrophysiological correlates underlying prediction errors are sensitive to valence (in a signed form) or to salience (in an unsigned form). One possible reason concerns the loose correspondence between objective probability and subjective prediction resulting from the optimistic bias, that is, the tendency to overestimate the likelihood of encountering positive future events. In the present electroencephalography (EEG) study, we approached this question by directly measuring participants' idiosyncratic, trial-to-trial prediction errors elicited by subjective and objective probabilities across two experiments. We adopted monetary gain and loss feedback in Experiment 1 and positive and negative feedback as communicated by the same zero-value feedback in Experiment 2. We provided electrophysiological evidence in time and time-frequency domains supporting both reward and salience prediction error signals. Moreover, we showed that these electrophysiological signatures were highly flexible and sensitive to an optimistic bias and various forms of salience. Our findings shed new light on multiple presentations of prediction error in the human brain, which differ in format and functional role.

Electrophysiological Markers of Aberrant Cue-Specific Exploration in Hazardous Drinkers

Background

Hazardous drinking is associated with maladaptive alcohol-related decision-making. Existing studies have often focused on how participants learn to exploit familiar cues based on prior reinforcement, but little is known about the mechanisms that drive hazardous drinkers to explore novel alcohol cues when their value is not known.

Methods

We investigated exploration of novel alcohol and non-alcohol cues in hazardous drinkers (N = 27) and control participants (N = 26) during electroencephalography (EEG). A normative computational model with two free parameters was fit to estimate participants' weighting of the future value of exploration and immediate value of exploitation.

Results

Hazardous drinkers demonstrated increased exploration of novel alcohol cues, and conversely, increased probability of exploiting familiar alternatives instead of exploring novel non-alcohol cues. The motivation to explore novel alcohol stimuli in hazardous drinkers was driven by an elevated relative future valuation of uncertain alcohol cues. P3a predicted more exploratory decision policies driven by an enhanced relative future valuation of novel alcohol cues. P3b did not predict choice behavior, but computational parameter estimates suggested that hazardous drinkers with enhanced P3b to alcohol cues were likely to learn to exploit their immediate expected value.

Conclusions

Hazardous drinkers did not display atypical choice behavior, different P3a/P3b amplitudes, or computational estimates to novel non-alcohol cues-diverging from previous studies in addiction showing atypical generalized explore-exploit decisions with non-drug-related cues. These findings reveal that cue-specific neural computations may drive aberrant alcohol-related decision-making in hazardous drinkers-highlighting the importance of drug-relevant cues in studies of decision-making in addiction.

Cerebral Projection of Mirrored Touch via sLORETA Imaging

Touch is one of the primary communication tools. Interestingly, the sensation of touch can also be experienced when observed in another person. Due to the system of mirror neurons, it is, in fact, being mapped on the somatosensory cortex of the observer. This phenomenon can be triggered not only by observing touch in another individual, but also by a mirror reflection of the contralateral limb. Our study aims to evaluate and localize changes in the intracerebral source activity via sLORETA imaging during the haptic stimulation of hands, while modifying this contact by a mirror illusion. A total of 10 healthy volunteers aged 23-42 years attended the experiment. The electrical brain activity was detected via scalp EEG. First, we registered the brain activity during resting state with open and with closed eyes, each for 5 min. Afterwards, the subjects were seated at a table with a mirror reflecting their left hand and occluding their right hand. The EEG was then recorded in 2 min sequencies during four modifications of the experiment (haptic contact on both hands, stimulation of the left hand only, right hand only and without any tactile stimuli). We randomized the order of the modifications for each participant. The obtained EEG data were converted into the sLORETA program and evaluated statistically at the significance level of p ≤ 0.05. The subjective experience of all the participants was registered using a survey. A statistically significant difference in source brain activity occurred during all four modifications of our experiment in the beta-2, beta-3 and delta frequency bands, resulting in the activation of 10 different Brodmann areas varying by modification. The results suggest that the summation of stimuli secured by interpersonal haptic contact modified by mirror illusion can activate the brain areas integrating motor, sensory and cognitive functions and further areas related to communication and understanding processes, including the mirror neuron system. We believe these findings may have potential for therapy.

Alpha Event-Related Desynchronization During Reward Processing in Schizophrenia

BACKGROUND

Alterations in the brain's reward system may underlie motivation and pleasure deficits in schizophrenia (SZ). Neuro-oscillatory desynchronization in the alpha band is thought to direct resource allocation away from the internal state, to prioritize processing salient environmental events, including reward feedback. We hypothesized reduced reward-related alpha event-related desynchronization (ERD) in SZ, consistent with less externally focused processing during reward feedback.

METHODS

Electroencephalography was recorded while participants with SZ (n = 54) and healthy control participants (n = 54) played a simple slot machine task. Total alpha band power (8-14 Hz), a measure of neural oscillation magnitude, was extracted via principal component analysis and compared between groups and reward outcomes. The clinical relevance of hypothesized alpha power alterations was examined by testing associations with negative symptoms within the SZ group and with trait rumination, dimensionally, across groups.

RESULTS

A group × reward outcome interaction (p = .018) was explained by healthy control participants showing significant posterior-occipital alpha power suppression to wins versus losses (p < .001), in contrast to participants with SZ (p > .1). Among participants with SZ, this alpha ERD was unrelated to negative symptoms (p > .1). Across all participants, less alpha ERD to reward outcomes covaried with greater trait rumination for both win (p = .005) and loss (p = .002) outcomes, with no group differences in slope.

CONCLUSIONS

These findings demonstrate alpha ERD alterations in SZ during reward outcome processing. Additionally, higher trait rumination was associated with less alpha ERD during reward feedback, suggesting that individual differences in rumination covary with external attention to reward processing, regardless of reward outcome valence or group membership.

Electrophysiological signatures of reward learning in the rodent touchscreen-based Probabilistic Reward Task

Blunted reward learning and reward-related activation within the corticostriatal-midbrain circuitry have been implicated in the pathophysiology of anhedonia and depression. Unfortunately, the search for more efficacious interventions for anhedonic behaviors has been hampered by the use of vastly different preclinical and clinical assays. In a first step in addressing this gap, in the current study, we used event-related potentials and spectral analyses in conjunction with a touchscreen version of the rodent Probabilistic Reward Task (PRT) to identify the electrophysiological signatures of reward learning in rats. We trained 11 rats (5 females and 6 males) on the rodent touchscreen-based PRT and subsequently implanted them with deep electrodes in the anterior cingulate cortex (ACC) and nucleus accumbens (NAc) for local field potentials recordings during the PRT. Behaviorally, the expected responsivity-to-reward profile was observed. At the electrophysiological level, we identified a negative amplitude deflection 250-500 ms after feedback in the ACC and NAc electrodes, as well as power increase in feedback-locked delta (1-5 Hz) and alpha/beta (9-17 Hz) bands in both electrodes for rewarded trials. Using a reverse-translational approach, we identified electrophysiological signatures of reward learning in rats similar to those described in humans. These findings and approaches might provide a useful translational platform to efficiently evaluate novel therapeutics targeting anhedonia.

All the Pringle ladies: Neural and behavioral responses to high-calorie food rewards in young adult women

Reward processing is vital for learning and survival, and can be indexed using the Reward Positivity (RewP), an event-related potential (ERP) component that is larger for rewards than losses. Prior work suggests that heightened motivation to obtain reward, as well as greater reward value, is associated with an enhanced RewP. However, the extent to which internal and external factors modulate neural responses to rewards, and whether such neural responses motivate reward-seeking behavior, remains unclear. The present study investigated whether the degree to which a reward is salient to an individual's current motivational state modulates the RewP, and whether the RewP predicts motivated behaviors, in a sample of 133 women. To elicit the RewP, participants completed a forced-choice food reward guessing task. Data were also collected on food-related behaviors (i.e., type of food chosen, consumption of the food reward) and motivational salience factors (i.e., self-reported hunger, time since last meal, and subjective "liking" of food reward). Results showed that hungrier participants displayed an enhanced RewP compared to less hungry individuals. Further, self-reported snack liking interacted with RewP magnitude to predict behavior, such that when participants reported low levels of snack liking, those with a smaller RewP were more likely to consume their snacks than those with a larger RewP. Our data suggest that food-related motivational state may increase neural sensitivity to food reward in young women, and that neural markers of reward sensitivity might interact with subjective reward liking to predict real-world eating behavior.

Reduced positive affect alters reward learning via reduced information encoding in the Reward Positivity

Reward Positivity (RewP) is a feedback-locked event-related potential component that is specifically elicited by rewarding feedback and scales with positive reward prediction error, a hallmark of reinforcement learning models. The RewP is also diminished in depression, suggesting that it may be a novel marker of anhedonia. Here, we examined if a sad mood induction offered an opportunity to causally induce a mood-related alteration of the RewP and reward-related learning. In Experiment 1 (N = 50 total), participants were randomly assigned to previously established sad or neutral mood induction procedures before a probabilistic selection task. This manipulation failed to induce changes in affect, suggesting that standard methods are inadequate. In Experiment 2 (N = 50 total), participants were randomly assigned to newly developed happy versus sad mood manipulations, which successfully induced large changes in affect. While the RewP was unaffected by mood induction, positive mood moderated the relationship between prediction error encoding in the RewP and reward learning, such that low positive mood and low prediction error encoding resulted in poorer reward learning. These findings provide a mechanistic example of how reduced positive affect moderates reward learning via poorer information encoding in the RewP.

Borderline personality features and altered social feedback processing in emerging adults: An EEG study

The goal of this study was to examine social feedback processing among emerging adults with borderline personality features (BPF). Participants (N = 118; 66.9% female) completed ratings of BPF and a computerized peer interaction task designed to measure processing of rejection and acceptance cues at the neurophysiological (i.e., electroencephalogram [EEG]), behavioral, and self-report levels. When covarying symptoms of depression and social anxiety, greater BPF were associated with heightened neural processing of social acceptance cues, accounting for reactivity to neutral and rejection cues, as demonstrated by an enhanced reward positivity (RewP) component. Additionally, BPF were associated with less adaptive voting in response to peer acceptance, such that emerging adults with higher BPF made fewer votes to keep peers in the game who had provided acceptance feedback to participants. These neural and behavioral patterns associated with BPF highlight the potential role of social reward processing in borderline personality. Specifically, emerging adults high in BPF show a hyper-responsiveness to social acceptance at the neural level but difficulty modulating behavioral responses in an adaptive way to obtain more social rewards. Future research replicating these effects across development may guide efforts to address and prevent the profound social dysfunction associated with BPF.

Dissociable feedback valence effects on frontal midline theta during reward gain versus threat avoidance learning

While frontal midline theta (FMθ) has been associated with threat processing, with cognitive control in the context of anxiety, and with reinforcement learning, most reinforcement learning studies on FMθ have used reward rather than threat-related stimuli as reinforcer. Accordingly, the role of FMθ in threat-related reinforcement learning is largely unknown. Here, n = 23 human participants underwent one reward-, and one punishment-, based reversal learning task, which differed only with regard to the kind of reinforcers that feedback was tied to (i.e., monetary gain vs. loud noise burst, respectively). In addition to single-trial EEG, we assessed single-trial feedback expectations based on both a reinforcement learning computational model and trial-by-trial subjective feedback expectation ratings. While participants' performance and feedback expectations were comparable between the reward and punishment tasks, FMθ was more reliably amplified to negative vs. positive feedback in the reward vs. punishment task. Regressions with feedback valence, computationally derived, and self-reported expectations as predictors and FMθ as criterion further revealed that trial-by-trial variations in FMθ specifically relate to reward-related feedback-valence and not to threat-related feedback or to violated expectations/prediction errors. These findings suggest that FMθ as measured in reinforcement learning tasks may be less sensitive to the processing of events with direct relevance for fear and anxiety.

Reward-based decision-making in mesial temporal lobe epilepsy patients with unilateral hippocampal sclerosis pre- and post-surgery

BACKGROUND

Correct functioning of the reward processing system is critical for optimizing decision-making as well as preventing the development of addictions and/or neuropsychiatric symptoms such as depression, apathy, and anhedonia. Consequently, patients with mesial temporal lobe epilepsy due to unilateral hippocampal sclerosis (mTLE-UHS) represent an excellent opportunity to study the brain networks involved in this system.

OBJECTIVE

The aim of the current study was to evaluate decision-making and the electrophysiological correlates of feedback processing in a sample of mTLE-UHS patients, compared to healthy controls. In addition, we assessed the impact of mesial temporal lobe surgical resection on these processes, as well as general, neuropsychological functioning.

METHOD

17 mTLE-UHS patients and 17 matched healthy controls completed: [1] a computerized version of the Game of Dice Task, [2] a Standard Iowa Gambling Task, and [3] a modified ERP version of a probabilistic gambling task coupled with multichannel electroencephalography. Neuropsychological scores were also obtained both pre- and post-surgery.

RESULTS

Behavioral analyses showed a pattern of increased risk for the mTLE-UHS group in decision-making under ambiguity compared to the control group. A decrease in the amplitude of the Feedback Related Negativity (FRN), a weaker effect of valence on delta power, and a general reduction of delta and theta power in the mTLE-UHS group, as compared to the control group, were also found. The beta-gamma activity associated with the delivery of positive reward was similar in both groups. Behavioral performance and electrophysiological measures did not worsen post-surgery.

CONCLUSIONS

Patients with mTLE-UHS showed impairments in decision-making under ambiguity, particularly when they had to make decisions based on the outcomes of their choices, but not in decision-making under risk. No group differences were observed in decision-making when feedbacks were random. These results might be explained by the abnormal feedback processing seen in the EEG activity of patients with mTLE-UHS, and by concomitant impairments in working memory, and memory. These impairments may be linked to the disruption of mesial temporal lobe networks. Finally, feedback processing and decision-making under ambiguity were already affected in mTLE-UHS patients pre-surgery and did not show evidence of clear worsening post-surgery.

Electrophysiological evidence for the effects of pain on the different stages of reward evaluation under a purchasing situation

Pain and reward have crucial roles in determining human behaviors. It is still unclear how pain influences different stages of reward processing. This study aimed to assess the physical pain’s impact on reward processing with event-related potential (ERP) method. In the present study, a flash sale game (reward-seeking task) was carried out, in which the participants were instructed to press a button as soon as possible to obtain the earphone (a reward) after experiencing either electric shock or not and finally evaluated the outcome of their response. High-temporal-resolution electroencephalogram data were simultaneously recorded to reveal the neural mechanism underlying the pain effect. The ERP analyses revealed that pain affected the feedback processing reflected by feedback-related negativity (FRN) and P300. Specifically, participants in the nopain situation exhibited greater FRN discrepancy between success and failure feedbacks relative to that in the pain situation. Moreover, the P300 amplitude was enhanced in the nopain condition compared to the pain condition regardless of the feedback valence. These results demonstrate that the pain reduced the sensitivity to the reward valence at the early stage and weakened the motivational salience at the late stage. Altogether, this study extends the understanding of the effect of pain on reward processing from the temporal perspective under a purchasing situation.

Expectations of immediate and delayed reward differentially affect cognitive task performance

The current study used a modified Monetary Incentive Delay task to examine the neural mechanisms underlying anticipating and receiving an immediate or delayed reward and examined the influence of pursuing these rewards on cognitive task performance. A pre-cue indicating the potential of gaining a monetary reward (immediate-, delayed-, vs. no-reward) was followed by a target stimulus requiring a fast and accurate response. Then, response-contingent feedback was presented indicating whether or not the participant would receive the corresponding reward. Linear mixed-effect models revealed the fastest behavioural responses and the strongest neural activity, as reflected in event-related-potentials and event-related-spectral-perturbation responses, for immediate reward, followed by delayed reward, with the slowest behavioural responses and the weakest neural activities observed in the no-reward condition. Expectations related to the cue-P3 component and the cue-delta activities predicted behavioural performance, especially in the immediate reward condition. Moreover, exploratory analyses revealed that depression moderated the relationship between target-locked neural activity and behavioural performance in the delayed reward condition, with lower neural activity being related to worse behavioural performance amongst participants scoring high on depression. These results indicate that differential value representations formed through delay discounting directly affect neural responses in reward processing and directly influence the effort invested in the current task, which is reflected by behavioural responses and is in agreement with the expected value of control theory.

Disentangling performance-monitoring signals encoded in feedback-related EEG dynamics

The feedback-related negativity (FRN) is a well-established electrophysiological correlate of feedback-processing. However, there is still an ongoing debate whether the FRN is driven by negative or positive reward prediction errors (RPE), valence of feedback, or mere surprise. Our study disentangles independent contributions of valence, surprise, and RPE on the feedback-related neuronal signal including the FRN and P3 components using the statistical power of a sample of N = 992 healthy individuals. The participants performed a modified time-estimation task, while EEG from 64 scalp electrodes was recorded. Our results show that valence coding is present during the FRN with larger amplitudes for negative feedback. The FRN is further modulated by surprise in a valence-dependent way being more positive-going for surprising positive outcomes. The P3 was strongly driven by both global and local surprise, with larger amplitudes for unexpected feedback and local deviants. Behavioral adaptations after feedback and FRN just show small associations. Results support the theory of the FRN as a representation of a signed RPE. Additionally, our data indicates that surprising positive feedback enhances the EEG response in the time window of the P3. These results corroborate previous findings linking the P3 to the evaluation of PEs in decision making and learning tasks.

The reward positivity is sensitive to affective liking

The EEG feature known as the Reward Positivity (RewP) is elicited by reward receipt and appears to reflect sensitively and specifically positive prediction errors during reinforcement learning. Yet, the RewP also is modulated by state and trait affect, suggesting that it has a more complex computational role than simple reinforcement surprise. We conducted a series of experiments aimed to investigate underlying affect processing reflected in the RewP during a reinforcement learning task. In the first experiment (N = 25), we manipulated the type of rewards a person could win (simple points or hedonically-appraised pictures). Although there were no differences in the amplitudes of the RewP for different types of rewards, there was a significant correlation between the individual rating of liking for the images and RewP amplitude. In a second experiment (N = 25), we manipulated reinforcement rates (easy vs. hard) and affective picture content (liked vs. ambivalent) to examine the potential interaction of prediction error and liking on RewP amplitude. We again found a significant relationship between liking and RewP amplitude, however, only in the hard condition. These findings suggest that the RewP reflects cortical computations of reward surprise as well as hedonic liking, identifying it as a possible nexus where multidimensional value is computed.

Amphetamine alters an EEG marker of reward processing in humans and mice

The bench-to-bedside development of pro-cognitive therapeutics for psychiatric disorders has been mired by translational failures. This is, in part, due to the absence of pharmacologically sensitive cognitive biomarkers common to humans and rodents. Here, we describe a cross-species translational marker of reward processing that is sensitive to the aminergic agonist, d-amphetamine. Motivated by human electroencephalographic (EEG) findings, we recently reported that frontal midline delta-band power is an electrophysiological biomarker of reward surprise in humans and in mice. In the current series of experiments, we determined the impact of parametric doses of d-amphetamine on this reward-related EEG response from humans (n = 23) and mice (n = 28) performing a probabilistic learning task. In humans, d-amphetamine (placebo, 10 mg, 20 mg) boosted the Reward Positivity event-related potential (ERP) component as well as the spectral delta-band representations of this signal. In mice, d-amphetamine (placebo, 0.1 mg/kg, 0.3 mg/kg, 1.0 mg/kg) boosted both reward and punishment ERP features, yet there was no modulation of spectral activities. In sum, the present results confirm the role of dopamine in the generation of the Reward Positivity in humans, and pave the way toward a pharmacologically valid biomarker of reward sensitivity across species.

On second thought … the influence of a second stage in the ultimatum game on decision behavior, electro-cortical correlates and their trait interrelation

Previous EEG research only investigated one stage ultimatum games (UGs). We investigated the influence of a second bargaining stage in an UG concerning behavioral responses, electro-cortical correlates and their moderations by the traits altruism, anger, anxiety, and greed in 92 participants. We found that an additional stage led to more rejection in the 2-stage UG (2SUG) and that increasing offers in the second stage compared to the first stage led to more acceptance. The FRN during a trial was linked to expectance evaluation concerning the fairness of the offers, while midfrontal theta was a marker for the needed cognitive control to overcome the respective default behavioral pattern. The FRN responses to unfair offers were more negative for either low or high altruism in the UG, while high trait anxiety led to more negative FRN responses in the first stage of 2SUG, indicating higher sensitivity to unfairness. Accordingly, the mean FRN response, representing the trait-like general electrocortical reactivity to unfairness, predicted rejection in the first stage of 2SUG. Additionally, we found that high trait anger led to more rejections for unfair offer in 2SUG in general, while trait altruism led to more rejection of unimproving unfair offers in the second stage of 2SUG. In contrast, trait anxiety led to more acceptance in the second stage of 2SUG, while trait greed even led to more acceptance if the offer was worse than in the stage before. These findings suggest, that 2SUG creates a trait activation situation compared to the UG.

Randomized trial of rTMS in traumatic brain injury: improved subjective neurobehavioral symptoms and increases in EEG delta activity

PRIMARY OBJECTIVE

While repetitive transcranial magnetic stimulation (rTMS) has shown efficacy for cognitive difficulties accompanying depression, it is unknown if it can improve cognition in persons with traumatic brain injury.

RESEARCH DESIGN

Using a sham-controlled crossover design, we tested the capacity of high frequency rTMS of the prefrontal cortex to improve neuropsychological performance in attention, learning and memory, and executive function.

METHODS

Twenty-six participants with cognitive complaints and a history of mild-to-moderate traumatic brain injury were randomly assigned to receive first either active or sham 10 Hz stimulation for 20 minutes (1200 pulses) per session for five consecutive days. After a one-week washout, the other condition (active or sham) was applied. Pre- and post-treatment measures included neuropsychological tests, cognitive and emotional symptoms, and EEG.

MAIN OUTCOMES AND RESULTS

Results indicated no effect of treatment on cognitive function. Subjective measures of depression, sleep dysfunction, post-concussive symptoms (PCS), and executive function showed significant improvement with stimulation, retaining improved levels at two-week follow-up. EEG delta power exhibited elevation one week after stimulation cessation.

CONCLUSIONS

While there is no indication that rTMS is beneficial for neuropsychological performance, it may improve PCS and subjective cognitive dysfunction. Long-term alterations in cortical oscillations may underlie the therapeutic effects of rTMS.

Effect of reward and punishment on no-risk decision-making in young men: an EEG study

Decision-making is a process that allows adapting behavior in response to feedback to achieve a goal. Previous studies have suggested that the cerebral cortex shows different activation patterns in response to feedback. However, the effects of reward and punishment on learning contexts and decision-making are not clear. Thus, this experiment compared the effects of reward and punishment on behavior and the electroencephalographic activity of cortical areas related to decision-making in a no-risk context. Twenty healthy males were asked to perform a decision-making task under two conditions in which the goal was to finish in the shortest time possible. In the reward condition, the more points the participant accumulated the sooner the task ended, while in the punishment condition, the more points accumulated the longer the task lasted. Lower reaction times were found in the reward condition, characterized by a higher absolute power of the slow bands in almost all the cortices recorded. Changes in the interhemispheric correlation were also obtained in the comparison of the two feedback conditions. Results suggest that changes in the type of feedback affect cortical functionality and behavioral execution during decision-making, with the reward being related to a quick emotional response strategy and punishment associated with slower and, likely, more reasoned responses.

Win, lose, or draw: Examining salience, reward memory, and depression with the reward positivity

The reward positivity (RewP) is a putative biomarker of depression. Careful control of stimulus properties and manipulation of both stimulus valence and salience could facilitate interpretation of the RewP. RewP interpretation could further be improved by investigating functional outcomes of a blunted RewP in depression, such as reduced memory for rewarding outcomes. This study sought to advance RewP interpretation first by advancing task design through use of neutral (i.e., draw) control trials and counterbalanced feedback stimuli. Second, we examined the RewP's association with memory and the impact of depression. Undergraduates completed self-report measures of depression and anhedonia prior to a modified doors task in which words were displayed in colored fonts that indicated win, loss, or draw feedback. Memory of the feedback associated with each word (i.e., source memory) was tested. Results showed that RewP response to wins was more positive than to losses, which was more positive than to draws. The RewP was not associated with depression or anhedonia. The low depression group showed a source memory advantage for win words, but the high depression group did not. Source memory showed small relations to the RewP, but these did not survive Bonferroni correction. Results suggest the RewP is sensitive to salience and highlight challenges in detecting an association between the RewP and depression in modified doors tasks. Findings indicate that depression is related to dysfunctional source memory for reward but not loss and that future research should probe the possible associations between the RewP and memory in depression.

Reward, Salience, and Agency in Event-Related Potentials for Appetitive and Aversive Contexts

Cognitive architectures tasked with swiftly and adaptively processing biologically important events are likely to classify these on two central axes: motivational salience, that is, those events' importance and unexpectedness, and motivational value, the utility they hold, relative to that expected. Because of its temporal precision, electroencephalography provides an opportunity to resolve processes associated with these two axes. A focus of attention for the last two decades has been the feedback-related negativity (FRN), a frontocentral component occurring 240-340 ms after valenced events that are not fully predicted. Both motivational salience and value are present in such events and competing claims have been made for which of these is encoded by the FRN. The present study suggests that motivational value, in the form of a reward prediction error, is the primary determinant of the FRN in active contexts, while in both passive and active contexts, a weaker and earlier overlapping motivational salience component may be present.

Electrophysiological biomarkers of behavioral dimensions from cross-species paradigms

There has been a fundamental failure to translate preclinically supported research into clinically efficacious treatments for psychiatric disorders. One of the greatest impediments toward improving this species gap has been the difficulty of identifying translatable neurophysiological signals that are related to specific behavioral constructs. Here, we present evidence from three paradigms that were completed by humans and mice using analogous procedures, with each task eliciting candidate a priori defined electrophysiological signals underlying effortful motivation, reinforcement learning, and cognitive control. The effortful motivation was assessed using a progressive ratio breakpoint task, yielding a similar decrease in alpha-band activity over time in both species. Reinforcement learning was assessed via feedback in a probabilistic learning task with delta power significantly modulated by reward surprise in both species. Additionally, cognitive control was assessed in the five-choice continuous performance task, yielding response-locked theta power seen across species, and modulated by difficulty in humans. Together, these successes, and also the teachings from these failures, provide a roadmap towards the use of electrophysiology as a method for translating findings from the preclinical assays to the clinical settings.

Parametric Cortical Representations of Complexity and Preference for Artistic and Computer-Generated Fractal Patterns Revealed by Single-Trial EEG Power Spectral Analysis

Fractals are self-similar patterns that repeat at different scales, the complexity of which are expressed as a fractional Euclidean dimension D between 0 (a point) and 2 (a filled plane). The drip paintings of American painter Jackson Pollock (JP) are fractal in nature, and Pollock's most illustrious works are of the high-D (~1.7) category. This would imply that people prefer more complex fractal patterns, but some research has instead suggested people prefer lower-D fractals. Furthermore, research has suggested that parietal and frontal brain activity tracks the complexity of fractal patterns, but previous research has artificially binned fractals depending on fractal dimension, rather than treating fractal dimension as a parametrically varying value. We used white layers extracted from JP artwork as stimuli, and constructed statistically matched 2-dimensional random Cantor sets as control stimuli. We recorded the electroencephalogram (EEG) while participants viewed the JP and matched random Cantor fractal patterns. Participants then rated their subjective preference for each pattern. We used a single-trial analysis to construct within-subject models relating subjective preference to fractal dimension D, as well as relating D and subjective preference to single-trial EEG power spectra. Results indicated that participants preferred higher-D images for both JP and Cantor stimuli. Power spectral analysis showed that, for artistic fractal images, parietal alpha and beta power parametrically tracked complexity of fractal patterns, while for matched mathematical fractals, parietal power tracked complexity of patterns over a range of frequencies, but most prominently in alpha band. Furthermore, parietal alpha power parametrically tracked aesthetic preference for both artistic and matched Cantor patterns. Overall, our results suggest that perception of complexity for artistic and computer-generated fractal images is reflected in parietal-occipital alpha and beta activity, and neural substrates of preference for complex stimuli are reflected in parietal alpha band activity.

Sequential gains and losses during gambling feedback: Differential effects in time-frequency delta and theta measures

One critical aspect of reward-feedback is the impact of local outcome history-how past experiences with choices and outcomes influences current behavior and neural activity. Yet, prior event-related potential work in this area has been contentious. This study contributes to this field by using time-frequency measures to better isolate constituent processes. Specifically, we identify how theta and delta are differentially sensitive to local outcome history. Participants completed a binary monetary choice task while we collected EEG data. Unbeknownst to them, trial outcomes were manipulated into pre-determined sequences, ranging from one to eight gains or losses in a row. Analyses were arranged by sequence establishment (first 2 trials of a sequence) and continuation (prolonged sequences of 3-8 trials). During the establishment of a sequence, delta activity to gains and losses were virtually identical on the first (change) trial, demonstrating marked divergence only on the second trial. This difference grew throughout the continuation period, as delta activity was sustained with accruing gains but declined with multiple losses. Theta activity, conversely, demonstrated a maximal loss-gain difference on the change trial but was insensitive to the establishment of a new sequence. Differential theta activity between outcomes decreased as sequences continued, with theta activity increasing over accruing gains and remaining stable over losses. Results indicate that delta-gain and theta-loss signals are relatively stable across sequential outcomes. Furthermore, theta is most sensitive to loss-gain differences on the initial change trial, while delta is more sensitive to gain-loss differences with the continuation of a sequence.

Single-trial modeling separates multiple overlapping prediction errors during reward processing in human EEG

Learning signals during reinforcement learning and cognitive control rely on valenced reward prediction errors (RPEs) and non-valenced salience prediction errors (PEs) driven by surprise magnitude. A core debate in reward learning focuses on whether valenced and non-valenced PEs can be isolated in the human electroencephalogram (EEG). We combine behavioral modeling and single-trial EEG regression to disentangle sequential PEs in an interval timing task dissociating outcome valence, magnitude, and probability. Multiple regression across temporal, spatial, and frequency dimensions characterized a spatio-tempo-spectral cascade from early valenced RPE value to non-valenced RPE magnitude, followed by outcome probability indexed by a late frontal positivity. Separating negative and positive outcomes revealed the valenced RPE value effect is an artifact of overlap between two non-valenced RPE magnitude responses: frontal theta feedback-related negativity on losses and posterior delta reward positivity on wins. These results reconcile longstanding debates on the sequence of components representing reward and salience PEs in the human EEG.

Causal role of cross-frequency coupling in distinct components of cognitive control

Cognitive control is the capacity to guide motor and perceptual systems towards abstract goals. High-frequency neural oscillations related to motor activity in the beta band (13-30 Hz) and to visual processing in the gamma band (>30 Hz) are known to be modulated by cognitive control signals. One proposed mechanism for cognitive control is via cross-frequency coupling whereby low frequency network oscillations in prefrontal cortex (delta from 2-3 Hz and theta from 4-8 Hz) guide the expression of motor-related activity in action planning and guide perception-related activity in memory access. However, there is no causal evidence for cross-frequency coupling in these dissociable components of cognitive control. To address this important gap in knowledge, we delivered cross-frequency transcranial alternating current stimulation (CF-tACS) during performance of a task that manipulated cognitive control demands along two dimensions: the abstraction of the rules of the task (nested levels of action selection) that increased delta-beta coupling and the number of rules (set-size held in memory) that increased theta-gamma coupling. As hypothesized, we found that CF-tACS increased the targeted phase-amplitude coupling and modulated task performance of the associated cognitive control component. These findings provide causal evidence that prefrontal cortex orchestrates different components of cognitive control via two different cross-frequency coupling modalities.

The aversion positivity: Mediofrontal cortical potentials reflect parametric aversive prediction errors and drive behavioral modification following negative reinforcement

Reinforcement learning capitalizes on prediction errors (PEs), representing the deviation of received outcomes from expected outcomes. Mediofrontal event-related potentials (ERPs), in particular the feedback-related negativity (FRN)/reward positivity (RewP), are related to PE signaling, but there is disagreement as to whether the FRN/RewP encode signed or unsigned PEs. PE encoding can potentially be dissected by time-frequency analysis, as frontal theta [4-8 Hz] might represent poor outcomes, while central delta [1-3 Hz] might instead represent rewarding outcomes. However, cortical PE signaling in negative reinforcement is still poorly understood, and the role of cortical PE representations in behavioral reinforcement learning following negative reinforcement is relatively unexplored. We recorded EEG while participants completed a task with matched positive and negative reinforcement outcome modalities, with parametrically manipulated single-trial outcomes producing positive and negative PEs. We first demonstrated that PEs systematically influence future behavior in both positive and negative reinforcement conditions. In negative reinforcement conditions, mediofrontal ERPs positively signaled unsigned PEs in a time window encompassing the P2 potential, and negatively signaled signed PEs for a time window encompassing the FRN/RewP and frontal P3 (an "aversion positivity"). Central delta power increased parametrically with increasingly aversive outcomes, contributing to the "aversion positivity". Finally, negative reinforcement ERPs correlated with RTs on the following trial, suggesting cortical PEs guide behavioral adaptations. Positive reinforcement PEs did not influence ERP or time-frequency activity, despite significant behavioral effects. These results demonstrate that mediofrontal PE signals are a mechanism underlying negative reinforcement learning, and that delta power increases for aversive outcomes might contribute to the "aversion positivity."