Learning something new versus changing your ways: Distinct effects on midfrontal oscillations and cardiac activity for learning and flexible adjustments

Freedom of choice boosts midfrontal theta power during affective feedback processing of goal-directed actions

Sense of agency, the feeling of being in control of one's actions and their effects, is particularly relevant during goal-directed actions. During feedback learning, action effects provide information about the best course of action to reinforce positive and prevent negative outcomes. However, it is unclear whether agency experience selectively affects the processing of negative or positive feedback during the performance of goal-directed actions. As an important marker of feedback processing, we examined agency-related changes in midfrontal oscillatory activity in response to performance feedback using electroencephalography. Thirty-three participants completed a reinforcement learning task during which they received positive (monetary gain) or negative (monetary loss) feedback following item choices made either by themselves (free-choice) or by the computer (forced-choice). Independent of choice context, midfrontal theta activity was more enhanced for negative than positive feedback. In addition, free, compared to forced choices increased midfrontal theta power for both gain and loss feedback. These results indicate that freedom of choice in a motivationally salient learning task leads to a general enhancement in the processing of affective action outcomes. Our findings contribute to an understanding of the neuronal mechanisms underlying agency-related changes during action regulation and indicate midfrontal theta activity as a neurophysiological marker important for the monitoring of affective action outcomes, irrespective of feedback valence.

Midfrontal theta as an index of conflict strength in approach-approach vs avoidance-avoidance conflicts

The seminal theory of motivational conflicts distinguishes between approach-approach (AP-AP) conflicts, in which a decision is made between desirable alternatives, and avoidance-avoidance (AV-AV) conflicts, in which a decision is made between undesirable alternatives. The behavioral differences between AP-AP and AV-AV conflicts are well documented: abundant research showed that AV-AV conflicts are more difficult to resolve than AP-AP ones. However, there is little to no research looking into the neural underpinnings of the differences between the two conflict types. Here, we show that midfrontal theta, an established neural marker of conflict, distinguished between the two conflict types such that midfrontal theta power was higher in AV-AV conflicts than in AP-AP conflicts. We further demonstrate that higher midfrontal theta power was associated with shorter decision times on a single-trial basis, indicating that midfrontal theta played a role in promoting successful controlled behavior. Taken together, our results show that AP-AP and AV-AV conflicts are distinguishable on the neural level. The implications of these results go beyond motivational conflicts, as they establish midfrontal theta as a measure of the continuous degree of conflict in subjective decisions.

Function without feeling: neural reactivity and intercommunication during flexible motor adjustments evoked by emotional and neutral stimuli

Motor conflicts arise when we need to quickly overwrite prepotent behavior. It has been proposed that affective stimuli modulate the neural processing of motor conflicts. However, previous studies have come to inconsistent conclusions regarding the neural impact of affective information on conflict processing. We employed functional magnetic resonance imaging during a Go/Change-Go task, where motor conflicts were either evoked by neutral or emotionally negative stimuli. Dynamic causal modeling was used to investigate how motor conflicts modulate the intercommunication between the anterior cingulate cortex (ACC) and the anterior insula (AI) as 2 central regions for cognitive control. Conflicts compared to standard actions were associated with increased BOLD activation in several brain areas, including the dorsal ACC and anterior insula. There were no differences in neural activity between emotional and non-emotional conflict stimuli. Conflicts compared to standard actions lowered neural self-inhibition of the ACC and AI and led to increased effective connectivity from the ACC to AI contralateral to the acting hand. Thus, our study indicates that neural conflict processing is primarily driven by the functional relevance of action-related stimuli, not their inherent affective meaning. Furthermore, it sheds light on the role of interconnectivity between ACC and AI for the implementation of flexible behavioral change.

An Action-Independent Role for Midfrontal Theta Activity Prior to Error Commission

Error-related electroencephalographic (EEG) signals have been widely studied concerning the human cognitive capability of differentiating between erroneous and correct actions. Midfrontal error-related negativity (ERN) and theta band oscillations are believed to underlie post-action error monitoring. However, it remains elusive how early monitoring activity is trackable and what are the pre-response brain mechanisms related to performance monitoring. Moreover, it is still unclear how task-specific parameters, such as cognitive demand or motor control, influence these processes. Here, we aimed to test pre- and post-error EEG patterns for different types of motor responses and investigate the neuronal mechanisms leading to erroneous actions. We implemented a go/no-go paradigm based on keypresses and saccades. Participants received an initial instruction about the direction of response to be given based on a facial cue and a subsequent one about the type of action to be performed based on an object cue. The paradigm was tested in 20 healthy volunteers combining EEG and eye tracking. We found significant differences in reaction time, number, and type of errors between the two actions. Saccadic responses reflected a higher number of premature responses and errors compared to the keypress ones. Nevertheless, both led to similar EEG patterns, supporting previous evidence for increased ERN amplitude and midfrontal theta power during error commission. Moreover, we found pre-error decreased theta activity independent of the type of action. Source analysis suggested different origin for such pre- and post-error neuronal patterns, matching the anterior insular cortex and the anterior cingulate cortex, respectively. This opposite pattern supports previous evidence of midfrontal theta not only as a neuronal marker of error commission but also as a predictor of action performance. Midfrontal theta, mostly associated with alert mechanisms triggering behavioral adjustments, also seems to reflect pre-response attentional mechanisms independently of the action to be performed. Our findings also add to the discussion regarding how salience network nodes interact during performance monitoring by suggesting that pre- and post-error patterns have different neuronal sources within this network.

Preparing for Success: Neural Frontal Theta and Posterior Alpha Dynamics during Action Preparation Predict Flexible Resolution of Cognitive Conflicts

Cognitive conflicts typically arise in situations that call for sudden changes in our behavior. Resolving cognitive conflicts is challenging and prone to errors. Humans can improve their chances to successfully resolve conflicts by mentally preparing for potential behavioral adjustments. Previous studies indicated that neural theta oscillations (4-7 Hz), as well as alpha oscillations (8-14 Hz), are reflective of cognitive control processes during conflict resolution. However, the role or neural oscillations for conflict preparation is still unclear. Therefore, the aim of the current study was to determine which oscillatory changes during conflict preparation predict subsequent resolution success. Participants performed a cued change-signal task, in which an anticipatory cue indicated if the upcoming trial might contain a cognitive conflict or not. Oscillatory activity was assessed via EEG. Cues that indicated that a conflict might arise compared with cues that indicated no conflict led to increases, directly followed by decreases, in theta power, as well as to decreases in alpha power. These cue-induced changes in theta and alpha oscillations occurred widespread across the cortex. Importantly, successful compared with failed conflict trials were characterized by selective increases in frontal theta power, as well as decreases in posterior alpha power during preparation. In addition, higher frontal theta power and lower posterior alpha power during preparation predicted faster conflict resolution. Our study shows that increases in frontal theta power, as well as decreases in posterior alpha power, are markers of optimal preparation for situations that necessitate flexible changes in behavior.

From the inside out: Interoceptive feedback facilitates the integration of visceral signals for efficient sensory processing

Neuroscientific studies have mainly focused on the way humans perceive and interact with the external world. Recent work in the interoceptive domain indicates that the brain predictively models information from inside the body such as the heartbeat and that the efficiency with which this is executed can have implications for exteroceptive processing. However, to date direct evidence underpinning these hypotheses is lacking. Here, we show how the brain predictively refines neural resources to process afferent cardiac feedback and uses these interoceptive cues to enable more efficient processing of external sensory information. Participants completed a repetition-suppression paradigm consisting of a neutral repeating face. During the first face presentation, they heard auditory feedback of their heartbeat which either coincided with the systole of the cardiac cycle, the time at which cardiac events are registered by the brain or the diastole during which the brain receives no internal cardiac feedback. We used electroencephalography to measure the heartbeat evoked potential (HEP) as well as auditory (AEP) and visual evoked potentials (VEP). Exteroceptive cardiac feedback which coincided with the systole produced significantly higher HEP amplitudes relative to feedback timed to the diastole. Elevation of the HEP in this condition was followed by significant suppression of the VEP in response to the repeated neutral face and a stepwise decrease of AEP amplitude to repeated heartbeat feedback. Our results hereby show that exteroceptive heartbeat feedback coinciding with interoceptive signals at systole enhanced interoceptive cardiac processing. Furthermore, the same cue facilitating interoceptive integration enabled efficient suppression of a visual stimulus, as well as repetition suppression of the AEP across successive auditory heartbeat feedback. Our findings provide evidence that the alignment of external to internal signals can enhance the efficiency of interoceptive processing and that cues facilitating this process in either domain have beneficial effects for internal as well as external sensory processing.

A developmental examination of medial frontal theta dynamics and inhibitory control

Medial frontal theta-band oscillations are a robust marker of action-outcome monitoring. In a large developmental sample (n = 432, 9-16 years), we examined whether phase and non-phase locked medial frontal theta power were related to inhibitory control among children and adolescents. Our results showed that the well-established increase in medial frontal theta power during inhibitory control was captured largely by non-phase locked dynamics, which partially mediated the positive effect of age on task performance. A person-centered approach also revealed latent classes of individuals based on their multivariate theta power dynamics (phase locked/non-phase locked, GO/NOGO). The class of individuals showing low phase locked and high non-phase locked medial frontal theta were significantly older, had better inhibitory control, scored higher on measures of general cognitive function, and were more efficient in their behavioural responses. The functional significance of phase and non-phase locked theta dynamics, and their potential changes, could have important implications for action-outcome monitoring and cognitive function in both typical and atypical development, as well as related psychopathology .

The Interplay Between Affective Processing and Sense of Agency During Action Regulation: A Review

Sense of agency is the feeling of being in control of one's actions and their perceivable effects. Most previous research identified cognitive or sensory determinants of agency experience. However, it has been proposed that sense of agency is also bound to the processing of affective information. For example, during goal-directed actions or instrumental learning we often rely on positive feedback (e.g., rewards) or negative feedback (e.g., error messages) to determine our level of control over the current task. Nevertheless, we still lack a scientific model which adequately explains the relation between affective processing and sense of agency. In this article, we review current empirical findings on how affective information modulates agency experience, and, conversely, how sense of agency changes the processing of affective action outcomes. Furthermore, we discuss in how far agency-related changes in affective processing might influence the ability to enact cognitive control and action regulation during goal-directed behavior. A preliminary model is presented for describing the interplay between sense of agency, affective processing, and action regulation. We propose that affective processing could play a role in mediating the influence between subjective sense of agency and the objective ability to regulate one's behavior. Thus, determining the interrelation between affective processing and sense of agency will help us to understand the potential mechanistic basis of agency experience, as well as its functional significance for goal-directed behavior.

Motor Interference, But Not Sensory Interference, Increases Midfrontal Theta Activity and Brain Synchronization during Reactive Control

Cognitive control helps us to overcome task interference in challenging situations. Resolving conflicts because of interfering influences is believed to rely on midfrontal theta oscillations. However, different sources of interference necessitate different types of control. Attentional control is needed to suppress salient distractors. Motor control is needed to suppress goal-incompatible action impulses. While previous studies mostly studied the additive effects of attentional and motor conflicts, we independently manipulated the need for attentional control (via visual distractors) and motor control (via unexpected response deviations) in an EEG study with male and female humans. We sought to find out whether these different types of control rely on the same midfrontal oscillatory mechanisms. Motor conflicts, but not attentional conflicts, elicited increases in midfrontal theta power during conflict resolution. Independent of the type of conflict, theta power was predictive of motor slowing. Connectivity analysis via phase-based synchronization indicated a widespread increase interbrain connectivity for motor conflicts, but a midfrontal-to-posterior decrease in connectivity for attentional conflicts. For each condition, we found stronger midfrontal connectivity with the parietal region contralateral to, rather than ipsilateral to, the acting hand. Parietal lateralization in connectivity was strongest for motor conflicts. Previous studies suggested that midfrontal theta oscillations might represent a general control mechanism, which aids conflict resolution independent of the conflict domain. In contrast, our results show that oscillatory theta dynamics during reactive control mostly reflect motor-related adjustments.SIGNIFICANCE STATEMENT Humans need to exercise self-control over both their attention (to avoid distraction) and their motor activity (to suppress inappropriate action impulses). Midfrontal theta oscillations have been assumed to indicate a general control mechanism, which help to exert top-down control during both motor and sensory interference. We are using a novel approach for the independent manipulation of attentional and motor control to show that increases in midfrontal theta power and brainwide connectivity are linked to the top-down adjustments of motor responses, not sensory interference. These findings clarify the function of midfrontal theta dynamics as a key aspect of neural top-down control and help to dissociate domain-general from motor-specific aspects of self-control.