Pupil dilation in the Simon task as a marker of conflict processing

Hearing Impairment: Reduced Pupil Dilation Response and Frontal Activation During Degraded Speech Perception

PURPOSE

A relevant aspect of listening is the effort required during speech processing, which can be assessed by pupillometry. Here, we assessed the pupil dilation response of normal-hearing (NH) and hard of hearing (HH) individuals during listening to clear sentences and masked or degraded sentences. We combined this assessment with functional magnetic resonance imaging (fMRI) to investigate the neural correlates of the pupil dilation response.

METHOD

Seventeen NH participants (Mage = 46 years) were compared to 17 HH participants (Mage = 45 years) who were individually matched in age and educational level. Participants repeated sentences that were presented clearly, that were distorted, or that were masked. The sentence intelligibility level of masked and distorted sentences was 50% correct. Silent baseline trials were presented as well. Performance measures, pupil dilation responses, and fMRI data were acquired.

RESULTS

HH individuals had overall poorer speech reception than the NH participants, but not for noise-vocoded speech. In addition, an interaction effect was observed with smaller pupil dilation responses in HH than in NH listeners for the degraded speech conditions. Hearing impairment was associated with higher activation across conditions in the left superior temporal gyrus, as compared to the silent baseline. However, the region of interest analysis indicated lower activation during degraded speech relative to clear speech in bilateral frontal regions and the insular cortex, for HH compared to NH listeners. Hearing impairment was also associated with a weaker relation between the pupil response and activation in the right inferior frontal gyrus. Overall, degraded speech evoked higher frontal activation than clear speech.

CONCLUSION

Brain areas associated with attentional and cognitive-control processes may be increasingly recruited when speech is degraded and are related to the pupil dilation response, but this relationship is weaker in HH listeners.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.27162135.

Pupillary response to cognitive control in depression-prone individuals

Revealing the pupillary correlates of depression-prone individuals is conducive to the early intervention and treatment of depression. This study recruited 31 depression-prone and 31 healthy individuals. They completed an emotional task-switching task combined with a go/no-go task, and task-evoked pupillary responses (TEPR) were recorded. Behavioral results showed no significant differences in behavioral performance in terms of cognitive flexibility and inhibition between the depression-prone group and the healthy control group. The pupillary results revealed that (1) the depression-prone group showed slightly lower TEPRs to positive stimuli than the healthy controls during cue presentation; (2) during target presentation, the depression-prone group did not show an effect of emotional valence on the pupillary response in the task-repeat trials; and (3) compared to the healthy controls, the depression-prone group showed significantly smaller TEPRs to negative no-go stimuli and had a longer latency of the second peak of pupil dilation in no-go trials. These results imply that depression-prone individuals may have slower neural responses in cognitive control tasks and emotion-specific weakened cognitive control than healthy individuals.

Pupil dilation reflects effortful action invigoration in overcoming aversive Pavlovian biases

"Pavlovian" or "motivational" biases describe the phenomenon that the valence of prospective outcomes modulates action invigoration: Reward prospect invigorates action, whereas punishment prospect suppresses it. The adaptive role of these biases in decision-making is still unclear. One idea is that they constitute a fast-and-frugal decision strategy in situations characterized by high arousal, e.g., in presence of a predator, which demand a quick response. In this pre-registered study (N = 35), we tested whether such a situation-induced via subliminally presented angry versus neutral faces-leads to increased reliance on Pavlovian biases. We measured trial-by-trial arousal by tracking pupil diameter while participants performed an orthogonalized Motivational Go/NoGo Task. Pavlovian biases were present in responses, reaction times, and even gaze, with lower gaze dispersion under aversive cues reflecting "freezing of gaze." The subliminally presented faces did not affect responses, reaction times, or pupil diameter, suggesting that the arousal manipulation was ineffective. However, pupil dilations reflected facets of bias suppression, specifically the physical (but not cognitive) effort needed to overcome aversive inhibition: Particularly strong and sustained dilations occurred when participants managed to perform Go responses to aversive cues. Conversely, no such dilations occurred when they managed to inhibit responses to Win cues. These results suggest that pupil diameter does not reflect response conflict per se nor the inhibition of prepotent responses, but specifically effortful action invigoration as needed to overcome aversive inhibition. We discuss our results in the context of the "value of work" theory of striatal dopamine.

Overcoming resistance to belief revision and correction of misinformation beliefs: psychophysiological and behavioral effects of a counterfactual mindset

In a series of experiments involving beliefs and misinformation beliefs, we find that individuals who are prompted with a counterfactual mindset are significantly more likely to change their existing beliefs when presented with evidence that contradicts their beliefs. While research finds that beliefs that are considered part of one's identity are highly resistant to change in the face of evidence that challenges these beliefs, four experiments provide evidence that counterfactual generation causes individuals to adjust beliefs and correct misinformation beliefs in response to contradicting evidence. Indeed, we find that a counterfactual mindset was effective in promoting incorporation of accurate facts and causing individuals to revise misinformation beliefs about COVID vaccination safety for a large sample of individuals who have rejected COVID vaccinations. Finally, the results of the psychophysiological experiment reveal that counterfactual generation alters decision makers' search strategies, increases their cognitive arousal in response to evidence that challenges their beliefs, and increases their desire to seek out disconfirming evidence. Overall, the four experiments indicate that counterfactual generation can effectively activate mindsets that increase individuals' willingness to evaluate evidence that contradicts their beliefs and adjust their beliefs in response to evidence.

Sequence effects and speech processing: cognitive load for speaker-switching within and across accents

Prior work in speech processing indicates that listening tasks with multiple speakers (as opposed to a single speaker) result in slower and less accurate processing. Notably, the trial-to-trial cognitive demands of switching between speakers or switching between accents have yet to be examined. We used pupillometry, a physiological index of cognitive load, to examine the demands of processing first (L1) and second (L2) language-accented speech when listening to sentences produced by the same speaker consecutively (no switch), a novel speaker of the same accent (within-accent switch), and a novel speaker with a different accent (across-accent switch). Inspired by research on sequential adjustments in cognitive control, we aimed to identify the cognitive demands of accommodating a novel speaker and accent by examining the trial-to-trial changes in pupil dilation during speech processing. Our results indicate that switching between speakers was more cognitively demanding than listening to the same speaker consecutively. Additionally, switching to a novel speaker with a different accent was more cognitively demanding than switching between speakers of the same accent. However, there was an asymmetry for across-accent switches, such that switching from an L1 to an L2 accent was more demanding than vice versa. Findings from the present study align with work examining multi-talker processing costs, and provide novel evidence that listeners dynamically adjust cognitive processing to accommodate speaker and accent variability. We discuss these novel findings in the context of an active control model and auditory streaming framework of speech processing.

To err is human- to understand error-processing is divine: Contributions of working memory and anxiety to error-related brain and pupil responses

Both anxiety and working memory capacity appear to predict increased (more negative) error-related negativity (ERN) amplitudes, despite being inversely related to one another. Until the interactive effects of these variables on the ERN are clarified, there may be challenges posed to our ability to use the ERN as an endophenotype for anxiety, as some have suggested. The compensatory error monitoring hypothesis suggests that high trait-anxiety individuals have larger ERN amplitudes because they must employ extra, compensatory efforts to override the working memory demands of their anxiety. Yet, to our knowledge, no ERN study has employed direct manipulation of working memory demands in conjunction with direct manipulations of induced (state) anxiety. Furthermore, little is known about how these manipulations affect other measures of error processing, such as the error-related pupil dilation response and post-error behavioral adjustments. Therefore, we manipulate working memory load and anxiety in a 2 × 2 within-subjects design to examine the interactive effects of working memory load and anxiety on ERN amplitude, error-related pupil dilation response amplitude, and post-error behavior. There were no effects of our manipulations on ERN amplitude, suggesting a strong interpretation of compensatory error-processing theory. However, our worry manipulation affected post-error behavior, such that worry caused a reduction in post-error accuracy. Additionally, our working memory manipulation affected error-related PDR magnitude and the amplitude of the error-related positivity (Pe), such that increased working memory load decreased the amplitude of these responses. Implications of these results within the context of the compensatory error processing framework are discussed.

Action-orientation shields against primed cognitive conflict effects on effort-related cardiac response

This article presents a quasi-experiment (N = 79 university students) testing whether individual differences in action-state orientation moderate primed cognitive conflict's effects on sympathetically mediated cardiac response during task performance reflecting effort. Action control theory posits that action-oriented individuals are less receptive to distracting affective stimuli during goal pursuit than state-oriented individuals because action-orientation is related to higher volitional skills. Therefore, we expected that action-oriented individuals should be shielded against conflict primes' effect on effort-related responses in the cardiovascular system. By contrast, state-oriented individuals should be more sensitive to irrelevant negative affective stimulation and therefore mobilize higher resources under such conditions. Responses of the cardiac pre-ejection period (PEP) during a moderately difficult short-term memory task corroborated these predictions. The present findings provide the first evidence that individual differences in action-state orientation indeed moderate previously demonstrated cognitive conflict priming effects on effort-related cardiac response and extend recent findings on action shielding.

Novelty and learning in cognitive control: evidence from the Simon task

While information that is associated with inappropriate responses can interfere with an ongoing task and be detrimental to performance, cognitive control mechanisms and specific contextual conditions can alleviate interference from unwanted information. In the spatial correspondence (Simon) task, interference has been consistently shown to be reduced by spatial non-correspondence in the previous trial (i.e., correspondence sequence effect, CSE); however the mechanisms supporting this sequential effect are not well understood. Here we investigated the role of novelty and trial-to-trial changes in stimulus and response features in a Simon task, observing similar modulation of CSE for novel and non-novel stimulus changes. However, changing the response modality from trial to trial dampened CSE, and this dampening was more pronounced when the probability of switch trials was higher, suggesting a role for long-term learning. The results are consistent with recent accounts, which indicate that spatial interference can be prevented by cognitive control mechanisms triggered by learned bindings.

Is cognitive conflict really effortful? Conflict priming and shielding effects on cardiac response

Two experiments with N = 221 university students investigated the impact of primed cognitive conflict on effort assessed as cardiac response in tasks that were not conflict-related themselves. Manifest cognitive conflict in cognitive control tasks is confounded with objective response difficulty (e.g., in incongruent Stroop task trials). This makes conclusions about the effortfulness of cognitive conflict itself difficult. We bypassed this problem by administrating pictures of congruent versus incongruent Stroop task stimuli as conflict primes. As predicted, primed cognitive conflict increased cardiac pre-ejection period (PEP) responses in an easy attention task in Experiment 1. Accordingly, cognitive conflict itself is indeed effortful. This effect was replicated in an easy short-term memory task in Experiment 2. Moreover, as further predicted, the primed cognitive conflict effect on PEP reactivity disappeared when participants could personally choose task characteristics. This latter effect corresponds to other recent evidence showing that personal action choice shields against incidental affective influences on action execution and especially on effort-related cardiovascular response.

The Use of Pupillometry in Autobiographical Implicit Association Test

The Autobiographical Implicit Association Test (aIAT) is a reaction time-based methodology to assess one's recognition of the truth value of propositions about an autobiographical episode. This study introduced pupillometry to examine its utility as an additional measure of aIAT. Participants blindly chose one of two cards and memorized it. They then underwent the aIAT to assess the cards they chose. The pupil diameter was larger in the block in which sentences related to the chosen card shared the same response key with sentences describing false events than the block in which sentences related to the chosen card shared the same response key with true-event sentences. Although preliminary, pupil measurement also yielded high efficiency in discriminating the chosen card. These results indicate that pupillometry can be used as a measure of aIAT.

Pupil dilation predicts individual self-regulation success across domains

Multiple theories have proposed that increasing central arousal through the brain's locus coeruleus-norepinephrine system may facilitate cognitive control and memory. However, the role of the arousal system in emotion regulation is less well understood. Pupil diameter is a proxy to infer upon the central arousal state. We employed an emotion regulation paradigm with a combination of design features that allowed us to dissociate regulation from emotional arousal in the pupil diameter time course of 34 healthy adults. Pupil diameter increase during regulation predicted individual differences in emotion regulation success beyond task difficulty. Moreover, the extent of this individual regulatory arousal boost predicted performance in another self-control task, dietary health challenges. Participants who harnessed more regulation-associated arousal during emotion regulation were also more successful in choosing healthier foods. These results suggest that a common arousal-based facilitation mechanism may support an individual's self-control across domains.

Real-world stress resilience is associated with the responsivity of the locus coeruleus

Individuals may show different responses to stressful events. Here, we investigate the neurobiological basis of stress resilience, by showing that neural responsitivity of the noradrenergic locus coeruleus (LC-NE) and associated pupil responses are related to the subsequent change in measures of anxiety and depression in response to prolonged real-life stress. We acquired fMRI and pupillometry data during an emotional-conflict task in medical residents before they underwent stressful emergency-room internships known to be a risk factor for anxiety and depression. The LC-NE conflict response and its functional coupling with the amygdala was associated with stress-related symptom changes in response to the internship. A similar relationship was found for pupil-dilation, a potential marker of LC-NE firing. Our results provide insights into the noradrenergic basis of conflict generation, adaptation and stress resilience.

Phasic activity of the locus-coeruleus is not a mediator of the relationship between fitness and inhibition in college-aged adults

Aerobic fitness is consistently and robustly associated with superior performance on assessments of cognitive control. One potential mechanism underlying this phenomenon is activation of the locus-coeruleus. Specifically, individuals with greater aerobic fitness may be better able to sustain engagement in a cognitively demanding task via a superior ability to meet the metabolic demands of this neural system. Accordingly, the present investigation examined 1) the relationship between aerobic fitness and phasic activation of the locus-coeruleus (indexed using pupillometry) and 2) the potential mediating influence of locus-coeruleus activity on the relationship between aerobic fitness and cognitive task performance. Participants performed an inhibition task while their pupillary responses were measured using an infrared eye tracker. A VO_2max test was then performed to determine individuals' aerobic fitness levels. Consistent with previous research, higher levels of aerobic fitness were related to shorter reaction time. However, phasic activity of the locus-coeruleus did not mediate this relationship - nor did it relate to aerobic fitness level. These results suggest that aerobic fitness does not relate to differences in locus-coeruleus activity in the context of cognitive control in college-aged adults.

Top-down effect on pupillary response: Evidence from shape from shading

Shaded 2D images often create an illusion of depth, due to the shading information and assumptions regarding the location of the light source. Specifically, 2D images that are lighter on top usually appear convex while images that are darker on top, usually appear concave, reflecting the assumption that light is coming from above. The process of recovering the 3D shape of a shaded image is called Shape from Shading. Here we examined whether the pupil responds to the illusion of depth in a shape from shading task. In three experiments we show that pupil size is affected by the percept of depth, so that it dilates more when participants perceive the stimulus as concave, compared to when they perceive it as convex. This only happens if participants make a judgment regarding the shape of the stimulus or when they view it passively but are aware of the different shapes. No differences in pupil size were found with passive viewing if participants were not aware of the illusion, suggesting that some aspects of shape from shading require attention. All stimuli were equiluminant, and the percept of depth was created by manipulating the orientation of the shading, so that changes in pupil size could not be accounted by changes in the amount of light in the image. We posit, and confirmed it in a behavioral control experiment, that the perception of depth is translated to a subjective perception of darkness, due to the "darker is deeper" heuristic and conclude that the pupillary physiological response reflects the subjective perception of light.

Linear and non linear measures of pupil size as a function of hypnotizability

Higher arousal and cortical excitability have been observed in high hypnotizable individuals (highs) with respect to low hypnotizables (lows), which may be due to differences in the activation of ascending activating systems. The present study investigated the possible hypnotizability-related difference in the cortical noradrenergic tone sustained by the activity of the Locus Coeruleus which is strongly related to pupil size. This was measured during relaxation in three groups of participants—highs (N = 15), lows (N = 15) and medium hypnotizable individuals (mediums, N = 11)—in the time and frequency domains and through the Recurrence Quantification Analysis. ECG and Skin Conductace (SC) were monitored to extract autonomic indices of relaxation (heart interbeats intervals, parasympathetic component of heart rate variability (RMSSD) and tonic SC (MeanTonicSC). Most variables indicated that participants relaxed throughout the session. Pupil features did not show significant differences between highs, mediums and lows, except for the spectral Band Median Frequency which was higher in mediums than in lows and highs at the beginning, but not at the end of the session.Thus, the present findings of pupil size cannot account for the differences in arousal and motor cortex excitability observed between highs and lows in resting conditions.

Transcutaneous Vagus Nerve Stimulation in Humans Induces Pupil Dilation and Attenuates Alpha Oscillations

Vagus nerve stimulation (VNS) is widely used to treat drug-resistant epilepsy and depression. While the precise mechanisms mediating its long-term therapeutic effects are not fully resolved, they likely involve locus coeruleus (LC) stimulation via the nucleus of the solitary tract, which receives afferent vagal inputs. In rats, VNS elevates LC firing and forebrain noradrenaline levels, whereas LC lesions suppress VNS therapeutic efficacy. Noninvasive transcutaneous VNS (tVNS) uses electrical stimulation that targets the auricular branch of the vagus nerve at the cymba conchae of the ear. However, the extent to which tVNS mimics VNS remains unclear. Here, we investigated the short-term effects of tVNS in healthy human male volunteers (n = 24), using high-density EEG and pupillometry during visual fixation at rest. We compared short (3.4 s) trials of tVNS to sham electrical stimulation at the earlobe (far from the vagus nerve branch) to control for somatosensory stimulation. Although tVNS and sham stimulation did not differ in subjective intensity ratings, tVNS led to robust pupil dilation (peaking 4-5 s after trial onset) that was significantly higher than following sham stimulation. We further quantified, using parallel factor analysis, how tVNS modulates idle occipital alpha (8-13Hz) activity identified in each participant. We found greater attenuation of alpha oscillations by tVNS than by sham stimulation. This demonstrates that tVNS reliably induces pupillary and EEG markers of arousal beyond the effects of somatosensory stimulation, thus supporting the hypothesis that tVNS elevates noradrenaline and other arousal-promoting neuromodulatory signaling, and mimics invasive VNS.SIGNIFICANCE STATEMENT Current noninvasive brain stimulation techniques are mostly confined to modulating cortical activity, as is typical with transcranial magnetic or transcranial direct/alternating current electrical stimulation. Transcutaneous vagus nerve stimulation (tVNS) has been proposed to stimulate subcortical arousal-promoting nuclei, though previous studies yielded inconsistent results. Here we show that short (3.4 s) tVNS pulses in naive healthy male volunteers induced transient pupil dilation and attenuation of occipital alpha oscillations. These markers of brain arousal are in line with the established effects of invasive VNS on locus coeruleus-noradrenaline signaling, and support that tVNS mimics VNS. Therefore, tVNS can be used as a tool for studying how endogenous subcortical neuromodulatory signaling affects human cognition, including perception, attention, memory, and decision-making; and also for developing novel clinical applications.

The Influence of Hearing Loss on Cognitive Control in an Auditory Conflict Task: Behavioral and Pupillometry Findings

Purpose The pupil dilation response is sensitive not only to auditory task demand but also to cognitive conflict. Conflict is induced by incompatible trials in auditory Stroop tasks in which participants have to identify the presentation location (left or right ear) of the words "left" or "right." Previous studies demonstrated that the compatibility effect is reduced if the trial is preceded by another incompatible trial (conflict adaptation). Here, we investigated the influence of hearing status on cognitive conflict and conflict adaptation in an auditory Stroop task. Method Two age-matched groups consisting of 32 normal-hearing participants (M _age = 52 years, age range: 25-67 years) and 28 participants with hearing impairment (M _age = 52 years, age range: 23-64 years) performed an auditory Stroop task. We assessed the effects of hearing status and stimulus compatibility on reaction times (RTs) and pupil dilation responses. We furthermore analyzed the Pearson correlation coefficients between age, degree of hearing loss, and the compatibility effects on the RT and pupil response data across all participants. Results As expected, the RTs were longer and pupil dilation was larger for incompatible relative to compatible trials. Furthermore, these effects were reduced for trials following incompatible (as compared to compatible) trials (conflict adaptation). No general effect of hearing status was observed, but the correlations suggested that higher age and a larger degree of hearing loss were associated with more interference of current incompatibility on RTs. Conclusions Conflict processing and adaptation effects were observed on the RTs and pupil dilation responses in an auditory Stroop task. No general effects of hearing status were observed, but the correlations suggested that higher age and a greater degree of hearing loss were related to reduced conflict processing ability. The current study underlines the relevance of taking into account cognitive control and conflict adaptation processes.

Behavioural manifestations and associated non-motor features of freezing of gait: A narrative review and theoretical framework

Over the past decade, non-motor related symptoms and provocative contexts have offered unique opportunities to gain insight into the potential mechanisms that may underpin freezing of gait (FOG) in Parkinson's disease (PD). While this large body of work has informed several theoretical models, to date, few are capable of explaining behavioural findings across multiple domains (i.e. cognitive, sensory-perceptual and affective) and in different behavorial contexts. As such, the exact nature of these interrelationships and their neural basis remain quite enigmatic. Here, the non-motor, behavioural evidence for cognitive, sensory-perceptual and affective contributors to FOG are reviewed and synthesized by systematically examining (i) studies that manipulated contextual environments that provoke freezing of gait, (ii) studies that uncovered factors that have been proposed to contribute to freezing, and (iii) studies that longitudinally tracked factors that predict the future development of freezing of gait. After consolidating the evidence, we offer a novel perspective for integrating these multi-faceted behavioural patterns and identify key challenges that warrant consideration in future work.

Mind the social feedback: effects of tDCS applied to the left DLPFC on psychophysiological responses during the anticipation and reception of social evaluations

The left dorsolateral prefrontal cortex (lDLPFC) is implicated in anticipatory (i.e. during anticipation of emotional stimuli) and online (i.e. during confrontation with emotional stimuli) emotion regulatory processes. However, research that investigates the causal role of the lDLPFC in these processes is lacking. In this study, 74 participants received active or sham transcranial direct current stimulation (tDCS) over the lDLPFC. Participants were told strangers evaluated them. These (rigged) social evaluations were presented, and in 50% of the trials, participants could anticipate the valence (positive or negative) of the upcoming social feedback. Pupil dilation (a marker of cognitive resource allocation), and skin conductance responses (a marker of arousal) were measured. The results indicate that active (compared to sham) tDCS reduced arousal during the confrontation with anticipated feedback, but only marginally during the confrontation with unanticipated feedback. When participants were given the opportunity to anticipate the social feedback, tDCS reduced arousal, irrespective of whether one was anticipating or being confronted with the anticipated feedback. Moreover, tDCS reduced cognitive resource allocation during anticipation, which was associated with resource allocation increases during the subsequent confrontation. Altogether, results suggest that the lDLPFC is causally implicated in the interplay between anticipatory and online emotion regulatory processes.

Emotion and conflict adaptation: the role of phasic arousal and self-relevance

Conflict adaptation reflects the increase in cognitive control after previous conflict between task-relevant and task-irrelevant information. Tonic (sustained) arousal elicited by emotional words embedded in a conflict task has previously been shown to increase conflict adaptation. However, the role of phasic (transient) emotional arousal remains unclear. In Experiment 1 (N = 55), we therefore investigated the effect of phasic arousal using a colour flanker task with negative, positive, and neutral words as stimuli. We hypothesised that phasic arousal elicited in this context will increase conflict adaptation in the subsequent trial. Indeed, when the words were positive or negative as compared to neutral, we observed increased conflict adaptation. In Experiment 2 (N = 54), we examined the role of the self-relevance by presenting words with a self-related pronoun ("my") or sender-related pronoun ("his"/"her"). We expected that emotional words with high self-relevance would lead to stronger effects of emotional arousal on conflict adaptation. Confirming this hypothesis, results showed that emotional words within a self-related context again increased conflict adaptation, whereas this effect was not observed in the sender-related context. Taken together, these results are the first to show that phasic arousal elicited by emotional words increases conflict adaptation, in particular when these words have high self-relevance.

Memory effects of conflict and cognitive control are processing stage-specific: evidence from pupillometry

An increasing number of studies in the conflict/control and perceptual desirable difficulty literatures show memory benefits for information in high-conflict task situations. Recent work suggests that increased conflict does not produce a task-wide encoding benefit; rather, conflict must focus high-level attention on to-be-tested information to produce an encoding benefit. We used pupil dilation measures to directly assess this stage-specific model of conflict-encoding effects. We show clear performance costs of incongruency (slower RT and larger pupil dilation) with both semantic and response distractors, but show memory benefits only with semantic conflict. Further, when participants were encouraged to focus more (eliciting greater endogenous effort and control for all trials, not just incongruent trials), we observe larger and more similar pupil responses and reduced memory differences between high versus low semantic conflict conditions. These data confirm and extend a stage-specific model of conflict-encoding effects, with converging behavioural and physiological data.

The face of control: Corrugator supercilii tracks aversive conflict signals in the service of adaptive cognitive control

Cognitive control is the ability to monitor, evaluate, and adapt behavior in the service of long‐term goals. Recent theories have proposed that the integral negative emotions elicited by conflict are critical for the adaptive adjustment of cognitive control. However, evidence for the negative valence of conflict in cognitive control tasks mainly comes from behavioral studies that interrupted trial sequences, making it difficult to directly test the link between conflict‐induced affect and subsequent increases in cognitive control. In the present study, we therefore use online measures of valence‐sensitive electromyography (EMG) of the facial corrugator (frowning) and zygomaticus (smiling) muscles while measuring the adaptive cognitive control in a Stroop‐like task. In line with the prediction that conflict is aversive, results showed that conflict relative to non‐conflict trials led to increased activity of the corrugator muscles after correct responses, both in a flanker task (Experiment 1) and in a prime‐probe task (Experiment 2). This conflict‐induced corrugator activity effect correlated marginally with conflict‐driven increases in cognitive control in the next trial in the confound‐minimalized task used in Experiment 2. However, in the absence of performance feedback (Experiment 3), no reliable effect of conflict was observed in the facial muscle activity despite robust behavioral conflict adaptation. Taken together, our results show that facial EMG can be used as an indirect index of the temporal dynamics of conflict‐induced aversive signals and/or effortful processes in particular when performance feedback is presented, providing important new insights into the dynamic affective nature of cognitive control.

Cognitive control plays a pivotal role in goal‐directed behavior. Nevertheless, it still remains elusive what mechanisms determine how cognitive control is recruited. Recent theories have proposed that negative emotions elicited by conflict help to adaptively increase the cognitive control. Although there is indeed accumulating evidence for the negative valence of conflict, no study has yet linked this directly to increased adaptive control. Using valence‐sensitive EMG measures, we here show that conflict is associated with increased activation of the corrugator (frowning) muscle and that the size of this effect predicts the size of conflict‐driven control adjustment in the next trial.

Temporal Dynamics of Human Frontal and Cingulate Neural Activity During Conflict and Cognitive Control

Cognitive control refers to the ability to produce flexible, goal-oriented behavior in the face of changing task demands and conflicting response tendencies. A classic cognitive control experiment is the Stroop-color naming task, which requires participants to name the color in which a word is written while inhibiting the tendency to read the word. By comparing stimuli with conflicting word-color associations to congruent ones, control processes over response tendencies can be isolated. We assessed the spatial specificity and temporal dynamics in the theta and gamma bands for regions engaged in detecting and resolving conflict in a cohort of 13 patients using a combination of high-resolution surface and depth recordings. We show that cognitive control manifests as a sustained increase in gamma band power, which correlates with response time. Conflict elicits a sustained gamma power increase but a transient theta power increase, specifically localized to the left cingulate sulcus and bilateral dorsolateral prefrontal cortex (DLPFC). Additionally, activity in DLPFC is affected by trial-by-trial modulation of cognitive control (the Gratton effect). Altogether, the sustained local neural activity in dorsolateral and medial regions is what determines the timing of the correct response.

How sequential changes in reward expectation modulate cognitive control: Pupillometry as a tool to monitor dynamic changes in reward expectation

Much evidence suggests that positive affect associated with performance-contingent reward modulates cognitive flexibility and stability. For example, in voluntary task switching, it has been shown that unchanged high reward promotes cognitive stability whereas increases or decreases in reward prospect as well as unchanged low reward promote cognitive flexibility (higher voluntary switch rate, VSR). Pupil diameter has been shown to respond to reward prospect, to task switching manipulations, and more generally to effort in cognitive control tasks and thus appears to be the ideal tool to learn more about the processes underlying these reward-modulated decisions. Therefore, we measured pupillary activity in two voluntary task switching experiments with randomly changing reward magnitudes. Behaviorally, VSR was again lowest when reward remained high as compared to all other reward sequences. Baseline pupil diameter was generally higher following switch trials as compared to repetition trials. Furthermore, the pupil responded dynamically to the reward manipulation: Phasic cue- and target-locked pupil dilation was larger in the reward phase as compared to the non-reward baseline block. Most importantly, phasic pupil dilation in the target interval was highest when reward prospect increased and lowest when reward prospect decreased, suggesting that motivational arousal fluctuates in sync with changes in reward expectation. These results are discussed with respect to current theories on cognitive control as a form of affect regulation.

Pupillometric investigation into the speed-accuracy trade-off in a visuo-motor aiming task

Convergent lines of evidence suggest that fluctuations in the size of the pupil may be associated with the trade‐off between the speed (adrenergic, sympathetic) and accuracy (cholinergic, parasympathetic) of behavior across a variety of task contexts. Here, we explored whether pupil size was related to this trade‐off during a visuospatial motor aiming task. Participants were shown visual targets at random locations on a screen and were instructed and incentivized to move a computer mouse‐controlled cursor to the center of the targets, either as fast as possible, as accurately as possible, or to strike a balance between the two. Behavioral results showed that these instructions led to typical speed‐accuracy trade‐off effects on movement reaction times and hit distances to target centers. Pupillometric analyses revealed that movements were faster and less accurate when participants had relatively large baseline pupil sizes, as measured before target onset. Furthermore, trial‐evoked pupil dilation was related specifically to a bias toward speed in the trade‐off and the speed of the ballistic and error‐correction phases of the motor responses such that larger pupils predicted shorter latencies and higher movement speeds. Pupil responses were also associated with performance in a manner that may reflect the combined influence of a number of factors, including the generation of dynamic urgency and an arousal response to negative feedback. Our results generally support a role for pupil‐linked arousal in regulating the trade‐off between speed and accuracy, while also highlighting how the trial‐related pupil response can exhibit multifaceted, temporally discrete associations with behavior.

The eye’s pupil has been considered a “window into the soul” as its dynamics are related to a wide variety of cognitive processes. Here, we present convergent evidence that both slow, prestimulus fluctuations and fast, event‐related changes in pupil diameter are sensitive to a fundamental trade‐off between the speed and accuracy of visuo‐motor actions—an association that holds for both instructed and endogenous variation in this trade‐off. This finding complements a growing literature linking pupil size to adaptive, contextually appropriate changes in behavior.

CHAP: Open-source software for processing and analyzing pupillometry data

Pupil dilation is an effective indicator of cognitive and affective processes. Although several eyetracker systems on the market can provide effective solutions for pupil dilation measurement, there is a lack of tools for processing and analyzing the data provided by these systems. For this reason, we developed CHAP: open-source software written in MATLAB. This software provides a user-friendly graphical user interface for processing and analyzing pupillometry data. Our software creates uniform conventions for the preprocessing and analysis of pupillometry data and provides a quick and easy-to-use tool for researchers interested in pupillometry. To download CHAP or join our mailing list, please visit CHAP's website: http://in.bgu.ac.il/en/Labs/CNL/chap .

Eye pupil signals information gain

In conditions of constant illumination, the eye pupil diameter indexes the modulation of arousal state and responds to a large breadth of cognitive processes, including mental effort, attention, surprise, decision processes, decision biases, value beliefs, uncertainty, volatility, exploitation/exploration trade-off, or learning rate. Here, I propose an information theoretic framework that has the potential to explain the ensemble of these findings as reflecting pupillary response to information processing. In short, updates of the brain’s internal model, quantified formally as the Kullback–Leibler (KL) divergence between prior and posterior beliefs, would be the common denominator to all these instances of pupillary dilation to cognition. I show that stimulus presentation leads to pupillary response that is proportional to the amount of information the stimulus carries about itself and to the quantity of information it provides about other task variables. In the context of decision making, pupil dilation in relation to uncertainty is explained by the wandering of the evidence accumulation process, leading to large summed KL divergences. Finally, pupillary response to mental effort and variations in tonic pupil size are also formalized in terms of information theory. On the basis of this framework, I compare pupillary data from past studies to simple information-theoretic simulations of task designs and show good correspondance with data across studies. The present framework has the potential to unify the large set of results reported on pupillary dilation to cognition and to provide a theory to guide future research.

Negative Emotional Stimuli Enhance Conflict Resolution Without Altering Arousal

In our daily life, we frequently need to make decisions between competing behavioral options while we are exposed to various contextual factors containing emotional/social information. We examined how changes in emotional/arousal state influence resolving conflict between behavioral rules. Visual stimuli with emotional content (positive, negative and neutral) and music (High/Low tempo), which could potentially alter emotional/arousal states, were included in the task context while participants performed the Wisconsin Card Sorting Test (WCST). The WCST requires the application of abstract matching rules, to resolve conflict between competing behavioral options. We found that conflict influenced both accuracy and response time (RT) in implementing rules. Measuring event-related autonomic responses indicated that these behavioral effects were accompanied by concomitant alterations in arousal levels. Performance in the WCST was modulated by the emotional content of visual stimuli and appeared as a faster response and higher accuracy when trials commenced with negative emotional stimuli. These effects were dependent on the level of conflict but were not accompanied by changes in arousal levels. Here, we report that visual stimuli with emotional content influence conflict processing without trial-by-trial changes in arousal level. Our findings indicate intricate interactions between emotional context and various aspects of executive control such as conflict resolution and suggest that these interactions are not necessarily mediated through alterations in arousal level.

Inverse effects of tDCS over the left versus right DLPC on emotional processing: A pupillometry study

Background and objectives

The Dorsolateral prefrontal cortex (DLPFC) is implicated in cognitive and emotional responses. Yet, research that investigates the causal role of the left versus right DLPFC during the processes of emotion appraisal is lacking. In the current study, transcranial direct current stimulation (tDCS) was used to disentangle the functional lateralization of the DLPFC on emotional processing in response to the anticipation of, and subsequent confrontation with emotional stimuli in healthy volunteers.

Methods

Forty-eight subjects received both active and sham (on separate days) anodal tDCS over either the left (N = 24) or right (N = 24) DLPFC. Subjects’ pupil dilation (PD, a physiological marker of cognitive resource allocation) was recorded while performing an appraisal task in which negative and positive emotion eliciting images were presented, each preceded by an informative cue indicating the valence of the upcoming stimulus.

Results

As compared to sham stimulation, left DLPFC anodal tDCS resulted in increased PD when confronted with negative emotional images, whereas right DLPFC anodal tDCS resulted in decreased PD when confronted with emotional images, irrespective of valence.

Limitations

The interpretation of pupil dilation in response to emotional stimuli is limited.

Conclusion

These findings suggest inverse lateralized DLPFC effects on cognitive resource allocation (as measured by pupillary responses) when confronted with emotional stimuli. The current findings may shed some light on mechanisms that explain the antidepressant effects of non-invasive brain stimulation of the left DLPFC.

Transcutaneous vagus nerve stimulation (tVNS) enhances conflict-triggered adjustment of cognitive control

Response conflicts play a prominent role in the flexible adaptation of behavior as they represent context-signals that indicate the necessity for the recruitment of cognitive control. Previous studies have highlighted the functional roles of the affectively aversive and arousing quality of the conflict signal in triggering the adaptation process. To further test this potential link with arousal, participants performed a response conflict task in two separate sessions with either transcutaneous vagus nerve stimulation (tVNS), which is assumed to activate the locus coeruleus-noradrenaline (LC-NE) system, or with neutral sham stimulation. In both sessions the N2 and P3 event-related potentials (ERP) were assessed. In line with previous findings, conflict interference, the N2 and P3 amplitude were reduced after conflict. Most importantly, this adaptation to conflict was enhanced under tVNS compared to sham stimulation for conflict interference and the N2 amplitude. No effect of tVNS on the P3 component was found. These findings suggest that tVNS increases behavioral and electrophysiological markers of adaptation to conflict. Results are discussed in the context of the potentially underlying LC-NE and other neuromodulatory (e.g., GABA) systems. The present findings add important pieces to the understanding of the neurophysiological mechanisms of conflict-triggered adjustment of cognitive control.

Cortical modulation of pupillary function: systematic review

BACKGROUND

The pupillary light reflex is the main mechanism that regulates the pupillary diameter; it is controlled by the autonomic system and mediated by subcortical pathways. In addition, cognitive and emotional processes influence pupillary function due to input from cortical innervation, but the exact circuits remain poorly understood. We performed a systematic review to evaluate the mechanisms behind pupillary changes associated with cognitive efforts and processing of emotions and to investigate the cerebral areas involved in cortical modulation of the pupillary light reflex.

METHODOLOGY

We searched multiple databases until November 2018 for studies on cortical modulation of pupillary function in humans and non-human primates. Of 8,809 papers screened, 258 studies were included.

RESULTS

Most investigators focused on pupillary dilatation and/or constriction as an index of cognitive and emotional processing, evaluating how changes in pupillary diameter reflect levels of attention and arousal. Only few tried to correlate specific cerebral areas to pupillary changes, using either cortical activation models (employing micro-stimulation of cortical structures in non-human primates) or cortical lesion models (e.g., investigating patients with stroke and damage to salient cortical and/or subcortical areas). Results suggest the involvement of several cortical regions, including the insular cortex (Brodmann areas 13 and 16), the frontal eye field (Brodmann area 8) and the prefrontal cortex (Brodmann areas 11 and 25), and of subcortical structures such as the locus coeruleus and the superior colliculus.

CONCLUSIONS

Pupillary dilatation occurs with many kinds of mental or emotional processes, following sympathetic activation or parasympathetic inhibition. Conversely, pupillary constriction may occur with anticipation of a bright stimulus (even in its absence) and relies on a parasympathetic activation. All these reactions are controlled by subcortical and cortical structures that are directly or indirectly connected to the brainstem pupillary innervation system.

IR-camera-based measurements of 2D/3D cognitive fatigue in 2D/3D display system using task-evoked pupillary response

This study was carried out to evaluate a method used to measure three-dimensional (3D) cognitive fatigue based on the pupillary response. This technique was designed to overcome measurement burdens by using non-contact methods. The pupillary response is related to cognitive function by a neural pathway and may be an indicator of 3D cognitive fatigue. Twenty-six undergraduate students (including 14 women) watched both 2D and 3D versions of a video for 70 min. The participants experienced visual fatigue after viewing the 3D content. Measures such as subjective rating, response time, event-related potential latency, heartbeat-evoked potential (HEP) alpha power, and task-evoked pupillary response (TEPR) latency were significantly different. Multitrait-multimethod matrix analysis indicated that HEP and TEPR latency measures had stronger reliability and higher correlations with 3D cognitive fatigue than other measures. TEPR latency may be useful for quantitatively determining 3D visual fatigue, as it can be easily used to evaluate 3D visual fatigue using a non-contact method without measuring burden.

Pupil dilation as an index of effort in cognitive control tasks: A review

Pupillometry research has experienced an enormous revival in the last two decades. Here we briefly review the surge of recent studies on task-evoked pupil dilation in the context of cognitive control tasks with the primary aim being to evaluate the feasibility of using pupil dilation as an index of effort exertion, rather than task demand or difficulty. Our review shows that across the three cognitive control domains of updating, switching, and inhibition, increases in task demands typically leads to increases in pupil dilation. Studies show a diverging pattern with respect to the relationship between pupil dilation and performance and we show how an effort account of pupil dilation can provide an explanation of these findings. We also discuss future directions to further corroborate this account in the context of recent theories on cognitive control and effort and their potential neurobiological substrates.

Infrared Camera-Based Non-contact Measurement of Brain Activity From Pupillary Rhythms

Pupillary responses are associated with affective processing, cognitive function, perception, memory, attention, and other brain activities involving neural pathways. The present study aimed to develop a noncontact system to measure brain activity based on pupillary rhythms using an infra-red web camera. Electroencephalogram (EEG) signals and pupil imaging of 70 undergraduate volunteers (35 female, 35 male) were measured in response to sound stimuli designed to evoke arousal, relaxation, happiness, sadness, or neutral responses. This study successfully developed a real-time system that could detect an EEG spectral index (relative power: low beta in FP1; mid beta in FP1; SMR in FP1; beta in F3; high beta in F8; gamma P4; mu in C4) from pupillary rhythms using the synchronization phenomenon in harmonic frequency (1/100 f) between the pupil and brain oscillations. This method was effective in measuring and evaluating brain activity using a simple, low-cost, noncontact system, and may be an alternative to previous methods used to evaluate brain activity.

Beyond Self-Report: A Review of Physiological and Neuroscientific Methods to Investigate Consumer Behavior

The current paper investigates the value and application of a range of physiological and neuroscientific techniques in applied marketing research and consumer science, highlighting new insights from research in social psychology and neuroscience. We review measures of sweat secretion, heart rate, facial muscle activity, eye movements, and electrical brain activity, using techniques including skin conductance, pupillometry, eyetracking, and magnetic brain imaging. For each measure, after a brief explanation of the underlying technique, we illustrate concepts and mechanisms that the measure allows researchers in marketing and consumer science to investigate, with a focus on consumer attitudes and behavior. By providing reviews on recent research that applied these methods in consumer science and relevant related fields, we also highlight methodological and theoretical strengths and limitations, with an emphasis on ecological validity. We argue that the inclusion of physiological and neuroscientific techniques can advance consumer research by providing insights into the often unconscious mechanisms underlying consumer behavior. Therefore, such technologies can help researchers and marketing practitioners understand the mechanisms of consumer behavior and improve predictions of consumer behavior.

Visual versus auditory Simon effect: A behavioural and physiological investigation

This study investigated whether the visual and auditory Simon effects could be accounted for by the same mechanism. In a single experiment, we performed a detailed comparison of the visual and the auditory Simon effects arising in behavioural responses and in pupil dilation, a psychophysiological measure considered as a marker of the cognitive effort induced by conflict processing. To address our question, we performed sequential and distributional analyses on both reaction times and pupil dilation. Results confirmed that the mechanisms underlying the visual and auditory Simon effects are functionally equivalent in terms of the interaction between unconditional and conditional response processes. The two modalities, however, differ with respect to the strength of their activation and inhibition. Importantly, pupillary data mirrored the pattern observed in behavioural data for both tasks, adding physiological evidence to the current literature on the processing of visual and auditory information in a conflict task.

Pre-stimulus pupil dilation and the preparatory control of attention

Task preparation involves multiple component processes, including a general evaluative process that signals the need for adjustments in control, and the engagement of task-specific control settings. Here we examined the dynamics of these different mechanisms in preparing the attentional control system for visual search. We explored preparatory activity using pupil dilation, a well-established measure of task demands and effortful processing. In an initial exploratory experiment, participants were cued at the start of each trial to search for either a salient color singleton target (an easy search task) or a low-salience shape singleton target (a difficult search task). Pupil dilation was measured during the preparation period from cue onset to search display onset. Mean dilation was larger in preparation for the difficult shape target than the easy color target. In two additional experiments, we sought to vary effects of evaluative processing and task-specific preparation separately. Experiment 2 showed that when the color and shape search tasks were matched for difficulty, the shape target no longer evoked larger dilations, and the pattern of results was in fact reversed. In Experiment 3, we manipulated difficulty within a single feature dimension, and found that the difficult search task evoked larger dilations. These results suggest that pupil dilation reflects expectations of difficulty in preparation for a search task, consistent with the activity of an evaluative mechanism. We did not find consistent evidence for relationship between pupil dilation and search performance (accuracy and response timing), suggesting that pupil dilation during search preparation may not be strongly linked to ongoing task-specific preparation.

Anticipating cognitive effort: roles of perceived error-likelihood and time demands

Why are some actions evaluated as effortful? In the present set of experiments we address this question by examining individuals' perception of effort when faced with a trade-off between two putative cognitive costs: how much time a task takes vs. how error-prone it is. Specifically, we were interested in whether individuals anticipate engaging in a small amount of hard work (i.e., low time requirement, but high error-likelihood) vs. a large amount of easy work (i.e., high time requirement, but low error-likelihood) as being more effortful. In between-subject designs, Experiments 1 through 3 demonstrated that individuals anticipate options that are high in perceived error-likelihood (yet less time consuming) as more effortful than options that are perceived to be more time consuming (yet low in error-likelihood). Further, when asked to evaluate which of the two tasks was (a) more effortful, (b) more error-prone, and (c) more time consuming, effort-based and error-based choices closely tracked one another, but this was not the case for time-based choices. Utilizing a within-subject design, Experiment 4 demonstrated overall similar pattern of judgments as Experiments 1 through 3. However, both judgments of error-likelihood and time demand similarly predicted effort judgments. Results are discussed within the context of extant accounts of cognitive control, with considerations of how error-likelihood and time demands may independently and conjunctively factor into judgments of cognitive effort.

More pain, more gain: Blocking the opioid system boosts adaptive cognitive control

The ability to adaptively increase cognitive control in response to cognitive challenges is crucial for goal-directed behavior. Recent findings suggest that aversive arousal triggers adaptive increases of control, but the neurochemical mechanisms underlying these effects remain unclear. Given the known contributions of the opioid system to hedonic states, we investigated whether blocking this system increases adaptive control modulations. To do so, we conducted a double-blind, placebo-controlled psychopharmacological study (n=52 females) involving a Stroop-like task. Specifically, we assessed the effect of naltrexone, an opioid blocker most selective to the mu-opioid system, on two measures of adaptive control that are thought to depend differentially on aversive arousal: post-error slowing and conflict adaptation. Consistent with our hypothesis, relative to placebo, naltrexone increased post-error slowing without influencing conflict adaptation. This finding not only supports the view that aversive arousal triggers adaptive control but also reveals a novel role for the opioid system in modulating such effects.

Cognitive effort is modulated outside of the explicit awareness of conflict frequency: Evidence from pupillometry

Classic theories of cognitive control conceptualized controlled processes as slow, strategic, and willful, with automatic processes being fast and effortless. The context-specific proportion compatibility (CSPC) effect, the reduction in the compatibility effect in a context (e.g., location) associated with a high relative to low likelihood of conflict, challenged classic theories by demonstrating fast and flexible control that appears to operate outside of conscious awareness. Two theoretical questions yet to be addressed are whether the CSPC effect is accompanied by context-dependent variation in effort, and whether the exertion of effort depends on explicit awareness of context-specific task demands. To address these questions, pupil diameter was measured during a CSPC paradigm. Stimuli were randomly presented in either a mostly compatible location or a mostly incompatible location. Replicating prior research, the CSPC effect was found. The novel finding was that pupil diameter was greater in the mostly incompatible location compared to the mostly compatible location, despite participants' lack of awareness of context-specific task demands. Additionally, this difference occurred regardless of trial type or a preceding switch in location. These patterns support the view that context (location) dictates selection of optimal attentional settings in the CSPC paradigm, and varying levels of effort and performance accompany these settings. Theoretically, these patterns imply that cognitive control may operate fast, flexibly, and outside of awareness, but not effortlessly. (PsycINFO Database Record