Pupil dilation as an index of Pavlovian conditioning. A systematic review and meta-analysis

Unraveling the influence of Pavlovian cues on decision-making: A pre-registered meta-analysis on Pavlovian-to-instrumental transfer

Amidst the replicability crisis, promoting transparency and rigor in research becomes imperative. The Pavlovian-to-Instrumental Transfer (PIT) paradigm is increasingly used in human studies to offer insights into how Pavlovian cues, by anticipating rewards or punishments, influence decision-making and potentially contribute to the development of clinical conditions. However, research on this topic faces challenges, including methodological variability and the need for standardized approaches, which can undermine the quality and robustness of experimental findings. Hence, we conducted a meta-analysis to unravel the methodological, task-related, individual, training, and learning factors that can modulate PIT. By scrutinizing these factors, the present meta-analysis reviews the current literature on human PIT, provides practical guidelines for future research to enhance study outcomes and refine methodologies, and identifies knowledge gaps that can serve as a direction for future studies aiming to advance the comprehension of how Pavlovian cues shape decision-making.

Neuropsychobiology of fear-induced bradycardia in humans: progress and pitfalls

In the last century, the paradigm of fear conditioning has greatly evolved in a variety of scientific fields. The techniques, protocols, and analysis methods now most used have undergone a progressive development, theoretical and technological, improving the quality of scientific productions. Fear-induced bradycardia is among these techniques and represents the temporary deceleration of heart beats in response to negative outcomes. However, it has often been used as a secondary measure to assess defensive responding to threat, along other more popular techniques. In this review, we aim at paving the road for its employment as an additional tool in fear conditioning experiments in humans. After an overview of the studies carried out throughout the last century, we describe more recent evidence up to the most contemporary research insights. Lastly, we provide some guidelines concerning the best practices to adopt in human fear conditioning studies which aim to investigate fear-induced bradycardia.

The impact of physical exercise on the consolidation of fear extinction memories

Based on the mechanisms of fear extinction, exposure therapy is the most common treatment for anxiety disorders. However, extinguished fear responses can reemerge even after successful treatment. Novel interventions enhancing exposure therapy efficacy are therefore critically needed. Physical exercise improves learning and memory and was also shown to enhance extinction processes. This study tested whether physical exercise following fear extinction training improves the consolidation of extinction memories. Sixty healthy men underwent a differential fearconditioning paradigm with fear acquisition training on day 1 and fear extinction training followed by an exercise or resting control intervention on day 2. On day 3, retrieval and reinstatement were tested including two additional but perceptually similar stimuli to explore the generalization of exercise effects. Exercise significantly increased heart rate, salivary alpha amylase, and cortisol, indicating successful exercise manipulation. Contrary to our expectations, exercise did not enhance but rather impaired extinction memory retrieval on the next day, evidenced by significantly stronger differential skin conductance responses (SCRs) and pupil dilation (PD). Importantly, although conditioned fear responses were successfully acquired, they did not fully extinguish, explaining why exercise might have boosted the consolidation of the original fear memory trace instead. Additionally, stronger differential SCRs and PD toward the novel stimuli suggest that the memory enhancing effects of exercise also generalized to perceptually similar stimuli. Together, these findings indicate that physical exercise can facilitate both the long-term retrievability and generalization of extinction memories, but presumably only when extinction was successful in the first place.

Gender congruence and emotion effects in cross-modal associative learning: Insights from ERPs and pupillary responses

Social and emotional cues from faces and voices are highly relevant and have been reliably demonstrated to attract attention involuntarily. However, there are mixed findings as to which degree associating emotional valence to faces occurs automatically. In the present study, we tested whether inherently neutral faces gain additional relevance by being conditioned with either positive, negative, or neutral vocal affect bursts. During learning, participants performed a gender-matching task on face-voice pairs without explicit emotion judgments of the voices. In the test session on a subsequent day, only the previously associated faces were presented and had to be categorized regarding gender. We analyzed event-related potentials (ERPs), pupil diameter, and response times (RTs) of N = 32 subjects. Emotion effects were found in auditory ERPs and RTs during the learning session, suggesting that task-irrelevant emotion was automatically processed. However, ERPs time-locked to the conditioned faces were mainly modulated by the task-relevant information, that is, the gender congruence of the face and voice, but not by emotion. Importantly, these ERP and RT effects of learned congruence were not limited to learning but extended to the test session, that is, after removing the auditory stimuli. These findings indicate successful associative learning in our paradigm, but it did not extend to the task-irrelevant dimension of emotional relevance. Therefore, cross-modal associations of emotional relevance may not be completely automatic, even though the emotion was processed in the voice.

The next frontier: Moving human fear conditioning research online

Fear conditioning is a significant area of research that has featured prominently among the topics published in Biological Psychology over the last 50 years. This work has greatly contributed to our understanding of human anxiety and stressor-related disorders. While mainly conducted in the laboratory, recently, there have been initial attempts to conduct fear conditioning experiments online, with around 10 studies published on the subject, primarily in the last two years. These studies have demonstrated the potential of online fear conditioning research, although challenges to ensure that this research meets the same methodological standards as in-person experimentation remain, despite recent progress. We expect that in the coming years new outcome measures will become available online including the measurement of eye-tracking, pupillometry and probe reaction time and that compliance monitoring will be improved. This exciting new approach opens new possibilities for large-scale data collection among hard-to-reach populations and has the potential to transform the future of fear conditioning research.

Coherence and divergence in autonomic-subjective affective space

A central tenet of many theories of emotion is that emotional states are accompanied by distinct patterns of autonomic activity. However, experimental studies of coherence between subjective and autonomic responses during emotional states provide little evidence of coherence. Crucially, previous studies investigating coherence have either adopted univariate approaches or made limited use of multivariate analytic approaches by investigating subjective and autonomic responses separately. The current study addressed this question using a multivariate dimensional approach to build a common autonomic-subjective affective space incorporating subjective responses and three different autonomic signals (heart rate, skin conductance response, and pupil diameter), measured during an emotion-inducing task, in 51 participants. Results showed that autonomic and subjective responses could be adequately described in a two-dimensional affective space. The first dimension included contributions from subjective and autonomic responses, indicating coherence, while contributions to the second dimension were almost exclusively of autonomic covariance. Thus, while there was a degree of coherence between autonomic and subjective emotional responses, there was substantial structure in autonomic responses that did not covary with subjective emotional experience. This study, therefore, contributes new insights into the relationship between subjective and autonomic emotional responses, and provides a framework for future multimodal emotion research, enabling both hypothesis- and data-driven testing.

Few-shot learning: temporal scaling in behavioral and dopaminergic learning

How do we learn associations in the world (e.g., between cues and rewards)? Cue-reward associative learning is controlled in the brain by mesolimbic dopamine1-4. It is widely believed that dopamine drives such learning by conveying a reward prediction error (RPE) in accordance with temporal difference reinforcement learning (TDRL) algorithms5. TDRL implementations are "trial-based": learning progresses sequentially across individual cue-outcome experiences. Accordingly, a foundational assumption-often considered a mere truism-is that the more cue-reward pairings one experiences, the more one learns this association. Here, we disprove this assumption, thereby falsifying a foundational principle of trial-based learning algorithms. Specifically, when a group of head-fixed mice received ten times fewer experiences over the same total time as another, a single experience produced as much learning as ten experiences in the other group. This quantitative scaling also holds for mesolimbic dopaminergic learning, with the increase in learning rate being so high that the group with fewer experiences exhibits dopaminergic learning in as few as four cue-reward experiences and behavioral learning in nine. An algorithm implementing reward-triggered retrospective learning explains these findings. The temporal scaling and few-shot learning observed here fundamentally changes our understanding of the neural algorithms of associative learning.

Pupillary motility responses to affectively salient stimuli in individuals with depression or elevated risk of depression: A systematic review and meta-analysis

Elaborative affective processing is observed in depression, and pupillary reactivity, a continuous, sensitive, and reliable indicator of physiological arousal and neurocognitive processing, is increasingly utilized in studies of depression-related characteristics. As a first attempt to quantitively summarize existing evidence on depression-related pupillary reactivity alterations, this review and meta-analysis evaluated the direction, magnitude, and specificity of pupillary indices of affective processing towards positively, negatively, and neutrally-valenced stimuli among individuals diagnosed with depression or with elevated risk of depression. Studies on pupillary responses to affective stimuli in the target groups were identified in PsycINFO and PubMed databases. Twenty-two articles met inclusion criteria for the qualitative review and 16 for the quantitative review. Three-level frequentist and Bayesian models were applied to summarize pooled effects from baseline-controlled stimuli-induced average changes in pupillary responses. In general, compared to non-depressed individuals, individuals with depression or elevated risk of depression exhibited higher pupillary reactivity (d =0.15) towards negatively-valenced stimuli during affective processing. Pupillary motility towards negatively-valenced stimuli may be a promising trait-like marker for depression vulnerability.

Pupil dilation tracks divergent learning processes in aware versus unaware Pavlovian conditioning

Evidence regarding unaware differential fear conditioning in humans is mixed and even less is known about the effects of contingency awareness on appetitive conditioning. Phasic pupil dilation responses (PDR) might be more sensitive for capturing implicit learning than other measures, such as skin conductance responses (SCR). Here, we report data from two delay conditioning experiments utilizing PDR (alongside SCR and subjective assessments) to investigate the role of contingency awareness in aversive and appetitive conditioning. In both experiments, valence of unconditioned stimuli (UCS) was varied within participants by administering aversive (mild electric shocks) and appetitive UCSs (monetary rewards). Preceding visual stimuli (CSs) predicted either the reward, the shock (65% reinforcement), or neither UCS. In Exp. 1, participants were fully instructed about CS-UCS contingencies, whereas in Exp. 2, no such information was given. PDR and SCR demonstrated successful differential conditioning in Exp. 1 and in (learned) aware participants in Exp. 2. In non-instructed participants who remained fully unaware of contingencies (Exp. 2), differential modulation of early PDR (immediately after CS onset) by appetitive cues emerged. Associations with model-derived learning parameters further suggest that early PDR in unaware participants mainly reflect implicit learning of expected outcome value, whereas early PDR in aware (instructed/learned-aware) participants presumably index attentional processes (related to uncertainty/prediction error processing). Similar, but less clear results emerged for later PDR (preceding UCS onset). Our data argue in favor of a dual-process account of associative learning, suggesting that value-related processing can take place irrespective of mechanisms involved in conscious memory formation.

Pupillary dynamics of mice performing a Pavlovian delay conditioning task reflect reward-predictive signals

Pupils can signify various internal processes and states, such as attention, arousal, and working memory. Changes in pupil size have been associated with learning speed, prediction of future events, and deviations from the prediction in human studies. However, the detailed relationships between pupil size changes and prediction are unclear. We explored pupil size dynamics in mice performing a Pavlovian delay conditioning task. A head-fixed experimental setup combined with deep-learning-based image analysis enabled us to reduce spontaneous locomotor activity and to track the precise dynamics of pupil size of behaving mice. By setting up two experimental groups, one for which mice were able to predict reward in the Pavlovian delay conditioning task and the other for which mice were not, we demonstrated that the pupil size of mice is modulated by reward prediction and consumption, as well as body movements, but not by unpredicted reward delivery. Furthermore, we clarified that pupil size is still modulated by reward prediction even after the disruption of body movements by intraperitoneal injection of haloperidol, a dopamine D2 receptor antagonist. These results suggest that changes in pupil size reflect reward prediction signals. Thus, we provide important evidence to reconsider the neuronal circuit involved in computing reward prediction error. This integrative approach of behavioral analysis, image analysis, pupillometry, and pharmacological manipulation will pave the way for understanding the psychological and neurobiological mechanisms of reward prediction and the prediction errors essential to learning and behavior.

Developmental aspects of fear generalization - A MEG study on neurocognitive correlates in adolescents versus adults

BACKGROUND

Fear generalization is pivotal for the survival-promoting avoidance of potential danger, but, if too pronounced, it promotes pathological anxiety. Similar to adult patients with anxiety disorders, healthy children tend to show overgeneralized fear responses.

OBJECTIVE

This study aims to investigate neuro-developmental aspects of fear generalization in adolescence - a critical age for the development of anxiety disorders.

METHODS

We compared healthy adolescents (14-17 years) with healthy adults (19-34 years) regarding their fear responses towards tilted Gabor gratings (conditioned stimuli, CS; and slightly differently titled generalization stimuli, GS). In the conditioning phase, CS were paired (CS+) or remained unpaired (CS-) with an aversive stimulus (unconditioned stimuli, US). In the test phase, behavioral, peripheral and neural responses to CS and GS were captured by fear- and UCS expectancy ratings, a perceptual discrimination task, pupil dilation and source estimations of event-related magnetic fields.

RESULTS

Closely resembling adults, adolescents showed robust generalization gradients of fear ratings, pupil dilation, and estimated neural source activity. However, in the UCS expectancy ratings, adolescents revealed shallower generalization gradients indicating overgeneralization. Moreover, adolescents showed stronger visual cortical activity after as compared to before conditioning to all stimuli.

CONCLUSION

Various aspects of fear learning and generalization appear to be mature in healthy adolescents. Yet, cognitive aspects might show a slower course of development.

No trait anxiety influences on early and late differential neuronal responses to aversively conditioned faces across three different tasks

The human brain's ability to quickly detect dangerous stimuli is crucial in selecting appropriate responses to possible threats. Trait anxiety has been suggested to moderate these processes on certain processing stages. To dissociate such different information-processing stages, research using classical conditioning has begun to examine event-related potentials (ERPs) in response to fear-conditioned (CS +) faces. However, the impact of trait anxiety on ERPs to fear-conditioned faces depending on specific task conditions is unknown. In this preregistered study, we measured ERPs to faces paired with aversive loud screams (CS +) or neutral sounds (CS −) in a large sample (N = 80) under three different task conditions. Participants had to discriminate face-irrelevant perceptual information, the gender of the faces, or the CS category. Results showed larger amplitudes in response to aversively conditioned faces for all examined ERPs, whereas interactions with the attended feature occurred for the P1 and the early posterior negativity (EPN). For the P1, larger CS + effects were observed during the perceptual distraction task, while the EPN was increased for CS + faces when deciding about the CS association. Remarkably, we found no significant correlations between ERPs and trait anxiety. Thus, fear-conditioning potentiates all ERP amplitudes, some processing stages being further modulated by the task. However, the finding that these ERP differences were not affected by individual differences in trait anxiety does not support theoretical accounts assuming increased threat processing or reduced threat discrimination depending on trait anxiety.

Early Auditory Event Related Potentials Distinguish Higher-Order From First-Order Aversive Conditioning

Stimuli in reality rarely co-occur with primary reward or punishment to allow direct associative learning of value. Instead, value is thought to be inferred through complex higher-order associations. Rodent research has demonstrated that the formation and maintenance of first-order and higher-order associations are supported by distinct neural substrates. In this study, we explored whether this pattern of findings held true for humans. Participants underwent first-order and subsequent higher-order conditioning using an aversive burst of white noise or neutral tone as the unconditioned stimuli. Four distinct tones, initially neutral, served as first-order and higher-order conditioned stimuli. Autonomic and neural responses were indexed by pupillometry and evoked response potentials (ERPs) respectively. Conditioned aversive values of first-order and higher-order stimuli led to increased autonomic responses, as indexed by pupil dilation. Distinct temporo-spatial auditory evoked response potentials were elicited by first-order and high-order conditioned stimuli. Conditioned first-order responses peaked around 260 ms and source estimation suggested a primary medial prefrontal and amygdala source. Conversely, conditioned higher-order responses peaked around 120 ms with an estimated source in the medial temporal lobe. Interestingly, pupillometry responses to first-order conditioned stimuli were diminished after higher order training, possibly signifying concomitant incidental extinction, while responses to higher-order stimuli remained. This suggests that once formed, higher order associations are at least partially independent of first order conditioned representations. This experiment demonstrates that first-order and higher-order conditioned associations have distinct neural signatures, and like rodents, the medial temporal lobe may be specifically involved with higher-order conditioning.

Robust BOLD Responses to Faces But Not to Conditioned Threat: Challenging the Amygdala's Reputation in Human Fear and Extinction Learning

Most of our knowledge about human emotional memory comes from animal research. Based on this work, the amygdala is often labeled the brain's "fear center", but it is unclear to what degree neural circuitries underlying fear and extinction learning are conserved across species. Neuroimaging studies in humans yield conflicting findings, with many studies failing to show amygdala activation in response to learned threat. Such null findings are often treated as resulting from MRI-specific problems related to measuring deep brain structures. Here we test this assumption in a mega-analysis of three studies on fear acquisition (n = 98; 68 female) and extinction learning (n = 79; 53 female). The conditioning procedure involved the presentation of two pictures of faces and two pictures of houses: one of each pair was followed by an electric shock [a conditioned stimulus (CS+)], the other one was never followed by a shock (CS-), and participants were instructed to learn these contingencies. Results revealed widespread responses to the CS+ compared with the CS- in the fear network, including anterior insula, midcingulate cortex, thalamus, and bed nucleus of the stria terminalis, but not the amygdala, which actually responded stronger to the CS- Results were independent of spatial smoothing, and of individual differences in trait anxiety and conditioned pupil responses. In contrast, robust amygdala activation distinguished faces from houses, refuting the idea that a poor signal could account for the absence of effects. Moving forward, we suggest that, apart from imaging larger samples at higher resolution, alternative statistical approaches may be used to identify cross-species similarities in fear and extinction learning.SIGNIFICANCE STATEMENT The science of emotional memory provides the foundation of numerous theories on psychopathology, including stress and anxiety disorders. This field relies heavily on animal research, which suggests a central role of the amygdala in fear learning and memory. However, this finding is not strongly corroborated by neuroimaging evidence in humans, and null findings are too easily explained away by methodological limitations inherent to imaging deep brain structures. In a large nonclinical sample, we find widespread BOLD activation in response to learned fear, but not in the amygdala. A poor signal could not account for the absence of effects. While these findings do not disprove the involvement of the amygdala in human fear learning, they challenge its typical portrayals and illustrate the complexities of translational science.