Memory, emotion, and pupil diameter: Repetition of natural scenes

Emotional response in babies' pupil contagion

In this study, it was investigated whether an emotional response would occur in pupil contagion by using skin conductance response (SCR) in 5- and 6-month-old infants. In the experiment, emotional responses to pupil diameter change (dilating/constricting) between the face and eyes regions were compared by using pupil diameter response and SCR. The results showed that pupil diameter responses to pupil diameter changes did not differ between face and eyes regions. The emotional response indicated by the SCR significantly increased when participants looked at dilating pupils of face stimuli compared with when participants looked at constricted pupils of face stimuli. In addition, we found a significant correlation between SCR and pupil dilation in the face. This means that pupil diameter expansion significantly increases emotional response in pupil dilation of the face region.

Pupil size tracks cue-trace interactions during episodic memory retrieval

Our ability to remember past events requires not only storing enduring engrams or memory traces of these events, but also successfully reactivating these latent traces in response to appropriate cues at the time of retrieval-a process that has been termed ecphory. However, relatively little is known about the processes that facilitate the dynamic interactions between retrieval cues and stored memory traces that are critical for successful recognition and recollection. Recently, an intriguing link between pupil dilation and recognition memory has been identified, with studied items eliciting greater pupil dilation than unstudied items during retrieval. However, the processes contributing to this "pupillary old/new effect" remain unresolved, with current explanations suggesting that it reflects the strength of the underlying memory trace. Here, we explore the novel hypothesis that the pupillary old/new effect does not index memory strength alone, but rather reflects the facilitation of cue-trace interactions during episodic memory retrieval that may be supported by activity within the pupil-linked locus coeruleus-noradrenergic (LC-NA) arousal system. First, we show that the magnitude of pupil dilation is influenced by the degree of overlap between cue and trace information. Second, we find that the magnitude of pupil dilation reflects the amount of study contextual information reinstated during retrieval. These findings provide a novel framework for understanding the pupillary old/new effect, and identify a potential role for the LC-NA system in recognition memory retrieval.

Novelty and learning in cognitive control: evidence from the Simon task

While information that is associated with inappropriate responses can interfere with an ongoing task and be detrimental to performance, cognitive control mechanisms and specific contextual conditions can alleviate interference from unwanted information. In the spatial correspondence (Simon) task, interference has been consistently shown to be reduced by spatial non-correspondence in the previous trial (i.e., correspondence sequence effect, CSE); however the mechanisms supporting this sequential effect are not well understood. Here we investigated the role of novelty and trial-to-trial changes in stimulus and response features in a Simon task, observing similar modulation of CSE for novel and non-novel stimulus changes. However, changing the response modality from trial to trial dampened CSE, and this dampening was more pronounced when the probability of switch trials was higher, suggesting a role for long-term learning. The results are consistent with recent accounts, which indicate that spatial interference can be prevented by cognitive control mechanisms triggered by learned bindings.

Eyes don't lie: Eye movements differ during covert and overt autobiographical recall

In everyday life, autobiographical memories are revisited silently (i.e., covert recall) or shared with others (i.e., overt recall), yet most research regarding eye movements and autobiographical recall has focused on overt recall. With that in mind, the aim of the current study was to evaluate eye movements during the retrieval of autobiographical memories (with a focus on emotion), recollected during covert and overt recall. Forty-three participants recalled personal memories out loud and silently, while wearing eye-tracking glasses, and rated these memories in terms of mental imagery and emotional intensity. Analyses showed fewer and longer fixations, fewer and shorter saccades, and fewer blinks during covert recall compared with overt recall. Participants perceived more mental images and had a more intense emotional experience during covert recall. These results are discussed considering cognitive load theories and the various functions of autobiographical recall. We theorize that fewer and longer fixations during covert recall may be due to more intense mental imagery. This study enriches the field of research on eye movements and autobiographical memory by addressing how we retrieve memories silently, a common activity of everyday life. More broadly, our results contribute to building objective tools to measure autobiographical memory, alongside already existing subjective scales.

Pupillometry as an index for cognitive processing in behavioral variant FrontoTemporal Dementia: a series of case studies

We investigated whether pupil size can variate with the intensity of cognitive processing in patients with behavioral-variant-Frontotemporal-Dementia (bvFTD). We invited five bvFTD participants and 21 controls to perform forward spans and backward spans, and, in a control condition, to count aloud. We recorded pupil activity using eye-tracking-glasses during the spans and control condition. Analysis demonstrated larger pupil sizes during backward spans than during forward spans, and larger pupil sizes during forward spans than during counting in both bvFTD and control participants. These findings demonstrate how increased cognitive load triggers increased pupil size and how this connection is maintained in bvFTD.

Individual pupil size changes as a robust indicator of cognitive familiarity differences

Cognitive psychology has a long history of using physiological measures, such as pupillometry. However, their susceptibility to confounds introduced by stimulus properties, such as color and luminance, has limited their application. Pupil size measurements, in particular, require sophisticated experimental designs to dissociate relatively small changes in pupil diameter due to cognitive responses from larger ones elicited by changes in stimulus properties or the experimental environment. Here, building on previous research, we present a pupillometry paradigm that adapts the pupil to stimulus properties during the baseline period without revealing stimulus meaning or context by using a pixel-scrambled image mask around an intact image. We demonstrate its robustness in the context of pupillary responses to branded product familiarity. Results show larger average and peak pupil dilation for passively viewed familiar product images and an extended later temporal component representing differences in familiarity across participants (starting around 1400 ms post-stimulus onset). These amplitude differences are present for almost all participants at the single-participant level, and vary somewhat by product category. However, amplitude differences were absent during the baseline period. These findings demonstrate that involuntary pupil size measurements combined with the presented paradigm are successful in dissociating cognitive effects of familiarity from physical stimulus confounds.

Trial-wise exposure to visual emotional cues increases physiological arousal but not temporal discounting

Humans and many animals devalue future rewards as a function of time (temporal discounting). Increased discounting has been linked to various psychiatric conditions, including substance-use-disorders, behavioral addictions, and obesity. Despite its high intra-individual stability, temporal discounting is partly under contextual control. One prominent manipulation that has been linked to increases in discounting is the exposure to highly arousing appetitive cues. However, results from trial-wise cue exposure studies appear highly mixed, and changes in physiological arousal were not adequately controlled. Here we tested the effects of appetitive (erotic), aversive, and neutral visual cues on temporal discounting in 35 healthy male participants. The contribution of single-trial physiological arousal was assessed using comprehensive monitoring of autonomic activity (pupil size, heart rate, electrodermal activity). Physiological arousal was elevated following aversive and in particular erotic cues. In contrast to our pre-registered hypothesis, steepness of temporal discounting was not significantly affected by emotional cues of either valence. Aversive cues tended to increase decision noise. Computational modeling revealed that trial-wise arousal only accounted for minor variance over and above aversive and erotic condition effects, arguing against a general effect of physiological arousal on temporal discounting.

Increased Pupil Size during Future Thinking in a Subject with Retrograde Amnesia

Recent research has assessed pupil size during past thinking in patients with retrograde amnesia. Building on this research, we assessed pupil size during future thinking in a retrograde amnesia patient. To this end, we measured pupil size during past and future thinking in L, a 19-year-old, right-handed man free of neurological/psychiatric disorders except for retrograde amnesia that occurred after an episode of fugue. During a past thinking condition, we invited L to retrieve retrograde events (i.e., events that occurred before amnesia) and anterograde events (i.e., events that occurred after amnesia). During a future thinking condition, we invited him to imagine events that might occur the following week, the following month, and in the new year. Past and future thinking occurred while L's pupil size was monitored with eye-tracking glasses. L demonstrated higher specificity during future than during past thinking. Critically, the results demonstrated a larger pupil size during future than during past thinking. The larger pupil size during future thinking observed in L can be attributed to the high cognitive load involved in future thinking. Our study not only demonstrates preserved future thinking in a patient with dissociative retrograde amnesia, but also shows that pupillometry can be used for the physiological assessment of future thinking in retrograde amnesia patients.

Stimulus novelty and emotionality interact in the processing of visual distractors

Novel distractors are prioritized for attentional selection. When distractors also convey emotional content, they divert attention from the primary task more than neutral stimuli do. In the present study, while participants were engaged in a central task, we examined the impact of peripheral distractors that varied for emotional content and novelty. Results showed that emotional interference on reaction times completely habituated with repetition and promptly recovered with novelty. The enhanced LPP for emotional pictures was attenuated by repetitions and, interestingly, stimulus novelty only affected emotional, but not neutral distractors, in both the RTs and LPP. Alpha-ERD was similarly reduced for repeated emotional and neutral distractors. Altogether, these findings suggest that the impact of peripheral distractors can be attenuated through a non-strategic learning mechanism mediated by mere stimulus repetition, which is fine-tuned to detect changes in emotional distractors only, supporting the hypothesis that novelty and emotion share the same motivational circuits.

Pupil dilation as an index of Pavlovian conditioning. A systematic review and meta-analysis

The use of pupillometry to track emotional learning processes in humans is generating an increasing interest. Here, we provide a first systematic review and meta-analysis on the value of pupil dilation as a marker of Pavlovian conditioning, focusing on the roles of UCS valence (aversive vs. appetitive), the time course across trials and response intervals within trials. Based on data from 39 independent samples (total n = 1303), our results revealed strong evidence for the overall validity of conditioned pupil responses, with a trend for larger effects in aversive (average g = 0.73) vs. appetitive conditioning (g = 0.39). Response differentiation increased over the course of acquisition. Substantial differentiation effects were found in both early and late response windows. Moderator analyses revealed a consistent influence of UCS modality on differential conditioning, while evidence for moderation by contingency instructions and length of acquisition phase was mixed. The results highlight pupil dilation as a sensitive and reliable index of Pavlovian conditioning across valence categories and stimulus modalities. Important implications regarding methodological considerations and research goals are discussed.

Pupillary response reflects attentional modulation to sound after emotional arousal

There have been various studies on the effects of emotional visual processing on subsequent non-emotional auditory stimuli. A previous study with EEG has shown that responses to deviant sounds presented after presenting negative pictures collected more attentional resources than those for neutral pictures. To investigate such a compelling between emotional and cognitive processing, this study aimed to examined pupillary responses to an auditory stimulus after a positive, negative, or neutral emotional state was elicited by an emotional image. An emotional image was followed by a beep sound that was either repetitive or unexpected, and the pupillary dilation was measured. As a result, we found that the early component of the pupillary response to the beep sound was larger for negative and positive emotional states than the neutral emotional state, whereas the late component was larger for the positive emotional state than the negative and neutral emotional states. In addition, the peak latency of the pupillary response was earlier for negative than neutral or positive images. Further, to compensate for the disadvantage of low-temporal resolution of the pupillary data, the pupillary responses were deconvoluted and used in the analysis. The deconvolution analysis of pupillary responses confirmed that the responses to beep sound were more likely to be modulated by the emotional state rather than being influenced by the short presentation interval between the images and sounds. These findings suggested that pupil size index modulations in the compelling situation between emotional and cognitive processing.

The eyes of the past: larger pupil size for autobiographical memories retrieved from field perspective

BACKGROUND

Visual perspective during memory retrieval has mainly been evaluated with methodologies based on introspection and subjective reports. The current study investigates whether visual perspective can be evaluated with a physiological measurement: pupil dilation.

METHODS

While their pupil diameter was measured with an eye-tracker, forty-five participants retrieved one memory from a field perspective (i.e., as viewed through our own eyes) and one memory from an observer perspective (i.e., as viewed from a spectator's standpoint). After retrieval, participants rated the emotional intensity of the memories.

RESULTS

Analysis demonstrated larger pupils during the retrieval of memories from a field perspective and higher emotional intensity for memories retrieved from a field perspective.

DISCUSSION

The larger pupils for memories recalled from a field perspective could, however, not be attributed to their higher emotional intensity. These findings suggest that pupil dilation could be used as a physiological assessment of visual perspective during memory retrieval.

Sparse Extended Redundancy Analysis: Variable Selection via the Exclusive LASSO

Extended Redundancy Analysis is a statistical tool for exploring the directional relationships of multiple sets of exogenous variables on a set of endogenous variables. This approach posits that the endogenous and exogenous variables are related via latent components, each of which is extracted from a set of exogenous variables, that account for the maximum variation of the endogenous variables. However, it is often difficult to distinguish between the true variables that form the latent components and the false variables that do not, especially when the association between the true variables and the exogenous set is weak. To overcome this limitation, we propose a Sparse Extended Redundancy Analysis via the Exclusive LASSO that performs variable selection while maintaining model specification. We validate the performance of the proposed approach in a simulation study. Finally, the empirical utility of this approach is demonstrated through two examples-one on a study of youth academic achievement and the other on a text analysis of newspaper data.

Amnesia in your pupils: decreased pupil size during autobiographical retrieval in a case of retrograde amnesia

We investigate whether retrograde-amnesia can be indexed with pupil activity. We present the case of L, 19-year-old, without neurological or psychiatric disorders except for retrograde-amnesia. We invited L to retrieve retrograde and anterograde memories while his pupil size was monitering with eye-tracking glasses. Results demonstrated impaired retrograde retrieval but successful anterograde retrieval in L. He also attributed lower emotional value and visual imagery to his retrograde compared to his anterograde memories. Critically, smaller pupils were observed during retrograde than during anterograde retrieval. Our study provides the first evidence on the value of pupillometry as a potential physiological marker of amnesia.

Replicating five pupillometry studies of Eckhard Hess

Several papers by Eckhard Hess from the 1960s and 1970s report that the pupils dilate or constrict according to the interest value, arousing content, or mental demands of visual stimuli. However, Hess mostly used small sample sizes and undocumented luminance control. In a first experiment (N = 182) and a second preregistered experiment (N = 147), we replicated five studies of Hess using modern equipment. Our experiments (1) did not support the hypothesis of gender differences in pupil diameter change with respect to baseline (PC) when viewing stimuli of different interest value, (2) showed that solving more difficult multiplications yields a larger PC in the seconds before providing an answer and a larger maximum PC, but a smaller PC at a fixed time after the onset of the multiplication, (3) did not support the hypothesis that participants' PC mimics the pupil diameter in a pair of schematic eyes but not in single-eyed or three-eyed stimuli, (4) did not support the hypothesis of gender differences in PC when watching a video of a male trying to escape a mob, and (5) supported the hypothesis that arousing words yield a higher PC than non-arousing words. Although we did not observe consistent gender differences in PC, additional analyses showed gender differences in eye movements towards erogenous zones. Furthermore, PC strongly correlated with the luminance of the locations where participants looked. Overall, our replications confirm Hess's findings that pupils dilate in response to mental demands and stimuli of an arousing nature. Hess's hypotheses regarding pupil mimicry and gender differences in pupil dilation did not replicate.

Pupillary Responses for Cognitive Load Measurement to Classify Difficulty Levels in an Educational Video Game: Empirical Study

Background

A learning task recurrently perceived as easy (or hard) may cause poor learning results. Gamer data such as errors, attempts, or time to finish a challenge are widely used to estimate the perceived difficulty level. In other contexts, pupillometry is widely used to measure cognitive load (mental effort); hence, this may describe the perceived task difficulty.

Objective

This study aims to assess the use of task-evoked pupillary responses to measure the cognitive load measure for describing the difficulty levels in a video game. In addition, it proposes an image filter to better estimate baseline pupil size and to reduce the screen luminescence effect.

Methods

We conducted an experiment that compares the baseline estimated from our filter against that estimated from common approaches. Then, a classifier with different pupil features was used to classify the difficulty of a data set containing information from students playing a video game for practicing math fractions.

Results

We observed that the proposed filter better estimates a baseline. Mauchly’s test of sphericity indicated that the assumption of sphericity had been violated (χ²₁₄=0.05; P=.001); therefore, a Greenhouse-Geisser correction was used (ε=0.47). There was a significant difference in mean pupil diameter change (MPDC) estimated from different baseline images with the scramble filter (F_5,78=30.965; P<.001). Moreover, according to the Wilcoxon signed rank test, pupillary response features that better describe the difficulty level were MPDC (z=−2.15; P=.03) and peak dilation (z=−3.58; P<.001). A random forest classifier for easy and hard levels of difficulty showed an accuracy of 75% when the gamer data were used, but the accuracy increased to 87.5% when pupillary measurements were included.

Conclusions

The screen luminescence effect on pupil size is reduced with a scrambled filter on the background video game image. Finally, pupillary response data can improve classifier accuracy for the perceived difficulty of levels in educational video games.

Pupil Dilation as an Index of Verbal Fluency

Verbal fluency tasks are widely used as a neuropsychological test of language production. We assessed pupil dilation during a verbal fluency task and during a control task. On the verbal fluency task, we asked 45 healthy participants (mean age = 23.55 years) to generate as many words as possible beginning with the letter “P,” whereas on the control task we asked them to count aloud. In both tasks we recorded pupil dilation with eye-tracking glasses. Results demonstrated that, compared with counting, verbal fluency resulted in a larger pupil dilation. The larger pupil dilation observed during verbal fluency compared with counting can be attributed to the cognitive load of verbal fluency, which involves both linguistic processing and executive function. By highlighting how verbal fluency can increase pupil dilation, our findings pave the way for the physiological assessment of verbal processing in healthy and pathological populations.

Pupil Constrictions and Their Associations With Increased Negative Affect During Responses to Recalled Memories of Interpersonal Stress

Abstract. Pupil diameter change is indicative of emotional processing. Most previous findings regarding pupillary response and emotion have reported that the pupil enlarges in response to the presentation of emotional perceptual stimuli (e.g., visual images) within several seconds. It is considered that such stimuli activate the sympathetic nervous system, leading to pupil dilation. In order to examine the effects of emotions similar to daily emotional experiences of mood, the present study examined pupil diameter changes and their relationships with subjective emotional changes while recalling a topic of stressful interpersonal events in daily life. The data of 20 university students (11 males, Mage = 20.36 ± 2.38 years; 9 females, Mage = 22.33 ± 3.57) were analyzed. In the experimental task, participants were instructed to recall their memories concerning the topic through instructions and questions presented on a monitor, which proceeded at their own pace, through a key press. Subsequently, after baseline and instruction periods, participants were instructed to freely recall their memories. They were then asked to respond silently to a series of questions concerning the freely recalled memories. In the analysis, we compared the pupil diameters between these different periods and observed that pupil diameters significantly decreased during the response period relative to the free recall or baseline periods. Furthermore, pupil constrictions during the response period were negatively correlated with increases in negative affect scale scores. Pupil constriction, which is indicative of decreased arousal level and parasympathetic activation, was presumably caused by multiple factors including less cognitive difficulty and a relatively long experimental task period. As the result of a less tonic mode in the response period, the attention of participants might be more successfully focused on ongoing tasks, which might lead to optimal performance in recalling memories, possibly leading to correlations between pupil diameter and negative emotional changes.

Pupil size changes signal hippocampus-related memory functions

A major task of episodic memory is to create unique, distinguishable representations of highly overlapping perceptual inputs. Several studies on this basic function have shown that it is based on the intact functioning of certain subregions of the hippocampus and is among the most sensitive behavioral indicators of mild cognitive impairment (MCI) and dementia. Here we assessed pupil dilation associated with performance in a widely used recognition paradigm that aims to uncover the intactness of fine-graded mnemonic discrimination. A sample of healthy undergraduate students was used. First, we showed that the correct discrimination between highly similar lure items and target items elicit larger pupil response than correct target identification. Second, we found that mnemonic discrimination is associated with larger pupil response in general as compared to target identification, regardless of whether the response was correct or not. These results suggest the pupil changes differentiate mnemonic discrimination and memory identification processes in recognition performance.

Affect variability and emotional reactivity in generalized anxiety disorder

BACKGROUND AND OBJECTIVES

Research indicates that greater variability in affect and emotion over time is associated with depression and anxiety. However, it remains unclear whether individuals with generalized anxiety disorder (GAD) experience greater affect variability due to individual differences or differences in the stimuli they encounter. The current study investigated whether individuals with analogue GAD demonstrate greater affect variability in response to a standardized set of stimuli.

METHODS

Participants were 134 (95 female) undergraduate participants with analogue GAD (endorsing DSM-IV criteria A, B, C, and E on the GAD-Q-IV; n = 66) or with no symptoms of GAD (n = 68). Participants reported affective reactions (positive affect, negative affect, affective arousal, and affective dominance) to each of nine sets of standardized images varying in valence (positive, neutral, or negative) and arousal (low, medium, or high).

RESULTS

In a logistic regression model controlling for baseline measurements, higher variability of affective arousal across the nine sets of images uniquely predicted analogue GAD status, whereas variability in positive affect, negative affect, and affective dominance did not. Additional analyses revealed that lower mean affective arousal also uniquely predicted analogue GAD.

LIMITATIONS

Limitations include using self-report measures to determine analogue GAD status; using a short laboratory session for the assessment of affect variability; and potential repeated testing effects.

CONCLUSIONS

These findings suggest that individuals with GAD symptoms experience higher levels of affective arousal variability, even when the stimuli presented are held constant. Assessing variability in affective arousal may be helpful in both conceptualizing and treating individuals with GAD symptoms.

Asymmetrical characteristics of emotional responses to pictures and sounds: Evidence from pupillometry

In daily life, our emotions are often elicited by a multimodal environment, mainly visual and auditory stimuli. Therefore, it is crucial to investigate the symmetrical characteristics of emotional responses to pictures and sounds. In this study, we aimed to elucidate the relationship of attentional states to emotional unimodal stimuli (pictures or sounds) and emotional responses by measuring the pupil diameter, which reflects the emotional arousal associated with increased sympathetic activity. Our hypothesis was that the emotional responses to both the image and sound stimuli are symmetrical: emotion might be suppressed when attentional resources are allocated to another stimulus of the same modality as the emotional stimulus—such as a dot presented at the same time as an emotional image, and a beep sound presented at the same time as an emotional sound. In our two experiments, data for 24 participants were analyzed for a pupillary response. In experiment 1, we investigated the relationship of the attentional state with emotional visual stimuli (International Affective Picture System) and emotional responses by using pupillometry. We set four task conditions to modulate the attentional state (emotional task, no task, visual detection task, and auditory detection task). We observed that the velocity of pupillary dilation was faster during the presentation of emotionally arousing pictures compared to that of neutral ones, regardless of the valence of the pictures. Importantly, this effect was not dependent on the task condition. In experiment 2, we investigated the relationship of the attentional state with emotional auditory sounds (International Affective Digitized Sounds) and emotional responses. We observed a trend towards a significant interaction between the stimulus and the task conditions with regard to the velocity of pupillary dilation. In the emotional and auditory detection tasks, the velocity of pupillary dilation was faster with positive and neutral sounds than negative sounds. However, there were no significant differences between the no task and visual detection task conditions. Taken together, the current data reveal that different pupillary responses were elicited to emotional visual and auditory stimuli, at least in the point that there is no attentional effect to emotional responses to visual stimuli, despite both experiments being sufficiently controlled to be of symmetrical experimental design.

Visual Behavior, Pupil Dilation, and Ability to Identify Emotions From Facial Expressions After Stroke

Social cognition is the innate human ability to interpret the emotional state of others from contextual verbal and non-verbal information, and to self-regulate accordingly. Facial expressions are one of the most relevant sources of non-verbal communication, and their interpretation has been extensively investigated in the literature, using both behavioral and physiological measures, such as those derived from visual activity and visual responses. The decoding of facial expressions of emotion is performed by conscious and unconscious cognitive processes that involve a complex brain network that can be damaged after cerebrovascular accidents. A diminished ability to identify facial expressions of emotion has been reported after stroke, which has traditionally been attributed to impaired emotional processing. While this can be true, an alteration in visual behavior after brain injury could also negatively contribute to this ability. This study investigated the accuracy, distribution of responses, visual behavior, and pupil dilation of individuals with stroke while identifying emotional facial expressions. Our results corroborated impaired performance after stroke and exhibited decreased attention to the eyes, evidenced by a diminished time and number of fixations made in this area in comparison to healthy subjects and comparable pupil dilation. The differences in visual behavior reached statistical significance in some emotions when comparing individuals with stroke with impaired performance with healthy subjects, but not when individuals post-stroke with comparable performance were considered. The performance dependence of visual behavior, although not determinant, might indicate that altered visual behavior could be a negatively contributing factor for emotion recognition from facial expressions.

How the size of the to-be-learned material influences the encoding and later retrieval of associative memories: A pupillometric assessment

Pupillometry have recently added valuable insights about the cognitive and possible neurobiological processes underlying episodic memory. Most of the studies, however, investigated recognition memory, which only partially relies on cue-driven recollection, the hallmark feature of episodic memory. Here we measured pupil size during a paired associate learning task, where participants encoded word-pairs, and after a short delay they took part in a cued recall. Importantly, we manipulated the size of the learning set: participants either learnt two, four or eight word-pairs in a row. As expected, increasing set size resulted in larger forgetting, assumingly as a consequence of weaker memory strength for the word-pairs. Our results show an important difference between pupil size changes observed during encoding and retrieval. During retrieval, the pupil instantly begun to dilate, as a sign of increased processing load accompanying the retrieval of the target memory. Importantly, large set size was also associated with larger pupil dilation during retrieval. This supports the notion that pupil dilation can be regarded as a marker of memory strength. In contrast, during encoding, pupil dilation decreased with increasing amount of encoded information, which might be due to the overuse of attentional resources. Furthermore, we also found that serial position during encoding modulated subsequent memory effects: for the first three serial positions, successful recall was predicted by larger pupil dilation during encoding, whereas such subsequent memory effect was absent for later serial positions. These results suggest that the amount of information independently modulates pupil dilation during encoding and retrieval, and support the assumption that pupillometric investigation of paired associate learning could be an informative way to investigate the cognitive and neurobiological processes of episodic memory.

J. Janssen S, Gallouj K, Lenoble Q. Autobiographical Memory Increases Pupil Dilation

BACKGROUND

Pupil activity has been widely considered as a "summed index" of physiological activities during cognitive processing.

METHODOLOGY

We investigated pupil dilation during retrieval of autobiographical memory and compared pupil diameter with a control condition in which participants had to count aloud. We also measured pupil diameters retrieval of free (i.e., first memory that comes to mind), positive, and negative memories (memories associated, respectively, with the words "happy" and "sad").

RESULTS

Analyses demonstrated larger pupil diameters during the free, positive, and negative autobiographical memory retrieval than during the control task. Analyses also demonstrated no significant differences in pupil diameters across the three autobiographical memory conditions.

CONCLUSION

These outcomes demonstrate that, compared with counting, autobiographical retrieval results in a larger pupil size. However, the emotional valence of memories yields non-significant effect on pupil diameters. Our findings demonstrate how autobiographical memory retrieval yields pupil dilation.

The pupil response as an indicator of user experience in a digital exercise game

To study whether psychophysiological indicators are suitable measures of user experience in a digital exercise game (exergame), a laboratory study employing both psychophysiological and self-report measures was conducted. Sixty-six participants cycled for 10 min on an ergometer while pupil diameter, skin conductance, and heart rate were measured; afterward, they completed a user experience questionnaire. The participants performed under three experimental conditions varying between subjects: active gaming (participants controlled the altitude of a digital bird by varying their pedal rate in order to catch letters flying across the screen), observing a game (they observed a replay of another participant's game), and no-game (blank screen). Only the gaming condition showed evidence for statistically significant pupil dilations-indicating emotional arousal-in response to game events (catching a letter) or corresponding points in time. The observational condition did not differ statistically from the no-game control condition. Self-reports also indicated that the gaming condition was rated most fun and least demanding. Other psychophysiological indicators (heart rate, skin conductance) showed no systematic effects in response to game events, rather they steadily increased during training. Thus, pupil responses were shown to be suitable indicators of positive emotional reactions to game events and user experience in a (training) game.

Cortical modulation of pupillary function: systematic review

BACKGROUND

The pupillary light reflex is the main mechanism that regulates the pupillary diameter; it is controlled by the autonomic system and mediated by subcortical pathways. In addition, cognitive and emotional processes influence pupillary function due to input from cortical innervation, but the exact circuits remain poorly understood. We performed a systematic review to evaluate the mechanisms behind pupillary changes associated with cognitive efforts and processing of emotions and to investigate the cerebral areas involved in cortical modulation of the pupillary light reflex.

METHODOLOGY

We searched multiple databases until November 2018 for studies on cortical modulation of pupillary function in humans and non-human primates. Of 8,809 papers screened, 258 studies were included.

RESULTS

Most investigators focused on pupillary dilatation and/or constriction as an index of cognitive and emotional processing, evaluating how changes in pupillary diameter reflect levels of attention and arousal. Only few tried to correlate specific cerebral areas to pupillary changes, using either cortical activation models (employing micro-stimulation of cortical structures in non-human primates) or cortical lesion models (e.g., investigating patients with stroke and damage to salient cortical and/or subcortical areas). Results suggest the involvement of several cortical regions, including the insular cortex (Brodmann areas 13 and 16), the frontal eye field (Brodmann area 8) and the prefrontal cortex (Brodmann areas 11 and 25), and of subcortical structures such as the locus coeruleus and the superior colliculus.

CONCLUSIONS

Pupillary dilatation occurs with many kinds of mental or emotional processes, following sympathetic activation or parasympathetic inhibition. Conversely, pupillary constriction may occur with anticipation of a bright stimulus (even in its absence) and relies on a parasympathetic activation. All these reactions are controlled by subcortical and cortical structures that are directly or indirectly connected to the brainstem pupillary innervation system.

Recognition memory and featural similarity between concepts: The pupil's point of view

Differences in pupil dilation are observed for studied compared to new items in recognition memory. According to cognitive load theory, this effect reflects the greater cognitive demands of retrieving contextual information from study phase. Pupil dilation can also occur when new items conceptually related to old ones are erroneously recognized as old, but the aspects of similarity that modulate false memory and related pupil responses remain unclear. We investigated this issue by manipulating the degree of featural similarity between new (unstudied) and old (studied) concepts in an old/new recognition task. We found that new concepts with high similarity were mistakenly identified as old and had greater pupil dilation than those with low similarity, suggesting that pupil dilation reflects the strength of evidence on which recognition judgments are based and, importantly, greater locus coeruleus and prefrontal activity determined by the higher degree of retrieval monitoring involved in recognizing these items.

Amygdala Adaptation and Temporal Dynamics of the Salience Network in Conditioned Fear: A Single-Trial fMRI Study

Research in rodents has established the role of the amygdaloid complex in defensive responses to conditioned threat. In human imaging studies, however, activation of the amygdala by conditioned threat cues is often not observed. One hypothesis states that this finding reflects adaptation of amygdaloid responses over time. We tested this hypothesis by estimating single-trial neural responses over a large number of conditioning trials. Functional MRI (fMRI) was recorded from 18 participants during classical differential fear conditioning: Participants viewed oriented grayscale grating stimuli (45° or 135°) presented centrally in random order. In the acquisition block, one grating (the CS+) was paired with a noxious noise, the unconditioned stimulus (US), on 25% of trials. The other grating, denoted CS–, was never paired with the US. Consistent with previous reports, BOLD in dorsal anterior cingulate cortex (dACC) and insula, but not the amygdala, was heightened when viewing CS+ stimuli that were not paired with US compared to CS– stimuli. Trial-by-trial analysis showed that over the course of acquisition, activity in the amygdala attenuated. Interestingly, activity in the dACC and insula also declined. Representational similarity analysis (RSA) corroborated these results, indicating that the voxel patterns evoked by CS+ and CS– in these brain regions became less distinguishable over time. Together, the present findings support the hypothesis that the lack of BOLD differences in the amygdaloid complex in many studies of classical conditioning is due to adaptation, and the adaptation effects may reflect changes in large-scale networks mediating aversive conditioning, particularly the salience network.

Emotional imagery and pupil diameter

Pupil diameter is enhanced in a variety of emotional contexts, including viewing pictures, listening to sounds, and during threat of shock. In this study, we investigated pupil diameter changes during emotional imagery. Participants imagined scenes describing pleasant, unpleasant, or neutral events while pupil diameter was continuously recorded. Second by second changes in pupil diameter were analyzed to determine whether, and when, modulation of the pupil as a function of hedonic content is found. Results indicated a significant effect of hedonic content beginning shortly after script onset, with enhanced pupil diameter when imagining emotional (pleasant or unpleasant), compared to neutral, scenes. Pupil diameter during imagery covaried with rated emotional arousal, consistent with an interpretation that changes in pupil diameter during emotional imagery reflect sympathetic nervous system activity. Because emotional imagery is a key element in clinical assessment and treatment, pupil diameter could prove a useful index of emotional engagement in a variety of clinically pertinent contexts.

The effect of motor task precision on pupil diameter

It is well established that an increase in cognitive task demands is associated with increased pupil diameter. However, the effect of increased motor task demands on pupil diameter is less clear. Previous research indicates that higher motor task complexity increases pupil diameter but suggests that higher motor task precision demands may decrease pupil diameter during task movement. The current study investigated the effect of increased motor task precision on pupil diameter using a Fitts' Law movement task to manipulate motor response precision. Increased precision demands were associated with reduced pupil diameter during the response preparation and response execution phases of the movement trials. This result has implications for the interpretation of pupil diameter as an index of workload during tasks which involve precise motor movements.

Sympathetic ANS modulation of pupil diameter in emotional scene perception: Effects of hedonic content, brightness, and contrast

A series of studies investigated the effects of hedonic content, brightness, and contrast on pupil diameter during free viewing of natural scenes, assessing the amplitude of the initial light reflex and subsequent sustained pupil diameter change. Hedonic picture content varied from highly arousing scenes of erotica and violence to scenes depicting nature, babies, loss, contamination, food, and more. Despite equivalent overall picture brightness and contrast, pupil diameter still varied as a function of the local brightness of central vision at fixation. Statistical (Experiment 1) and methodological (Experiment 2, 3) solutions produced complementary data indicating that scenes of erotica and violence reliably attenuate the amplitude of the initial light reflex and prompt enhanced late diameter pupil changes, compared to other scene contents. A principal components analysis supported the hypothesis that a single sympathetically mediated process enhances pupil dilation during picture viewing, modulating both initial constriction and late diameter changes. Rather than being a subtle index of "liking," pupil diameter is primarily sensitive to events that reliably elicit measurable sympathetic nervous system activity.

Mothers' pupillary responses to infant facial expressions

BACKGROUND

Human parental care relies heavily on the ability to monitor and respond to a child's affective states. The current study examined pupil diameter as a potential physiological index of mothers' affective response to infant facial expressions.

METHODS

Pupillary time-series were measured from 86 mothers of young infants in response to an array of photographic infant faces falling into four emotive categories based on valence (positive vs. negative) and arousal (mild vs. strong).

RESULTS

Pupil dilation was highly sensitive to the valence of facial expressions, being larger for negative vs. positive facial expressions. A separate control experiment with luminance-matched non-face stimuli indicated that the valence effect was specific to facial expressions and cannot be explained by luminance confounds. Pupil response was not sensitive to the arousal level of facial expressions.

CONCLUSIONS

The results show the feasibility of using pupil diameter as a marker of mothers' affective responses to ecologically valid infant stimuli and point to a particularly prompt maternal response to infant distress cues.

As Far as the Eye Can See: Relationship between Psychopathic Traits and Pupil Response to Affective Stimuli

Psychopathic individuals show a range of affective processing deficits, typically associated with the interpersonal/affective component of psychopathy. However, previous research has been inconsistent as to whether psychopathy, within both offender and community populations, is associated with deficient autonomic responses to the simple presentation of affective stimuli. Changes in pupil diameter occur in response to emotionally arousing stimuli and can be used as an objective indicator of physiological reactivity to emotion. This study used pupillometry to explore whether psychopathic traits within a community sample were associated with hypo-responsivity to the affective content of stimuli. Pupil activity was recorded for 102 adult (52 female) community participants in response to affective (both negative and positive affect) and affectively neutral stimuli, that included images of scenes, static facial expressions, dynamic facial expressions and sound-clips. Psychopathic traits were measured using the Triarchic Psychopathy Measure. Pupil diameter was larger in response to negative stimuli, but comparable pupil size was demonstrated across pleasant and neutral stimuli. A linear relationship between subjective arousal and pupil diameter was found in response to sound-clips, but was not evident in response to scenes. Contrary to predictions, psychopathy was unrelated to emotional modulation of pupil diameter across all stimuli. The findings were the same when participant gender was considered. This suggests that psychopathy within a community sample is not associated with autonomic hypo-responsivity to affective stimuli, and this effect is discussed in relation to later defensive/appetitive mobilisation deficits.

Getting directions from the hippocampus: The neural connection between looking and memory

Investigations into the neural basis of memory in human and non-human primates have focused on the hippocampus and associated medial temporal lobe (MTL) structures. However, how memory signals from the hippocampus affect motor actions is unknown. We propose that approaching this question through eye movement, especially by assessing the changes in looking behavior that occur with experience, is a promising method for exposing neural computations within the hippocampus. Here, we review how looking behavior is guided by memory in several ways, some of which have been shown to depend on the hippocampus, and how hippocampal neural signals are modulated by eye movements. Taken together, these findings highlight the need for future research on how MTL structures interact with the oculomotor system. Probing how the hippocampus reflects and impacts motor output during looking behavior renders a practical path to advance our understanding of the hippocampal memory system.

The pupil's response to affective pictures: Role of image duration, habituation, and viewing mode

The pupil has been shown to be sensitive to the emotional content of stimuli. We examined this phenomenon by comparing fearful and neutral images carefully matched in the domains of luminance, image contrast, image color, and complexity of content. The pupil was more dilated after viewing affective pictures, and this effect was (a) shown to be independent of the presentation time of the images (from 100–3,000 ms), (b) not diminished by repeated presentations of the images, and (c) not affected by actively naming the emotion of the stimuli in comparison to passive viewing. Our results show that the emotional modulation of the pupil is present over a range of variables that typically vary from study to study (image duration, number of trials, free viewing vs. task), and encourages the use of pupillometry as a measure of emotional processing in populations where alternative techniques may not be appropriate.