The eye of the retriever: developing episodic memory mechanisms in preverbal infants assessed through pupil dilation

Pupil old/new effect as an objective measure of recognition memory: a meta-analysis of 17 eye-tracking experiments

Recognition memory, the ability to recognise previously encountered information, correlates with pupil diameter changes during the recognition period. This physiological response, known as the pupil old/new effect, generally reflects the variation in pupil dilation when encountering previously studied (old) stimuli compared to new stimuli. To develop a more precise understanding of the pupil old/new effect, we conducted a meta-analysis of 17 eye-tracking experiments (across 12 articles spanning from 2008 to 2023) involving 560 healthy adults with a mean age of 22.31 years. Analysis of publication bias showed a rather low risk of bias in the selected articles. The main meta-analysis revealed a significant and large pooled pupil old/new effect (Cohen's dz = 0.73, 95% CI [0.50, 0.95]). Further analysis of moderators showed that the number of participants included in the experiments and the criteria for selecting trials (only correct trials vs. all trials) had a significant impact on the meta-analytic results. In general, the analyses revealed a robust pupil old/new effect across all selected articles. This finding underscores its potential utility as a marker of recognition memory across different stimuli type, and various experimental designs.

Eyes on Memory: Pupillometry in Encoding and Retrieval

This review critically examines the contributions of pupillometry to memory research, primarily focusing on its enhancement of our understanding of memory encoding and retrieval mechanisms mainly investigated with the recognition memory paradigm. The evidence supports a close link between pupil response and memory formation, notably influenced by the type of novelty detected. This proposal reconciles inconsistencies in the literature regarding pupil response patterns that may predict successful memory formation, and highlights important implications for encoding mechanisms. The review also discusses the pupil old/new effect and its significance in the context of recollection and in reflecting brain signals related to familiarity or novelty detection. Additionally, the capacity of pupil response to serve as a true memory signal and to distinguish between true and false memories is evaluated. The evidence provides insights into the nature of false memories and offers a novel understanding of the cognitive mechanisms involved in memory distortions. When integrated with rigorous experimental design, pupillometry can significantly refine theoretical models of memory encoding and retrieval. Furthermore, combining pupillometry with neuroimaging and pharmacological interventions is identified as a promising direction for future research.

The pupil collaboration: A multi-lab, multi-method analysis of goal attribution in infants

The rise of pupillometry in infant research over the last decade is associated with a variety of methods for data preprocessing and analysis. Although pupil diameter is increasingly recognized as an alternative measure of the popular cumulative looking time approach used in many studies (Jackson & Sirois, 2022), an open question is whether the many approaches used to analyse this variable converge. To this end, we proposed a crowdsourced approach to pupillometry analysis. A dataset from 30 9-month-old infants (15 girls; Mage = 282.9 days, SD = 8.10) was provided to 7 distinct teams for analysis. The data were obtained from infants watching video sequences showing a hand, initially resting between two toys, grabbing one of them (after Woodward, 1998). After habituation, infants were shown (in random order) a sequence of four test events that varied target position and target toy. Results show that looking times reflect primarily the familiar path of the hand, regardless of target toy. Gaze data similarly show this familiarity effect of path. The pupil dilation analyses show that features of pupil baseline measures (duration and temporal location) as well as data retention variation (trial and/or participant) due to different inclusion criteria from the various analysis methods are linked to divergences in findings. Two of the seven teams found no significant findings, whereas the remaining five teams differ in the pattern of findings for main and interaction effects. The discussion proposes guidelines for best practice in the analysis of pupillometry data.

Seeing a talking face matters: Infants' segmentation of continuous auditory-visual speech

Visual speech cues from a speaker's talking face aid speech segmentation in adults, but despite the importance of speech segmentation in language acquisition, little is known about the possible influence of visual speech on infants' speech segmentation. Here, to investigate whether there is facilitation of speech segmentation by visual information, two groups of English-learning 7-month-old infants were presented with continuous speech passages, one group with auditory-only (AO) speech and the other with auditory-visual (AV) speech. Additionally, the possible relation between infants' relative attention to the speaker's mouth versus eye regions and their segmentation performance was examined. Both the AO and the AV groups of infants successfully segmented words from the continuous speech stream, but segmentation performance persisted for longer for infants in the AV group. Interestingly, while AV group infants showed no significant relation between the relative amount of time spent fixating the speaker's mouth versus eyes and word segmentation, their attention to the mouth was greater than that of AO group infants, especially early in test trials. The results are discussed in relation to the possible pathways through which visual speech cues aid speech perception.

Arousal-modulated memory encoding and retrieval in adults with autism spectrum disorder

Recently, we have shown that pupil dilation during a recognition memory task can serve as an index of memory retrieval difficulties in autism. At the time of publication, we were unaware of specific data-analysis methods that can be used to shed further light on the origins of such memory related pupil dilation. Specifically, by distinguishing "tonic" from "phasic" changes in pupil dilation and considering their temporal progression, it is possible to draw inferences about the functional integrity of a locus coeruleus-norepinephrine system (LC-NE) that is known to play a key role in regulating memory encoding and retrieval processes. We therefore apply these analyses to our previously published eye-tracking data of adults with ASD (N = 24) and neurotypical development (TD, N = 30) during the recognition memory task. In this re-analysis, we related pupil dilation during encoding and retrieval to recognition accuracy in a per-trial analysis of linear mixed models. In ASD, we replicated attenuated recognition accuracy, which was accompanied by attenuated pupil dilation during encoding and retrieval. Group differences in pupil dilation during retrieval occurred late during the trial (after 1.75 s) and indicated an altered top-down processing like attenuated attribution of semantic salience in response to previously encoded stimuli. In addition, only in the ASD group were higher pupil dilation during encoding and lower pupil dilation during retrieval associated with decreased recognition accuracy. This supports altered modulation of memory encoding and retrieval in ASD, with LC-NE phasic activity as promising underlying mechanism. LAY SUMMARY: We investigated the changes of pupil size during memory testing in autism spectrum disorder. Adults with ASD remembered fewer items correctly than neurotypical individuals (TD). This reduced memory was related to increased pupillary responses at study and decreased pupil dilation at test only for adults with ASD indicating a different modulation of memory by the locus coeruleus.

Twelve-month-old infants' physiological responses to music are affected by others' positive and negative reactions

Infants show remarkable skills for processing music in the first year of life. Such skills are believed to foster social and communicative development, yet little is known about how infants' own preferences for music develop and whether social information plays a role. Here, we investigate whether the reactions of another person influence infants' responses to music. Specifically, 12-month-olds (N = 33) saw an actor react positively or negatively after listening to clips of instrumental music. Arousal (measured via pupil dilation) and attention (measured via looking time) were assessed when infants later heard the clips without the actor visible. Results showed greater pupil dilation when listening to music clips that had previously been reacted to negatively than those that had been reacted to positively (Exp. 1). This effect was not replicated when a similar, rather than identical, clip from the piece of music was used in the test phase (Exp. 2, N = 35 12-month-olds). There were no effects of the actor's positive or negative reaction on looking time. Together, our findings suggest that infants are sensitive to others' positive and negative reactions not only for concrete objects, such as food or toys, but also for more abstract stimuli including music.

Does surprise enhance infant memory? Assessing the impact of the encoding context on subsequent object recognition

A discrepancy between what was predicted and what is observed has been linked to increased looking times, changes in brain electrical activity, and increased pupil dilation in infants. These processes associated with heightened attention and readiness to learn might enhance the encoding and memory consolidation of the surprising object, as suggested by both the infant and the adult literature. We therefore investigated whether the presence of surprise during the encoding context enhances subsequent encoding and recognition memory processes for the items that violated infants' expectations. Seventeen-month-olds viewed 20 familiar objects, half of which were labeled correctly, while the other half were mislabeled. Subsequently, infants were presented with a silent recognition memory test where the previously labeled objects appeared along with new images. Pupil dilation was measured, with more dilated pupils indicating (1) surprise during those labeling events where the item was mislabeled and (2) successful retrieval processes during the memory test. Infants responded with more pupil dilation to mislabeling compared to correct labeling. Importantly, despite the presence of a surprise response during mislabeling, infants only differentiated between the previously seen and unseen items at the memory test, offering no evidence that surprise had facilitated the encoding of the mislabeled items.

Making the World Behave: A New Embodied Account on Mobile Paradigm

In this review article, we describe the mobile paradigm, a method used for more than 50 years to assess how infants learn and remember sensorimotor contingencies. The literature on the mobile paradigm demonstrates that infants below 6 months of age can remember the learning environment weeks after when reminded periodically and integrate temporally distributed information across modalities. The latter ability is only possible if events occur within a temporal window of a few days, and the width of this required window changes as a function of age. A major critique of these conclusions is that the majority of this literature has neglected the embodied experience, such that motor behavior was considered an equivalent developmental substitute for verbal behavior. Over recent years, simulation and empirical work have highlighted the sensorimotor aspect and opened up a discussion for possible learning mechanisms and variability in motor preferences of young infants. In line with this recent direction, we present a new embodied account on the mobile paradigm which argues that learning sensorimotor contingencies is a core feature of development forming the basis for active exploration of the world and body. In addition to better explaining recent findings, this new framework aims to replace the dis-embodied approach to the mobile paradigm with a new understanding that focuses on variance and representations grounded in sensorimotor experience. Finally, we discuss a potential role for the dorsal stream which might be responsible for guiding action according to visual information, while infants learn sensorimotor contingencies in the mobile paradigm.

Pupil size changes signal hippocampus-related memory functions

A major task of episodic memory is to create unique, distinguishable representations of highly overlapping perceptual inputs. Several studies on this basic function have shown that it is based on the intact functioning of certain subregions of the hippocampus and is among the most sensitive behavioral indicators of mild cognitive impairment (MCI) and dementia. Here we assessed pupil dilation associated with performance in a widely used recognition paradigm that aims to uncover the intactness of fine-graded mnemonic discrimination. A sample of healthy undergraduate students was used. First, we showed that the correct discrimination between highly similar lure items and target items elicit larger pupil response than correct target identification. Second, we found that mnemonic discrimination is associated with larger pupil response in general as compared to target identification, regardless of whether the response was correct or not. These results suggest the pupil changes differentiate mnemonic discrimination and memory identification processes in recognition performance.

Learning From Others: The Effects of Agency on Event Memory in Young Children

Little is known about the influence of social context on children's event memory. Across four studies, we examined whether learning that could occur in the absence of a person was more robust when a person was present. Three-year-old children (N = 125) viewed sequential events that either included or excluded an acting agent. In Experiment 1, children who viewed an agent recalled more than children who did not. Experiments 2a and 2b utilized an eye tracker to demonstrate this effect was not due to differences in attention. Experiment 3 used a combined behavioral and event-related potential paradigm to show that condition effects were present in memory-related components. These converging results indicate a particular role for social knowledge in supporting memory for events.

Putting effort into infant cognition

Working memory allows for the manipulation of information in support of ongoing tasks, providing a workspace for cognitive processes such as learning, reasoning, and decision making. How well working memory works depends, in part, on effort. Someone who pays attention at the right time and place will have better memory, and performance. In adult cognitive research studies, participants' devotion of maximal task-focused effort is often taken for granted, but in infant studies researchers cannot make that assumption. Here we showcase how pupillometry can provide an easy-to-obtain physiological measure of cognitive effort, allowing us to better understand infants' emerging abilities. In our work, we used pupillometry to measure trial-by-trial fluctuations of effort, establishing that, just as in adults, it influences how well infants could encode information in visual working memory. We hope that by using physiological measures such as pupil dilation, there will be a renewed effort to investigate the interaction between infants' attentive states and cognition.

Illuminating the Dark Ages: Pupil Dilation as a Measure of Expectancy Violation Across the Life Span

Mainly for methodological reasons, little is known about the course of development of early cognitive competencies diagnosed with the violation of expectation (VoE) method in infants. The goal of this research was to evaluate the use of pupillometry as a unified approach to assess expectancy violations during and beyond the "dark ages" between 1 and 3 years. We tested children aged 1-6 years and adults (N = 279) with pictures of animals combined with matching or mismatching animal sounds. All age groups exhibited significantly greater pupil dilation in mismatched than matched trials. We conclude that pupillometry is a viable alternative to the VoE method that, by contrast to the latter, can be used throughout the life span.

Focused attention predicts visual working memory performance in 13-month-old infants: A pupillometric study

Attention turns looking, into seeing. Yet, little developmental research has examined the interface of attention and visual working memory (VWM), where what is seen is maintained for use in ongoing visual tasks. Using the task-evoked pupil response - a sensitive, real-time, involuntary measure of focused attention that has been shown to correlate with VWM performance in adults and older children - we examined the relationship between focused attention and VWM in 13-month-olds. We used a Delayed Match Retrieval paradigm, to test infants' VWM for object-location bindings - what went where - while recording anticipatory gaze responses and pupil dilation. We found that infants with greater focused attention during memory encoding showed significantly better memory performance. As well, trials that ended in a correct response had significantly greater pupil response during memory encoding than incorrect trials. Taken together, this shows that pupillometry can be used as a measure of focused attention in infants, and a means to identify those individuals, or moments, where cognitive effort is maximized.

The Role of Callous-Unemotional Traits on Adolescent Positive and Negative Emotional Reactivity: A Longitudinal Community-Based Study

Callous-unemotional (CU) traits are associated with lower emotional reactivity in adolescents. However, since previous studies have focused mainly on reactivity to negative stimuli, it is unclear whether reactivity to positive stimuli is also affected. Further, few studies have addressed the link between CU traits and emotional reactivity in longitudinal community samples, which is important for determining its generalizability and developmental course. In the current study, pupil dilation and self-ratings of arousal and valence were assessed in 100 adolescents (15-17 years) from a community sample, while viewing images with negative and positive valence from the International Affective Pictures System (IAPS). Behavioral traits (CU) were assessed concurrently, as well as at ages 12-15, and 8-9 (subsample, n = 68, low levels of prosocial behavior were used as a proxy for CU traits). The results demonstrate that CU traits assessed at ages 12-15 and 8-9 predicted less pupil dilation to both positive and negative images at ages 15-17. Further, CU traits at ages 12-15 and concurrently were associated with less negative valence ratings for negative images and concurrently to less positive valence ratings for positive images. The current findings demonstrate that CU traits are related to lower emotional reactivity to both negative and positive stimuli in adolescents from a community sample.

Different novelties revealed by infants' pupillary responses

To account for infants' perceptual and cognitive development, the constructivist model proposes that learning a new object depends on the capability of processing simpler lower-level units, and then integrating these units into more complex higher-level units based on their relationships, such as regular co-occurrence. Here, we demonstrate that the process of associating visual and auditory attributes to build a new multisensory object representation is not only observed in the course of development, but also in the course of infants' in-the-moment information processing. After a brief familiarization session of learning two pairs of novel audiovisual stimuli, 15-month-old infants showed two components in pupil dilations over time: A rapid dilation was observed when processing perceptually novel compared to familiar stimuli, and a slower dilation was observed when processing novel combinations of familiar stimuli. However, in 10-month-old infants, only the effect elicited by novel stimuli was observed. Our results therefore demonstrate that detecting perceptual novelty occurred earlier than detecting association novelty in infants' information processing. These results support the view that infants perceive newly-learned objects by processing their constituent attributes and then integrating these components, as suggested by the constructivist model.