The "subjective" pupil old/new effect: is the truth plain to see?

Eyes on Memory: Pupillometry in Encoding and Retrieval

This review critically examines the contributions of pupillometry to memory research, primarily focusing on its enhancement of our understanding of memory encoding and retrieval mechanisms mainly investigated with the recognition memory paradigm. The evidence supports a close link between pupil response and memory formation, notably influenced by the type of novelty detected. This proposal reconciles inconsistencies in the literature regarding pupil response patterns that may predict successful memory formation, and highlights important implications for encoding mechanisms. The review also discusses the pupil old/new effect and its significance in the context of recollection and in reflecting brain signals related to familiarity or novelty detection. Additionally, the capacity of pupil response to serve as a true memory signal and to distinguish between true and false memories is evaluated. The evidence provides insights into the nature of false memories and offers a novel understanding of the cognitive mechanisms involved in memory distortions. When integrated with rigorous experimental design, pupillometry can significantly refine theoretical models of memory encoding and retrieval. Furthermore, combining pupillometry with neuroimaging and pharmacological interventions is identified as a promising direction for future research.

False memory-guided eye movements: insights from a DRM-Saccade paradigm

The Deese-Roediger and McDermott (DRM) paradigm and visually guided saccade tasks are both prominent research tools in their own right. This study introduces a novel DRM-Saccade paradigm, merging both methodologies. We used rule-based saccadic eye movements whereby participants were presented with items at test and were asked to make a saccade to the left or right of the item to denote a recognition or non-recognition decision. We measured old/new recognition decisions and saccadic latencies. Experiment 1 used a pro/anti saccade task to a single target. We found slower saccadic latencies for correct rejection of critical lures, but no latency difference between correct recognition of studied items and false recognition of critical lures. Experiment 2 used a two-target saccade task and also measured corrective saccades. Findings corroborated those from Experiment 1. Participants adjusted their initial decisions to increase accurate recognition of studied items and rejection of unrelated lures but there were no such corrections for critical lures. We argue that rapid saccades indicate cognitive processing driven by familiarity thresholds. These occur before slower source-monitoring is able to process any conflict. The DRM-Saccade task could effectively track real-time cognitive resource use during recognition decisions.

Pupil size tracks cue-trace interactions during episodic memory retrieval

Our ability to remember past events requires not only storing enduring engrams or memory traces of these events, but also successfully reactivating these latent traces in response to appropriate cues at the time of retrieval-a process that has been termed ecphory. However, relatively little is known about the processes that facilitate the dynamic interactions between retrieval cues and stored memory traces that are critical for successful recognition and recollection. Recently, an intriguing link between pupil dilation and recognition memory has been identified, with studied items eliciting greater pupil dilation than unstudied items during retrieval. However, the processes contributing to this "pupillary old/new effect" remain unresolved, with current explanations suggesting that it reflects the strength of the underlying memory trace. Here, we explore the novel hypothesis that the pupillary old/new effect does not index memory strength alone, but rather reflects the facilitation of cue-trace interactions during episodic memory retrieval that may be supported by activity within the pupil-linked locus coeruleus-noradrenergic (LC-NA) arousal system. First, we show that the magnitude of pupil dilation is influenced by the degree of overlap between cue and trace information. Second, we find that the magnitude of pupil dilation reflects the amount of study contextual information reinstated during retrieval. These findings provide a novel framework for understanding the pupillary old/new effect, and identify a potential role for the LC-NA system in recognition memory retrieval.

Pupil response patterns distinguish true from false memories

Memory is reconstructive and error-prone, which make memory illusions very common in everyday life. However, studying memory illusions can provide valuable insights into how memory works. Pupil response has emerged, in recent years, as an indicator of memory encoding and retrieval, however its validity as a measure of memory success is debated. In this study, we explored whether pupil response patterns can differentiate true from false memories and whether variations in the temporal dynamics of pupil response can elucidate the mechanisms underlying false memory creation. The Deese-Roediger-McDermott (DRM) paradigm was employed to generate false memories in two separate experiments involving visual and auditory stimuli. Pupil responses effectively differentiated true from false memories based on variations in pupil amplitude at different temporal components. This discrimination remained consistent across both experiments, with slightly stronger effects in the auditory condition, aligning with the more pronounced false memory effects in this condition. Notably, differential pupil responses between true and false memories varied based on the type of memory involved at recognition. These findings provide valuable insights into the cognitive processes underlying memory distortions, with implications for theoretical frameworks and real-world contexts.

Arousal-modulated memory encoding and retrieval in adults with autism spectrum disorder

Recently, we have shown that pupil dilation during a recognition memory task can serve as an index of memory retrieval difficulties in autism. At the time of publication, we were unaware of specific data-analysis methods that can be used to shed further light on the origins of such memory related pupil dilation. Specifically, by distinguishing "tonic" from "phasic" changes in pupil dilation and considering their temporal progression, it is possible to draw inferences about the functional integrity of a locus coeruleus-norepinephrine system (LC-NE) that is known to play a key role in regulating memory encoding and retrieval processes. We therefore apply these analyses to our previously published eye-tracking data of adults with ASD (N = 24) and neurotypical development (TD, N = 30) during the recognition memory task. In this re-analysis, we related pupil dilation during encoding and retrieval to recognition accuracy in a per-trial analysis of linear mixed models. In ASD, we replicated attenuated recognition accuracy, which was accompanied by attenuated pupil dilation during encoding and retrieval. Group differences in pupil dilation during retrieval occurred late during the trial (after 1.75 s) and indicated an altered top-down processing like attenuated attribution of semantic salience in response to previously encoded stimuli. In addition, only in the ASD group were higher pupil dilation during encoding and lower pupil dilation during retrieval associated with decreased recognition accuracy. This supports altered modulation of memory encoding and retrieval in ASD, with LC-NE phasic activity as promising underlying mechanism. LAY SUMMARY: We investigated the changes of pupil size during memory testing in autism spectrum disorder. Adults with ASD remembered fewer items correctly than neurotypical individuals (TD). This reduced memory was related to increased pupillary responses at study and decreased pupil dilation at test only for adults with ASD indicating a different modulation of memory by the locus coeruleus.

Can pupillometry distinguish accurate from inaccurate familiarity?

Pupillometry, the measurement of pupil diameter, has become increasingly popular as a tool to investigate human memory. It has long been accepted that the pupil is able to distinguish familiar from completely novel items, a phenomenon known as "pupil old/new effect". Surprisingly, most pupillometric studies on the pupil old/new effect tend to disregard the possibility that the pupillary response to familiarity memory may not be entirely exclusive. Here, we investigated whether the pupillary response to old items correctly judged familiar (hits; accurate familiarity) can be differentiated from the pupillary response to new items wrongly judged familiar (false alarms; inaccurate familiarity). We found no evidence that the two processes could be isolated, as both accurate and inaccurate familiarity showed nearly identical mean and across-time pupillary responses. However, both familiarity hits and false alarms showed pupillary responses unequivocally distinct from those observed during either recollection or novelty detection, which suggests that the pupil measure of familiarity hits and/or false alarms was sufficiently sensitive. The pupillary response to false alarms may have been partially driven by perceptual fluency, since novel objects incorrectly judged to be old (i.e., false alarms) showed a higher degree of similarity to studied images than items correctly judged as novel (i.e., correct rejections). Thus, our results suggest that pupil dilation may not be able to distinguish accurate from inaccurate familiarity using standard recognition memory paradigms, and they also suggest that the pupillary response during familiarity feelings may also partly reflect perceptual fluency.

Exploring word memorability: How well do different word properties explain item free-recall probability?

What makes some words more memorable than others? Words can vary in many dimensions, and a variety of lexical, semantic, and affective properties have previously been associated with variability in recall performance. Free recall data were used from 147 participants across 20 experimental sessions from the Penn Electrophysiology of Encoding and Retrieval Study (PEERS) data set, across 1,638 words. Here, I consider how well 20 different word properties-across lexical, semantic, and affective dimensions-relate to free recall. Semantic dimensions, particularly animacy (better memory for living), usefulness (with respect to survival; better memory for useful), and size (better memory for larger) demonstrated the strongest relationships with recall probability. These key results were then examined and replicated in the free recall data from Lau, Goh, and Yap (Quarterly Journal of Experimental Psychology, 71, 2207-2222, 2018), which had 532 words and 116 participants. This comprehensive investigation of a variety of word memorability demonstrates that semantic and function-related psycholinguistic properties play an important role in verbal memory processes.

Inferior parietal lobule is sensitive to different semantic similarity relations for concrete and abstract words

Similarity measures, the extent to which two concepts have similar meanings, are the key to understand how concepts are represented, with different theoretical perspectives relying on very different sources of data from which similarity can be calculated. While there is some commonality in similarity measures, the extent of their correlation is limited. Previous studies also suggested that the relative performance of different similarity measures may also vary depending on concept concreteness and that the inferior parietal lobule (IPL) may be involved in the integration of conceptual features in a multimodal system for the semantic categorization. Here, we tested for the first time whether theory-based similarity measures predict the pattern of brain activity in the IPL differently for abstract and concrete concepts. English speakers performed a semantic decision task, while we recorded their brain activity in IPL through fNIRS. Using representational similarity analysis, results indicated that the neural representational similarity in IPL conformed to the lexical co-occurrence among concrete concepts (regardless of the hemisphere) and to the affective similarity among abstract concepts in the left hemisphere only, implying that semantic representations of abstract and concrete concepts are characterized along different organizational principles in the IPL. We observed null results for the decoding accuracy. Our study suggests that the use of the representational similarity analysis as a complementary analysis to the decoding accuracy is a promising tool to reveal similarity patterns between theoretical models and brain activity recorded through fNIRS.

Pupil size changes signal hippocampus-related memory functions

A major task of episodic memory is to create unique, distinguishable representations of highly overlapping perceptual inputs. Several studies on this basic function have shown that it is based on the intact functioning of certain subregions of the hippocampus and is among the most sensitive behavioral indicators of mild cognitive impairment (MCI) and dementia. Here we assessed pupil dilation associated with performance in a widely used recognition paradigm that aims to uncover the intactness of fine-graded mnemonic discrimination. A sample of healthy undergraduate students was used. First, we showed that the correct discrimination between highly similar lure items and target items elicit larger pupil response than correct target identification. Second, we found that mnemonic discrimination is associated with larger pupil response in general as compared to target identification, regardless of whether the response was correct or not. These results suggest the pupil changes differentiate mnemonic discrimination and memory identification processes in recognition performance.

Catching the intangible: a role for emotion?

A crucial aspect of Gilead and colleagues’ ontology is the dichotomy between tangible and intangible representations, but the latter remains rather ill-defined. We propose a fundamental role for interoceptive experience and the statistical distribution of entities in language, especially for intangible representations, that we believe Gilead and colleagues’ ontology needs to incorporate.

J. Janssen S, Gallouj K, Lenoble Q. Autobiographical Memory Increases Pupil Dilation

BACKGROUND

Pupil activity has been widely considered as a "summed index" of physiological activities during cognitive processing.

METHODOLOGY

We investigated pupil dilation during retrieval of autobiographical memory and compared pupil diameter with a control condition in which participants had to count aloud. We also measured pupil diameters retrieval of free (i.e., first memory that comes to mind), positive, and negative memories (memories associated, respectively, with the words "happy" and "sad").

RESULTS

Analyses demonstrated larger pupil diameters during the free, positive, and negative autobiographical memory retrieval than during the control task. Analyses also demonstrated no significant differences in pupil diameters across the three autobiographical memory conditions.

CONCLUSION

These outcomes demonstrate that, compared with counting, autobiographical retrieval results in a larger pupil size. However, the emotional valence of memories yields non-significant effect on pupil diameters. Our findings demonstrate how autobiographical memory retrieval yields pupil dilation.

The interplay between control processes and feature relevance: Evidence from dual-task methodology

Neuropsychological studies suggest a distinction between (a) semantic knowledge and (b) control processes that shape the retrieval of conceptual information to suit the task or context. These aspects of semantic cognition are specifically impaired in patients with semantic dementia and semantic aphasia, respectively. However, interactions between the structure of knowledge and control processes that are expected during semantic retrieval have not been fully characterised. In particular, domain-general executive resources may not have equal relevance for the capacity to promote weak yet task relevant features (i.e., "controlled retrieval) and to ignore or suppress distracting information (i.e., "selection"). Here, using a feature selection task, we tested the contribution of featural relevance to semantic performance in healthy participants under conditions of divided attention. Healthy participants showed greater dual-task disruption as the relevance value of the distractor feature linearly increased, supporting the emerging view that semantic relevance is one of the organising principles of the structure of semantic representation. Moreover, word frequency, and inter-correlational strength affected overall performance, but they did not show an interaction with dual-task conditions. These results suggest that domain-general control processes, disrupted by divided attention, are more important to the capacity to efficiently avoid distracting information during semantic decision-making than to the promotion of weak target features. The present study therefore provides novel information about the nature of the interaction between structured conceptual knowledge and control processes that support the retrieval of appropriate information and relates these results to a new theoretical framework, termed controlled semantic cognition.

Cortical modulation of pupillary function: systematic review

BACKGROUND

The pupillary light reflex is the main mechanism that regulates the pupillary diameter; it is controlled by the autonomic system and mediated by subcortical pathways. In addition, cognitive and emotional processes influence pupillary function due to input from cortical innervation, but the exact circuits remain poorly understood. We performed a systematic review to evaluate the mechanisms behind pupillary changes associated with cognitive efforts and processing of emotions and to investigate the cerebral areas involved in cortical modulation of the pupillary light reflex.

METHODOLOGY

We searched multiple databases until November 2018 for studies on cortical modulation of pupillary function in humans and non-human primates. Of 8,809 papers screened, 258 studies were included.

RESULTS

Most investigators focused on pupillary dilatation and/or constriction as an index of cognitive and emotional processing, evaluating how changes in pupillary diameter reflect levels of attention and arousal. Only few tried to correlate specific cerebral areas to pupillary changes, using either cortical activation models (employing micro-stimulation of cortical structures in non-human primates) or cortical lesion models (e.g., investigating patients with stroke and damage to salient cortical and/or subcortical areas). Results suggest the involvement of several cortical regions, including the insular cortex (Brodmann areas 13 and 16), the frontal eye field (Brodmann area 8) and the prefrontal cortex (Brodmann areas 11 and 25), and of subcortical structures such as the locus coeruleus and the superior colliculus.

CONCLUSIONS

Pupillary dilatation occurs with many kinds of mental or emotional processes, following sympathetic activation or parasympathetic inhibition. Conversely, pupillary constriction may occur with anticipation of a bright stimulus (even in its absence) and relies on a parasympathetic activation. All these reactions are controlled by subcortical and cortical structures that are directly or indirectly connected to the brainstem pupillary innervation system.

Recognition memory and featural similarity between concepts: The pupil's point of view

Differences in pupil dilation are observed for studied compared to new items in recognition memory. According to cognitive load theory, this effect reflects the greater cognitive demands of retrieving contextual information from study phase. Pupil dilation can also occur when new items conceptually related to old ones are erroneously recognized as old, but the aspects of similarity that modulate false memory and related pupil responses remain unclear. We investigated this issue by manipulating the degree of featural similarity between new (unstudied) and old (studied) concepts in an old/new recognition task. We found that new concepts with high similarity were mistakenly identified as old and had greater pupil dilation than those with low similarity, suggesting that pupil dilation reflects the strength of evidence on which recognition judgments are based and, importantly, greater locus coeruleus and prefrontal activity determined by the higher degree of retrieval monitoring involved in recognizing these items.

Teaching the science of learning

The science of learning has made a considerable contribution to our understanding of effective teaching and learning strategies. However, few instructors outside of the field are privy to this research. In this tutorial review, we focus on six specific cognitive strategies that have received robust support from decades of research: spaced practice, interleaving, retrieval practice, elaboration, concrete examples, and dual coding. We describe the basic research behind each strategy and relevant applied research, present examples of existing and suggested implementation, and make recommendations for further research that would broaden the reach of these strategies.

Foggy windows: Pupillary responses during task preparation

We investigated pupil dilation in 96 subjects during task preparation and during a post-trial interval in a visual search task and an auditory working memory task. Completely informative difficulty cues (easy, medium, or hard) were presented right before task preparation to examine whether pupil dilation indicated advance mobilisation of attentional resources; functional magnetic resonance imaging (fMRI) studies have argued for the existence of such task preparation, and the literature shows that pupil dilation tracks attentional effort during task performance. We found, however, little evidence for such task preparation. In the working memory task, pupil size was identical across cues, and although pupil dilation in the visual search task tracked the cue, pupil dilation predicted subsequent performance in neither task. Pupil dilation patterns in the post-trial interval were more consistent with an effect of emotional reactivity. Our findings suggest that the mobilisation of attentional resources in the service of the task does not occur during the preparatory interval, but is delayed until the task itself is initiated.

Motivated Cognition: Effects of Reward, Emotion, and Other Motivational Factors Across a Variety of Cognitive Domains

A growing body of literature has demonstrated that motivation influences cognitive processing. The breadth of these effects is extensive and span influences of reward, emotion, and other motivational processes across all cognitive domains. As examples, this scope includes studies of emotional memory, value-based attentional capture, emotion effects on semantic processing, reward-related biases in decision making, and the role of approach/avoidance motivation on cognitive scope. Additionally, other less common forms of motivation–cognition interactions, such as self-referential and motoric processing can also be considered instances of motivated cognition. Here I outline some of the evidence indicating the generality and pervasiveness of these motivation influences on cognition, and introduce the associated ‘research nexus’ at Collabra: Psychology.

Is Moving More Memorable than Proving? Effects of Embodiment and Imagined Enactment on Verb Memory

Theories of embodied cognition propose that sensorimotor information is simulated during language processing (e.g., Barsalou, 1999). Previous studies have demonstrated that differences in simulation can have implications for word processing; for instance, lexical processing is facilitated for verbs that have relatively more embodied meanings (e.g., Sidhu et al., 2014). Here we examined the effects of these differences on memory for verbs. We observed higher rates of recognition (Experiments 1a-2a) and recall accuracy (Experiments 2b-3b) for verbs with a greater amount of associated bodily information (i.e., an embodiment effect). We also examined how this interacted with the imagined enactment effect: a memory benefit for actions that one imagines performing (e.g., Ditman et al., 2010). We found that these two effects did not interact (Experiment 3b), suggesting that the memory benefits of automatic simulation (i.e., the embodiment effect) and deliberate simulation (i.e., the imagined enactment effect) are distinct. These results provide evidence for the role of simulation in language processing, and its effects on memory.

The pupillary response discriminates between subjective and objective familiarity and novelty

The pupil response discriminates between old and new stimuli, with old stimuli characterized by larger pupil dilation patterns than new stimuli. We sought to explore the cause of the pupil old/new effect and discount the effect of targetness, effort, recollection retrieval, and complexity of the recognition decision. Two experiments are reported in which the pupil response and the eye fixation patterns were measured, while participants identified novel and familiar object stimuli, in two separate tasks, emphasizing either novelty or familiarity detection. In Experiment 1, familiarity and novelty decisions were taken using a rating scale, while in Experiment 2 a simpler yes/no decision was used. In both experiments, we found that detection of target familiar stimuli resulted in greater pupil dilation than the detection of target novel stimuli, while the duration of the first fixation discriminated between familiar and novel stimuli as early as within 320 ms after stimulus onset. Importantly, the pupil response distinguished between the objective (during an earlier temporal component) and the subjective (during a later temporal component) status of the stimulus for misses and false alarms. In the light of previous findings, we suggest that the pupil and fixation old/new effects reflect the distinct neural and cognitive mechanisms involved in the familiarity and novelty decisions. The findings also have important implications for the use of pupil dilation and eye movement patterns to explore explicit and implicit memory processes.

The eye in hand: predicting others' behavior by integrating multiple sources of information

The ability to predict the outcome of other beings' actions confers significant adaptive advantages. Experiments have assessed that human action observation can use multiple information sources, but it is currently unknown how they are integrated and how conflicts between them are resolved. To address this issue, we designed an action observation paradigm requiring the integration of multiple, potentially conflicting sources of evidence about the action target: the actor's gaze direction, hand preshape, and arm trajectory, and their availability and relative uncertainty in time. In two experiments, we analyzed participants' action prediction ability by using eye tracking and behavioral measures. The results show that the information provided by the actor's gaze affected participants' explicit predictions. However, results also show that gaze information was disregarded as soon as information on the actor's hand preshape was available, and this latter information source had widespread effects on participants' prediction ability. Furthermore, as the action unfolded in time, participants relied increasingly more on the arm movement source, showing sensitivity to its increasing informativeness. Therefore, the results suggest that the brain forms a robust estimate of the actor's motor intention by integrating multiple sources of information. However, when informative motor cues such as a preshaped hand with a given grip are available and might help in selecting action targets, people tend to capitalize on such motor cues, thus turning out to be more accurate and fast in inferring the object to be manipulated by the other's hand.

Manipulability impairs association-memory: revisiting effects of incidental motor processing on verbal paired-associates

Imageability is known to enhance association-memory for verbal paired-associates. High-imageability words can be further subdivided by manipulability, the ease by which the named object can be functionally interacted with. Prior studies suggest that motor processing enhances item-memory, but impairs association-memory. However, these studies used action verbs and concrete nouns as the high- and low-manipulability words, respectively, confounding manipulability with word class. Recent findings demonstrated that nouns can serve as both high- and low-manipulability words (e.g., CAMERA and TABLE, respectively), allowing us to avoid this confound. Here participants studied pairs of words that consisted of all possible pairings of high- and low-manipulability words and were tested with immediate cued recall. Recall was worse for pairs that contained high-manipulability words. In free recall, participants recalled more high- than low-manipulability words. Our results provide further evidence that manipulability influences memory, likely occurring through automatic motor imagery.