The pupil as an indicator of unconscious memory: Introducing the pupil priming effect

Applicability and usefulness of pupillometry in the study of lexical access. A scoping review of primary research

Pupil dilation has been associated with the effort required to perform various cognitive tasks. At the lexical level, some studies suggest that this neurophysiological measure would provide objective, real-time information during word processing and lexical access. However, due to the scarcity and incipient advancement of this line of research, its applicability, use, and sensitivity are not entirely clear. This scoping review aims to determine the applicability and usefulness of pupillometry in the study of lexical access by providing an up-to-date overview of research in this area. Following the PRISMA protocol, 16 articles were included in this review. The results show that pupillometry is a highly applicable, useful, and sensitive method for assessing lexical skills of word recognition, word retrieval, and semantic activation. Moreover, it easily fits into traditional research paradigms and methods in the field. Because it is a non-invasive, objective, and automated procedure, it can be applied to any population or age group. However, the emerging development of this specific area of research and the methodological diversity observed in the included studies do not yet allow for definitive conclusions in this area, which in turn does not allow for meta-analyses or fully conclusive statements about what the pupil response actually reflects when processing words. Standardized pupillary recording and analysis methods need to be defined to generate more accurate, replicable research designs with more reliable results to strengthen this line of research.

Pupil size tracks cue-trace interactions during episodic memory retrieval

Our ability to remember past events requires not only storing enduring engrams or memory traces of these events, but also successfully reactivating these latent traces in response to appropriate cues at the time of retrieval-a process that has been termed ecphory. However, relatively little is known about the processes that facilitate the dynamic interactions between retrieval cues and stored memory traces that are critical for successful recognition and recollection. Recently, an intriguing link between pupil dilation and recognition memory has been identified, with studied items eliciting greater pupil dilation than unstudied items during retrieval. However, the processes contributing to this "pupillary old/new effect" remain unresolved, with current explanations suggesting that it reflects the strength of the underlying memory trace. Here, we explore the novel hypothesis that the pupillary old/new effect does not index memory strength alone, but rather reflects the facilitation of cue-trace interactions during episodic memory retrieval that may be supported by activity within the pupil-linked locus coeruleus-noradrenergic (LC-NA) arousal system. First, we show that the magnitude of pupil dilation is influenced by the degree of overlap between cue and trace information. Second, we find that the magnitude of pupil dilation reflects the amount of study contextual information reinstated during retrieval. These findings provide a novel framework for understanding the pupillary old/new effect, and identify a potential role for the LC-NA system in recognition memory retrieval.

Ocular Autonomic Nervous System: An Update from Anatomy to Physiological Functions

The autonomic nervous system (ANS) confers neural control of the entire body, mainly through the sympathetic and parasympathetic nerves. Several studies have observed that the physiological functions of the eye (pupil size, lens accommodation, ocular circulation, and intraocular pressure regulation) are precisely regulated by the ANS. Almost all parts of the eye have autonomic innervation for the regulation of local homeostasis through synergy and antagonism. With the advent of new research methods, novel anatomical characteristics and numerous physiological processes have been elucidated. Herein, we summarize the anatomical and physiological functions of the ANS in the eye within the context of its intrinsic connections. This review provides novel insights into ocular studies.

Study-test congruence of response levels in item stimulus-response priming

We investigated stimulus-response (S-R) memory links during object priming using a binary associative size judgement paradigm. At study, participants decided which of two objects was bigger in real life and, at test, made the same or the reverse judgement. We examined the effects of response congruence on item S-R priming in the associative paradigm. In Experiment 1, a task reversal manipulation had minimal impact on RT priming when classifications were congruent for both recombined objects between study and test. Experiment 2 found that RT priming was more disrupted by classification incongruence of the selected than of the nonselected item alone, with incongruence of the nonselected object having no effect on RTs. Experiment 3, however, found that classification incongruence of both items eliminated RT priming, indicating that a significant effect of classification incongruence for the nonselected item is only evident if both items are classification-incongruent. Finally, across all experiments, we found that accuracy was more sensitive than RTs to decision/action incongruence. We interpret these findings in light of a two-stream account of S-R priming, and suggest a few extensions to account for interactions between S-R links of recombined items.

Increased pupil dilation during tip-of-the-tongue states

Tip-of-the-tongue states (TOTs) are feelings of impending word retrieval success during a current failure to retrieve a target word. Though much is known and understood about TOT states from decades of research, research on potential psychophysiological correlates of the TOT state is still in its infancy, and existing studies point toward the involvement of neural processes that are associated with enhanced attention, motivation, and information-seeking. In the present study, we demonstrate that, during instances of target retrieval failure, TOT states are associated with greater pupillary dilation (i.e., autonomic arousal) in 91% of our sample. This is the first study to demonstrate a pupillometric correlate of the TOT experience, and this finding provides an important step toward understanding emotional attributes associated with TOT states. Mean pupil dilation also increased such that instances of target identification failure that were unaccompanied by TOT states < instances in which TOTs occurred < instances of target identification success. It is possible that TOTs reflect an intermediary state between complete target retrieval failure and full target retrieval.

Can pupillometry distinguish accurate from inaccurate familiarity?

Pupillometry, the measurement of pupil diameter, has become increasingly popular as a tool to investigate human memory. It has long been accepted that the pupil is able to distinguish familiar from completely novel items, a phenomenon known as "pupil old/new effect". Surprisingly, most pupillometric studies on the pupil old/new effect tend to disregard the possibility that the pupillary response to familiarity memory may not be entirely exclusive. Here, we investigated whether the pupillary response to old items correctly judged familiar (hits; accurate familiarity) can be differentiated from the pupillary response to new items wrongly judged familiar (false alarms; inaccurate familiarity). We found no evidence that the two processes could be isolated, as both accurate and inaccurate familiarity showed nearly identical mean and across-time pupillary responses. However, both familiarity hits and false alarms showed pupillary responses unequivocally distinct from those observed during either recollection or novelty detection, which suggests that the pupil measure of familiarity hits and/or false alarms was sufficiently sensitive. The pupillary response to false alarms may have been partially driven by perceptual fluency, since novel objects incorrectly judged to be old (i.e., false alarms) showed a higher degree of similarity to studied images than items correctly judged as novel (i.e., correct rejections). Thus, our results suggest that pupil dilation may not be able to distinguish accurate from inaccurate familiarity using standard recognition memory paradigms, and they also suggest that the pupillary response during familiarity feelings may also partly reflect perceptual fluency.

Eye pupil signals information gain

In conditions of constant illumination, the eye pupil diameter indexes the modulation of arousal state and responds to a large breadth of cognitive processes, including mental effort, attention, surprise, decision processes, decision biases, value beliefs, uncertainty, volatility, exploitation/exploration trade-off, or learning rate. Here, I propose an information theoretic framework that has the potential to explain the ensemble of these findings as reflecting pupillary response to information processing. In short, updates of the brain’s internal model, quantified formally as the Kullback–Leibler (KL) divergence between prior and posterior beliefs, would be the common denominator to all these instances of pupillary dilation to cognition. I show that stimulus presentation leads to pupillary response that is proportional to the amount of information the stimulus carries about itself and to the quantity of information it provides about other task variables. In the context of decision making, pupil dilation in relation to uncertainty is explained by the wandering of the evidence accumulation process, leading to large summed KL divergences. Finally, pupillary response to mental effort and variations in tonic pupil size are also formalized in terms of information theory. On the basis of this framework, I compare pupillary data from past studies to simple information-theoretic simulations of task designs and show good correspondance with data across studies. The present framework has the potential to unify the large set of results reported on pupillary dilation to cognition and to provide a theory to guide future research.

Cortical modulation of pupillary function: systematic review

BACKGROUND

The pupillary light reflex is the main mechanism that regulates the pupillary diameter; it is controlled by the autonomic system and mediated by subcortical pathways. In addition, cognitive and emotional processes influence pupillary function due to input from cortical innervation, but the exact circuits remain poorly understood. We performed a systematic review to evaluate the mechanisms behind pupillary changes associated with cognitive efforts and processing of emotions and to investigate the cerebral areas involved in cortical modulation of the pupillary light reflex.

METHODOLOGY

We searched multiple databases until November 2018 for studies on cortical modulation of pupillary function in humans and non-human primates. Of 8,809 papers screened, 258 studies were included.

RESULTS

Most investigators focused on pupillary dilatation and/or constriction as an index of cognitive and emotional processing, evaluating how changes in pupillary diameter reflect levels of attention and arousal. Only few tried to correlate specific cerebral areas to pupillary changes, using either cortical activation models (employing micro-stimulation of cortical structures in non-human primates) or cortical lesion models (e.g., investigating patients with stroke and damage to salient cortical and/or subcortical areas). Results suggest the involvement of several cortical regions, including the insular cortex (Brodmann areas 13 and 16), the frontal eye field (Brodmann area 8) and the prefrontal cortex (Brodmann areas 11 and 25), and of subcortical structures such as the locus coeruleus and the superior colliculus.

CONCLUSIONS

Pupillary dilatation occurs with many kinds of mental or emotional processes, following sympathetic activation or parasympathetic inhibition. Conversely, pupillary constriction may occur with anticipation of a bright stimulus (even in its absence) and relies on a parasympathetic activation. All these reactions are controlled by subcortical and cortical structures that are directly or indirectly connected to the brainstem pupillary innervation system.

Pupil-Linked Arousal Responds to Unconscious Surprisal

Pupil size under constant illumination reflects brain arousal state, and dilates in response to novel information, or surprisal. Whether this response can be observed regardless of conscious perception is still unknown. In the present study, male and female adult humans performed an implicit learning task across a series of three experiments. We measured pupil and brain-evoked potentials to stimuli that violated transition statistics but were not relevant to the task. We found that pupil size dilated following these surprising events, in the absence of awareness of transition statistics, and only when attention was allocated to the stimulus. These pupil responses correlated with central potentials, evoking an anterior cingulate origin. Arousal response to surprisal outside the scope of conscious perception points to the fundamental relationship between arousal and information processing and indicates that pupil size can be used to track the progression of implicit learning.SIGNIFICANCE STATEMENT Pupil size dilates following increase in mental effort, surprise, or more generally global arousal. However, whether this response arises as a conscious response or reflects a more fundamental mechanism outside the scrutiny of awareness is still unknown. Here, we demonstrate that unexpected changes in the environment, even when processed unconsciously and without being relevant to the task, lead to an increase in arousal levels as reflected by the pupillary response. Further, we show that the concurrent electrophysiological response shares similarities with mismatch negativity, suggesting the involvement of anterior cingulate cortex. All in all, our results establish novel insights about the mechanisms driving global arousal levels, and it provides new possibilities for reliably measuring unconscious processes.

Replication and extension of long-term implicit memory: Perceptual priming but conceptual cessation

We endeavored to replicate Mitchell's (2006) finding of 17-year implicit memory priming. Subjects saw word and picture stimuli in 1999-2000 (M age = 18.9) and were retested after 11-14 years (M = 13.2; M age = 32.1). Via the internet, they completed four implicit memory tasks: picture fragment identification, word fragment completion, word stem completion, and category exemplar generation. Relative to control subjects (matched on stimuli, age, and education), longitudinal subjects revealed priming on picture and word fragment identification (perceptual tasks), but no priming on word stem completion or category exemplar generation (conceptual tasks). Four longitudinal subjects who failed to recall participating in the prior laboratory session had priming similar to the 10 subjects who did remember. Thus, we replicated the longevity of perceptual priming for pictures, and extended this to word fragment priming as well.

The pupillary response discriminates between subjective and objective familiarity and novelty

The pupil response discriminates between old and new stimuli, with old stimuli characterized by larger pupil dilation patterns than new stimuli. We sought to explore the cause of the pupil old/new effect and discount the effect of targetness, effort, recollection retrieval, and complexity of the recognition decision. Two experiments are reported in which the pupil response and the eye fixation patterns were measured, while participants identified novel and familiar object stimuli, in two separate tasks, emphasizing either novelty or familiarity detection. In Experiment 1, familiarity and novelty decisions were taken using a rating scale, while in Experiment 2 a simpler yes/no decision was used. In both experiments, we found that detection of target familiar stimuli resulted in greater pupil dilation than the detection of target novel stimuli, while the duration of the first fixation discriminated between familiar and novel stimuli as early as within 320 ms after stimulus onset. Importantly, the pupil response distinguished between the objective (during an earlier temporal component) and the subjective (during a later temporal component) status of the stimulus for misses and false alarms. In the light of previous findings, we suggest that the pupil and fixation old/new effects reflect the distinct neural and cognitive mechanisms involved in the familiarity and novelty decisions. The findings also have important implications for the use of pupil dilation and eye movement patterns to explore explicit and implicit memory processes.

Does long-term object priming depend on the explicit detection of object identity at encoding?

It is currently unclear whether objects have to be explicitly identified at encoding for reliable behavioral long-term object priming to occur. We conducted two experiments that investigated long-term object and non-object priming using a selective-attention encoding manipulation that reduces explicit object identification. In Experiment 1, participants either counted dots flashed within an object picture (shallow encoding) or engaged in an animacy task (deep encoding) at study, whereas, at test, they performed an object-decision task. Priming, as measured by reaction times (RTs), was observed for both types of encoding, and was of equivalent magnitude. In Experiment 2, non-object priming (faster RTs for studied relative to unstudied non-objects) was also obtained under the same selective-attention encoding manipulation as in Experiment 1, and the magnitude of the priming effect was equivalent between experiments. In contrast, we observed a linear decrement in recognition memory accuracy across conditions (deep encoding of Experiment 1 > shallow encoding Experiment 1 > shallow encoding of Experiment 2), suggesting that priming was not contaminated by explicit memory strategies. We argue that our results are more consistent with the identification/production framework than the perceptual/conceptual distinction, and we conclude that priming of pictures largely ignored at encoding can be subserved by the automatic retrieval of two types of instances: one at the motor level and another at an object-decision level.