The pupillary light response reveals the focus of covert visual attention

Mechanisms of visual working memory processing task-irrelevant information retrieved from visual long-term memory

Visual working memory (VWM) can selectively filter task-irrelevant information from incoming visual stimuli. However, whether a similar filtering process applies to task-irrelevant information retrieved from visual long-term memory (VLTM) remains elusive. We assume a "resource-limited retrieval mechanism" in VWM in charge of the retrieval of irrelevant VLTM information. To make a comprehensive understanding of this mechanism, we conducted three experiments using both a VLTM learning task and a VWM task combined with pupillometry. The presence of a significant pupil light response (PLR) served as empirical evidence that VLTM information can indeed make its way into VWM. Notably, task-relevant VLTM information induced a sustained PLR, contrasting with the transient PLR observed for task-irrelevant VLTM information. Importantly, the transience of the PLR occurred under conditions of low VWM load, but this effect was absent under conditions of high load. Collectively, these results show that task-irrelevant VLTM information can enter VWM and then fade away only under conditions of low VWM load. This dynamic underscores the resource-limited retrieval mechanism within VWM, exerting control over the entry of VLTM information.

Inter-individual variability (but intra-individual stability) of overt versus covert rehearsal strategies in a digital Corsi task

The Corsi (block-tapping) paradigm is a classic and well-established visuospatial working memory task in humans involving internal computations (memorizing of item sequences, organizing and updating the memorandum, and recall processes), as well as both overt and covert shifts of attention to facilitate rehearsal, serving to maintain the Corsi sequences during the retention phase. Here, we introduce a novel digital version of a Corsi task in which i) the difficulty of the memorandum (using sequence lengths ranging from 3 to 8) was controlled, ii) the execution of overt and/or covert attention as well as the visuospatial working memory load during the retention phase was manipulated, and iii) shifts of attention were quantified in all experimental phases. With this, we present behavioral data that demonstrate, characterize, and classify the individual effects of overt and covert strategies used as a means of encoding and rehearsal. In a full within-subject design, we tested 28 participants who had to solve three different Corsi conditions. While in condition A neither of the two strategies were restricted, in condition B the overt and in condition C the overt as well as the covert strategies were suppressed. Analyzing Corsi span, (eye) exploration index, and pupil size (change), data clearly show a continuum between overt and covert strategies over all participants (indicating inter-individual variability). Further, all participants showed stable strategy choice (indicating intra-individual stability), meaning that the preferred strategy was maintained in all three conditions, phases, and sequence lengths of the experiment.

Illusory light drives pupil responses in primates

In humans, the eye pupils respond to both physical light sensed by the retina and mental representations of light produced by the brain. Notably, our pupils constrict when a visual stimulus is illusorily perceived brighter, even if retinal illumination is constant. However, it remains unclear whether such perceptual penetrability of pupil responses is an epiphenomenon unique to humans or whether it represents an adaptive mechanism shared with other animals to anticipate variations in retinal illumination between successive eye fixations. To address this issue, we measured the pupil responses of both humans and macaque monkeys exposed to three chromatic versions (cyan, magenta, and yellow) of the Asahi brightness illusion. We found that the stimuli illusorily perceived brighter or darker trigger differential pupil responses that are very similar in macaques and human participants. Additionally, we show that this phenomenon exhibits an analogous cyan bias in both primate species. Beyond evincing the macaque monkey as a relevant model to study the perceptual penetrability of pupil responses, our results suggest that this phenomenon is tuned to ecological conditions because the exposure to a "bright cyan-bluish sky" may be associated with increased risks of dazzle and retinal damages.

Glossiness perception and its pupillary response

Recent studies have revealed that pupillary response changes depend on perceptual factors such as subjective brightness caused by optical illusions and luminance. However, the manner in which the perceptual factor that is derived from the glossiness perception of object surfaces affects the pupillary response remains unclear. We investigated the relationship between the glossiness perception and pupillary response through a glossiness rating experiment that included recording the pupil diameter. We prepared general object images (original) and randomized images (shuffled) that comprised the same images with randomized small square regions as stimuli. The image features were controlled by matching the luminance histogram. The observers were asked to rate the perceived glossiness of the stimuli presented for 3,000 ms and the changes in their pupil diameters were recorded. Images with higher glossiness ratings constricted the pupil size more than those with lower glossiness ratings at the peak constriction of the pupillary responses during the stimulus duration. The linear mixed-effects model demonstrated that the glossiness rating, image category (original/shuffled), variance of the luminance histogram, and stimulus area were most effective in predicting the pupillary responses. These results suggest that the illusory brightness obtained by the image regions of high-glossiness objects, such as specular highlights, induce pupil constriction.

Functional benefits of cognitively driven pupil-size changes

Pupil-size changes are typically associated with the pupil light response (PLR), where they are driven by the physical entry of light into the eye. However, pupil-size changes are also influenced by various cognitive processes, where they are driven by higher-level cognition. For example, the strength of the PLR is not solely affected by physical properties of the light but also by cognitive factors, such as whether the source of light is attended or not, which results in an increase or decrease in the strength of the PLR. Surprisingly, although cognitively driven pupil-size changes have been the focus of extensive research, their possible functions are rarely discussed. Here we consider the relative (dis)advantages of small versus large pupils in different situations from a theoretical point of view, and compare these to empirical results showing how pupil size actually changes in these situations. Based on this, we suggest that cognitively driven pupil-size changes optimize vision either through preparation, embodied representations, or a differential emphasis on central or peripheral vision. More generally, we argue that cognitively driven pupil-size changes are a form of sensory tuning: a subtle adjustment of the eyes to optimize vision for the current situation and the immediate future. This article is categorized under: Neuroscience > Cognition Neuroscience > Physiology Neuroscience > Behavior.

Adaptation to numerosity affects the pupillary light response

We recently showed that the gain of the pupillary light response depends on numerosity, with weaker responses to fewer items. Here we show that this effect holds when the stimuli are physically identical but are perceived as less numerous due to numerosity adaptation. Twenty-eight participants adapted to low (10 dots) or high (160 dots) numerosities and subsequently watched arrays of 10-40 dots, with variable or homogeneous dot size. Luminance was constant across all stimuli. Pupil size was measured with passive viewing, and the effects of adaptation were checked in a separate psychophysical session. We found that perceived numerosity was systematically lower, and pupillary light responses correspondingly smaller, following adaptation to high rather than low numerosities. This is consistent with numerosity being a primary visual feature, spontaneously encoded even when task irrelevant, and affecting automatic and unconscious behaviours like the pupillary light response.

Revealing visual working memory operations with pupillometry: Encoding, maintenance, and prioritization

Pupillary dynamics reflect effects of distinct and important operations of visual working memory: encoding, maintenance, and prioritization. Here, we review how pupil size predicts memory performance and how it provides novel insights into the mechanisms of each operation. Visual information must first be encoded into working memory with sufficient precision. The depth of this encoding process couples to arousal-linked baseline pupil size as well as a pupil constriction response before and after stimulus onset, respectively. Subsequently, the encoded information is maintained over time to ensure it is not lost. Pupil dilation reflects the effortful maintenance of information, wherein storing more items is accompanied by larger dilations. Lastly, the most task-relevant information is prioritized to guide upcoming behavior, which is reflected in yet another dilatory component. Moreover, activated content in memory can be pupillometrically probed directly by tagging visual information with distinct luminance levels. Through this luminance-tagging mechanism, pupil light responses reveal whether dark or bright items receive more attention during encoding and prioritization. Together, conceptualizing pupil responses as a sum of distinct components over time reveals insights into operations of visual working memory. From this viewpoint, pupillometry is a promising avenue to study the most vital operations through which visual working memory works. This article is categorized under: Psychology > Attention Psychology > Memory Psychology > Theory and Methods.

From pre-processing to advanced dynamic modeling of pupil data

The pupil of the eye provides a rich source of information for cognitive scientists, as it can index a variety of bodily states (e.g., arousal, fatigue) and cognitive processes (e.g., attention, decision-making). As pupillometry becomes a more accessible and popular methodology, researchers have proposed a variety of techniques for analyzing pupil data. Here, we focus on time series-based, signal-to-signal approaches that enable one to relate dynamic changes in pupil size over time with dynamic changes in a stimulus time series, continuous behavioral outcome measures, or other participants' pupil traces. We first introduce pupillometry, its neural underpinnings, and the relation between pupil measurements and other oculomotor behaviors (e.g., blinks, saccades), to stress the importance of understanding what is being measured and what can be inferred from changes in pupillary activity. Next, we discuss possible pre-processing steps, and the contexts in which they may be necessary. Finally, we turn to signal-to-signal analytic techniques, including regression-based approaches, dynamic time-warping, phase clustering, detrended fluctuation analysis, and recurrence quantification analysis. Assumptions of these techniques, and examples of the scientific questions each can address, are outlined, with references to key papers and software packages. Additionally, we provide a detailed code tutorial that steps through the key examples and figures in this paper. Ultimately, we contend that the insights gained from pupillometry are constrained by the analysis techniques used, and that signal-to-signal approaches offer a means to generate novel scientific insights by taking into account understudied spectro-temporal relationships between the pupil signal and other signals of interest.

Non-image-forming vision as measured through ipRGC-mediated pupil constriction is not modulated by covert visual attention

In brightness, the pupil constricts, while in darkness, the pupil dilates; this is known as the pupillary light response (PLR). The PLR is driven by all photoreceptors: rods and cones, which contribute to image-forming vision, and intrinsically photosensitive retinal ganglion cells (ipRGCs), which mainly contribute to non-image-forming vision. Rods and cones cause immediate pupil constriction upon light exposure, whereas ipRGCs cause sustained constriction throughout light exposure. Recent studies have shown that covert attention modulated the initial PLR; however, it remains unclear whether the same holds for the sustained PLR. We tested this by leveraging ipRGCs' responsiveness to blue light, causing the most prominent sustained constriction. While replicating previous studies by showing that pupils constricted more when either directly looking at, or covertly attending to, bright as compared to dim stimuli (with the same color), we also found that the pupil constricted more when directly looking at blue as compared to red stimuli (with the same luminosity). Crucially, however, in two high-powered studies (n = 60), we did not find any pupil-size difference when covertly attending to blue as compared to red stimuli. This suggests that ipRGC-mediated pupil constriction, and possibly non-image-forming vision more generally, is not modulated by covert attention.

Eye movements reveal that young school children shift attention when solving additions and subtractions

Adults shift their attention to the right or to the left along a spatial continuum when solving additions and subtractions, respectively. Studies suggest that these shifts not only support the exact computation of the results but also anticipatively narrow down the range of plausible answers when processing the operands. However, little is known on when and how these attentional shifts arise in childhood during the acquisition of arithmetic. Here, an eye-tracker with high spatio-temporal resolution was used to measure spontaneous eye movements, used as a proxy for attentional shifts, while children of 2nd (8 y-o; N = 50) and 4th (10 y-o; N = 48) Grade solved simple additions (e.g., 4+3) and subtractions (e.g., 3-2). Gaze patterns revealed horizontal and vertical attentional shifts in both groups. Critically, horizontal eye movements were observed in 4th Graders as soon as the first operand and the operator were presented and thus before the beginning of the exact computation. In 2nd Graders, attentional shifts were only observed after the presentation of the second operand just before the response was made. This demonstrates that spatial attention is recruited when children solve arithmetic problems, even in the early stages of learning mathematics. The time course of these attentional shifts suggests that with practice in arithmetic children start to use spatial attention to anticipatively guide the search for the answer and facilitate the implementation of solving procedures. RESEARCH HIGHLIGHTS: Additions and subtractions are associated to right and left attentional shifts in adults, but it is unknown when these mechanisms arise in childhood. Children of 8-10 years old solved single-digit additions and subtractions while looking at a blank screen. Eye movements showed that children of 8 years old already show spatial biases possibly to represent the response when knowing both operands. Children of 10 years old shift attention before knowing the second operand to anticipatively guide the search for plausible answers.

Changes in attentional breadth scale with the demands of Kanizsa-figure object completion-evidence from pupillometry

The present study investigated whether the integration of separate parts into a whole-object representation varies with the amount of available attentional resources. To this end, two experiments were performed, which required observers to maintain central fixation while searching in peripheral vision for a target among various distractor configurations. The target could either be a "grouped" whole-object Kanizsa figure, or an "ungrouped" configuration of identical figural parts, but which do not support object completion processes to the same extent. In the experiments, accuracies and changes in pupil size were assessed, with the latter reflecting a marker of the covert allocation of attention in the periphery. Experiment 1 revealed a performance benefit for grouped (relative to ungrouped) targets, which increased with decreasing distance from fixation. By contrast, search for ungrouped targets was comparably poor in accuracy without revealing any eccentricity-dependent variation. Moreover, measures of pupillary dilation mirrored this eccentricity-dependent advantage in localizing grouped targets. Next, in Experiment 2, an additional attention-demanding foveal task was introduced in order to further reduce the availability of attentional resources for the peripheral detection task. This additional task hampered performance overall, alongside with corresponding pupil size changes. However, there was still a substantial benefit for grouped over ungrouped targets in both the behavioral and the pupillometric data. This shows that perceptual grouping scales with the allocation of attention even when only residual attentional resources are available to trigger the representation of a complete (target) object, thus illustrating that object completion operates in the "near absence" of attention.

Eye pupil signals life motion perception

The ability to readily detect and recognize biological motion (BM) is fundamental to survival and interpersonal communication. However, perception of BM is strongly disrupted when it is shown upside down. This well-known inversion effect is proposed to be caused by a life motion detection mechanism highly tuned to gravity-compatible motion cues. In the current study, we assessed the inversion effect in BM perception using a no-report pupillometry. We found that the pupil size was significantly enlarged when observers viewed upright BMs (gravity-compatible) compared with the inverted counterparts (gravity-incompatible). Importantly, such an effect critically depended on the dynamic biological characteristics, and could be extended to local feet motion signals. These findings demonstrate that the eye pupil can signal gravity-dependent life motion perception. More importantly, with the convenience, objectivity, and noninvasiveness of pupillometry, the current study paves the way for the potential application of pupillary responses in detecting the deficiency of life motion perception in individuals with socio-cognitive disorders.

Decoupling of the pupillary light response during internal attention: The modulating effect of luminance intensity

In a world full of sensory stimuli, attention guides us between the external environment and our internal thoughts. While external attention involves processing sensory stimuli, internal attention is devoted to self-generated representations such as planning or spontaneous mind wandering. They both draw from common cognitive resources, thus simultaneous engagement in both often leads to interference between processes. In order to maintain internal focus, an attentional mechanism known as perceptual decoupling takes effect. This mechanism supports internal cognition by decoupling attention from the perception of sensory information. Two previous studies of our lab investigated to what extent perceptual decoupling is evident in voluntary eye movements. Findings showed that the effect is mediated by the internal task modality and workload (visuospatial > arithmetic and high > low, respectively). However, it remains unclear whether it extends to involuntary eye behavior, which may not share cognitive resources with internal activities. Therefore, the present experiment aimed to further elucidate attentional dynamics by examining whether internal attention affects the pupillary light response (PLR). Specifically, we consistently observed that workload and task modality of the internal task reduced the PLR to luminance changes of medium intensity. However, the PLR to strong luminance changes was less or not at all affected by the internal task. These results suggest that perceptual decoupling effects may be less consistent in involuntary eye behavior, particularly in the context of a salient visual stimulus.

Delayed oculomotor response associates with optic neuritis in youth with demyelinating disorders

INTRODUCTION

Impairment in visual and cognitive functions occur in youth with demyelinating disorders such as multiple sclerosis, neuromyelitis optica spectrum disorder, and myelin oligodendrocyte glycoprotein antibody-associated disease. Quantitative behavioral assessment using eye-tracking and pupillometry can provide functional metrics for important prognostic and clinically relevant information at the bedside.

METHODS

Children and adolescents diagnosed with demyelinating disorders and healthy, age-matched controls completed an interleaved pro- and anti-saccade task using video-based eye-tracking and underwent spectral-domain optical coherence tomography examination for evaluation of retinal nerve fiber layer and ganglion cell inner plexiform layer thickness. Low-contrast visual acuity and Symbol Digit Modalities Test were performed for visual and cognitive functional assessments. We assessed saccade and pupil parameters including saccade reaction time, direction error rate, pupil response latency, peak constriction time, and peak constriction and dilation velocities. Generalized Estimating Equations were used to examine the association of eye-tracking parameters with optic neuritis history, structural metrics, and visual and cognitive scores.

RESULTS

The study included 36 demyelinating disorders patients, aged 8-18 yrs. (75% F; median = 15.22 yrs., SD = 2.8) and 34 age-matched controls (65% F; median = 15.26 yrs., SD = 2.3). Surprisingly, pro- and anti-saccade performance was comparable between patients and controls, whereas pupil control was altered in patients. Oculomotor latency measures were strongly associated with the number of optic neuritis episodes, including saccade reaction time, pupil response latency, and peak constriction time. Peak constriction time was associated with both retinal nerve fiber layer and ganglion cell inner plexiform layer thickness. Pupil response latency and peak constriction time were associated with visual acuity. Pupil velocity for both constriction and dilation was associated with Symbol Digit Modalities Test scores.

CONCLUSION

The strong associations between oculomotor measures with history of optic neuritis, structural, visual, and cognitive assessments in these cohorts demonstrates that quantitative eye-tracking can be useful for probing demyelinating injury of the brain and optic nerve. Future studies should evaluate their utility in discriminating between demyelinating disorders and tracking disease progression.

Parallel phonological processing of Chinese characters revealed by flankers tasks

An important and extensively researched question in the field of reading is whether readers can process multiple words in parallel. An unresolved issue regarding this question is whether the phonological information from foveal and parafoveal words can be processed in parallel, i.e., parallel phonological processing. The present study aims to investigate whether there is parallel phonological processing of Chinese characters. The original and the revised flankers tasks were applied. In both tasks, a foveal target character was presented in isolation in the no-flanker condition, flanked on both sides by a parafoveal homophone in the homophone-flanker condition, and by a non-homophonic character in the unrelated-flanker condition. Participants were instructed to fixate on the target characters and press two keys to indicate whether they knew the target characters (lexical vs. non-lexical). In the original flankers task, the stimuli were presented for 150 ms without a post-mask. In the revised flankers task, we set the stimulus exposure time (duration of the stimuli plus the blank interval between the stimuli and the post-mask) to each participant's lexical decision threshold to prevent participants from processing the target and flanker characters serially. In both tasks, reaction times to the lexical targets were significantly shorter in the homophone-flanker condition than in the unrelated-flanker condition, suggesting parallel phonological processing of Chinese characters. In the revised flankers task, accuracy rates to the lexical targets were significantly lower in the unrelated-flanker condition compared to the homophone-flanker condition, further supporting parallel phonological processing of Chinese characters. Moreover, reaction times to the lexical targets were the shortest in the no-flanker condition in both tasks, reflecting the attention distribution over both the target and flanker characters. The findings of this study provide valuable insights into the parallel processing mechanisms involved in reading.

Pupil Size Is Sensitive to Low-Level Stimulus Features, Independent of Arousal-Related Modulation

Similar to a camera aperture, pupil size adjusts to the surrounding luminance. Unlike a camera, pupil size is additionally modulated both by stimulus properties and by cognitive processes, including attention and arousal, though the interdependence of these factors is unclear. We hypothesized that different stimulus properties interact to jointly modulate pupil size while remaining independent from the impact of arousal. We measured pupil responses from human observers to equiluminant stimuli during a demanding rapid serial visual presentation (RSVP) task at fixation and tested how response amplitude depends on contrast, spatial frequency, and reward level. We found that under constant luminance, unattended stimuli evoke responses that are separable from changes caused by general arousal or attention. We further uncovered a double-dissociation between task-related responses and stimulus-evoked responses, suggesting that different sources of pupil size modulation are independent of one another. Our results shed light on neural pathways underlying pupillary response.

Uncovering the (un)attended: Pupil light responses index persistent biases of spatial attention in neglect

Visuospatial neglect is a frequent and disabling disorder, mostly after stroke, that presents in impaired awareness to stimuli on one side of space. Neglect causes disability and functional dependence, even long after the injury. Improving measurements of the core attentional deficit might hold the key for better understanding of the condition and development of treatment. We present a rapid, pupillometry-based method that assesses automatic biases in (covert) attention, without requiring behavioral responses. We exploit the phenomenon that pupil light responses scale with the degree of covert attention to stimuli, and thereby reveal what draws (no) attention. Participants with left-sided neglect after right-sided lesions following stroke (n = 5), participants with hemianopia/quadrantanopia following stroke (n = 11), and controls (n = 22) were presented with two vertical bars, one of which was white and one of which was black, while fixating the center. We varied which brightness was left and right, respectively across trials. In line with the hypotheses, participants with neglect demonstrated biased pupil light responses to the brightness on the right side. Participants with hemianopia showed similar biases to intact parts of the visual field, whilst controls exhibited no bias. Together, this demonstrates that the pupil light response can reveal not only visual, but also attentional deficits. Strikingly, our pupillometry-based bias estimates were not in agreement with neuropsychological paper-and-pencil assessments conducted on the same day, but were with those administered in an earlier phase post-stroke. Potentially, we pick up on persistent biases in the covert attentional system that participants increasingly compensate for in classical neuropsychological tasks and everyday life. The here proposed method may not only find clinical application, but also advance theory and aid the development of successful restoration therapies by introducing a precise, longitudinally valid, and objective measurement that might not be affected by compensation.

Emphasis on peripheral vision is accompanied by pupil dilation

People are best able to detect stimuli in peripheral vision when their pupils are large, and best able to discriminate stimuli in central vision when their pupils are small. However, it is unclear whether our visual system makes use of this by dilating the pupils when attention is directed towards peripheral vision. Therefore, throughout three experiments (N = 100), we tested whether pupil size adapts to the "breadth" of attention. We found that pupils dilate with increasing attentional breadth, both when attention is diffusely spread and when attention is directed at specific locations in peripheral vision. Based on our results and others, we propose that cognitively driven pupil dilation is not an epiphenomenal marker of locus coeruleus activity, as is often assumed, but rather is an adaptive response that reflects an emphasis on peripheral vision.

Acceleration of inferred neural responses to oddball targets in an individual with bilateral amygdala lesion compared to healthy controls

Detecting unusual auditory stimuli is crucial for discovering potential threat. Locus coeruleus (LC), which coordinates attention, and amygdala, which is implicated in resource prioritization, both respond to deviant sounds. Evidence concerning their interaction, however, is sparse. Seeking to elucidate if human amygdala affects estimated LC activity during this process, we recorded pupillary responses during an auditory oddball and an illuminance change task, in a female with bilateral amygdala lesions (BG) and in n = 23 matched controls. Neural input in response to oddballs was estimated via pupil dilation, a reported proxy of LC activity, harnessing a linear-time invariant system and individual pupillary dilation response function (IRF) inferred from illuminance responses. While oddball recognition remained intact, estimated LC input for BG was compacted to an impulse rather than the prolonged waveform seen in healthy controls. This impulse had the earliest response mean and highest kurtosis in the sample. As a secondary finding, BG showed enhanced early pupillary constriction to darkness. These findings suggest that LC-amygdala communication is required to sustain LC activity in response to anomalous sounds. Our results provide further evidence for amygdala involvement in processing deviant sound targets, although it is not required for their behavioral recognition.

Methods in cognitive pupillometry: Design, preprocessing, and statistical analysis

Cognitive pupillometry is the measurement of pupil size to investigate cognitive processes such as attention, mental effort, working memory, and many others. Currently, there is no commonly agreed-upon methodology for conducting cognitive-pupillometry experiments, and approaches vary widely between research groups and even between different experiments from the same group. This lack of consensus makes it difficult to know which factors to consider when conducting a cognitive-pupillometry experiment. Here we provide a comprehensive, hands-on guide to methods in cognitive pupillometry, with a focus on trial-based experiments in which the measure of interest is the task-evoked pupil response to a stimulus. We cover all methodological aspects of cognitive pupillometry: experimental design, preprocessing of pupil-size data, and statistical techniques to deal with multiple comparisons when testing pupil-size data. In addition, we provide code and toolboxes (in Python) for preprocessing and statistical analysis, and we illustrate all aspects of the proposed workflow through an example experiment and example scripts.

Action space restructures visual working memory in prefrontal cortex

Visual working memory enables flexible behavior by decoupling sensory stimuli from behavioral actions. While previous studies have predominantly focused on the storage component of working memory, the role of future actions in shaping working memory remains unknown. To answer this question, we used two working memory tasks that allowed the dissociation of sensory and action components of working memory. We measured behavioral performance and neuronal activity in the macaque prefrontal cortex area, frontal eye fields. We show that the action space reshapes working memory, as evidenced by distinct patterns of memory tuning and attentional orienting between the two tasks. Notably, neuronal activity during the working memory period predicted future behavior and exhibited mixed selectivity in relation to the sensory space but linear selectivity relative to the action space. This linear selectivity was achieved through the rapid transformation from sensory to action space and was subsequently maintained as a stable cross-temporal population activity pattern. Combined, we provide direct physiological evidence of the action-oriented nature of frontal eye field neurons during memory tasks and demonstrate that the anticipation of behavioral outcomes plays a significant role in transforming and maintaining the contents of visual working memory.

Fixation offset decreases pupillary inhibition of return

Inhibition of return (IOR) is reflected as a slower manual or saccadic response to a cued rather than an uncued target (manual IOR and saccadic IOR, respectively), and as a pupillary dilation when a bright, relative to a dark side of a display is cued (pupillary IOR). The aim of this study was to investigate the relation between an IOR and oculomotor system. According to the predominant view, only the saccadic IOR is strictly related to the visuomotor process, and the manual and pupillary IORs depend on non-motor factors (e.g., short-term visual depression). Alternatively, the after-effect of the covert-orienting hypothesis postulates that IOR is strictly related to the oculomotor system. As fixation offset affects oculomotor processes, this study investigated whether fixation offset also affects pupillary and manual IORs. The results show that fixation offset decreased IOR in pupillary but not manual responses, and provides support for the hypothesis that at least the pupillary IOR is tightly linked to eye movement preparation.

Differential aspects of attention predict the depth of visual working memory encoding: Evidence from pupillometry

What determines how much one encodes into visual working memory? Traditionally, encoding depth is considered to be indexed by spatiotemporal properties of gaze, such as gaze position and dwell time. Although these properties inform about where and how long one looks, they do not necessarily inform about the current arousal state or how strongly attention is deployed to facilitate encoding. Here, we found that two types of pupillary dynamics predict how much information is encoded during a copy task. The task involved encoding a spatial pattern of multiple items for later reproduction. Results showed that smaller baseline pupil sizes preceding and stronger pupil orienting responses during encoding predicted that more information was encoded into visual working memory. Additionally, we show that pupil size reflects not only how much but also how precisely material is encoded. We argue that a smaller pupil size preceding encoding is related to increased exploitation, whereas larger pupil constrictions signal stronger attentional (re)orienting to the to-be-encoded pattern. Our findings support the notion that the depth of visual working memory encoding is the integrative outcome of differential aspects of attention: how alert one is, how much attention one deploys, and how long it is deployed. Together, these factors determine how much information is encoded into visual working memory.

Top-down control of the left visual field bias in cued visual spatial attention

A left visual field (LVF) bias in perceptual judgments, response speed, and discrimination accuracy has been reported in humans. Cognitive factors, such as visual spatial attention, are known to modulate or even eliminate this bias. We investigated this problem by recording pupillometry together with functional magnetic resonance imaging (fMRI) in a cued visual spatial attention task. We observed that (i) the pupil was significantly more dilated following attend-right than attend-left cues, (ii) the task performance (e.g. reaction time [RT]) did not differ between attend-left and attend-right trials, and (iii) the difference in cue-related pupil dilation between attend-left and attend-right trials was inversely related to the corresponding difference in RT. Neuroscientically, correlating the difference in cue-related pupil dilation with the corresponding cue-related fMRI difference yielded activations primarily in the right hemisphere, including the right intraparietal sulcus and the right ventrolateral prefrontal cortex. These results suggest that (i) there is an asymmetry in visual spatial attention control, with the rightward attention control being more effortful than the leftward attention control, (ii) this asymmetry underlies the reduction or the elimination of the LVF bias, and (iii) the components of the attentional control networks in the right hemisphere are likely part of the neural substrate of the observed asymmetry in attentional control.

A Novel Psychosocial Intervention for Motivational Negative Symptoms in Schizophrenia: Combined Motivational Interviewing and CBT

OBJECTIVE

Negative symptoms are a primary cause of disability in schizophrenia for which there are no established pharmacotherapies. This study evaluated a novel psychosocial intervention that combined two evidence-based practices-motivational interviewing and cognitive-behavioral therapy (MI-CBT)-for the treatment of motivational negative symptoms.

METHODS

Seventy-nine participants with schizophrenia and moderate to severe negative symptoms were included in a randomized controlled trial comparing the 12-session MI-CBT treatment with a mindfulness control condition. Participants were assessed at three time points through the study period, which included 12 weeks of active treatment and 12 weeks of follow-up. The primary outcome measures were motivational negative symptoms and community functioning; the secondary outcomes included a posited biomarker of negative symptoms: pupillometric response to cognitive effort.

RESULTS

Compared with the control group, participants in the MI-CBT group showed significantly greater improvements in motivational negative symptoms over the acute treatment period. Their gains relative to baseline were maintained at follow-up, although the differential benefit relative to control subjects was attenuated. There were nonsignificant effects toward improvements in community functioning and differential change in the pupillometric markers of cognitive effort.

CONCLUSIONS

The results show that combining motivational interviewing with CBT yields improvements in negative symptoms, a feature of schizophrenia generally thought of as resistant to intervention. Motivational negative symptoms not only responded to the novel treatment, but the gains were maintained over the follow-up period. Implications for future studies and for improving the generalization of the negative symptom gains to daily functioning domains are discussed.

Seeing an Auditory Object: Pupillary Light Response Reflects Covert Attention to Auditory Space and Object

Attention to the relevant object and space is the brain's strategy to effectively process the information of interest in complex environments with limited neural resources. Numerous studies have documented how attention is allocated in the visual domain, whereas the nature of attention in the auditory domain has been much less explored. Here, we show that the pupillary light response can serve as a physiological index of auditory attentional shift and can be used to probe the relationship between space-based and object-based attention as well. Experiments demonstrated that the pupillary response corresponds to the luminance condition where the attended auditory object (e.g., spoken sentence) was located, regardless of whether attention was directed by a spatial (left or right) or nonspatial (e.g., the gender of the talker) cue and regardless of whether the sound was presented via headphones or loudspeakers. These effects on the pupillary light response could not be accounted for as a consequence of small (although observable) biases in gaze position drifting. The overall results imply a unified audiovisual representation of spatial attention. Auditory object-based attention contains the space representation of the attended auditory object, even when the object is oriented without explicit spatial guidance.

Effects of Natural Scene Inversion on Visual-evoked Brain Potentials and Pupillary Responses: A Matter of Effortful Processing of Unfamiliar Configurations

The inversion of a picture of a face hampers the accuracy and speed at which observers can perceptually process it. Event-related potentials and pupillary responses, successfully used as biomarkers of face inversion in the past, suggest that the perception of visual features, that are organized in an unfamiliar manner, recruits demanding additional processes. However, it remains unclear whether such inversion effects generalize beyond face stimuli and whether indeed more mental effort is needed to process inverted images. Here we aimed to study the effects of natural scene inversion on visual evoked potentials and pupil dilations. We simultaneously measured responses of 47 human participants to presentations of images showing upright or inverted natural scenes. For inverted scenes, we observed relatively stronger occipito-temporo-parietal N1 peak amplitudes and larger pupil dilations (on top of an initial orienting response) than for upright scenes. This study revealed neural and physiological markers of natural scene inversion that are in line with inversion effects of other stimulus types and demonstrates the robustness and generalizability of the phenomenon that unfamiliar configurations of visual content require increased processing effort.

Brightness Perception in World-Centered Coordinates Assessed by Pupillometry

Subjective brightness perception reportedly differs among the peripheral visual fields owing to lower- and higher-order cognition. However, there is still a lack of information associated with subjective brightness perception in the world-centered coordinates, not in the visual fields. In this study, we aimed to investigate the anisotropy of subjective brightness perception in the world-centered coordinates based on pupillary responses to the stimuli in five locations by manipulating the world-centered coordinates through active (requiring head movement) and passive scenes (without head movement) in a virtual reality environment. Specifically, this study aimed to elucidate if there is an ecological advantage in the five different locations in the world-centered coordinates. The pupillary responses to glare and halo stimuli indicated that the brightness perception differed among the five locations in the world-centered coordinates. Furthermore, we found that the pupillary response to stimuli at the top location might be influenced by ecological factors (such as from the bright sky and the sun's existence). Thus, we have contributed to the understanding of the extraretinal information influence on subjective brightness perception in the world-centered coordinates, demonstrating that the pupillary response is independent of head movement.

The Trade-Off Between Luminance and Color Contrast Assessed With Pupil Responses

Purpose

A scene consisting of a white stimulus on a black background incorporates strong luminance contrast. When both stimulus and background receive different colors, luminance contrast decreases but color contrast increases. Here, we sought to characterize the pattern of stimulus salience across varying trade-offs of color and luminance contrasts by using the pupil light response.

Methods

Three experiments were conducted with 17, 16, and 17 healthy adults. For all experiments, a flickering stimulus (2 Hz; alternating color to black) was presented superimposed on a background with a complementary color to the stimulus (i.e., opponency colors in human color perception: blue and yellow for Experiment 1, red and green for Experiment 2, and equiluminant red and green for Experiment 3). Background luminance varied between 0% and 45% to trade off luminance and color contrast with the stimulus. By comparing the locus of the optimal trade-off between color and luminance across different color axes, we explored the generality of the trade-off.

Results

The strongest pupil responses were found when a substantial amount of color contrast was present (at the expense of luminance contrast). Pupil response amplitudes increased by 15% to 30% after the addition of color contrast. An optimal pupillary responsiveness was reached at a background luminance setting of 20% to 35% color contrast across several color axes.

Conclusions

These findings suggest that a substantial component of pupil light responses incorporates color processing. More sensitive pupil responses and more salient stimulus designs can be achieved by adding subtle levels of color contrast between stimulus and background.

Translational Relevance

More robust pupil responses will enhance tests of the visual field with pupil perimetry.

Independent bilateral-eye stimulation for gaze pattern recognition based on steady-state pupil light reflex

Objective:recently, pupil oscillations synchronized with steady visual stimuli were used as input for an interface. The proposed system, inspired by a brain-computer interface based on steady-state visual evoked potentials, does not require contact with the participant. However, the pupil oscillation mechanism limits the stimulus frequency to 2.5 Hz or less, making it hard to enhance the information transfer rate (ITR).Approach:here, we compared multiple conditions for stimulation to increase the ITR of the pupil vibration-based interface, which were called monocular-single, monocular-superposed, and binocular-independent conditions. The binocular-independent condition stimulates each eye at different frequencies respectively and mixes them by using the visual stereoscopic perception of users. The monocular-superposed condition stimulates both eyes by a mixed signal of two different frequencies. We selected the shape of the stimulation signal, evaluated the amount of spectral leakage in the monocular-superposed and binocular-independent conditions, and compared the power spectrum density at the stimulation frequency. Moreover, 5, 10, and 15 patterns of stimuli were classified in each condition.Main results:a square wave, which causes an efficient pupil response, was used as the stimulus. Spectral leakage at the beat frequency was higher in the monocular-superposed condition than in the binocular-independent one. The power spectral density of stimulus frequencies was greatest in the monocular-single condition. Finally, we could classify the 15-stimulus pattern, with ITRs of 14.4 (binocular-independent, using five frequencies), 14.5 (monocular-superimposed, using five frequencies), and 23.7 bits min^-1(monocular-single, using 15 frequencies). There were no significant differences for the binocular-independent and monocular-superposed conditions.Significance:this paper shows a way to increase the number of stimuli that can be simultaneously displayed without decreasing ITR, even when only a small number of frequencies are available. This could lead to the provision of an interface based on pupil oscillation to a wider range of users.

Behavioral and fMRI evidence that arousal enhances bottom-up selectivity in young but not older adults

The locus coeruleus-noradrenergic system integrates signals about arousal states throughout the brain and helps coordinate cognitive selectivity. However, age-related changes in this system may impact how arousal coordinates selectivity in older adults. To examine this, we compared how increases in emotional arousal modulates cognitive selectivity for images differing in perceptual salience in young and older adults. Using functional magnetic resonance imaging, we found that relative to older adults, hearing an arousing sound enhanced young adults' bottom-up processing and incidental memory for high versus low salience category-selective body images. We also examined how arousing sounds impacted a top-down goal to detect dot-probes that appeared immediately after high or low salience images. We found that young adults were slower to detect probes appearing after high salience body images on arousing trials, whereas older adults showed this pattern on non-arousing trials. Taken together, our findings show that arousal's effect on selectivity changes with age and differs across bottom-up and top-down processing.

Investigating the role of human frontal eye field in the pupil light reflex modulation by saccade planning and working memory

The pupil constricts in response to an increase in global luminance level, commonly referred to as the pupil light reflex. Recent research has shown that these reflex responses are modulated by high-level cognition. There is larger pupil constriction evoked by a bright stimulus when the stimulus location spatially overlaps with the locus of attention, and these effects have been extended to saccade planning and working memory (here referred to as pupil local-luminance modulation). Although research in monkeys has further elucidated a central role of the frontal eye field (FEF) and superior colliculus in the pupil local-luminance modulation, their roles remain to be established in humans. Through applying continuous theta-burst transcranial magnetic stimulation over the right FEF (and vertex) to inhibit its activity, we investigated the role of the FEF in human pupil local-luminance responses. Pupil light reflex responses were transiently evoked by a bright patch stimulus presented during the delay period in the visual- and memory-delay tasks. In the visual-delay task, larger pupil constriction was observed when the patch location was spatially aligned with the target location in both stimulation conditions. More interestingly, after FEF stimulation, larger pupil constriction was obtained when the patch was presented in the contralateral, compared to the ipsilateral visual field of the stimulation. In contrast, FEF stimulation effects were absence in the memory-delay task. Linear mixed model results further found that stimulation condition, patch location consistency, and visual field significantly modulated observed pupil constriction responses. Together, our results constitute the first evidence of FEF modulation in human pupil local-luminance responses.

Pupillometry tracks errors in interval timing

Recent primate studies suggest a potential link between pupil size and subjectively elapsed duration. Here, we sought to investigate the relationship between pupil size and perceived duration in human participants performing two temporal bisection tasks in the subsecond and suprasecond interval ranges. In the subsecond task, pupil diameter was greater during stimulus processing when shorter intervals were overestimated but also during and after stimulus offset when longer intervals were underestimated. By contrast, in the suprasecond task, larger pupil diameter was observed only in the late stimulus offset phase prior to response prompts when longer intervals were underestimated. This pattern of results suggests that pupil diameter relates to an error monitoring mechanism in interval timing. These results are at odds with a direct relationship between pupil size and the perception of duration but suggest that pupillometric variation might play a key role in signifying errors related to temporal judgments.

Arousal impacts distributed hubs modulating the integration of brain functional connectivity

Even when subjects are at rest, it is thought that brain activity is organized into distinct brain states during which reproducible patterns are observable. Yet, it is unclear how to define or distinguish different brain states. A potential source of brain state variation is arousal, which may play a role in modulating functional interactions between brain regions. Here, we use simultaneous resting state functional magnetic resonance imaging (fMRI) and pupillometry to study the impact of arousal levels indexed by pupil area on the integration of large-scale brain networks. We employ a novel sparse dictionary learning-based method to identify hub regions participating in between-network integration stratified by arousal, by measuring k-hubness, the number (k) of functionally overlapping networks in each brain region. We show evidence of a brain-wide decrease in between-network integration and inter-subject variability at low relative to high arousal, with differences emerging across regions of the frontoparietal, default mode, motor, limbic, and cerebellum networks. State-dependent changes in k-hubness relate to the actual patterns of network integration within these hubs, suggesting a brain state transition from high to low arousal characterized by global synchronization and reduced network overlaps. We demonstrate that arousal is not limited to specific brain areas known to be directly associated with arousal regulation, but instead has a brain-wide impact that involves high-level between-network communications. Lastly, we show a systematic change in pairwise fMRI signal correlation structures in the arousal state-stratified data, and demonstrate that the choice of global signal regression could result in different conclusions in conventional graph theoretical analysis and in the analysis of k-hubness when studying arousal modulations. Together, our results suggest the presence of global and local effects of pupil-linked arousal modulations on resting state brain functional connectivity.

Oxytocin and testosterone administration amplify viewing preferences for sexual images in male rhesus macaques

Social stimuli, like faces, and sexual stimuli, like genitalia, spontaneously attract visual attention in both human and non-human primates. Social orienting behaviour is thought to be modulated by neuropeptides as well as sex hormones. Using a free viewing task in which paired images of monkey faces and anogenital regions were presented simultaneously, we found that male rhesus macaques overwhelmingly preferred to view images of anogenital regions over faces. They were more likely to make an initial gaze shift towards, and spent more time viewing, anogenital regions compared with faces, and this preference was accompanied by relatively constricted pupils. On face images, monkeys mostly fixated on the forehead and eyes. These viewing preferences were found for images of both males and females. Both oxytocin (OT), a neuropeptide linked to social bonding and affiliation, and testosterone (TE), a sex hormone implicated in mating and aggression, amplified the pre-existing orienting bias for female genitalia over female faces; neither treatment altered the viewing preference for male anogenital regions over male faces. Testosterone but not OT increased the probability of monkeys making the first gaze shift towards female anogenital rather than face pictures, with the strongest effects on anogenital images of young and unfamiliar females. Finally, both OT and TE promoted viewing of the forehead region of both female and male faces, which display sexual skins, but decreased the relative salience of the eyes of older males. Together, these results invite the hypothesis that both OT and TE regulate reproductive behaviours by acting as a gain control on the visual orienting network to increase attention to mating-relevant signals in the environment.

This article is part of the theme issue ‘Interplays between oxytocin and other neuromodulators in shaping complex social behaviours’.

The eyes reflect an internal cognitive state hidden in the population activity of cortical neurons

Decades of research have shown that global brain states such as arousal can be indexed by measuring the properties of the eyes. The spiking responses of neurons throughout the brain have been associated with the pupil, small fixational saccades, and vigor in eye movements, but it has been difficult to isolate how internal states affect the eyes, and vice versa. While recording from populations of neurons in the visual and prefrontal cortex (PFC), we recently identified a latent dimension of neural activity called "slow drift," which appears to reflect a shift in a global brain state. Here, we asked if slow drift is correlated with the action of the eyes in distinct behavioral tasks. We recorded from visual cortex (V4) while monkeys performed a change detection task, and PFC, while they performed a memory-guided saccade task. In both tasks, slow drift was associated with the size of the pupil and the microsaccade rate, two external indicators of the internal state of the animal. These results show that metrics related to the action of the eyes are associated with a dominant and task-independent mode of neural activity that can be accessed in the population activity of neurons across the cortex.

Eye Movements in Mild Traumatic Brain Injury: Ocular Biomarkers

Mild traumatic brain injury (mTBI, or concussion), results from direct and indirect trauma to the head (i.e. a closed injury of transmitted forces), with or without loss of consciousness. The current method of diagnosis is largely based on symptom assessment and clinical history. There is an urgent need to identify an objective biomarker which can not only detect injury, but inform prognosis and recovery. Ocular motor impairment is argued to be ubiquitous across mTBI subtypes and may serve as a valuable clinical biomarker with the recent advent of more affordable and portable eye tracking technology. Many groups have positively correlated the degree of ocular motor impairment to symptom severity with a minority attempting to validate these findings with diffusion tract imaging and functional MRI. However, numerous methodological issues limit the interpretation of results, preventing any singular ocular biomarker from prevailing. This review will comprehensively describe the anatomical susceptibility, clinical measurement, and current eye tracking literature surrounding saccades, smooth pursuit, vestibulo-ocular reflex, vergence, pupillary light reflex, and accommodation in mTBI.

Attention cueing in rivalry: insights from pupillometry

We used pupillometry to evaluate the effects of attention cueing on perceptual bi-stability, as reported by adult human observers. Perceptual alternations and pupil diameter were measured during two forms of rivalry, generated by presenting a white and a black disk to the two eyes (binocular rivalry) or splitting the disks between eyes (interocular grouping rivalry). In line with previous studies, we found that subtle pupil size modulations (about 0.05 mm) tracked alternations between exclusive dominance phases of the black or white disk. These pupil responses were larger for perceptually stronger stimuli: presented to the dominant eye or with physically higher luminance contrast. However, cueing of endogenous attention to one of the rivaling percepts did not affect pupil modulations during exclusive dominance phases. This was observed despite the reliable effects of endogenous attention on perceptual dominance, which shifted in favor of the cued percept by about 10%. The results were comparable for binocular and interocular grouping rivalry. Cueing only had a marginal modulatory effect on pupil size during mixed percepts in binocular rivalry. This may suggest that, rather than acting by modulating perceptual strength, endogenous attention primarily acts during periods of unresolved competition, which is compatible with attention being automatically directed to the rivaling stimuli during periods of exclusive dominance and thereby sustaining perceptual alternations.Significance StatementBinocular rivalry depends on attention. When it is diverted away from the stimuli, perceptual alternations slow down; when it is preferentially directed to one stimulus, perception lingers more on it, consistent with attention enhancing the effective strength of the rivaling stimuli. Here we introduce pupillometry as a means to indirectly track changes in effective stimulus strength. We find that pupil size accurately tracks perceived luminance during two forms of rivalry: binocular rivalry and interocular grouping rivalry. Both show robust effects of attention cueing on perceptual dominance, but pupil modulations during exclusive dominance are unaffected by cueing. This suggests that endogenous attention does not affect perceptual strength during exclusive dominance, though it might do so during transition phases.

Backward and forward neck tilt affects perceptual bias when interpreting ambiguous figures

The relationships between posture and perception have already been investigated in several studies. However, it is still unclear how perceptual bias and experiential contexts of human perception affect observers’ perception when posture is changed. In this study, we hypothesized that a change in the perceptual probability caused by perceptual bias also depends on posture. In order to verify this hypothesis, we used the Necker cube with two types of appearance, from above and below, although the input is constant, and investigated the change of the probability of perceptual content. Specifically, we asked observers their perception of the appearance of the Necker cube placed at any of the five angles in the space of virtual reality. There were two patterns of neck movement, vertical and horizontal. During the experiment, pupil diameter, one of the cognitive indices, was also measured. Results showed that during the condition of looking down vertically, the probability of the viewing-from-above perception of the Necker cube was significantly greater than during the condition of looking up. Interestingly, the pupillary results were also consistent with the probability of the perception. These results indicate that perception was modulated by the posture of the neck and suggest that neck posture is incorporated into ecological constraints.

Pupil size variations reveal covert shifts of attention induced by numbers

The pupil light response is more than a pure reflexive mechanism that reacts to the amount of light entering the eye. The pupil size may also react to the luminance of objects lying in the visual periphery, revealing the locus of covert attention. In the present study, we took advantage of this response to study the spatial coding of abstract concepts with no physical counterpart: numbers. The participants' gaze was maintained fixed in the middle of a screen whose left and right parts were dark or bright, and variations in pupil size were recorded during an auditory number comparison task. The results showed that small numbers accentuated pupil dilation when the darker part of the screen was on the left, while large numbers accentuated pupil dilation when the darker part of the screen was on the right. This finding provides direct evidence for covert attention shifts on a left-to-right oriented mental spatial representation of numbers. From a more general perspective, it shows that the pupillary response to light is subject to modulation from spatial attention mechanisms operating on mental contents.

Effects of different light incident angles via a head-mounted device on the magnitude of nocturnal melatonin suppression in healthy young subjects

Bright light is a primary zeitgeber (synchronizer) for the central circadian pacemaker in humans. Recently, head-mounted devices for light therapy have been developed to treat patients suffering from circadian rhythm sleep disorders. In this study, to evaluate the influence of the light incident angle of head-mounted devices on the human circadian pacemaker, we examined the effects of bright light (ca.10000 lx) from two different angles (55° vs. 28°) on the suppression of melatonin secretion at night. Twenty-nine subjects (25.1 ± 6.3 SD years) participated in the present study. The subjects were kept under dim light conditions (< 5 lx) from 4 h before their habitual bedtime, followed by exposure to 1 h of bright light at two different angles during their habitual bedtime. Saliva samples were collected every hour under dim light conditions and then collected every 30 min during the bright light exposure. To assess the effect of the light incident angle on ipRGCs mediating light-evoked pupillary constriction, pupil size was measured in before and after exposure to bright light. Melatonin suppression in the group exposed to light at 28° was significantly higher than that in the group with light at 55° (p < 0.001). The pupillary constriction was significantly greater in the group exposed to light at 28° than that in the group with light at 55° (p < 0.001). The present findings suggest that the light incident angle is an important factor for bright light therapy and should be considered to effectively use head-mounted devices in home and clinical settings.

Publication guidelines and recommendations for pupillary measurement in psychophysiological studies

A variety of psychological and physical phenomena elicit variations in the diameter of pupil of the eye. Changes in pupil size are mediated by the relative activation of the sphincter pupillae muscle (decrease pupil diameter) and the dilator pupillae muscle (increase pupil diameter), innervated by the parasympathetic and sympathetic branches, respectively, of the autonomic nervous system. The current guidelines are intended to inform and guide psychophysiological research involving pupil measurement by (1) summarizing important aspects concerning the physiology of the pupil, (2) providing methodological and data-analytic guidelines and recommendations, and (3) briefly reviewing psychological phenomena that modulate pupillary reactivity. Because of the increased ease and tractability of pupil measurement, the goal of these guidelines is to promote accurate recording, analysis, and reporting of pupillary data in psychophysiological research.

Pupil dilation and constriction in the skate Leucoraja erinacea in a simulated natural light field

The skate Leucoraja erinacea has an elaborately shaped pupil, whose characteristics and functions have received little attention. The goal of our study was to investigate the pupil response in relation to natural ambient light intensities. First, we took a recently developed sensory–ecological approach, which gave us a tool for creating a controlled light environment for behavioural work: during a field survey, we collected a series of calibrated natural habitat images from the perspective of the skates' eyes. From these images, we derived a vertical illumination profile using custom-written software for quantification of the environmental light field (ELF). After collecting and analysing these natural light field data, we created an illumination set-up in the laboratory, which closely simulated the natural vertical light gradient that skates experience in the wild and tested the light responsiveness – in particular the extent of dilation – of the skate pupil to controlled changes in this simulated light field. Additionally, we measured pupillary dilation and constriction speeds. Our results confirm that the skate pupil changes from nearly circular under low light to a series of small triangular apertures under bright light. A linear regression analysis showed a trend towards smaller skates having a smaller dynamic range of pupil area (dilation versus constriction ratio around 4-fold), and larger skates showing larger ranges (around 10- to 20-fold). Dilation took longer than constriction (between 30 and 45 min for dilation; less than 20 min for constriction), and there was considerable individual variation in dilation/constriction time. We discuss our findings in terms of the visual ecology of L. erinacea and consider the importance of accurately simulating natural light fields in the laboratory.

Influence of the Location of a Decision Cue on the Dynamics of Pupillary Light Response

The pupils of the eyes reflexively constrict in light and dilate in dark to optimize retinal illumination. Non-visual cognitive factors, like attention, arousal, decision-making, etc., also influence pupillary light response (PLR). During passive viewing, the eccentricity of a stimulus modulates the pupillary aperture size driven by spatially weighted corneal flux density (CFD), which is the product of luminance and the area of the stimulus. Whether the scope of attention also influences PLR remains unclear. In this study, we contrasted the pupil dynamics between diffused and focused attentional conditions during decision-making, while the global CFD remained the same in the two conditions. A population of 20 healthy humans participated in a pair of forced choice tasks. They distributed attention to the peripheral decision cue in one task, and concentrated at the center in the other to select the target from four alternatives for gaze orientation. The location of this cue did not influence participants' reaction time (RT). However, the magnitude of constriction was significantly less in the task that warranted attention to be deployed at the center than on the periphery. We observed similar pupil dynamics when participants either elicited or canceled a saccadic eye movement, which ruled out pre-saccadic obligatory attentional orientation contributing to PLR. We further addressed how the location of attentional deployment might have influenced PLR. We simulated a biomechanical model of PLR with visual stimulation of different strengths as inputs corresponding to the two attentional conditions. In this homeomorphic model, the computational characteristic of each element was derived from the physiological and/or mechanical properties of the corresponding biological element. The simulation of this model successfully mimicked the observed data. In contrast to common belief that the global ambient luminosity drives pupillary response, the results of our study suggest that the effective CFD (eCFD) determined via the luminance multiplied by the size of the stimulus at the location of deployed attention in the visual space is critical for the magnitude of pupillary constriction.

Face-Specific Pupil Contagion in Infants

Pupil contagion is the phenomenon in which an observer's pupil-diameter changes in response to another person's pupil. Even chimpanzees and infants in early development stages show pupil contagion. This study investigated whether dynamic changes in pupil diameter would induce changes in infants' pupil diameter. We also investigated pupil contagion in the context of different faces. We measured the pupil-diameter of 50 five- to six-month-old infants in response to changes in the pupil diameter (dilating/constricting) of upright and inverted faces. The results showed that (1) in the upright presentation condition, dilating the pupil diameter induced a change in the infants' pupil diameter while constricting the pupil diameter did not induce a change, and (2) pupil contagion occurred only in the upright face presentation, and not in the inverted face presentation. These results indicate the face-inversion effect in infants' pupil contagion.

Pupil responses to implied motion in figurative and abstract paintings

Motion can be perceived in static images, such as photos and figurative paintings, representing realistic subjects in motion, with or without directional information (e.g., motion blur or speed lines). Motion impression can be achieved even in non-realistic static images such as motion illusions and abstract paintings. It has been shown that visual motion processing affects the diameter of the pupil, responding differently to real, illusory, and implied motion in photographs (IM). It has been suggested that these different effects might be due to top-down modulations from different cortical areas underlying their processing. It is worthwhile to investigate pupillary response to figurative paintings, since they require an even higher level of interpretation than photos representing the same kind of subjects, given the complexity of cognitive processes involved in the aesthetic experience. Also, pupil responses to abstract paintings allows to study the effect of IM perception in representations devoid of real-life motion cues. We measured pupil responses to IM in figurative and abstract artworks depicting static and dynamic scenes, as rated by a large group of individuals not participating in the following experiment. Since the pupillary response is modulated by the subjective image interpretation, a motion rating test has been used to correct individual pupil data according to whether participants actually perceived the presence of motion in the paintings. Pupil responses to movies showing figurative and abstract subjects, and to motion illusions were also measured, to compare real and illusory motion with painted IM. Movies, both figurative and abstract, elicit the largest pupillary dilation of all static stimuli, whereas motion illusions cause the smallest pupil size, as previously shown. Interestingly, pupil responses to IM depend on the paintings' style. Figurative paintings depicting moving subjects cause more dilation than those representing static figures, and pupil size increases with the strength of IM, as already found with realistic photos. The opposite effect is obtained with abstract artworks. Abstract paintings depicting motion produce less dilation than those depicting stillness. In any case, these results reflect the individual subjective perception of dynamism, as the very same paintings can induce opposite responses in observer which interpreted it as static or dynamic. Overall, our data show that pupil size depends on high-level interpretation of motion in paintings, even when they do not represent real-world scenes. Our findings further suggest that the pupil is modulated by multiple top-down cortical mechanisms, involving the processing of motion, attention, memory, imagination, and other cognitive functions necessary for enjoying a complete aesthetic experience.

Alertness and Visual Attention Impact Different Aspects of the Optokinetic Reflex

Purpose

Assessing visual attention and alertness is of great importance in visual and cognitive neuroscience, providing objective measures valuable for both researchers and clinicians. This study investigates how the optokinetic response differs between levels of visual attention in healthy adults while controlling for alertness.

Methods

Twelve healthy subjects (8 men and 4 women; mean age = 33 ± 9.36) with intact gaze-stability, visual acuity, and binocularity were recruited. Subjects viewed a rotating visual scene provoking torsional optokinetic nystagmus (OKN) while wearing a video eye tracker in a seated head-fixed position. Tasks requiring focused, neutral, and divided visual attention were issued to each subject and the OKN was recorded. Pupil sizes were monitored as a proxy for alertness.

Results

Pupil dilation was increased for both focused and divided visual attention. The number of nystagmus beats was highest for the focused condition and lowest for the divided attentional task. OKN gain was increased during both focused and divided attention. The distribution of nystagmus beats over time showed that only focused attention produced a reliable adaptation of the OKN.

Conclusions

Results consequently indicate that OKN frequency is adaptive to a viewer's level of visual attention, whereas OKN gain is influenced by alertness levels. This pattern offers insight into the neural processes integrating visual input with reflexive motor responses. For example, it contextualizes why attention to visual stimuli can cause dizziness, as the OKN frequency reflects activity of the velocity storage mechanism. Additionally, the OKN could offer a possible venue for differentiating between visual attention and alertness during psychometric testing.

Pupil dynamics: A potential proxy of neural preparation for goal-directed eye movement

The pupils reflexively constrict or dilate to regulate the influx of light on the retinae. Pupillary light reflex (PLR) is susceptible to many non-visual cognitive processes including covert orientation of attention and planning rapid saccadic eye movement. The frontal eye field (FEF) and superior colliculus (SC), which also send projections to the PLR pathway, are two important areas in primate's brain for planning saccade and orientation of attention. The saccadic reaction time (SRT) and the rate of increase in activity of movement neurons in these areas are inversely correlated. This study addressed how pupil dynamics, activity in the FEF and SC and SRT are related in a saccadic decision-making task. The rate of visually evoked pupil constriction was found inversely related to SRT. This was further verified by simulating a homeomorphic biomechanical model of pupillary muscle plants, wherein we projected signals similar to build-up activity in the FEF and SC to the parasympathetic (constriction) and sympathetic (dilation) division of the PLR pathway, respectively. A striking similarity between simulated and observed dynamics of pupil constriction suggests that PLR is a potential proxy of saccade planning by movement neurons in the FEF and SC. Indistinguishable pupil dynamics when planned saccades were elicited versus when they were cancelled eliminated the possibility that the obligatory pre-saccadic shift of attention alone influenced the rate of pupil constriction. Our study envisages a mechanism of how the oculomotor system influences the autonomic activity in an attempt to timely minimize saccadic visual transients by regulating the influx of light.

Pupillary Responses Obey Emmert's Law and Co-vary with Autistic Traits

We measured the pupil response to a light stimulus subject to a size illusion and found that stimuli perceived as larger evoke a stronger pupillary response. The size illusion depends on combining retinal signals with contextual 3D information; contextual processing is thought to vary across individuals, being weaker in individuals with stronger autistic traits. Consistent with this theory, autistic traits correlated negatively with the magnitude of pupil modulations in our sample of neurotypical adults; however, psychophysical measurements of the illusion did not correlate with autistic traits, or with the pupil modulations. This shows that pupillometry provides an accurate objective index of complex perceptual processes, particularly useful for quantifying interindividual differences, and potentially more informative than standard psychophysical measures.