The orienting response drives pseudoneglect - evidence from an objective pupillometric method

Catching Mind Wandering With Pupillometry: Conceptual and Methodological Challenges

Mind-wandering (MW) refers to the shift of attention away from an ongoing task and/or external environment towards mental contents (e.g., memories, prospective thoughts) unrelated to the task. Physiological measures (e.g., pupil size, EEG, and fMRI) have often been acquired as objective markers for MW states, which has greatly helped their study as well as triangulation with other measures. Pupillometry in particular has been used as a covert biomarker of MW because it is reliably modulated by several distinct processes spanning arousal, emotion, and attention, and it signals attentional lapses. Yet, coupling MW and the measurement of pupil size has led to seemingly contrasting results. We argue that, common to the studies reviewed here, one reason is resolving to the measurement of tonic pupil size, which reflects low-frequency, slow changes in one's physiological state, and thus implicitly assumes that MW is a static, long-lasting process. We then additionally focus on three major axes of variability in the reviewed studies: (i) the definition and measurement of MW; (ii) the impact of contextual aspects, such as task demands and individual arousal levels; (iii) the identification and tracking of MW in combination with pupillary measures. We provide an overview of these differences and put forward recommendations for using physiological measures-including, but not limited to, pupil size-in MW research effectively. In conclusion, pupillometry can be a very informative tool for MW research, provided that it is used with the due methodological caution.

A minor role for hemispheric specialization in determining pseudoneglect: A pre-registered replication-extension study

Neurologically intact individuals display a mild asymmetry in spatial attention that can be measured during experimental spatial tasks such as line bisection. Although this phenomenon, known as pseudoneglect, is traditionally explained as the consequence of right hemisphere dominance for visuospatial attention, surmounting evidence suggests this is not its sole or even its most important determinant. For instance, a recent fMRI study in left-handers revealed that rare individuals with a reversed, left hemispheric dominance (LHDS, N = 23) also demonstrated left-sided pseudoneglect, although their spatial bias was less marked compared to typically lateralized controls (N = 40). The current study sought to replicate and extend these findings in a broader cohort of right-handers (N = 75) and left-handers (N = 181), while addressing methodological limitations of the original study. Contrary to the predictions of the hemispheric specialization account, pseudoneglect was not reversed in LHDS participants (N = 49). However, the pseudoneglect effect was reduced compared to controls with typical cerebral laterality (N = 207) due to a population-level randomization of pseudoneglect in the LHDS group. These results align with those of the original study, supporting a multifactorial interpretation of pseudoneglect, with hemisphere specialization as one among many determinants rather than being the predominant cause.

Open-DPSM: An open-source toolkit for modeling pupil size changes to dynamic visual inputs

Pupil size change is a widely adopted, sensitive indicator for sensory and cognitive processes. However, the interpretation of these changes is complicated by the influence of multiple low-level effects, such as brightness or contrast changes, posing challenges to applying pupillometry outside of extremely controlled settings. Building on and extending previous models, we here introduce Open Dynamic Pupil Size Modeling (Open-DPSM), an open-source toolkit to model pupil size changes to dynamically changing visual inputs using a convolution approach. Open-DPSM incorporates three key steps: (1) Modeling pupillary responses to both luminance and contrast changes; (2) Weighing of the distinct contributions of visual events across the visual field on pupil size change; and (3) Incorporating gaze-contingent visual event extraction and modeling. These steps improve the prediction of pupil size changes beyond the here-evaluated benchmarks. Open-DPSM provides Python functions, as well as a graphical user interface (GUI), enabling the extension of its applications to versatile scenarios and adaptations to individualized needs. By obtaining a predicted pupil trace using video and eye-tracking data, users can mitigate the effects of low-level features by subtracting the predicted trace or assess the efficacy of the low-level feature manipulations a priori by comparing estimated traces across conditions.

Gaze data of 4243 participants shows link between leftward and superior attention biases and age

Healthy individuals typically show more attention to the left than to the right (known as pseudoneglect), and to the upper than to the lower visual field (known as altitudinal pseudoneglect). These biases are thought to reflect asymmetries in neural processes. Attention biases have been used to investigate how these neural asymmetries change with age. However, inconsistent results have been reported regarding the presence and direction of age-related effects on horizontal and vertical attention biases. The observed inconsistencies may be due to insensitive measures and small sample sizes, that usually only feature extreme age groups. We investigated whether spatial attention biases, as indexed by gaze position during free viewing of a single image, are influenced by age. We analysed free-viewing data from 4,243 participants aged 5-65 years and found that attention biases shifted to the right and superior directions with increasing age. These findings are consistent with the idea of developing cerebral asymmetries with age and support the hypothesis of the origin of the leftward bias. Age modulations were found only for the first seven fixations, corresponding to the time window in which an absolute leftward bias in free viewing was previously observed. We interpret this as evidence that the horizontal and vertical attention biases are primarily present when orienting attention to a novel stimulus - and that age modulations of attention orienting are not global modulations of spatial attention. Taken together, our results suggest that attention orienting may be modulated by age and that cortical asymmetries may change with age.

Revealing visual working memory operations with pupillometry: Encoding, maintenance, and prioritization

Pupillary dynamics reflect effects of distinct and important operations of visual working memory: encoding, maintenance, and prioritization. Here, we review how pupil size predicts memory performance and how it provides novel insights into the mechanisms of each operation. Visual information must first be encoded into working memory with sufficient precision. The depth of this encoding process couples to arousal-linked baseline pupil size as well as a pupil constriction response before and after stimulus onset, respectively. Subsequently, the encoded information is maintained over time to ensure it is not lost. Pupil dilation reflects the effortful maintenance of information, wherein storing more items is accompanied by larger dilations. Lastly, the most task-relevant information is prioritized to guide upcoming behavior, which is reflected in yet another dilatory component. Moreover, activated content in memory can be pupillometrically probed directly by tagging visual information with distinct luminance levels. Through this luminance-tagging mechanism, pupil light responses reveal whether dark or bright items receive more attention during encoding and prioritization. Together, conceptualizing pupil responses as a sum of distinct components over time reveals insights into operations of visual working memory. From this viewpoint, pupillometry is a promising avenue to study the most vital operations through which visual working memory works. This article is categorized under: Psychology > Attention Psychology > Memory Psychology > Theory and Methods.

Eye movements reveal that young school children shift attention when solving additions and subtractions

Adults shift their attention to the right or to the left along a spatial continuum when solving additions and subtractions, respectively. Studies suggest that these shifts not only support the exact computation of the results but also anticipatively narrow down the range of plausible answers when processing the operands. However, little is known on when and how these attentional shifts arise in childhood during the acquisition of arithmetic. Here, an eye-tracker with high spatio-temporal resolution was used to measure spontaneous eye movements, used as a proxy for attentional shifts, while children of 2nd (8 y-o; N = 50) and 4th (10 y-o; N = 48) Grade solved simple additions (e.g., 4+3) and subtractions (e.g., 3-2). Gaze patterns revealed horizontal and vertical attentional shifts in both groups. Critically, horizontal eye movements were observed in 4th Graders as soon as the first operand and the operator were presented and thus before the beginning of the exact computation. In 2nd Graders, attentional shifts were only observed after the presentation of the second operand just before the response was made. This demonstrates that spatial attention is recruited when children solve arithmetic problems, even in the early stages of learning mathematics. The time course of these attentional shifts suggests that with practice in arithmetic children start to use spatial attention to anticipatively guide the search for the answer and facilitate the implementation of solving procedures. RESEARCH HIGHLIGHTS: Additions and subtractions are associated to right and left attentional shifts in adults, but it is unknown when these mechanisms arise in childhood. Children of 8-10 years old solved single-digit additions and subtractions while looking at a blank screen. Eye movements showed that children of 8 years old already show spatial biases possibly to represent the response when knowing both operands. Children of 10 years old shift attention before knowing the second operand to anticipatively guide the search for plausible answers.

Attentional asymmetries in peripheral vision

Previous research on the use of peripheral vision to identify two spatially separated stimuli simultaneously has led to the conclusion that the focus of attention has the form of a symmetric ellipse with a broader expansion along the horizontal compared to the vertical meridian. However, research on pseudoneglect has indicated that attention is not symmetrically distributed to the whole visual field. Here, we test if the attention window is indeed symmetrical with regard to its shape and resolution during peripheral vision. The results indicate that the position of those stimuli relative to the focus of attention influences the ability to identify a given set of stimuli. Specifically, stimuli presented to the left and top of the fixation point were more frequently identified correctly compared to those presented to the right bottom. That is, the attention window is rather not symmetric, which must be considered in future studies on the nature of the focus of attention.

The Intensity of Internal and External Attention Assessed with Pupillometry

Not only is visual attention shifted to objects in the external world, attention can also be directed to objects in memory. We have recently shown that pupil size indexes how strongly items are attended externally, which was reflected in more precise encoding into visual working memory. Using a retro-cuing paradigm, we here replicated this finding by showing that stronger pupil constrictions during encoding were reflective of the depth of encoding. Importantly, we extend this previous work by showing that pupil size also revealed the intensity of internal attention toward content stored in visual working memory. Specifically, pupil dilation during the prioritization of one among multiple internally stored representations predicted the precision of the prioritized item. Furthermore, the dynamics of the pupillary responses revealed that the intensity of internal and external attention independently determined the precision of internalized visual representations. Our results show that both internal and external attention are not all-or-none processes, but should rather be thought of as continuous resources that can be deployed at varying intensities. The employed pupillometric approach allows to unravel the intricate interplay between internal and external attention and their effects on visual working memory.

Elevated and accelerated: Locus coeruleus activity and visual search abilities in autistic children

BACKGROUND

Autistic individuals excel at visual search, however, the neural mechanism(s) underlying this advantage remain unclear. The locus coeruleus-norepinephrine (LC-NE) system, which plays a critical role in sensory perception and selective attention, has been shown to function in a persistently elevated state in individuals on the spectrum. However, the relationship between elevated tonic LC-NE activity and accelerated search in autism has not been explored.

OBJECTIVE

To examine the relationship between visual search abilities and resting pupil diameter (an indirect measure of tonic LC-NE activation) in autistic and neurotypical children.

METHODS

Participants were 24 school-aged autistic children and 24 age- and IQ-matched neurotypical children aged 8-15 years. Children completed two tasks: a resting eye-tracking task and a visual search paradigm. For the resting eye-tracking task, pupil diameter was monitored while participants fixated a central crosshair. For the visual search paradigm, participants were instructed to find the target (vertical line) embedded within an array of tilted (10°) distractor lines. The target was present on 50% of trials, and displayed within set sizes of 18, 24, and 36 items.

RESULTS

Consistent with previous studies, autistic children had significantly larger resting pupil size and searched faster and more efficiently compared to their neurotypical peers. Eye-tracking findings revealed that accelerated search was associated with fewer, not shorter, fixations in the autism group. Autistic children also showed reduced leftward search bias. Larger resting pupil size, indicative of increased tonic activation of the LC-NE system, was associated with greater search efficiency, longer fixation durations, and reduced leftward bias. Finally, within both groups reduced leftward bias was associated with increased autism symptomatology.

DISCUSSION

Together, these findings add to the existing body of research highlighting superior search in autism, suggest that elevated tonic LC-NE activity may contribute to more efficient search, and link non-social visual-spatial processing strengths to autism symptoms.

Uncovering the (un)attended: Pupil light responses index persistent biases of spatial attention in neglect

Visuospatial neglect is a frequent and disabling disorder, mostly after stroke, that presents in impaired awareness to stimuli on one side of space. Neglect causes disability and functional dependence, even long after the injury. Improving measurements of the core attentional deficit might hold the key for better understanding of the condition and development of treatment. We present a rapid, pupillometry-based method that assesses automatic biases in (covert) attention, without requiring behavioral responses. We exploit the phenomenon that pupil light responses scale with the degree of covert attention to stimuli, and thereby reveal what draws (no) attention. Participants with left-sided neglect after right-sided lesions following stroke (n = 5), participants with hemianopia/quadrantanopia following stroke (n = 11), and controls (n = 22) were presented with two vertical bars, one of which was white and one of which was black, while fixating the center. We varied which brightness was left and right, respectively across trials. In line with the hypotheses, participants with neglect demonstrated biased pupil light responses to the brightness on the right side. Participants with hemianopia showed similar biases to intact parts of the visual field, whilst controls exhibited no bias. Together, this demonstrates that the pupil light response can reveal not only visual, but also attentional deficits. Strikingly, our pupillometry-based bias estimates were not in agreement with neuropsychological paper-and-pencil assessments conducted on the same day, but were with those administered in an earlier phase post-stroke. Potentially, we pick up on persistent biases in the covert attentional system that participants increasingly compensate for in classical neuropsychological tasks and everyday life. The here proposed method may not only find clinical application, but also advance theory and aid the development of successful restoration therapies by introducing a precise, longitudinally valid, and objective measurement that might not be affected by compensation.

Seeing an Auditory Object: Pupillary Light Response Reflects Covert Attention to Auditory Space and Object

Attention to the relevant object and space is the brain's strategy to effectively process the information of interest in complex environments with limited neural resources. Numerous studies have documented how attention is allocated in the visual domain, whereas the nature of attention in the auditory domain has been much less explored. Here, we show that the pupillary light response can serve as a physiological index of auditory attentional shift and can be used to probe the relationship between space-based and object-based attention as well. Experiments demonstrated that the pupillary response corresponds to the luminance condition where the attended auditory object (e.g., spoken sentence) was located, regardless of whether attention was directed by a spatial (left or right) or nonspatial (e.g., the gender of the talker) cue and regardless of whether the sound was presented via headphones or loudspeakers. These effects on the pupillary light response could not be accounted for as a consequence of small (although observable) biases in gaze position drifting. The overall results imply a unified audiovisual representation of spatial attention. Auditory object-based attention contains the space representation of the attended auditory object, even when the object is oriented without explicit spatial guidance.

Right-dominant contextual cueing for global configuration cues, but not local position cues

Contextual cueing can depend on global configuration or local item position. We investigated the role of these two kinds of cues in the lateralization of contextual cueing effects. Cueing by item position was tested by recombining two previously learned displays, keeping the individual item locations intact, but destroying the global configuration. In contrast, cueing by configuration was investigated by rotating learned displays, thereby keeping the configuration intact but changing all item positions. We observed faster search for targets in the left display half, both for repeated and new displays, along with more first fixation locations on the left. Both position and configuration cues led to faster search, but the search time reduction compared to new displays due to position cues was comparable in the left and right display half. In contrast, configural cues led to increased search time reduction for right half targets. We conclude that only configural cues enabled memory-guided search for targets across the whole search display, whereas position cueing guided search only to targets in the vicinity of the fixation. The right-biased configural cueing effect is a consequence of the initial leftward search bias and does not indicate hemispheric dominance for configural cueing.

Visuospatial perception is not affected by self-related information

Previous research suggests that attention is drawn by self-related information. Three online experiments were conducted to investigate whether self-related stimuli alter visuospatial perceptual judgments. In a matching task, associations were learned between labels ('Yourself'/friend/stranger's name) paired with cues. Cues were coloured outlines (Experiment 1, N = 135), geometric shapes (Experiment 2, N = 102), or coloured gradients (Experiment 3, N = 110). Visuospatial perception bias was measured with a greyscales task. Cues were presented prior to, and/or alongside greyscales. We hypothesized there would be a bias towards the self-related cue. In all experiments, we found a self-related bias in the matching task. Furthermore, there was an overall leftward visuospatial perceptual bias (pseudoneglect). However, we found anecdotal to moderate evidence for the absence of an effect of self-related cues on visuospatial perception judgments. Although self-related stimuli influence how our attention is oriented to stimuli, attention mechanisms that influence perceptual judgements are seemingly not affected by a self-bias.

Investigating the role of human frontal eye field in the pupil light reflex modulation by saccade planning and working memory

The pupil constricts in response to an increase in global luminance level, commonly referred to as the pupil light reflex. Recent research has shown that these reflex responses are modulated by high-level cognition. There is larger pupil constriction evoked by a bright stimulus when the stimulus location spatially overlaps with the locus of attention, and these effects have been extended to saccade planning and working memory (here referred to as pupil local-luminance modulation). Although research in monkeys has further elucidated a central role of the frontal eye field (FEF) and superior colliculus in the pupil local-luminance modulation, their roles remain to be established in humans. Through applying continuous theta-burst transcranial magnetic stimulation over the right FEF (and vertex) to inhibit its activity, we investigated the role of the FEF in human pupil local-luminance responses. Pupil light reflex responses were transiently evoked by a bright patch stimulus presented during the delay period in the visual- and memory-delay tasks. In the visual-delay task, larger pupil constriction was observed when the patch location was spatially aligned with the target location in both stimulation conditions. More interestingly, after FEF stimulation, larger pupil constriction was obtained when the patch was presented in the contralateral, compared to the ipsilateral visual field of the stimulation. In contrast, FEF stimulation effects were absence in the memory-delay task. Linear mixed model results further found that stimulation condition, patch location consistency, and visual field significantly modulated observed pupil constriction responses. Together, our results constitute the first evidence of FEF modulation in human pupil local-luminance responses.

Pupillometry as an integrated readout of distinct attentional networks

The course of pupillary constriction and dilation provides an easy-to-access, inexpensive, and noninvasive readout of brain activity. We propose a new taxonomy of factors affecting the pupil and link these to associated neural underpinnings in an ascending hierarchy. In addition to two well-established low-level factors (light level and focal distance), we suggest two further intermediate-level factors, alerting and orienting, and a higher-level factor, executive functioning. Alerting, orienting, and executive functioning - including their respective underlying neural circuitries - overlap with the three principal attentional networks, making pupil size an integrated readout of distinct states of attention. As a now widespread technique, pupillometry is ready to provide meaningful applications and constitutes a viable part of the psychophysiological toolbox.