1
|
Chang YH, Yep R, Wang CA. Pupil size correlates with heart rate, skin conductance, pulse wave amplitude, and respiration responses during emotional conflict and valence processing. Psychophysiology 2025; 62:e14726. [PMID: 39533166 DOI: 10.1111/psyp.14726] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Revised: 10/21/2024] [Accepted: 10/24/2024] [Indexed: 11/16/2024]
Abstract
Pupil size is a non-invasive index for autonomic arousal mediated by the locus coeruleus-norepinephrine (LC-NE) system. While pupil size and its derivative (velocity) are increasingly used as indicators of arousal, limited research has investigated the relationships between pupil size and other well-known autonomic responses. Here, we simultaneously recorded pupillometry, heart rate, skin conductance, pulse wave amplitude, and respiration signals during an emotional face-word Stroop task, in which task-evoked (phasic) pupil dilation correlates with LC-NE responsivity. We hypothesized that emotional conflict and valence would affect pupil and other autonomic responses, and trial-by-trial correlations between pupil and other autonomic responses would be observed during both tonic and phasic epochs. Larger pupil dilations, higher pupil size derivative, and lower heart rates were observed in the incongruent condition compared to the congruent condition. Additionally, following incongruent trials, the congruency effect was reduced, and arousal levels indexed by previous-trial pupil dilation were correlated with subsequent reaction times. Furthermore, linear mixed models revealed that larger pupil dilations correlated with higher heart rates, higher skin conductance responses, higher respiration amplitudes, and lower pulse wave amplitudes on a trial-by-trial basis. Similar effects were seen between positive and negative valence conditions. Moreover, tonic pupil size before stimulus presentation significantly correlated with all other tonic autonomic responses, whereas tonic pupil size derivative correlated with heart rates and skin conductance responses. These results demonstrate a trial-by-trial relationship between pupil dynamics and other autonomic responses, highlighting pupil size as an effective real-time index for autonomic arousal during emotional conflict and valence processing.
Collapse
Affiliation(s)
- Yi-Hsuan Chang
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan
| | - Rachel Yep
- Sunnybrook Research Institute, University of Toronto, Toronto, Ontario, Canada
| | - Chin-An Wang
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Department of Anesthesiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
| |
Collapse
|
2
|
Huang J, Smorenburg ML, Yep R, Riek HC, Calancie OG, Kirkpatrick RH, Brien DC, Coe BC, Wang CA, Munoz DP. Age-related changes in pupil dynamics and task modulation across the healthy lifespan. Front Neurosci 2024; 18:1445727. [PMID: 39628657 PMCID: PMC11611812 DOI: 10.3389/fnins.2024.1445727] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2024] [Accepted: 10/28/2024] [Indexed: 12/06/2024] Open
Abstract
The pupil is modulated by luminance, arousal, bottom-up sensory, and top-down cognitive signals, and has increasingly been used to assess these aspects of brain functioning in health and disease. However, changes in pupil dynamics across the lifespan have not been extensively examined, hindering our ability to fully utilize the pupil in probing these underlying neural processes in development and aging in healthy and clinical cohorts. Here, we examined pupil responses during the interleaved pro-/anti-saccade task (IPAST) in healthy participants across the lifespan (n = 567, 5-93 years of age). Based on the extracted measurements of pupil dynamics, we demonstrated age-related changes in pupil measures and task modulation. Moreover, we characterized the underlying factors and age-related effects in components of pupil responses that may be attributed to developmental and aging changes in the associated brain regions. Finally, correlations between factors of pupil dynamics and saccade behaviors revealed evidence of shared neural processes in the pupil and saccade control circuitries. Together, these results demonstrate changes in pupil dynamics as a result of development and aging, providing a baseline with which altered pupil responses due to neurological deficits at different ages can be studied.
Collapse
Affiliation(s)
- Jeff Huang
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON, Canada
| | | | - Rachel Yep
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON, Canada
| | - Heidi C. Riek
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON, Canada
| | - Olivia G. Calancie
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON, Canada
| | - Ryan H. Kirkpatrick
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON, Canada
- School of Medicine, Queen’s University, Kingston, ON, Canada
| | - Donald C. Brien
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON, Canada
| | - Brian C. Coe
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON, Canada
| | - Chin-An Wang
- Eye-Tracking Laboratory, Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Department of Anesthesiology, School of Medicine, College of Medicine, Taipei Medical University, New Taipei City, Taiwan
| | - Douglas P. Munoz
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON, Canada
| |
Collapse
|
3
|
Herrmann B, Ryan JD. Pupil Size and Eye Movements Differently Index Effort in Both Younger and Older Adults. J Cogn Neurosci 2024; 36:1325-1340. [PMID: 38683698 DOI: 10.1162/jocn_a_02172] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/02/2024]
Abstract
The assessment of mental effort is increasingly relevant in neurocognitive and life span domains. Pupillometry, the measure of the pupil size, is often used to assess effort but has disadvantages. Analysis of eye movements may provide an alternative, but research has been limited to easy and difficult task demands in younger adults. An effort measure must be sensitive to the whole effort profile, including "giving up" effort investment, and capture effort in different age groups. The current study comprised three experiments in which younger (n = 66) and older (n = 44) adults listened to speech masked by background babble at different signal-to-noise ratios associated with easy, difficult, and impossible speech comprehension. We expected individuals to invest little effort for easy and impossible speech (giving up) but to exert effort for difficult speech. Indeed, pupil size was largest for difficult but lower for easy and impossible speech. In contrast, gaze dispersion decreased with increasing speech masking in both age groups. Critically, gaze dispersion during difficult speech returned to levels similar to easy speech after sentence offset, when acoustic stimulation was similar across conditions, whereas gaze dispersion during impossible speech continued to be reduced. These findings show that a reduction in eye movements is not a byproduct of acoustic factors, but instead suggest that neurocognitive processes, different from arousal-related systems regulating the pupil size, drive reduced eye movements during high task demands. The current data thus show that effort in one sensory domain (audition) differentially impacts distinct functional properties in another sensory domain (vision).
Collapse
Affiliation(s)
- Björn Herrmann
- Rotman Research Institute, North York, Ontario, Canada
- University of Toronto, Ontario, Canada
| | - Jennifer D Ryan
- Rotman Research Institute, North York, Ontario, Canada
- University of Toronto, Ontario, Canada
| |
Collapse
|
4
|
Guadron L, Titchener SA, Abbott CJ, Ayton LN, van Opstal AJ, Petoe MA, Goossens J. Post-Saccadic Oscillations of the Pupil and Lens Reduce Fixation Stability in Retinitis Pigmentosa and Age-Related Macular Degeneration. Invest Ophthalmol Vis Sci 2024; 65:39. [PMID: 38787546 PMCID: PMC11129721 DOI: 10.1167/iovs.65.5.39] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Accepted: 04/17/2024] [Indexed: 05/25/2024] Open
Abstract
Purpose Post-saccadic oscillations (PSOs) reflect movements of gaze that result from motion of the pupil and lens relative to the eyeball rather than eyeball rotations. Here, we analyzed the characteristics of PSOs in subjects with age-related macular degeneration (AMD), retinitis pigmentosa (RP), and normal vision (NV). Our aim was to assess the differences in PSOs between people with vision loss and healthy controls because PSOs affect retinal image stability after each saccade. Methods Participants completed a horizontal saccade task and their gaze was measured using a pupil-based eye tracker. Oscillations occurring in the 80 to 200 ms post-saccadic period were described with a damped oscillation model. We compared the amplitude, decay time constant, and frequency of the PSOs for the three different groups. We also examined the correlation between these PSO parameters and the amplitude, peak velocity, and final deceleration of the preceding saccades. Results Subjects with vision loss (AMD, n = 6, and RP, n = 5) had larger oscillation amplitudes, longer decay constants, and lower frequencies than subjects with NV (n = 7). The oscillation amplitudes increased with increases in saccade deceleration in all three groups. The other PSO parameters, however, did not show consistent correlations with either saccade amplitude or peak velocity. Conclusions Post-saccadic fixation stability in AMD and RP is reduced due to abnormal PSOs. The differences with respect to NV are not due to differences in saccade kinematics, suggesting that anatomic and neuronal variations affect the suspension of the iris and the lens in the patients' eyes.
Collapse
Affiliation(s)
- Leslie Guadron
- Department of Cognitive Neuroscience, Donders Institute for Brain Cognition and Behaviour, RadboudUMC, Nijmegen, The Netherlands
| | - Samuel A. Titchener
- Bionics Institute, East Melbourne, VIC, Australia
- Medical Bionics Department, University of Melbourne, Melbourne, VIC, Australia
| | - Carla J. Abbott
- Centre for Eye Research Australia, Royal Victorian Eye & Ear Hospital, Melbourne, VIC, Australia
- Department of Surgery (Ophthalmology), University of Melbourne, Melbourne, VIC, Australia
| | - Lauren N. Ayton
- Centre for Eye Research Australia, Royal Victorian Eye & Ear Hospital, Melbourne, VIC, Australia
- Department of Surgery (Ophthalmology), University of Melbourne, Melbourne, VIC, Australia
- Department of Optometry and Vision Sciences, University of Melbourne, Melbourne, VIC, Australia
| | - A. John van Opstal
- Section Neurophysics, Donders Institute for Brain Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Matthew A. Petoe
- Bionics Institute, East Melbourne, VIC, Australia
- Medical Bionics Department, University of Melbourne, Melbourne, VIC, Australia
| | - Jeroen Goossens
- Department of Cognitive Neuroscience, Donders Institute for Brain Cognition and Behaviour, RadboudUMC, Nijmegen, The Netherlands
| |
Collapse
|
5
|
Johnston R, Smith MA. Brain-wide arousal signals are segregated from movement planning in the superior colliculus. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.04.26.591284. [PMID: 38746466 PMCID: PMC11092505 DOI: 10.1101/2024.04.26.591284] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2024]
Abstract
The superior colliculus (SC) is traditionally considered a brain region that functions as an interface between processing visual inputs and generating eye movement outputs. Although its role as a primary reflex center is thought to be conserved across vertebrate species, evidence suggests that the SC has evolved to support higher-order cognitive functions including spatial attention. When it comes to oculomotor areas such as the SC, it is critical that high precision fixation and eye movements are maintained even in the presence of signals related to ongoing changes in cognition and brain state, both of which have the potential to interfere with eye position encoding and movement generation. In this study, we recorded spiking responses of neuronal populations in the SC while monkeys performed a memory-guided saccade task and found that the activity of some of the neurons fluctuated over tens of minutes. By leveraging the statistical power afforded by high-dimensional neuronal recordings, we were able to identify a low-dimensional pattern of activity that was correlated with the subjects' arousal levels. Importantly, we found that the spiking responses of deep-layer SC neurons were less correlated with this brain-wide arousal signal, and that neural activity associated with changes in pupil size and saccade tuning did not overlap in population activity space with movement initiation signals. Taken together, these findings provide a framework for understanding how signals related to cognition and arousal can be embedded in the population activity of oculomotor structures without compromising the fidelity of the motor output.
Collapse
Affiliation(s)
- Richard Johnston
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, USA
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, USA
| | - Matthew A. Smith
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, USA
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, USA
| |
Collapse
|
6
|
Wang CA, Muggleton NG, Chang YH, Barquero C, Kuo YC. Time-on-task effects on human pupillary and saccadic metrics after theta burst transcranial magnetic stimulation over the frontal eye field. IBRO Neurosci Rep 2023; 15:364-375. [PMID: 38046886 PMCID: PMC10689284 DOI: 10.1016/j.ibneur.2023.11.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 10/01/2023] [Accepted: 11/01/2023] [Indexed: 12/05/2023] Open
Abstract
Pupil size undergoes constant changes primarily influenced by ambient luminance. These changes are referred to as the pupillary light reflex (PLR), where the pupil transiently constricts in response to light. PLR kinematics provides valuable insights into autonomic nervous system function and have significant clinical applications. Recent research indicates that attention plays a role in modulating the PLR, and the circuit involving the frontal eye field (FEF) and superior colliculus is causally involved in controlling this pupillary modulation. However, there is limited research exploring the role of the human FEF in these pupillary responses, and its impact on PLR metrics remains unexplored. Additionally, although the protocol of continuous theta-burst stimulation (cTBS) is well-established, the period of disruption after cTBS is yet to be examined in pupillary responses. Our study aimed to investigate the effects of FEF cTBS on pupillary and saccadic metrics in relation to time spent performing a task (referred to as time-on-task). We presented a bright stimulus to induce the PLR in visual- and memory-delay saccade tasks following cTBS over the right FEF or vertex. FEF cTBS, compared to vertex cTBS, resulted in decreased baseline pupil size, peak constriction velocities, and amplitude. Furthermore, the time-on-task effects on baseline pupil size, peak amplitude, and peak time differed between the two stimulation conditions. In contrast, the time-on-task effects on saccadic metrics were less pronounced between the two conditions. In summary, our study provides the first evidence that FEF cTBS affects human PLR metrics and that these effects are modulated by time-on-task.
Collapse
Affiliation(s)
- Chin-An Wang
- Department of Anesthesiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei City, Taiwan
- Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
| | - Neil G. Muggleton
- Institute of Cognitive Neuroscience, College of Health Science and Technology, National Central University, Taoyuan City, Taiwan
- Cognitive Intelligence and Precision Healthcare Center, National Central University, Taoyuan City, Taiwan
| | - Yi-Hsuan Chang
- Institute of Cognitive Neuroscience, College of Health Science and Technology, National Central University, Taoyuan City, Taiwan
| | - Cesar Barquero
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Institute of Cognitive Neuroscience, College of Health Science and Technology, National Central University, Taoyuan City, Taiwan
- Department of Physical Activity and Sport Science, Universidad Peruana de Ciencias Aplicadas, Lima, Peru
| | - Ying-Chun Kuo
- Department of Anesthesiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei City, Taiwan
- Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
| |
Collapse
|
7
|
Cui ME, Herrmann B. Eye Movements Decrease during Effortful Speech Listening. J Neurosci 2023; 43:5856-5869. [PMID: 37491313 PMCID: PMC10423048 DOI: 10.1523/jneurosci.0240-23.2023] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 06/09/2023] [Accepted: 07/18/2023] [Indexed: 07/27/2023] Open
Abstract
Hearing impairment affects many older adults but is often diagnosed decades after speech comprehension in noisy situations has become effortful. Accurate assessment of listening effort may thus help diagnose hearing impairment earlier. However, pupillometry-the most used approach to assess listening effort-has limitations that hinder its use in practice. The current study explores a novel way to assess listening effort through eye movements. Building on cognitive and neurophysiological work, we examine the hypothesis that eye movements decrease when speech listening becomes challenging. In three experiments with human participants from both sexes, we demonstrate, consistent with this hypothesis, that fixation duration increases and spatial gaze dispersion decreases with increasing speech masking. Eye movements decreased during effortful speech listening for different visual scenes (free viewing, object tracking) and speech materials (simple sentences, naturalistic stories). In contrast, pupillometry was less sensitive to speech masking during story listening, suggesting pupillometric measures may not be as effective for the assessments of listening effort in naturalistic speech-listening paradigms. Our results reveal a critical link between eye movements and cognitive load, suggesting that neural activity in the brain regions that support the regulation of eye movements, such as frontal eye field and superior colliculus, are modulated when listening is effortful.SIGNIFICANCE STATEMENT Assessment of listening effort is critical for early diagnosis of age-related hearing loss. Pupillometry is most used but has several disadvantages. The current study explores a novel way to assess listening effort through eye movements. We examine the hypothesis that eye movements decrease when speech listening becomes effortful. We demonstrate, consistent with this hypothesis, that fixation duration increases and gaze dispersion decreases with increasing speech masking. Eye movements decreased during effortful speech listening for different visual scenes (free viewing, object tracking) and speech materials (sentences, naturalistic stories). Our results reveal a critical link between eye movements and cognitive load, suggesting that neural activity in brain regions that support the regulation of eye movements are modulated when listening is effortful.
Collapse
Affiliation(s)
- M Eric Cui
- Rotman Research Institute, Baycrest Academy for Research and Education, North York, Ontario M6A 2E1, Canada
- Department of Psychology, University of Toronto, Toronto, Ontario M5S 1A1, Canada
| | - Björn Herrmann
- Rotman Research Institute, Baycrest Academy for Research and Education, North York, Ontario M6A 2E1, Canada
- Department of Psychology, University of Toronto, Toronto, Ontario M5S 1A1, Canada
| |
Collapse
|
8
|
Koevoet D, Strauch C, Naber M, der Stigchel SV. The Costs of Paying Overt and Covert Attention Assessed With Pupillometry. Psychol Sci 2023; 34:887-898. [PMID: 37314425 DOI: 10.1177/09567976231179378] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/15/2023] Open
Abstract
Attention can be shifted with or without an accompanying saccade (i.e., overtly or covertly, respectively). Thus far, it is unknown how cognitively costly these shifts are, yet such quantification is necessary to understand how and when attention is deployed overtly or covertly. In our first experiment (N = 24 adults), we used pupillometry to show that shifting attention overtly is more costly than shifting attention covertly, likely because planning saccades is more complex. We pose that these differential costs will, in part, determine whether attention is shifted overtly or covertly in a given context. A subsequent experiment (N = 24 adults) showed that relatively complex oblique saccades are more costly than relatively simple saccades in horizontal or vertical directions. This provides a possible explanation for the cardinal-direction bias of saccades. The utility of a cost perspective as presented here is vital to furthering our understanding of the multitude of decisions involved in processing and interacting with the external world efficiently.
Collapse
Affiliation(s)
- Damian Koevoet
- Experimental Psychology, Helmholtz Institute, Utrecht University
| | | | - Marnix Naber
- Experimental Psychology, Helmholtz Institute, Utrecht University
| | | |
Collapse
|
9
|
Michalczyk Ł. Fixation offset decreases pupillary inhibition of return. Brain Cogn 2023; 170:106058. [PMID: 37390691 DOI: 10.1016/j.bandc.2023.106058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Revised: 06/14/2023] [Accepted: 06/22/2023] [Indexed: 07/02/2023]
Abstract
Inhibition of return (IOR) is reflected as a slower manual or saccadic response to a cued rather than an uncued target (manual IOR and saccadic IOR, respectively), and as a pupillary dilation when a bright, relative to a dark side of a display is cued (pupillary IOR). The aim of this study was to investigate the relation between an IOR and oculomotor system. According to the predominant view, only the saccadic IOR is strictly related to the visuomotor process, and the manual and pupillary IORs depend on non-motor factors (e.g., short-term visual depression). Alternatively, the after-effect of the covert-orienting hypothesis postulates that IOR is strictly related to the oculomotor system. As fixation offset affects oculomotor processes, this study investigated whether fixation offset also affects pupillary and manual IORs. The results show that fixation offset decreased IOR in pupillary but not manual responses, and provides support for the hypothesis that at least the pupillary IOR is tightly linked to eye movement preparation.
Collapse
Affiliation(s)
- Łukasz Michalczyk
- Institute of Psychology, Jesuit University Ignatianum in Krakow, Krakow, Poland.
| |
Collapse
|
10
|
Kraus F, Tune S, Obleser J, Herrmann B. Neural α Oscillations and Pupil Size Differentially Index Cognitive Demand under Competing Audiovisual Task Conditions. J Neurosci 2023; 43:4352-4364. [PMID: 37160365 PMCID: PMC10255021 DOI: 10.1523/jneurosci.2181-22.2023] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2022] [Revised: 04/12/2023] [Accepted: 04/17/2023] [Indexed: 05/11/2023] Open
Abstract
Cognitive demand is thought to modulate two often used, but rarely combined, measures: pupil size and neural α (8-12 Hz) oscillatory power. However, it is unclear whether these two measures capture cognitive demand in a similar way under complex audiovisual-task conditions. Here we recorded pupil size and neural α power (using electroencephalography), while human participants of both sexes concurrently performed a visual multiple object-tracking task and an auditory gap detection task. Difficulties of the two tasks were manipulated independent of each other. Participants' performance decreased in accuracy and speed with increasing cognitive demand. Pupil size increased with increasing difficulty for both the auditory and the visual task. In contrast, α power showed diverging neural dynamics: parietal α power decreased with increasing difficulty in the visual task, but not with increasing difficulty in the auditory task. Furthermore, independent of task difficulty, within-participant trial-by-trial fluctuations in pupil size were negatively correlated with α power. Difficulty-induced changes in pupil size and α power, however, did not correlate, which is consistent with their different cognitive-demand sensitivities. Overall, the current study demonstrates that the dynamics of the neurophysiological indices of cognitive demand and associated effort are multifaceted and potentially modality-dependent under complex audiovisual-task conditions.SIGNIFICANCE STATEMENT Pupil size and oscillatory α power are associated with cognitive demand and effort, but their relative sensitivity under complex audiovisual-task conditions is unclear, as is the extent to which they share underlying mechanisms. Using an audiovisual dual-task paradigm, we show that pupil size increases with increasing cognitive demands for both audition and vision. In contrast, changes in oscillatory α power depend on the respective task demands: parietal α power decreases with visual demand but not with auditory task demand. Hence, pupil size and α power show different sensitivity to cognitive demands, perhaps suggesting partly different underlying neural mechanisms.
Collapse
Affiliation(s)
- Frauke Kraus
- Department of Psychology, University of Lübeck, 23562 Lübeck, Germany
- Center of Brain, Behavior and Metabolism, University of Lübeck, 23562 Lübeck, Germany
| | - Sarah Tune
- Department of Psychology, University of Lübeck, 23562 Lübeck, Germany
- Center of Brain, Behavior and Metabolism, University of Lübeck, 23562 Lübeck, Germany
| | - Jonas Obleser
- Department of Psychology, University of Lübeck, 23562 Lübeck, Germany
- Center of Brain, Behavior and Metabolism, University of Lübeck, 23562 Lübeck, Germany
| | - Björn Herrmann
- Rotman Research Institute, Baycrest Health Sciences, Toronto, Ontario M6A 2E1, Canada
- University of Toronto, Toronto, Ontario M5S 1A1, Canada
| |
Collapse
|
11
|
Koevoet D, Naber M, Strauch C, Somai RS, Van der Stigchel S. Differential aspects of attention predict the depth of visual working memory encoding: Evidence from pupillometry. J Vis 2023; 23:9. [PMID: 37318440 PMCID: PMC10278550 DOI: 10.1167/jov.23.6.9] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Accepted: 05/15/2023] [Indexed: 06/16/2023] Open
Abstract
What determines how much one encodes into visual working memory? Traditionally, encoding depth is considered to be indexed by spatiotemporal properties of gaze, such as gaze position and dwell time. Although these properties inform about where and how long one looks, they do not necessarily inform about the current arousal state or how strongly attention is deployed to facilitate encoding. Here, we found that two types of pupillary dynamics predict how much information is encoded during a copy task. The task involved encoding a spatial pattern of multiple items for later reproduction. Results showed that smaller baseline pupil sizes preceding and stronger pupil orienting responses during encoding predicted that more information was encoded into visual working memory. Additionally, we show that pupil size reflects not only how much but also how precisely material is encoded. We argue that a smaller pupil size preceding encoding is related to increased exploitation, whereas larger pupil constrictions signal stronger attentional (re)orienting to the to-be-encoded pattern. Our findings support the notion that the depth of visual working memory encoding is the integrative outcome of differential aspects of attention: how alert one is, how much attention one deploys, and how long it is deployed. Together, these factors determine how much information is encoded into visual working memory.
Collapse
Affiliation(s)
- Damian Koevoet
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| | - Marnix Naber
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| | - Christoph Strauch
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| | - Rosyl S Somai
- Psychology, Faculty of Natural Sciences, University of Stirling, Stirling, UK
| | | |
Collapse
|
12
|
Dercksen TT, Widmann A, Wetzel N. Salient omissions-pupil dilation in response to unexpected omissions of sound and touch. Front Psychiatry 2023; 14:1143931. [PMID: 37032955 PMCID: PMC10077953 DOI: 10.3389/fpsyt.2023.1143931] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Accepted: 02/21/2023] [Indexed: 04/11/2023] Open
Abstract
Introduction Recent theories describe perception as an inferential process based on internal predictive models adjusted by means of prediction violations (prediction error). To study and demonstrate predictive processing in the brain the use of unexpected stimulus omissions has been suggested as a promising approach as the evoked brain responses are uncontaminated by responses to stimuli. Here, we aimed to investigate the pupil's response to unexpected stimulus omissions in order to better understand surprise and orienting of attention resulting from prediction violation. So far only few studies have used omission in pupillometry research and results have been inconsistent. Methods This study adapted an EEG paradigm that has been shown to elicit omission responses in auditory and somatosensory modalities. Healthy adults pressed a button at their own pace, which resulted in the presentation of sounds or tactile stimuli in either 88%, 50% or 0% (motor-control) of cases. Pupil size was recorded continuously and averaged to analyze the pupil dilation response associated with each condition. Results Results revealed that omission responses were observed in both modalities in the 88%-condition compared to motor-control. Similar pupil omission responses were observed between modalities, suggesting modality-unspecific activation of the underlying brain circuits. Discussion In combination with previous omission studies using EEG, the findings demonstrate predictive models in brain processing and point to the involvement of subcortical structures in the omission response. Our pupillometry approach is especially suitable to study sensory prediction in vulnerable populations within the psychiatric field.
Collapse
Affiliation(s)
- Tjerk T. Dercksen
- Research Group Neurocognitive Development, Leibniz Institute for Neurobiology, Magdeburg, Germany
- Center for Behavioral Brain Sciences, Magdeburg, Germany
| | - Andreas Widmann
- Research Group Neurocognitive Development, Leibniz Institute for Neurobiology, Magdeburg, Germany
- Wilhelm Wundt Institute for Psychology, Leipzig University, Leipzig, Germany
| | - Nicole Wetzel
- Research Group Neurocognitive Development, Leibniz Institute for Neurobiology, Magdeburg, Germany
- Center for Behavioral Brain Sciences, Magdeburg, Germany
- University of Applied Sciences Magdeburg-Stendal, Stendal, Germany
| |
Collapse
|
13
|
Lawlor J, Zagala A, Jamali S, Boubenec Y. Pupillary dynamics reflect the impact of temporal expectation on detection strategy. iScience 2023; 26:106000. [PMID: 36798438 PMCID: PMC9926307 DOI: 10.1016/j.isci.2023.106000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Revised: 11/09/2022] [Accepted: 01/12/2023] [Indexed: 01/18/2023] Open
Abstract
Everyday life's perceptual decision-making is informed by experience. In particular, temporal expectation can ease the detection of relevant events in noisy sensory streams. Here, we investigated if humans can extract hidden temporal cues from the occurrences of probabilistic targets and utilize them to inform target detection in a complex acoustic stream. To understand what neural mechanisms implement temporal expectation influence on decision-making, we used pupillometry as a proxy for underlying neuromodulatory activity. We found that participants' detection strategy was influenced by the hidden temporal context and correlated with sound-evoked pupil dilation. A model of urgency fitted on false alarms predicted detection reaction time. Altogether, these findings suggest that temporal expectation informs decision-making and could be implemented through neuromodulatory-mediated urgency signals.
Collapse
Affiliation(s)
- Jennifer Lawlor
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, USA,Corresponding author
| | - Agnès Zagala
- International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal, Canada
| | - Sara Jamali
- Institut Pasteur, INSERM, Institut de l’Audition, Paris, France
| | - Yves Boubenec
- Laboratoire des systèmes perceptifs, Département d’études cognitives, École normale supérieure, PSL University, CNRS, 75005 Paris, France
| |
Collapse
|
14
|
Nakayama R, Bardin JB, Koizumi A, Motoyoshi I, Amano K. Building a decoder of perceptual decisions from microsaccades and pupil size. Front Psychol 2022; 13:942859. [PMID: 36176801 PMCID: PMC9514321 DOI: 10.3389/fpsyg.2022.942859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2022] [Accepted: 08/17/2022] [Indexed: 11/21/2022] Open
Abstract
Many studies have reported neural correlates of visual awareness across several brain regions, including the sensory, parietal, and frontal areas. In most of these studies, participants were instructed to explicitly report their perceptual experience through a button press or verbal report. It is conceivable, however, that explicit reporting itself may trigger specific neural responses that can confound the direct examination of the neural correlates of visual awareness. This suggests the need to assess visual awareness without explicit reporting. One way to achieve this is to develop a technique to predict the visual awareness of participants based on their peripheral responses. Here, we used eye movements and pupil sizes to decode trial-by-trial changes in the awareness of a stimulus whose visibility was deteriorated due to adaptation-induced blindness (AIB). In the experiment, participants judged whether they perceived a target stimulus and rated the confidence they had in their perceptual judgment, while their eye movements and pupil sizes were recorded. We found that not only perceptual decision but also perceptual confidence can be separately decoded from the eye movement and pupil size. We discuss the potential of this technique with regard to assessing visual awareness in future neuroimaging experiments.
Collapse
Affiliation(s)
- Ryohei Nakayama
- Department of Psychology, The University of Tokyo, Tokyo, Japan
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Osaka, Japan
| | - Jean-Baptiste Bardin
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Osaka, Japan
- École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Ai Koizumi
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Osaka, Japan
- Sony Computer Science Laboratories, Inc., Tokyo, Japan
| | - Isamu Motoyoshi
- Department of Life Sciences, The University of Tokyo, Tokyo, Japan
| | - Kaoru Amano
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Osaka, Japan
- Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan
- *Correspondence: Kaoru Amano,
| |
Collapse
|
15
|
Chen JT, Kuo YC, Hsu TY, Wang CA. Fatigue and Arousal Modulations Revealed by Saccade and Pupil Dynamics. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19159234. [PMID: 35954585 PMCID: PMC9367726 DOI: 10.3390/ijerph19159234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 07/25/2022] [Accepted: 07/27/2022] [Indexed: 11/16/2022]
Abstract
Saccadic eye movements are directed to the objects of interests and enable high-resolution visual images in the exploration of the visual world. There is a trial-to-trial variation in saccade dynamics even in a simple task, possibly attributed to arousal fluctuations. Previous studies have showed that an increase of fatigue level over time, also known as time-on-task, can be revealed by saccade peak velocity. In addition, pupil size, controlled by the autonomic nervous system, has long been used as an arousal index. However, limited research has been done with regards to the relation between pupil size and saccade behavior in the context of trial-to-trial variation. To investigate fatigue and arousal effects on saccadic and pupillary responses, we used bright and emotional stimuli to evoke pupillary responses in tasks requiring reactive and voluntary saccade generation. Decreased voluntary saccade peak velocities, reduced tonic pupil size and phasic pupillary responses were observed as time-on-task increased. Moreover, tonic pupil size affected saccade latency and dynamics, with steeper saccade main sequence slope as tonic pupil size increased. In summary, saccade dynamics and tonic pupil size were sensitive to fatigue and arousal level, together providing valuable information for the understanding of human behavior.
Collapse
Affiliation(s)
- Jui-Tai Chen
- Department of Anesthesiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei 110, Taiwan;
- Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City 235, Taiwan
| | - Ying-Chun Kuo
- Institute of Cognitive Neuroscience, College of Health Science and Technology, National Central University, Taoyuan City 320, Taiwan;
- Cognitive Intelligence and Precision Healthcare Research Center, National Central University, Taoyuan City 320, Taiwan
| | - Tzu-Yu Hsu
- Graduate Institute of Mind, Brain, and Consciousness (GIMBC), Taipei Medical University, Taipei 110, Taiwan;
- Brain and Consciousness Research Center (BCRC), TMU-Shuang Ho Hospital, New Taipei City 235, Taiwan
| | - Chin-An Wang
- Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City 235, Taiwan
- Institute of Cognitive Neuroscience, College of Health Science and Technology, National Central University, Taoyuan City 320, Taiwan;
- Cognitive Intelligence and Precision Healthcare Research Center, National Central University, Taoyuan City 320, Taiwan
- Graduate Institute of Mind, Brain, and Consciousness (GIMBC), Taipei Medical University, Taipei 110, Taiwan;
- Brain and Consciousness Research Center (BCRC), TMU-Shuang Ho Hospital, New Taipei City 235, Taiwan
- Correspondence:
| |
Collapse
|
16
|
Strauch C, Wang CA, Einhäuser W, Van der Stigchel S, Naber M. Pupillometry as an integrated readout of distinct attentional networks. Trends Neurosci 2022; 45:635-647. [PMID: 35662511 DOI: 10.1016/j.tins.2022.05.003] [Citation(s) in RCA: 83] [Impact Index Per Article: 27.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Revised: 04/15/2022] [Accepted: 05/09/2022] [Indexed: 10/18/2022]
Abstract
The course of pupillary constriction and dilation provides an easy-to-access, inexpensive, and noninvasive readout of brain activity. We propose a new taxonomy of factors affecting the pupil and link these to associated neural underpinnings in an ascending hierarchy. In addition to two well-established low-level factors (light level and focal distance), we suggest two further intermediate-level factors, alerting and orienting, and a higher-level factor, executive functioning. Alerting, orienting, and executive functioning - including their respective underlying neural circuitries - overlap with the three principal attentional networks, making pupil size an integrated readout of distinct states of attention. As a now widespread technique, pupillometry is ready to provide meaningful applications and constitutes a viable part of the psychophysiological toolbox.
Collapse
Affiliation(s)
- Christoph Strauch
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands.
| | - Chin-An Wang
- Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan; Cognitive Intelligence and Precision Healthcare Center, National Central University, Taoyuan City, Taiwan
| | - Wolfgang Einhäuser
- Physics of Cognition Group, Chemnitz University of Technology, Chemnitz, Germany
| | | | - Marnix Naber
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
17
|
Wang CA, White B, Munoz DP. Pupil-linked Arousal Signals in the Midbrain Superior Colliculus. J Cogn Neurosci 2022; 34:1340-1354. [PMID: 35579984 DOI: 10.1162/jocn_a_01863] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
The orienting response evoked by the appearance of a salient stimulus is modulated by arousal; however, neural underpinnings for the interplay between orienting and arousal are not well understood. The superior colliculus (SC), causally involved in multiple components of the orienting response including gaze and attention shifts, receives not only multisensory and cognitive inputs but also arousal-regulated inputs from various cortical and subcortical structures. To investigate the impact of moment-by-moment fluctuations in arousal on orienting saccade responses, we used microstimulation of the monkey SC to trigger saccade responses, and we used pupil size and velocity to index the level of arousal at stimulation onset because these measures correlate with changes in brain states and locus coeruleus activity. Saccades induced by SC microstimulation correlated with prestimulation pupil velocity, with higher pupil velocities on trials without evoked saccades than with evoked saccades. In contrast, prestimulation absolute pupil size did not correlate with saccade behavior. However, pupil velocity correlated with evoked saccade latency and metrics. Together, our results demonstrated that small fluctuations in arousal, indexed by pupil velocity, can modulate the saccade response evoked by SC microstimulation in awake behaving monkeys.
Collapse
Affiliation(s)
| | - Brian White
- Queen's University, Kingston, Ontario, Canada
| | | |
Collapse
|
18
|
Burlingham CS, Mirbagheri S, Heeger DJ. A unified model of the task-evoked pupil response. SCIENCE ADVANCES 2022; 8:eabi9979. [PMID: 35442730 PMCID: PMC9020670 DOI: 10.1126/sciadv.abi9979] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/14/2021] [Accepted: 03/04/2022] [Indexed: 06/14/2023]
Abstract
The pupil dilates and reconstricts following task events. It is popular to model this task-evoked pupil response as a linear transformation of event-locked impulses, whose amplitudes are used as estimates of arousal. We show that this model is incorrect and propose an alternative model based on the physiological finding that a common neural input drives saccades and pupil size. The estimates of arousal from our model agreed with key predictions: Arousal scaled with task difficulty and behavioral performance but was invariant to small differences in trial duration. Moreover, the model offers a unified explanation for a wide range of phenomena: entrainment of pupil size and saccades to task timing, modulation of pupil response amplitude and noise with task difficulty, reaction time-dependent modulation of pupil response timing and amplitude, a constrictory pupil response time-locked to saccades, and task-dependent distortion of this saccade-locked pupil response.
Collapse
Affiliation(s)
| | - Saghar Mirbagheri
- Graduate Program in Neuroscience, University of Washington, Seattle, WA 98195, USA
| | - David J. Heeger
- Department of Psychology, New York University, New York, NY 10003, USA
- Center for Neural Science, New York University, New York, NY 10003, USA
| |
Collapse
|
19
|
Pandey P, Ray S. Influence of the Location of a Decision Cue on the Dynamics of Pupillary Light Response. Front Hum Neurosci 2022; 15:755383. [PMID: 35153699 PMCID: PMC8826249 DOI: 10.3389/fnhum.2021.755383] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2021] [Accepted: 12/22/2021] [Indexed: 11/16/2022] Open
Abstract
The pupils of the eyes reflexively constrict in light and dilate in dark to optimize retinal illumination. Non-visual cognitive factors, like attention, arousal, decision-making, etc., also influence pupillary light response (PLR). During passive viewing, the eccentricity of a stimulus modulates the pupillary aperture size driven by spatially weighted corneal flux density (CFD), which is the product of luminance and the area of the stimulus. Whether the scope of attention also influences PLR remains unclear. In this study, we contrasted the pupil dynamics between diffused and focused attentional conditions during decision-making, while the global CFD remained the same in the two conditions. A population of 20 healthy humans participated in a pair of forced choice tasks. They distributed attention to the peripheral decision cue in one task, and concentrated at the center in the other to select the target from four alternatives for gaze orientation. The location of this cue did not influence participants' reaction time (RT). However, the magnitude of constriction was significantly less in the task that warranted attention to be deployed at the center than on the periphery. We observed similar pupil dynamics when participants either elicited or canceled a saccadic eye movement, which ruled out pre-saccadic obligatory attentional orientation contributing to PLR. We further addressed how the location of attentional deployment might have influenced PLR. We simulated a biomechanical model of PLR with visual stimulation of different strengths as inputs corresponding to the two attentional conditions. In this homeomorphic model, the computational characteristic of each element was derived from the physiological and/or mechanical properties of the corresponding biological element. The simulation of this model successfully mimicked the observed data. In contrast to common belief that the global ambient luminosity drives pupillary response, the results of our study suggest that the effective CFD (eCFD) determined via the luminance multiplied by the size of the stimulus at the location of deployed attention in the visual space is critical for the magnitude of pupillary constriction.
Collapse
Affiliation(s)
| | - Supriya Ray
- Centre of Behavioural and Cognitive Sciences, University of Allahabad, Prayagraj, India
| |
Collapse
|
20
|
May PJ, Gamlin PD, Warren S. A Novel Tectal/Pretectal Population of Premotor Lens Accommodation Neurons. Invest Ophthalmol Vis Sci 2022; 63:35. [PMID: 35084433 PMCID: PMC8802014 DOI: 10.1167/iovs.63.1.35] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
Purpose Under real-world conditions, saccades are often accompanied by changes in vergence angle and lens accommodation that compensate for changes in the distance between the current fixation point and the next target. As the superior colliculus directs saccades, we examined whether it contains premotor neurons that might control lens compensation for target distance. Methods Rabies virus or recombinant rabies virus was injected into the ciliary bodies of Macaca fascicularis monkeys to label circuits controlling lens accommodation via retrograde transsynaptic transport. In addition, conventional anterograde tracers were used to confirm the rabies findings with respect to projections to preganglionic Edinger–Westphal motoneurons. Results At time courses that rabies virus labeled lens-related premotor neurons in the supraoculomotor area and central mesencephalic reticular formation, labeled neurons were not found within the superior colliculus. They were, however, found bilaterally in the medial pretectal nucleus continuing caudally into the tectal longitudinal column, which lies on the midline, between the colliculi. A bilateral projection by this area to the preganglionic Edinger–Westphal nucleus was confirmed by anterograde tracing. Only at longer time courses were cells labeled in the superior colliculus. Conclusions The superior colliculus does not provide premotor input to preganglionic Edinger–Westphal nucleus motoneurons, but may provide input to lens-related premotor populations in the supraoculomotor area and central mesencephalic reticular formation. There is, however, a novel third population of lens-related premotor neurons in the tectal longitudinal column and rostrally adjacent medial pretectal nucleus. The specific function of this premotor population remains to be determined.
Collapse
Affiliation(s)
- Paul J May
- Department of Neurobiology & Anatomical Sciences, University of Mississippi Medical Center, Jackson, Mississippi, United States.,Department of Ophthalmology, University of Mississippi Medical Center, Jackson, MS, United States.,Department of Neurology, University of Mississippi Medical Center, Jackson, Mississippi, United States
| | - Paul D Gamlin
- Department of Ophthalmology and Visual Sciences, University of Alabama at Birmingham, Birmingham, Alabama, United States
| | - Susan Warren
- Department of Neurobiology & Anatomical Sciences, University of Mississippi Medical Center, Jackson, Mississippi, United States
| |
Collapse
|
21
|
Eberhardt LV, Strauch C, Hartmann TS, Huckauf A. Increasing pupil size is associated with improved detection performance in the periphery. Atten Percept Psychophys 2022; 84:138-149. [PMID: 34820766 PMCID: PMC8795034 DOI: 10.3758/s13414-021-02388-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/27/2021] [Indexed: 11/08/2022]
Abstract
Visible light enters our body via the pupil. By changing its size, the pupil shapes visual input. Small apertures increase the resolution of high spatial frequencies, thus allowing discrimination of fine details. Large apertures, in contrast, provide a better signal-to-noise ratio, because more light can enter the eye. This should lead to better detection performance of peripheral stimuli. Experiment 1 shows that the effect can reliably be demonstrated even in a less controlled online setting. In Experiment 2, pupil size was measured in a laboratory using an eye tracker. The findings replicate findings showing that large pupils provide an advantage for peripheral detection of faint stimuli. Moreover, not only pupil size during information intake in the current trial n, but also its interaction with pupil size preceding information intake, i.e., in trial n-1, predicted performance. This suggests that in addition to absolute pupil size, the extent of pupillary change provides a mechanism to modulate perceptual functions. The results are discussed in terms of low-level sensory as well as higher-level arousal-driven changes in stimulus processing.
Collapse
Affiliation(s)
- Lisa Valentina Eberhardt
- General Psychology, Faculty of Engineering, Computer Science and Psychology, Ulm University, Albert-Einstein-Allee 47, 89069, Ulm, Germany.
| | - Christoph Strauch
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, the Netherlands
| | - Tim Samuel Hartmann
- General Psychology, Faculty of Engineering, Computer Science and Psychology, Ulm University, Albert-Einstein-Allee 47, 89069, Ulm, Germany
| | - Anke Huckauf
- General Psychology, Faculty of Engineering, Computer Science and Psychology, Ulm University, Albert-Einstein-Allee 47, 89069, Ulm, Germany
| |
Collapse
|
22
|
Enlargement of female pupils when perceiving something cute. Sci Rep 2021; 11:23367. [PMID: 34862420 PMCID: PMC8642513 DOI: 10.1038/s41598-021-02852-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2021] [Accepted: 11/22/2021] [Indexed: 11/08/2022] Open
Abstract
It is reported that women's pupils dilate when they see a baby; it is unclear if this pupillary response is caused by the perception of cuteness itself. Since many objects besides babies can be perceived as cute, we investigated whether the perception of cuteness, or the type of object observed, is related to pupil dilation. In the first experiment, female participants were requested to rate the subjective cuteness of greyscale pictures of objects such as animals and foods; their pupil sizes were measured. The results showed a significant positive correlation between perceived cuteness and participants' pupil dilation. In the second experiment, participants rated the cuteness of images of female faces. Results revealed a significant negative correlation between perceived cuteness and pupil dilation. In our study, perceiving cuteness enlarged female observers' pupils except when observing female faces. Positive reactions associated with cuteness may be premised on the existence of unconscious perceptual alterations and physical responses.
Collapse
|
23
|
Wang CA, Nguyen KT, Juan CH. Linking Pupil Size Modulated by Global Luminance and Motor Preparation to Saccade Behavior. Neuroscience 2021; 476:90-101. [PMID: 34571085 DOI: 10.1016/j.neuroscience.2021.09.014] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2021] [Revised: 09/03/2021] [Accepted: 09/18/2021] [Indexed: 01/21/2023]
Abstract
Saccades are rapid eye movements that are used to move the high acuity fovea in a serial manner in the exploration of the visual scene. Stimulus contrast is known to modulate saccade latency and metrics possibly via changing visual activity in the superior colliculus (SC), a midbrain structure causally involved in saccade generation. However, the quality of visual signals should also be modulated by the amount of lights projected onto the retina, which is gated by the size of the pupil. Although absolute pupil size should modulate visual signals and in turn affect saccade responses, research examining this relationship is very limited. Besides, pupil size is associated with motor preparation. However, the role of pupil dilation in saccade metrics remains unexplored. Through varying peripheral background luminance level and target visual contrast in the saccade task, we investigated the role of absolute pupil size and baseline-corrected pupil dilation in saccade latency and metrics. Higher target detection accuracy was obtained with lower background luminance level, and larger absolute pupil diameter correlated with smaller saccade amplitude and higher saccade peak velocities. More interestingly, the comparable modulation between pupil dilation and stimulus contrast was obtained, showing larger pupil dilation (or higher contrast stimuli) correlating with faster saccade latencies, larger amplitude, higher peak velocities, and smaller endpoint deviation. Together, our results demonstrated the influence of absolute pupil size induced by global luminance level and baseline-corrected pupil dilation associated with motor preparation on saccade latency and metrics, implicating the role of the SC in this behavior.
Collapse
Affiliation(s)
- Chin-An Wang
- Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan; Cognitive Intelligence and Precision Healthcare Center, National Central University, Taoyuan City, Taiwan.
| | - Kien Trong Nguyen
- Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan; Faculty of Electronics Engineering, Posts and Telecommunications Institute of Technology, Ho Chi Minh City, Viet Nam
| | - Chi-Hung Juan
- Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan; Cognitive Intelligence and Precision Healthcare Center, National Central University, Taoyuan City, Taiwan; Department of Psychology, Kaohsiung Medical University, Kaohsiung City, Taiwan
| |
Collapse
|
24
|
Wang CA, Munoz DP. Differentiating global luminance, arousal and cognitive signals on pupil size and microsaccades. Eur J Neurosci 2021; 54:7560-7574. [PMID: 34716728 DOI: 10.1111/ejn.15508] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Revised: 10/22/2021] [Accepted: 10/23/2021] [Indexed: 10/19/2022]
Abstract
Pupil size reflects a proxy for neural activity associated with global luminance, arousal and cognitive processing. Microsaccades are also modulated by arousal and cognitive processing. Are these effects of arousal and cognitive signals on pupil size and microsaccades coordinated? If so, via what neural mechanisms? We hypothesized that if pupil size and microsaccades are coordinately modulated by these processes, pupil size immediately before microsaccade onset, as an index for ongoing cognitive and arousal processing, should correlate with microsaccade responses during tasks alternating these signals. Here, we examined the relationship between pupil size and microsaccade responses in tasks that included variations in global luminance, arousal and inhibitory control. Higher microsaccade peak velocities correlated with larger pre-microsaccade pupil response related to arousal and inhibitory control signals. In contrast, pupil responses evoked by global luminance signals did not correlate with microsaccade responses. Given the central role of the superior colliculus in microsaccade generation, these results suggest the critical involvement of the superior colliculus to coordinate pupil and microsaccade responses for arousal and inhibitory control modulations, but not for the pupil luminance modulation.
Collapse
Affiliation(s)
- Chin-An Wang
- Institute of Cognitive Neuroscience, College of Health Science and Technology, National Central University, Taoyuan City, Taiwan.,Cognitive Intelligence and Precision Healthcare Research Center, National Central University, Taoyuan City, Taiwan
| | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| |
Collapse
|
25
|
Zangrossi A, Cona G, Celli M, Zorzi M, Corbetta M. Visual exploration dynamics are low-dimensional and driven by intrinsic factors. Commun Biol 2021; 4:1100. [PMID: 34535744 PMCID: PMC8448835 DOI: 10.1038/s42003-021-02608-x] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Accepted: 08/17/2021] [Indexed: 02/08/2023] Open
Abstract
When looking at visual images, the eyes move to the most salient and behaviourally relevant objects. Saliency and semantic information significantly explain where people look. Less is known about the spatiotemporal properties of eye movements (i.e., how people look). We show that three latent variables explain 60% of eye movement dynamics of more than a hundred observers looking at hundreds of different natural images. The first component explaining 30% of variability loads on fixation duration, and it does not relate to image saliency or semantics; it approximates a power-law distribution of gaze steps, an intrinsic dynamic measure, and identifies observers with two viewing styles: static and dynamic. Notably, these viewing styles were also identified when observers look at a blank screen. These results support the importance of endogenous processes such as intrinsic dynamics to explain eye movement spatiotemporal properties.
Collapse
Affiliation(s)
- Andrea Zangrossi
- grid.5608.b0000 0004 1757 3470Department of Neuroscience, University of Padova, Padova, Italy ,grid.5608.b0000 0004 1757 3470Padova Neuroscience Center (PNC), University of Padova, Padova, Italy ,grid.428736.cVenetian Institute of Molecular Medicine, VIMM, Padova, Italy
| | - Giorgia Cona
- grid.5608.b0000 0004 1757 3470Padova Neuroscience Center (PNC), University of Padova, Padova, Italy ,grid.5608.b0000 0004 1757 3470Department of General Psychology, University of Padova, Padova, Italy
| | - Miriam Celli
- grid.5608.b0000 0004 1757 3470Padova Neuroscience Center (PNC), University of Padova, Padova, Italy ,grid.428736.cVenetian Institute of Molecular Medicine, VIMM, Padova, Italy
| | - Marco Zorzi
- grid.5608.b0000 0004 1757 3470Department of General Psychology, University of Padova, Padova, Italy ,grid.492797.6IRCCS San Camillo Hospital, Venice, Italy
| | - Maurizio Corbetta
- grid.5608.b0000 0004 1757 3470Department of Neuroscience, University of Padova, Padova, Italy ,grid.5608.b0000 0004 1757 3470Padova Neuroscience Center (PNC), University of Padova, Padova, Italy ,grid.428736.cVenetian Institute of Molecular Medicine, VIMM, Padova, Italy
| |
Collapse
|
26
|
Pandey P, Ray S. Pupil dynamics: A potential proxy of neural preparation for goal-directed eye movement. Eur J Neurosci 2021; 54:6587-6607. [PMID: 34510602 DOI: 10.1111/ejn.15453] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Revised: 08/22/2021] [Accepted: 09/03/2021] [Indexed: 01/10/2023]
Abstract
The pupils reflexively constrict or dilate to regulate the influx of light on the retinae. Pupillary light reflex (PLR) is susceptible to many non-visual cognitive processes including covert orientation of attention and planning rapid saccadic eye movement. The frontal eye field (FEF) and superior colliculus (SC), which also send projections to the PLR pathway, are two important areas in primate's brain for planning saccade and orientation of attention. The saccadic reaction time (SRT) and the rate of increase in activity of movement neurons in these areas are inversely correlated. This study addressed how pupil dynamics, activity in the FEF and SC and SRT are related in a saccadic decision-making task. The rate of visually evoked pupil constriction was found inversely related to SRT. This was further verified by simulating a homeomorphic biomechanical model of pupillary muscle plants, wherein we projected signals similar to build-up activity in the FEF and SC to the parasympathetic (constriction) and sympathetic (dilation) division of the PLR pathway, respectively. A striking similarity between simulated and observed dynamics of pupil constriction suggests that PLR is a potential proxy of saccade planning by movement neurons in the FEF and SC. Indistinguishable pupil dynamics when planned saccades were elicited versus when they were cancelled eliminated the possibility that the obligatory pre-saccadic shift of attention alone influenced the rate of pupil constriction. Our study envisages a mechanism of how the oculomotor system influences the autonomic activity in an attempt to timely minimize saccadic visual transients by regulating the influx of light.
Collapse
Affiliation(s)
- Pragya Pandey
- Centre of Behavioural and Cognitive Sciences, University of Allahabad, Prayagraj, India
| | - Supriya Ray
- Centre of Behavioural and Cognitive Sciences, University of Allahabad, Prayagraj, India
| |
Collapse
|
27
|
Hsu TY, Hsu YF, Wang HY, Wang CA. Role of the frontal eye field in human pupil and saccade orienting responses. Eur J Neurosci 2021; 54:4283-4294. [PMID: 33901328 DOI: 10.1111/ejn.15253] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2021] [Indexed: 11/28/2022]
Abstract
The appearance of a salient stimulus evokes a series of orienting responses including saccades and pupil size to prepare the body for appropriate action. The midbrain superior colliculus (SC) that receives critical control signals from the frontal eye field (FEF) is hypothesized to coordinate all components of orienting. It has shown recently that the FEF, together with the SC, is also importantly involved in the control of pupil size, in addition to its well-documented role in eye movements. Although the role of the FEF in pupil size is demonstrated in monkeys, its role in human pupil responses and the coordination between pupil size and saccades remains to be established. Through applying continuous theta-burst stimulation over the right FEF and vertex, we investigated the role of the FEF in human pupil and saccade responses evoked by a salient stimulus, and the coordination between pupil size and saccades. Our results showed that neither saccade reaction times (SRT) nor pupil responses evoked by salient stimuli were modulated by FEF stimulation. In contrast, the correlation between pupil size and SRTs in the contralateral stimulus condition was diminished with FEF stimulation, but intact with vertex stimulation. Moreover, FEF stimulation effects between saccade and pupil responses associated with salient stimuli correlated across participants. This is the first transcranial magnetic stimulation (TMS) study on the pupil orienting response, and our findings suggest that human FEF was involved in coordinating pupil size and saccades, but not involved in the control of pupil orienting responses.
Collapse
Affiliation(s)
- Tzu-Yu Hsu
- Graduate Institute of Mind, Brain, and Consciousness (GIMBC), Taipei Medical University, Taipei, Taiwan
- Brain and Consciousness Research Center (BCRC), TMU-Shuang Ho Hospital, New Taipei City, Taiwan
| | - Yu-Fan Hsu
- Graduate Institute of Mind, Brain, and Consciousness (GIMBC), Taipei Medical University, Taipei, Taiwan
- Brain and Consciousness Research Center (BCRC), TMU-Shuang Ho Hospital, New Taipei City, Taiwan
- Institute of Cognitive Neuroscience, College of Health Science and Technology, National Central University, Taoyuan City, Taiwan
- Cognitive Intelligence and Precision Healthcare Research Center, National Central University, Taoyuan City, Taiwan
| | - Hsin-Yi Wang
- Graduate Institute of Mind, Brain, and Consciousness (GIMBC), Taipei Medical University, Taipei, Taiwan
- Brain and Consciousness Research Center (BCRC), TMU-Shuang Ho Hospital, New Taipei City, Taiwan
| | - Chin-An Wang
- Graduate Institute of Mind, Brain, and Consciousness (GIMBC), Taipei Medical University, Taipei, Taiwan
- Brain and Consciousness Research Center (BCRC), TMU-Shuang Ho Hospital, New Taipei City, Taiwan
- Institute of Cognitive Neuroscience, College of Health Science and Technology, National Central University, Taoyuan City, Taiwan
- Cognitive Intelligence and Precision Healthcare Research Center, National Central University, Taoyuan City, Taiwan
- Department of Anesthesiology, TMU-Shuang Ho Hospital, New Taipei City, Taiwan
| |
Collapse
|