1
|
Ricou C, Rabadan V, Mofid Y, Aguillon-Hernandez N, Wardak C. Pupil dilation reflects the social and motion content of faces. Soc Cogn Affect Neurosci 2024; 19:nsae055. [PMID: 39167473 PMCID: PMC11403811 DOI: 10.1093/scan/nsae055] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2024] [Revised: 07/15/2024] [Accepted: 08/19/2024] [Indexed: 08/23/2024] Open
Abstract
Human facial features (eyes, nose, and mouth) allow us to communicate with others. Observing faces triggers physiological responses, including pupil dilation. Still, the relative influence of social and motion content of a visual stimulus on pupillary reactivity has never been elucidated. A total of 30 adults aged 18-33 years old were recorded with an eye tracker. We analysed the event-related pupil dilation in response to stimuli distributed along a gradient of social salience (non-social to social, going from objects to avatars to real faces) and dynamism (static to micro- to macro-motion). Pupil dilation was larger in response to social (faces and avatars) compared to non-social stimuli (objects), with surprisingly a larger response for avatars. Pupil dilation was also larger in response to macro-motion compared to static. After quantifying each stimulus' real quantity of motion, we found that the higher the quantity of motion, the larger the pupil dilated. However, the slope of this relationship was not higher for social stimuli. Overall, pupil dilation was more sensitive to the real quantity of motion than to the social component of motion, highlighting the relevance of ecological stimulations. Physiological response to faces results from specific contributions of both motion and social processing.
Collapse
Affiliation(s)
- Camille Ricou
- Université de Tours, INSERM, Imaging Brain & Neuropsychiatry iBraiN U1253, Tours 37032, France
| | - Vivien Rabadan
- Université de Tours, INSERM, Imaging Brain & Neuropsychiatry iBraiN U1253, Tours 37032, France
| | - Yassine Mofid
- Université de Tours, INSERM, Imaging Brain & Neuropsychiatry iBraiN U1253, Tours 37032, France
| | | | - Claire Wardak
- Université de Tours, INSERM, Imaging Brain & Neuropsychiatry iBraiN U1253, Tours 37032, France
| |
Collapse
|
2
|
Reyes-Lopez M, Vaca-Palomares I, Dávila-Ortiz de Montellano DJ, White BJ, Brien DC, Coe BC, Munoz DP, Fernandez-Ruiz J. Saccades, pupil response and blink abnormalities in Huntington's disease patients during free viewing. Clin Neurophysiol 2024; 165:117-124. [PMID: 39013355 DOI: 10.1016/j.clinph.2024.06.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Revised: 05/16/2024] [Accepted: 06/18/2024] [Indexed: 07/18/2024]
Abstract
OBJECTIVE Video-based eye tracking was used to investigate saccade, pupil, and blink abnormalities among patients with Huntington's disease (HD) who watched sequences of short videos. HD, an autosomal dominant neurodegenerative disorder resulting from a CAG mutation on chromosome 4, produces motor and cognitive impairments including slow or irregular eye movements, which have been studied using structured tasks. METHODS To explore how HD affects eye movements under instruction free conditions, we assessed 22 HD patients and their age matched controls in a 10-minute video-based free viewing task. RESULTS Patients with HD experienced a significant reduction in saccade exploration rate following video clip transitions, an increase in pupil reactions to luminance changes after clip transitions, and a significant higher blink rate throughout the task compared to the control group. CONCLUSIONS These results show that HD has a significant impact on how patients visually explore and respond to their environment under unconstrained and ecologically natural conditions. SIGNIFICANCE Eye tracking in HD patients revealed saccadic, pupil, and blink abnormalities in early HD patients, suggestive of brain circuitry abnormalities that probably involve brain stem deficits. Further research should explore the impact of these changes on the quality of life of the patients affected by the disease.
Collapse
Affiliation(s)
- Mariana Reyes-Lopez
- Ciencias Cognitivas y del Comportamiento, Facultad de Psicología, Universidad Nacional Autónoma de México, CDMX, Mexico
| | - Israel Vaca-Palomares
- Ciencias Cognitivas y del Comportamiento, Facultad de Psicología, Universidad Nacional Autónoma de México, CDMX, Mexico
| | | | - Brian J White
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
| | - Donald C Brien
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
| | - Brian C Coe
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
| | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
| | - Juan Fernandez-Ruiz
- Instituto de Neuroetología, Universidad Veracruzana, Xalapa, Mexico; Departamento de Fisiología, Facultad de Medicina, Universidad Nacional Autónoma de México, CDMX, Mexico.
| |
Collapse
|
3
|
Lapteva A, Martarelli CS. Pupil old/new effect as an objective measure of recognition memory: a meta-analysis of 17 eye-tracking experiments. Memory 2024:1-16. [PMID: 39190618 DOI: 10.1080/09658211.2024.2395367] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2024] [Accepted: 08/15/2024] [Indexed: 08/29/2024]
Abstract
Recognition memory, the ability to recognise previously encountered information, correlates with pupil diameter changes during the recognition period. This physiological response, known as the pupil old/new effect, generally reflects the variation in pupil dilation when encountering previously studied (old) stimuli compared to new stimuli. To develop a more precise understanding of the pupil old/new effect, we conducted a meta-analysis of 17 eye-tracking experiments (across 12 articles spanning from 2008 to 2023) involving 560 healthy adults with a mean age of 22.31 years. Analysis of publication bias showed a rather low risk of bias in the selected articles. The main meta-analysis revealed a significant and large pooled pupil old/new effect (Cohen's dz = 0.73, 95% CI [0.50, 0.95]). Further analysis of moderators showed that the number of participants included in the experiments and the criteria for selecting trials (only correct trials vs. all trials) had a significant impact on the meta-analytic results. In general, the analyses revealed a robust pupil old/new effect across all selected articles. This finding underscores its potential utility as a marker of recognition memory across different stimuli type, and various experimental designs.
Collapse
|
4
|
Kirkpatrick RH, Booij L, Riek HC, Huang J, Pitigoi IC, Brien DC, Coe BC, Couturier J, Khalid-Khan S, Munoz DP. Oculomotor behaviors in youth with an eating disorder: findings from a video-based eye tracking task. J Eat Disord 2024; 12:121. [PMID: 39169420 PMCID: PMC11337776 DOI: 10.1186/s40337-024-01084-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/17/2024] [Accepted: 08/10/2024] [Indexed: 08/23/2024] Open
Abstract
BACKGROUND The oculomotor circuit spans many cortical and subcortical areas that have been implicated in psychiatric disease. This, combined with previous findings, suggests that eye tracking may be a useful method to investigate eating disorders. Therefore, this study aimed to assess oculomotor behaviors in youth with and without an eating disorder. METHODS Female youth with and without an eating disorder completed a structured task involving randomly interleaved pro-saccade (toward at a stimulus) and anti-saccade (away from stimulus) trials with video-based eye tracking. Differences in saccades (rapid eye movements between two points), eye blinks and pupil were examined. RESULTS Youth with an eating disorder (n = 65, Mage = 17.16 ± 3.5 years) were compared to healthy controls (HC; n = 65, Mage = 17.88 ± 4.3 years). The eating disorder group was composed of individuals with anorexia nervosa (n = 49), bulimia nervosa (n = 7) and other specified feeding or eating disorder (n = 9). The eating disorder group was further divided into two subgroups: individuals with a restrictive spectrum eating disorder (ED-R; n = 43) or a bulimic spectrum eating disorder (ED-BP; n = 22). In pro-saccade trials, the eating disorder group made significantly more fixation breaks than HCs (F(1,128) = 5.33, p = 0.023). The ED-BP group made the most anticipatory pro-saccades, followed by ED-R, then HCs (F(2,127) = 3.38, p = 0.037). Groups did not differ on rate of correct express or regular latency pro-saccades. In anti-saccade trials, groups only significantly differed on percentage of direction errors corrected (F(2, 127) = 4.554, p = 0.012). The eating disorder group had a significantly smaller baseline pupil size (F(2,127) = 3.60, p = 0.030) and slower pro-saccade dilation velocity (F(2,127) = 3.30, p = 0.040) compared to HCs. The ED-R group had the lowest blink probability during the intertrial interval (ITI), followed by ED-BP, with HCs having the highest ITI blink probability (F(2,125) = 3.63, p = 0.029). CONCLUSIONS These results suggest that youth with an eating disorder may have different oculomotor behaviors during a structured eye tracking task. The oculomotor behavioral differences observed in this study presents an important step towards identifying neurobiological and cognitive contributions towards eating disorders.
Collapse
Affiliation(s)
- Ryan H Kirkpatrick
- Centre for Neuroscience Studies, Queen's University, Botterell Hall, 18 Stuart St, K7L 3N6, Kingston, ON, Canada.
- School of Medicine, Queen's University, Kingston, ON, Canada.
| | - Linda Booij
- Eating Disorders Continuum & Research Centre, Douglas Mental Health University Institute, Montreal, QC, Canada
- Department of Psychiatry, McGill University, Montreal, QC, Canada
| | - Heidi C Riek
- Centre for Neuroscience Studies, Queen's University, Botterell Hall, 18 Stuart St, K7L 3N6, Kingston, ON, Canada
| | - Jeff Huang
- Centre for Neuroscience Studies, Queen's University, Botterell Hall, 18 Stuart St, K7L 3N6, Kingston, ON, Canada
| | - Isabell C Pitigoi
- Centre for Neuroscience Studies, Queen's University, Botterell Hall, 18 Stuart St, K7L 3N6, Kingston, ON, Canada
| | - Donald C Brien
- Centre for Neuroscience Studies, Queen's University, Botterell Hall, 18 Stuart St, K7L 3N6, Kingston, ON, Canada
| | - Brian C Coe
- Centre for Neuroscience Studies, Queen's University, Botterell Hall, 18 Stuart St, K7L 3N6, Kingston, ON, Canada
| | - Jennifer Couturier
- Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, ON, Canada
| | - Sarosh Khalid-Khan
- Centre for Neuroscience Studies, Queen's University, Botterell Hall, 18 Stuart St, K7L 3N6, Kingston, ON, Canada
- Department of Psychiatry, Queen's University, Kingston, ON, Canada
| | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, Botterell Hall, 18 Stuart St, K7L 3N6, Kingston, ON, Canada
- School of Medicine, Queen's University, Kingston, ON, Canada
| |
Collapse
|
5
|
Doll L, Dykstra AR, Gutschalk A. Perceptual awareness of near-threshold tones scales gradually with auditory cortex activity and pupil dilation. iScience 2024; 27:110530. [PMID: 39175766 PMCID: PMC11338958 DOI: 10.1016/j.isci.2024.110530] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Revised: 04/16/2024] [Accepted: 07/15/2024] [Indexed: 08/24/2024] Open
Abstract
Negative-going responses in sensory cortex co-vary with perceptual awareness of sensory stimuli. Given that this awareness negativity has also been observed for undetected stimuli, some have challenged its role for perception. To address this question, we combined magnetoencephalography, electroencephalography, and pupillometry to study how sustained attention and response criterion affect the auditory awareness negativity. Participants first detected distractor sounds and denied hearing task-irrelevant near-threshold tones, which evoked neither awareness negativity nor pupil dilation. These same tones evoked both responses when task-relevant, stronger for hit but also present for miss trials. Participants then rated their perception on a six-point scale to test whether response criterion explains the presence of these responses for miss trials. Decreasing perception ratings were associated with gradually reduced evoked responses, consistent with signal detection theory. These results support the concept of an awareness negativity that is modulated by attention but does not require a non-linear threshold mechanism.
Collapse
Affiliation(s)
- Laura Doll
- Department of Neurology, Ruprecht-Karls-Universität Heidelberg, 69120 Heidelberg, Germany
| | - Andrew R. Dykstra
- School of Communication Sciences and Disorders, University of Central Florida, Orlando, FL, USA
| | - Alexander Gutschalk
- Department of Neurology, Ruprecht-Karls-Universität Heidelberg, 69120 Heidelberg, Germany
| |
Collapse
|
6
|
Demiral ŞB, Volkow ND. Blink-induced changes in pupil dynamics are consistent and heritable. RESEARCH SQUARE 2024:rs.3.rs-4718613. [PMID: 39149500 PMCID: PMC11326410 DOI: 10.21203/rs.3.rs-4718613/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/17/2024]
Abstract
Pupil size and blink rates are heritable but the extent to which they interact with one another has not been properly investigated. Though changes in pupil size due to eye blinks have been reported, they are considered a pupillary artifact. In this study we used the HCP 7T fMRI dataset with resting state eye-tracking data obtained in monozygous and dizygous twins to assess their heritability and their interactions. For this purpose, we characterized the pupil dilation (positive peak) and constriction (negative peak) that followed blink events, which we describe as blink-induced pupillary response (BIPR). We show that the BIPR is highly consistent with a positive dilatory peak (D-peak) around 500ms and a negative constricting peak (C-peak) around 1s. These patterns were reproducible within- and between- subjects across two time points and differed by vigilance state (vigilant versus drowsy). By comparing BIPR between monozygous and dizygous twins we show that BIPR have a heritable component with significant additive genetic (A) and environmental (E) factors dominating the structural equation models, particularly in the time-domain for both D- and C-peaks and amplitude domain for the C-peak. (a2 between 42-49%). Blink duration, pupil size and blink rate were also found to be highly heritable (a2 up to 62% for pupil size). Our study documents an association between BIPR and wakefulness and indicates that BIPR should not be treated as a coincidental artefact, but part of a larger oculomotor system that we label here as Oculomotor Adaptive System, OAS, that is genetically determined.
Collapse
|
7
|
Grujic N, Polania R, Burdakov D. Neurobehavioral meaning of pupil size. Neuron 2024:S0896-6273(24)00406-9. [PMID: 38925124 DOI: 10.1016/j.neuron.2024.05.029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2023] [Revised: 03/22/2024] [Accepted: 05/31/2024] [Indexed: 06/28/2024]
Abstract
Pupil size is a widely used metric of brain state. It is one of the few signals originating from the brain that can be readily monitored with low-cost devices in basic science, clinical, and home settings. It is, therefore, important to investigate and generate well-defined theories related to specific interpretations of this metric. What exactly does it tell us about the brain? Pupils constrict in response to light and dilate during darkness, but the brain also controls pupil size irrespective of luminosity. Pupil size fluctuations resulting from ongoing "brain states" are used as a metric of arousal, but what is pupil-linked arousal and how should it be interpreted in neural, cognitive, and computational terms? Here, we discuss some recent findings related to these issues. We identify open questions and propose how to answer them through a combination of well-defined tasks, neurocomputational models, and neurophysiological probing of the interconnected loops of causes and consequences of pupil size.
Collapse
Affiliation(s)
- Nikola Grujic
- Neurobehavioural Dynamics Lab, ETH Zürich, Department of Health Sciences and Technology, Schorenstrasse 16, 8603 Schwerzenbach, Switzerland.
| | - Rafael Polania
- Decision Neuroscience Lab, ETH Zürich, Department of Health Sciences and Technology, Winterthurstrasse 190, 8057 Zürich, Switzerland
| | - Denis Burdakov
- Neurobehavioural Dynamics Lab, ETH Zürich, Department of Health Sciences and Technology, Schorenstrasse 16, 8603 Schwerzenbach, Switzerland.
| |
Collapse
|
8
|
Sudár A, Csapó ÁB. Comparing desktop 3D virtual reality with web 2.0 interfaces: Identifying key factors behind enhanced user capabilities. Heliyon 2024; 10:e31717. [PMID: 38845966 PMCID: PMC11154203 DOI: 10.1016/j.heliyon.2024.e31717] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2024] [Revised: 05/01/2024] [Accepted: 05/21/2024] [Indexed: 06/09/2024] Open
Abstract
The aim of this paper is to investigate how commonly used 2D digital layouts can be transformed into 3-dimensional dashboards with the effect of reducing cognitive load. To this end, we compared user performance metrics, pupil dilation data as well as subject-reported qualitative measures in a Web 2.0-based 2D scenario and two different versions of a desktop 3D virtual reality scenario. All three scenarios focused on a use case involving the most prevalent 2D digital formats and designs encountered in digital education, making use of e.g. textual information (PDF files, PPT files), images and videos. Based on the assumption that cognitive load differences can be validated based on pupillometry measurements, we showed that it is possible to develop 3D virtual reality scenarios where users experience less cognitive load while achieving the same performance metrics as in commonly used 2D environments. At the same time, our experiment also showed that such improvements do not come automatically; instead, 3D workflows that require less locomotion - even at the expense of increased camera rotations - seem to result in more effective cognitive load reduction.
Collapse
Affiliation(s)
- Anna Sudár
- Corvinus Institute for Advanced Studies, Corvinus University of Budapest, Fővám tér 8, Budapest, 1093, Hungary
- Institute of Data Analytics and Information Systems, Corvinus University of Budapest, Fővám tér 8, Budapest, 1093, Hungary
- Hungarian Research Network, Piarista u. 4, Budapest, 1052, Hungary
| | - Ádám B. Csapó
- Corvinus Institute for Advanced Studies, Corvinus University of Budapest, Fővám tér 8, Budapest, 1093, Hungary
- Institute of Data Analytics and Information Systems, Corvinus University of Budapest, Fővám tér 8, Budapest, 1093, Hungary
- Hungarian Research Network, Piarista u. 4, Budapest, 1052, Hungary
| |
Collapse
|
9
|
Tamura H, Nakauchi S, Minami T. Glossiness perception and its pupillary response. Vision Res 2024; 219:108393. [PMID: 38579405 DOI: 10.1016/j.visres.2024.108393] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Revised: 03/18/2024] [Accepted: 03/20/2024] [Indexed: 04/07/2024]
Abstract
Recent studies have revealed that pupillary response changes depend on perceptual factors such as subjective brightness caused by optical illusions and luminance. However, the manner in which the perceptual factor that is derived from the glossiness perception of object surfaces affects the pupillary response remains unclear. We investigated the relationship between the glossiness perception and pupillary response through a glossiness rating experiment that included recording the pupil diameter. We prepared general object images (original) and randomized images (shuffled) that comprised the same images with randomized small square regions as stimuli. The image features were controlled by matching the luminance histogram. The observers were asked to rate the perceived glossiness of the stimuli presented for 3,000 ms and the changes in their pupil diameters were recorded. Images with higher glossiness ratings constricted the pupil size more than those with lower glossiness ratings at the peak constriction of the pupillary responses during the stimulus duration. The linear mixed-effects model demonstrated that the glossiness rating, image category (original/shuffled), variance of the luminance histogram, and stimulus area were most effective in predicting the pupillary responses. These results suggest that the illusory brightness obtained by the image regions of high-glossiness objects, such as specular highlights, induce pupil constriction.
Collapse
Affiliation(s)
- Hideki Tamura
- Department of Computer Science and Engineering, Toyohashi University of Technology, Toyohashi, Aichi, Japan.
| | - Shigeki Nakauchi
- Department of Computer Science and Engineering, Toyohashi University of Technology, Toyohashi, Aichi, Japan
| | - Tetsuto Minami
- Department of Computer Science and Engineering, Toyohashi University of Technology, Toyohashi, Aichi, Japan
| |
Collapse
|
10
|
Chintalacheruvu N, Kalelkar A, Boutin J, Breton-Provencher V, Huda R. A cortical locus for modulation of arousal states. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.05.24.595859. [PMID: 38826269 PMCID: PMC11142248 DOI: 10.1101/2024.05.24.595859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2024]
Abstract
Fluctuations in global arousal are key determinants of spontaneous cortical activity and function. Several subcortical structures, including neuromodulator nuclei like the locus coeruleus (LC), are involved in the regulation of arousal. However, much less is known about the role of cortical circuits that provide top-down inputs to arousal-related subcortical structures. Here, we investigated the role of a major subdivision of the prefrontal cortex, the anterior cingulate cortex (ACC), in arousal modulation. Pupil size, facial movements, heart rate, and locomotion were used as non-invasive measures of arousal and behavioral state. We designed a closed loop optogenetic system based on machine vision and found that real time inhibition of ACC activity during pupil dilations suppresses ongoing arousal events. In contrast, inhibiting activity in a control cortical region had no effect on arousal. Fiber photometry recordings showed that ACC activity scales with the magnitude of spontaneously occurring pupil dilations/face movements independently of locomotion. Moreover, optogenetic ACC activation increases arousal independently of locomotion. In addition to modulating global arousal, ACC responses to salient sensory stimuli scaled with the size of evoked pupil dilations. Consistent with a role in sustaining saliency-linked arousal events, pupil responses to sensory stimuli were suppressed with ACC inactivation. Finally, our results comparing arousal-related ACC and norepinephrinergic LC neuron activity support a role for the LC in initiation of arousal events which are modulated in real time by the ACC. Collectively, our experiments identify the ACC as a key cortical site for sustaining momentary increases in arousal and provide the foundation for understanding cortical-subcortical dynamics underlying the modulation of arousal states.
Collapse
Affiliation(s)
- Nithik Chintalacheruvu
- WM Keck Center for Collaborative Neuroscience, Department of Cell Biology and Neuroscience, Rutgers University – New Brunswick, Piscataway, New Jersey, USA
| | - Anagha Kalelkar
- WM Keck Center for Collaborative Neuroscience, Department of Cell Biology and Neuroscience, Rutgers University – New Brunswick, Piscataway, New Jersey, USA
| | - Jöel Boutin
- Department of Psychiatry and Neuroscience, CERVO Brain Research Center, Universite Laval, Québec City, Québec, Canada
| | - Vincent Breton-Provencher
- Department of Psychiatry and Neuroscience, CERVO Brain Research Center, Universite Laval, Québec City, Québec, Canada
| | - Rafiq Huda
- WM Keck Center for Collaborative Neuroscience, Department of Cell Biology and Neuroscience, Rutgers University – New Brunswick, Piscataway, New Jersey, USA
| |
Collapse
|
11
|
Becker J, Viertler M, Korn CW, Blank H. The pupil dilation response as an indicator of visual cue uncertainty and auditory outcome surprise. Eur J Neurosci 2024; 59:2686-2701. [PMID: 38469976 DOI: 10.1111/ejn.16306] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Revised: 01/05/2024] [Accepted: 02/18/2024] [Indexed: 03/13/2024]
Abstract
In everyday perception, we combine incoming sensory information with prior expectations. Expectations can be induced by cues that indicate the probability of following sensory events. The information provided by cues may differ and hence lead to different levels of uncertainty about which event will follow. In this experiment, we employed pupillometry to investigate whether the pupil dilation response to visual cues varies depending on the level of cue-associated uncertainty about a following auditory outcome. Also, we tested whether the pupil dilation response reflects the amount of surprise about the subsequently presented auditory stimulus. In each trial, participants were presented with a visual cue (face image) which was followed by an auditory outcome (spoken vowel). After the face cue, participants had to indicate by keypress which of three auditory vowels they expected to hear next. We manipulated the cue-associated uncertainty by varying the probabilistic cue-outcome contingencies: One face was most likely followed by one specific vowel (low cue uncertainty), another face was equally likely followed by either of two vowels (intermediate cue uncertainty) and the third face was followed by all three vowels (high cue uncertainty). Our results suggest that pupil dilation in response to task-relevant cues depends on the associated uncertainty, but only for large differences in the cue-associated uncertainty. Additionally, in response to the auditory outcomes, the pupil dilation scaled negatively with the cue-dependent probabilities, likely signalling the amount of surprise.
Collapse
Affiliation(s)
- Janika Becker
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Marvin Viertler
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Christoph W Korn
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
- Section Social Neuroscience, Department of General Psychiatry, University of Heidelberg, Heidelberg, Germany
| | - Helen Blank
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
12
|
Vidal M, Onderdijk KE, Aguilera AM, Six J, Maes PJ, Fritz TH, Leman M. Cholinergic-related pupil activity reflects level of emotionality during motor performance. Eur J Neurosci 2024; 59:2193-2207. [PMID: 37118877 DOI: 10.1111/ejn.15998] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2022] [Revised: 04/20/2023] [Accepted: 04/26/2023] [Indexed: 04/30/2023]
Abstract
Pupil size covaries with the diffusion rate of the cholinergic and noradrenergic neurons throughout the brain, which are essential to arousal. Recent findings suggest that slow pupil fluctuations during locomotion are an index of sustained activity in cholinergic axons, whereas phasic dilations are related to the activity of noradrenergic axons. Here, we investigated movement induced arousal (i.e., by singing and swaying to music), hypothesising that actively engaging in musical behaviour will provoke stronger emotional engagement in participants and lead to different qualitative patterns of tonic and phasic pupil activity. A challenge in the analysis of pupil data is the turbulent behaviour of pupil diameter due to exogenous ocular activity commonly encountered during motor tasks and the high variability typically found between individuals. To address this, we developed an algorithm that adaptively estimates and removes pupil responses to ocular events, as well as a functional data methodology, derived from Pfaffs' generalised arousal, that provides a new statistical dimension on how pupil data can be interpreted according to putative neuromodulatory signalling. We found that actively engaging in singing enhanced slow cholinergic-related pupil dilations and having the opportunity to move your body while performing amplified the effect of singing on pupil activity. Phasic pupil oscillations during motor execution attenuated in time, which is often interpreted as a measure of sense of agency over movement.
Collapse
Affiliation(s)
- Marc Vidal
- IPEM, Ghent University, Ghent, Belgium
- Department of Statistics and Operations Research, Institute of Mathematics, University of Granada, Granada, Spain
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | | | - Ana M Aguilera
- Department of Statistics and Operations Research, Institute of Mathematics, University of Granada, Granada, Spain
| | - Joren Six
- IPEM, Ghent University, Ghent, Belgium
| | | | - Thomas Hans Fritz
- IPEM, Ghent University, Ghent, Belgium
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | | |
Collapse
|
13
|
Vilotijević A, Mathôt S. Functional benefits of cognitively driven pupil-size changes. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2024; 15:e1672. [PMID: 38149763 DOI: 10.1002/wcs.1672] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Revised: 10/30/2023] [Accepted: 11/27/2023] [Indexed: 12/28/2023]
Abstract
Pupil-size changes are typically associated with the pupil light response (PLR), where they are driven by the physical entry of light into the eye. However, pupil-size changes are also influenced by various cognitive processes, where they are driven by higher-level cognition. For example, the strength of the PLR is not solely affected by physical properties of the light but also by cognitive factors, such as whether the source of light is attended or not, which results in an increase or decrease in the strength of the PLR. Surprisingly, although cognitively driven pupil-size changes have been the focus of extensive research, their possible functions are rarely discussed. Here we consider the relative (dis)advantages of small versus large pupils in different situations from a theoretical point of view, and compare these to empirical results showing how pupil size actually changes in these situations. Based on this, we suggest that cognitively driven pupil-size changes optimize vision either through preparation, embodied representations, or a differential emphasis on central or peripheral vision. More generally, we argue that cognitively driven pupil-size changes are a form of sensory tuning: a subtle adjustment of the eyes to optimize vision for the current situation and the immediate future. This article is categorized under: Neuroscience > Cognition Neuroscience > Physiology Neuroscience > Behavior.
Collapse
Affiliation(s)
- Ana Vilotijević
- Department of Psychology, University of Groningen, The Netherlands
| | | |
Collapse
|
14
|
Madsen J, Parra LC. Bidirectional brain-body interactions during natural story listening. Cell Rep 2024; 43:114081. [PMID: 38581682 DOI: 10.1016/j.celrep.2024.114081] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Revised: 11/25/2023] [Accepted: 03/24/2024] [Indexed: 04/08/2024] Open
Abstract
Narratives can synchronize neural and physiological signals between individuals, but the relationship between these signals, and the underlying mechanism, is unclear. We hypothesized a top-down effect of cognition on arousal and predicted that auditory narratives will drive not only brain signals but also peripheral physiological signals. We find that auditory narratives entrained gaze variation, saccade initiation, pupil size, and heart rate. This is consistent with a top-down effect of cognition on autonomic function. We also hypothesized a bottom-up effect, whereby autonomic physiology affects arousal. Controlled breathing affected pupil size, and heart rate was entrained by controlled saccades. Additionally, fluctuations in heart rate preceded fluctuations of pupil size and brain signals. Gaze variation, pupil size, and heart rate were all associated with anterior-central brain signals. Together, these results suggest bidirectional causal effects between peripheral autonomic function and central brain circuits involved in the control of arousal.
Collapse
Affiliation(s)
- Jens Madsen
- Department of Biomedical Engineering, City College of New York, 85 St. Nicholas Terrace, New York, NY 10031, USA.
| | - Lucas C Parra
- Department of Biomedical Engineering, City College of New York, 85 St. Nicholas Terrace, New York, NY 10031, USA
| |
Collapse
|
15
|
Lorenceau J, Ajasse S, Barbet R, Boucart M, Chavane F, Lamirel C, Legras R, Matonti F, Rateaux M, Rouland JF, Sahel JA, Trinquet L, Wexler M, Vignal-Clermont C. Method to Quickly Map Multifocal Pupillary Response Fields (mPRF) Using Frequency Tagging. Vision (Basel) 2024; 8:17. [PMID: 38651438 PMCID: PMC11036301 DOI: 10.3390/vision8020017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2024] [Accepted: 03/27/2024] [Indexed: 04/25/2024] Open
Abstract
We present a method for mapping multifocal Pupillary Response Fields in a short amount of time using a visual stimulus covering 40° of the visual angle divided into nine contiguous sectors simultaneously modulated in luminance at specific, incommensurate, temporal frequencies. We test this multifocal Pupillary Frequency Tagging (mPFT) approach with young healthy participants (N = 36) and show that the spectral power of the sustained pupillary response elicited by 45 s of fixation of this multipartite stimulus reflects the relative contribution of each sector/frequency to the overall pupillary response. We further analyze the phase lag for each temporal frequency as well as several global features related to pupil state. Test/retest performed on a subset of participants indicates good repeatability. We also investigate the existence of structural (RNFL)/functional (mPFT) relationships. We then summarize the results of clinical studies conducted with mPFT on patients with neuropathies and retinopathies and show that the features derived from pupillary signal analyses, the distribution of spectral power in particular, are homologous to disease characteristics and allow for sorting patients from healthy participants with excellent sensitivity and specificity. This method thus appears as a convenient, objective, and fast tool for assessing the integrity of retino-pupillary circuits as well as idiosyncrasies and permits to objectively assess and follow-up retinopathies or neuropathies in a short amount of time.
Collapse
Affiliation(s)
- Jean Lorenceau
- Integrative Neuroscience and Cognition Center, UMR8002, Université Paris Cité, 75006 Paris, France; (R.B.); (M.W.)
| | | | - Raphael Barbet
- Integrative Neuroscience and Cognition Center, UMR8002, Université Paris Cité, 75006 Paris, France; (R.B.); (M.W.)
| | - Muriel Boucart
- CNRS, INSERM UMR-S 1172-Lille Neurosciences & Cognition, 59000 Lille, France;
| | - Frédéric Chavane
- Institut des Neurosciences de la Timone-CNRS UMR 7289, 13005 Marseille, France;
| | - Cédric Lamirel
- Hopital Fondation, Adolphe de Rothschild 29, rue Manin, 75019 Paris, France; (C.L.); (C.V.-C.)
| | - Richard Legras
- LuMIn, CNRS, ENS Paris-Saclay, Centrale Supelec, Université Paris-Saclay, 91192 Orsay, France;
| | - Frédéric Matonti
- Centre Monticelli Paradis d’Ophtalmologie, 13008 Marseille, France;
| | - Maxence Rateaux
- Centre BORELLI, Université Paris Cité, ENS Paris-Saclay, CNRS, INSERM, SSA, 75006 Paris, France;
| | - Jean-François Rouland
- Department of Ophthalmology, Hôpital Claude Huriez, CHRU de Lille, 59037 Lille, France;
| | - José-Alain Sahel
- Department of Ophthalmology, University of Pittsburgh, Pittsburgh, PA 15219, USA;
| | - Laure Trinquet
- Faculté des Sciences Médicales et Paramédicales, Aix-Marseille Université, 13385 Marseille, France;
| | - Mark Wexler
- Integrative Neuroscience and Cognition Center, UMR8002, Université Paris Cité, 75006 Paris, France; (R.B.); (M.W.)
| | | |
Collapse
|
16
|
Chang YH, Chen HJ, Barquero C, Tsai HJ, Liang WK, Hsu CH, Muggleton NG, Wang CA. Linking tonic and phasic pupil responses to P300 amplitude in an emotional face-word Stroop task. Psychophysiology 2024; 61:e14479. [PMID: 37920144 DOI: 10.1111/psyp.14479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Revised: 09/04/2023] [Accepted: 10/17/2023] [Indexed: 11/04/2023]
Abstract
The locus coeruleus-norepinephrine (LC-NE) system, which regulates arousal levels, is important for cognitive control, including emotional conflict resolution. Additionally, the LC-NE system is implicated in P300 generation. If the P300 is mediated by the LC-NE system, and considering the established correlations between LC activity and pupil dilation, P300 amplitude should correlate with task-evoked (phasic) pupil dilation on a trial-by-trial basis. However, prior studies, predominantly utilizing oddball-type paradigms, have not demonstrated correlations between concurrently recorded task-evoked pupil dilation and P300 responses. Using a recently developed emotional face-word Stroop task that links pupil dilation to the LC-NE system, here, we examined both intra- and inter-individual correlations between task-evoked pupil dilation and P300 amplitude. We found that lower accuracy, slower reaction times, and larger task-evoked pupil dilation were obtained in the incongruent compared to the congruent condition. Furthermore, we observed intra-individual correlations between task-evoked pupil dilation and P300 amplitude, with larger pupil dilation correlating with a greater P300 amplitude. In contrast, pupil dilation did not exhibit consistent correlations with N450 and N170 amplitudes. Baseline (tonic) pupil size also showed correlations with P300 and N170 amplitudes, with smaller pupil size corresponding to larger amplitude. Moreover, inter-individual differences in task-evoked pupil dilation between the congruent and incongruent conditions correlated with differences in reaction time and P300 amplitude, though these effects only approached significance. To summarize, our study provides evidence for a connection between task-evoked pupil dilation and P300 amplitude at the single-trial level, suggesting the involvement of the LC-NE system in P300 generation.
Collapse
Affiliation(s)
- Yi-Hsuan Chang
- Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan
| | - He-Jun Chen
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
| | - Cesar Barquero
- Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Department of Physical Activity and Sport Science, Universidad Peruana de Ciencias Aplicadas, Lima, Peru
| | - Hsu Jung Tsai
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Department of Anesthesiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei City, Taiwan
- Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
| | - Wei-Kuang Liang
- Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan
- Cognitive Intelligence and Precision Healthcare Center, National Central University, Taoyuan City, Taiwan
| | - Chun-Hsien Hsu
- Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan
| | - Neil G Muggleton
- Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan
- Cognitive Intelligence and Precision Healthcare Center, National Central University, Taoyuan City, Taiwan
| | - Chin-An Wang
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Department of Anesthesiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei City, Taiwan
- Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
| |
Collapse
|
17
|
Koevoet D, Strauch C, Van der Stigchel S, Mathôt S, Naber M. Revealing visual working memory operations with pupillometry: Encoding, maintenance, and prioritization. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2024; 15:e1668. [PMID: 37933423 DOI: 10.1002/wcs.1668] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Revised: 09/22/2023] [Accepted: 09/25/2023] [Indexed: 11/08/2023]
Abstract
Pupillary dynamics reflect effects of distinct and important operations of visual working memory: encoding, maintenance, and prioritization. Here, we review how pupil size predicts memory performance and how it provides novel insights into the mechanisms of each operation. Visual information must first be encoded into working memory with sufficient precision. The depth of this encoding process couples to arousal-linked baseline pupil size as well as a pupil constriction response before and after stimulus onset, respectively. Subsequently, the encoded information is maintained over time to ensure it is not lost. Pupil dilation reflects the effortful maintenance of information, wherein storing more items is accompanied by larger dilations. Lastly, the most task-relevant information is prioritized to guide upcoming behavior, which is reflected in yet another dilatory component. Moreover, activated content in memory can be pupillometrically probed directly by tagging visual information with distinct luminance levels. Through this luminance-tagging mechanism, pupil light responses reveal whether dark or bright items receive more attention during encoding and prioritization. Together, conceptualizing pupil responses as a sum of distinct components over time reveals insights into operations of visual working memory. From this viewpoint, pupillometry is a promising avenue to study the most vital operations through which visual working memory works. This article is categorized under: Psychology > Attention Psychology > Memory Psychology > Theory and Methods.
Collapse
Affiliation(s)
- Damian Koevoet
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| | - Christoph Strauch
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| | | | - Sebastiaan Mathôt
- Department of Psychology, University of Groningen, Groningen, The Netherlands
| | - Marnix Naber
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
18
|
Fink L, Simola J, Tavano A, Lange E, Wallot S, Laeng B. From pre-processing to advanced dynamic modeling of pupil data. Behav Res Methods 2024; 56:1376-1412. [PMID: 37351785 PMCID: PMC10991010 DOI: 10.3758/s13428-023-02098-1] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/20/2023] [Indexed: 06/24/2023]
Abstract
The pupil of the eye provides a rich source of information for cognitive scientists, as it can index a variety of bodily states (e.g., arousal, fatigue) and cognitive processes (e.g., attention, decision-making). As pupillometry becomes a more accessible and popular methodology, researchers have proposed a variety of techniques for analyzing pupil data. Here, we focus on time series-based, signal-to-signal approaches that enable one to relate dynamic changes in pupil size over time with dynamic changes in a stimulus time series, continuous behavioral outcome measures, or other participants' pupil traces. We first introduce pupillometry, its neural underpinnings, and the relation between pupil measurements and other oculomotor behaviors (e.g., blinks, saccades), to stress the importance of understanding what is being measured and what can be inferred from changes in pupillary activity. Next, we discuss possible pre-processing steps, and the contexts in which they may be necessary. Finally, we turn to signal-to-signal analytic techniques, including regression-based approaches, dynamic time-warping, phase clustering, detrended fluctuation analysis, and recurrence quantification analysis. Assumptions of these techniques, and examples of the scientific questions each can address, are outlined, with references to key papers and software packages. Additionally, we provide a detailed code tutorial that steps through the key examples and figures in this paper. Ultimately, we contend that the insights gained from pupillometry are constrained by the analysis techniques used, and that signal-to-signal approaches offer a means to generate novel scientific insights by taking into account understudied spectro-temporal relationships between the pupil signal and other signals of interest.
Collapse
Affiliation(s)
- Lauren Fink
- Department of Music, Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322, Frankfurt am Main, Germany.
- Department of Psychology, Neuroscience & Behavior, McMaster University, 1280 Main St. West, Hamilton, Ontario, L8S 4L8, Canada.
| | - Jaana Simola
- Helsinki Collegium for Advanced Studies, University of Helsinki, Helsinki, Finland
- Department of Education, University of Helsinki, Helsinki, Finland
| | - Alessandro Tavano
- Department of Cognitive Neuropsychology, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
| | - Elke Lange
- Department of Music, Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322, Frankfurt am Main, Germany
| | - Sebastian Wallot
- Department of Literature, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
- Institute for Sustainability Education and Psychologyy, Leuphana University, Lüneburg, Germany
| | - Bruno Laeng
- Department of Psychology, University of Oslo, Oslo, Norway
- RITMO Centre for Interdisciplinary studies in Rhythm, Time, and Motion, University of Oslo, Oslo, Norway
| |
Collapse
|
19
|
Hu J, Vetter P. How the eyes respond to sounds. Ann N Y Acad Sci 2024; 1532:18-36. [PMID: 38152040 DOI: 10.1111/nyas.15093] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2023]
Abstract
Eye movements have been extensively studied with respect to visual stimulation. However, we live in a multisensory world, and how the eyes are driven by other senses has been explored much less. Here, we review the evidence on how audition can trigger and drive different eye responses and which cortical and subcortical neural correlates are involved. We provide an overview on how different types of sounds, from simple tones and noise bursts to spatially localized sounds and complex linguistic stimuli, influence saccades, microsaccades, smooth pursuit, pupil dilation, and eye blinks. The reviewed evidence reveals how the auditory system interacts with the oculomotor system, both behaviorally and neurally, and how this differs from visually driven eye responses. Some evidence points to multisensory interaction, and potential multisensory integration, but the underlying computational and neural mechanisms are still unclear. While there are marked differences in how the eyes respond to auditory compared to visual stimuli, many aspects of auditory-evoked eye responses remain underexplored, and we summarize the key open questions for future research.
Collapse
Affiliation(s)
- Junchao Hu
- Visual and Cognitive Neuroscience Lab, Department of Psychology, University of Fribourg, Fribourg, Switzerland
| | - Petra Vetter
- Visual and Cognitive Neuroscience Lab, Department of Psychology, University of Fribourg, Fribourg, Switzerland
| |
Collapse
|
20
|
Liu W, Cheng Y, Yuan X, Jiang Y. Linear integration of multisensory signals in the pupil. Psychophysiology 2024; 61:e14453. [PMID: 37813676 DOI: 10.1111/psyp.14453] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 09/10/2023] [Accepted: 09/15/2023] [Indexed: 10/11/2023]
Abstract
The pupil of the eye responds to various salient signals from different modalities, but there is no consensus on how these pupillary responses are integrated when multiple signals appear simultaneously. Both linear and nonlinear integration have been found previously. The current study aimed to reexamine the nature of pupillary integration, and specifically focused on the early, transient pupillary responses due to its close relationship with orienting. To separate the early pupillary responses out of the pupil time series, we adopted a pupil oscillation paradigm in which sensory stimuli were periodically presented. The simulation analysis confirmed that the amplitude of the pupil oscillation, induced by stimuli repeatedly presented at relatively high rates, can precisely reflect the early, transient pupillary responses without involving the late and sustained pupillary responses. The experimental results then showed that the amplitude of pupil oscillation induced by a series of simultaneous audiovisual stimuli equaled to a linear summation of the oscillatory amplitudes when unisensory stimuli were presented alone. Moreover, the tonic arousal levels, indicated by the baseline pupil size, cannot shift the summation from linear to nonlinear. These findings together support the additive nature of multisensory pupillary integration for the early, orienting-related pupillary responses. The additive nature of pupillary integration further implies that multiple pupillary responses may be independent of each other, irrespective of their potential cognitive and neural drivers.
Collapse
Affiliation(s)
- Wenjie Liu
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
- Chinese Institute for Brain Research, Beijing, China
| | - Yuhui Cheng
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
- Chinese Institute for Brain Research, Beijing, China
| | - Xiangyong Yuan
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
- Chinese Institute for Brain Research, Beijing, China
| | - Yi Jiang
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
- Chinese Institute for Brain Research, Beijing, China
| |
Collapse
|
21
|
Riley E, Turker H, Wang D, Swallow KM, Anderson AK, De Rosa E. Nonlinear changes in pupillary attentional orienting responses across the lifespan. GeroScience 2024; 46:1017-1033. [PMID: 37318717 PMCID: PMC10828243 DOI: 10.1007/s11357-023-00834-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Accepted: 05/18/2023] [Indexed: 06/16/2023] Open
Abstract
The cognitive aging process is not necessarily linear. Central task-evoked pupillary responses, representing a brainstem-pupil relationship, may vary across the lifespan. Thus we examined, in 75 adults ranging in age from 19 to 86, whether task-evoked pupillary responses to an attention task may serve in as an index of cognitive aging. This is because the locus coeruleus (LC), located in the brainstem, is not only among the earliest sites of degeneration in pathological aging, but also supports both attentional and pupillary behaviors. We assessed brief, task-evoked phasic attentional orienting to behaviorally relevant and irrelevant auditory tones, stimuli known specifically to recruit the LC in the brainstem and evoke pupillary responses. Due to potential nonlinear changes across the lifespan, we used a novel data-driven analysis on 6 dynamic pupillary behaviors on 10% of the data to reveal cut off points that best characterized the three age bands: young (19-41 years old), middle aged (42-68 years old), and older adults (69 + years old). Follow-up analyses on independent data, the remaining 90%, revealed age-related changes such as monotonic decreases in tonic pupillary diameter and dynamic range, along with curvilinear phasic pupillary responses to the behaviorally relevant target events, increasing in the middle-aged group and then decreasing in the older group. Additionally, the older group showed decreased differentiation of pupillary responses between target and distractor events. This pattern is consistent with potential compensatory LC activity in midlife that is diminished in old age, resulting in decreased adaptive gain. Beyond regulating responses to light, pupillary dynamics reveal a nonlinear capacity for neurally mediated gain across the lifespan, thus providing evidence in support of the LC adaptive gain hypothesis.
Collapse
Affiliation(s)
- Elizabeth Riley
- Department of Psychology, Cornell University, Ithaca, NY, USA.
| | - Hamid Turker
- Department of Psychology, Cornell University, Ithaca, NY, USA
| | - Dongliang Wang
- Department of Public Health and Preventative Medicine, SUNY Upstate Medical University, Syracuse, NY, USA
| | - Khena M Swallow
- Department of Psychology, Cornell University, Ithaca, NY, USA
| | - Adam K Anderson
- Department of Psychology, Cornell University, Ithaca, NY, USA
| | - Eve De Rosa
- Department of Psychology, Cornell University, Ithaca, NY, USA
| |
Collapse
|
22
|
Koevoet D, Naber M, Strauch C, Van der Stigchel S. The Intensity of Internal and External Attention Assessed with Pupillometry. J Cogn 2024; 7:8. [PMID: 38223232 PMCID: PMC10786008 DOI: 10.5334/joc.336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Accepted: 11/30/2023] [Indexed: 01/16/2024] Open
Abstract
Not only is visual attention shifted to objects in the external world, attention can also be directed to objects in memory. We have recently shown that pupil size indexes how strongly items are attended externally, which was reflected in more precise encoding into visual working memory. Using a retro-cuing paradigm, we here replicated this finding by showing that stronger pupil constrictions during encoding were reflective of the depth of encoding. Importantly, we extend this previous work by showing that pupil size also revealed the intensity of internal attention toward content stored in visual working memory. Specifically, pupil dilation during the prioritization of one among multiple internally stored representations predicted the precision of the prioritized item. Furthermore, the dynamics of the pupillary responses revealed that the intensity of internal and external attention independently determined the precision of internalized visual representations. Our results show that both internal and external attention are not all-or-none processes, but should rather be thought of as continuous resources that can be deployed at varying intensities. The employed pupillometric approach allows to unravel the intricate interplay between internal and external attention and their effects on visual working memory.
Collapse
Affiliation(s)
- Damian Koevoet
- Experimental Psychology, Helmholtz Institute, Utrecht University, The Netherlands
| | - Marnix Naber
- Experimental Psychology, Helmholtz Institute, Utrecht University, The Netherlands
| | - Christoph Strauch
- Experimental Psychology, Helmholtz Institute, Utrecht University, The Netherlands
| | | |
Collapse
|
23
|
Meissner SN, Bächinger M, Kikkert S, Imhof J, Missura S, Carro Dominguez M, Wenderoth N. Self-regulating arousal via pupil-based biofeedback. Nat Hum Behav 2024; 8:43-62. [PMID: 37904022 PMCID: PMC10810759 DOI: 10.1038/s41562-023-01729-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Accepted: 09/20/2023] [Indexed: 11/01/2023]
Abstract
The brain's arousal state is controlled by several neuromodulatory nuclei known to substantially influence cognition and mental well-being. Here we investigate whether human participants can gain volitional control of their arousal state using a pupil-based biofeedback approach. Our approach inverts a mechanism suggested by previous literature that links activity of the locus coeruleus, one of the key regulators of central arousal and pupil dynamics. We show that pupil-based biofeedback enables participants to acquire volitional control of pupil size. Applying pupil self-regulation systematically modulates activity of the locus coeruleus and other brainstem structures involved in arousal control. Furthermore, it modulates cardiovascular measures such as heart rate, and behavioural and psychophysiological responses during an oddball task. We provide evidence that pupil-based biofeedback makes the brain's arousal system accessible to volitional control, a finding that has tremendous potential for translation to behavioural and clinical applications across various domains, including stress-related and anxiety disorders.
Collapse
Affiliation(s)
- Sarah Nadine Meissner
- Neural Control of Movement Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland.
| | - Marc Bächinger
- Neural Control of Movement Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Sanne Kikkert
- Neural Control of Movement Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
- Neuroscience Center Zurich, University and ETH Zurich, Zurich, Switzerland
- Spinal Cord Injury Center, Balgrist University Hospital, University of Zurich, Zurich, Switzerland
| | - Jenny Imhof
- Neural Control of Movement Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
- Neuroscience Center Zurich, University and ETH Zurich, Zurich, Switzerland
| | - Silvia Missura
- Neural Control of Movement Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Manuel Carro Dominguez
- Neural Control of Movement Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
- Neuroscience Center Zurich, University and ETH Zurich, Zurich, Switzerland
| | - Nicole Wenderoth
- Neural Control of Movement Laboratory, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland.
- Neuroscience Center Zurich, University and ETH Zurich, Zurich, Switzerland.
- Future Health Technologies, Singapore-ETH Centre, Campus for Research Excellence and Technological Enterprise (CREATE), Singapore, Singapore.
| |
Collapse
|
24
|
van Leeuwen JEP, McDougall A, Mylonas D, Suárez-González A, Crutch SJ, Warren JD. Pupil responses to colorfulness are selectively reduced in healthy older adults. Sci Rep 2023; 13:22139. [PMID: 38092848 PMCID: PMC10719259 DOI: 10.1038/s41598-023-48513-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Accepted: 11/27/2023] [Indexed: 12/17/2023] Open
Abstract
The alignment between visual pathway signaling and pupil dynamics offers a promising non-invasive method to further illuminate the mechanisms of human color perception. However, only limited research has been done in this area and the effects of healthy aging on pupil responses to the different color components have not been studied yet. Here we aim to address this by modelling the effects of color lightness and chroma (colorfulness) on pupil responses in young and older adults, in a closely controlled passive viewing experiment with 26 broad-spectrum digital color fields. We show that pupil responses to color lightness and chroma are independent from each other in both young and older adults. Pupil responses to color lightness levels are unaffected by healthy aging, when correcting for smaller baseline pupil sizes in older adults. Older adults exhibit weaker pupil responses to chroma increases, predominantly along the Green-Magenta axis, while relatively sparing the Blue-Yellow axis. Our findings complement behavioral studies in providing physiological evidence that colors fade with age, with implications for color-based applications and interventions both in healthy aging and later-life neurodegenerative disorders.
Collapse
Affiliation(s)
- Janneke E P van Leeuwen
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, 8-11 Queen Square, London, WC1N 3AR, UK.
- The Thinking Eye, ACAVA Limehouse Arts Foundation, London, UK.
| | - Amy McDougall
- Department of Medical Statistics, London School of Hygiene & Tropical Medicine, London, UK
| | - Dimitris Mylonas
- Faculty of Philosophy, Northeastern University London, London, UK
| | - Aida Suárez-González
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, 8-11 Queen Square, London, WC1N 3AR, UK
| | - Sebastian J Crutch
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, 8-11 Queen Square, London, WC1N 3AR, UK
| | - Jason D Warren
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, 8-11 Queen Square, London, WC1N 3AR, UK.
| |
Collapse
|
25
|
Wang CA, Muggleton NG, Chang YH, Barquero C, Kuo YC. Time-on-task effects on human pupillary and saccadic metrics after theta burst transcranial magnetic stimulation over the frontal eye field. IBRO Neurosci Rep 2023; 15:364-375. [PMID: 38046886 PMCID: PMC10689284 DOI: 10.1016/j.ibneur.2023.11.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 10/01/2023] [Accepted: 11/01/2023] [Indexed: 12/05/2023] Open
Abstract
Pupil size undergoes constant changes primarily influenced by ambient luminance. These changes are referred to as the pupillary light reflex (PLR), where the pupil transiently constricts in response to light. PLR kinematics provides valuable insights into autonomic nervous system function and have significant clinical applications. Recent research indicates that attention plays a role in modulating the PLR, and the circuit involving the frontal eye field (FEF) and superior colliculus is causally involved in controlling this pupillary modulation. However, there is limited research exploring the role of the human FEF in these pupillary responses, and its impact on PLR metrics remains unexplored. Additionally, although the protocol of continuous theta-burst stimulation (cTBS) is well-established, the period of disruption after cTBS is yet to be examined in pupillary responses. Our study aimed to investigate the effects of FEF cTBS on pupillary and saccadic metrics in relation to time spent performing a task (referred to as time-on-task). We presented a bright stimulus to induce the PLR in visual- and memory-delay saccade tasks following cTBS over the right FEF or vertex. FEF cTBS, compared to vertex cTBS, resulted in decreased baseline pupil size, peak constriction velocities, and amplitude. Furthermore, the time-on-task effects on baseline pupil size, peak amplitude, and peak time differed between the two stimulation conditions. In contrast, the time-on-task effects on saccadic metrics were less pronounced between the two conditions. In summary, our study provides the first evidence that FEF cTBS affects human PLR metrics and that these effects are modulated by time-on-task.
Collapse
Affiliation(s)
- Chin-An Wang
- Department of Anesthesiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei City, Taiwan
- Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
| | - Neil G. Muggleton
- Institute of Cognitive Neuroscience, College of Health Science and Technology, National Central University, Taoyuan City, Taiwan
- Cognitive Intelligence and Precision Healthcare Center, National Central University, Taoyuan City, Taiwan
| | - Yi-Hsuan Chang
- Institute of Cognitive Neuroscience, College of Health Science and Technology, National Central University, Taoyuan City, Taiwan
| | - Cesar Barquero
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Institute of Cognitive Neuroscience, College of Health Science and Technology, National Central University, Taoyuan City, Taiwan
- Department of Physical Activity and Sport Science, Universidad Peruana de Ciencias Aplicadas, Lima, Peru
| | - Ying-Chun Kuo
- Department of Anesthesiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei City, Taiwan
- Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
| |
Collapse
|
26
|
Marois A, Kopf M, Fortin M, Huot-Lavoie M, Martel A, Boyd JG, Gagnon JF, Archambault PM. Psychophysiological models of hypovigilance detection: A scoping review. Psychophysiology 2023; 60:e14370. [PMID: 37350389 DOI: 10.1111/psyp.14370] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Revised: 05/31/2023] [Accepted: 06/01/2023] [Indexed: 06/24/2023]
Abstract
Hypovigilance represents a major contributor to accidents. In operational contexts, the burden of monitoring/managing vigilance often rests on operators. Recent advances in sensing technologies allow for the development of psychophysiology-based (hypo)vigilance prediction models. Still, these models remain scarcely applied to operational situations and need better understanding. The current scoping review provides a state of knowledge regarding psychophysiological models of hypovigilance detection. Records evaluating vigilance measuring tools with gold standard comparisons and hypovigilance prediction performances were extracted from MEDLINE, PsychInfo, and Inspec. Exclusion criteria comprised aspects related to language, non-empirical papers, and sleep studies. The Quality Assessment tool for Diagnostic Accuracy Studies (QUADAS) and the Prediction model Risk Of Bias ASsessment Tool (PROBAST) were used for bias evaluation. Twenty-one records were reviewed. They were mainly characterized by participant selection and analysis biases. Papers predominantly focused on driving and employed several common psychophysiological techniques. Yet, prediction methods and gold standards varied widely. Overall, we outline the main strategies used to assess hypovigilance, their principal limitations, and we discuss applications of these models.
Collapse
Affiliation(s)
- Alexandre Marois
- Thales Research and Technology Canada, Quebec City, Québec, Canada
- School of Psychology and Computer Science, University of Central Lancashire, Preston, Lancashire, United Kingdom
| | - Maëlle Kopf
- Thales Research and Technology Canada, Quebec City, Québec, Canada
| | - Michelle Fortin
- Faculty of Medicine, Université Laval, Quebec City, Québec, Canada
| | | | - Alexandre Martel
- Faculty of Medicine, Université Laval, Quebec City, Québec, Canada
| | - J Gordon Boyd
- Department of Medicine, Queen's University, Kingston, Ontario, Canada
- Kingston General Hospital, Kingston, Ontario, Canada
| | | | - Patrick M Archambault
- Faculty of Medicine, Université Laval, Quebec City, Québec, Canada
- Centre de recherche intégrée pour un système apprenant en santé et services sociaux, Centre intégré de santé et de services sociaux de Chaudière-Appalaches, Lévis, Québec, Canada
- VITAM - Centre de recherche en santé durable, Centre intégré universitaire de santé et de services sociaux de la Capitale-Nationale, Quebec City, Québec, Canada
| |
Collapse
|
27
|
Huang J, Brien D, Coe BC, Longoni G, Mabbott DJ, Munoz DP, Yeh EA. Delayed oculomotor response associates with optic neuritis in youth with demyelinating disorders. Mult Scler Relat Disord 2023; 79:104969. [PMID: 37660456 DOI: 10.1016/j.msard.2023.104969] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Revised: 07/20/2023] [Accepted: 08/28/2023] [Indexed: 09/05/2023]
Abstract
INTRODUCTION Impairment in visual and cognitive functions occur in youth with demyelinating disorders such as multiple sclerosis, neuromyelitis optica spectrum disorder, and myelin oligodendrocyte glycoprotein antibody-associated disease. Quantitative behavioral assessment using eye-tracking and pupillometry can provide functional metrics for important prognostic and clinically relevant information at the bedside. METHODS Children and adolescents diagnosed with demyelinating disorders and healthy, age-matched controls completed an interleaved pro- and anti-saccade task using video-based eye-tracking and underwent spectral-domain optical coherence tomography examination for evaluation of retinal nerve fiber layer and ganglion cell inner plexiform layer thickness. Low-contrast visual acuity and Symbol Digit Modalities Test were performed for visual and cognitive functional assessments. We assessed saccade and pupil parameters including saccade reaction time, direction error rate, pupil response latency, peak constriction time, and peak constriction and dilation velocities. Generalized Estimating Equations were used to examine the association of eye-tracking parameters with optic neuritis history, structural metrics, and visual and cognitive scores. RESULTS The study included 36 demyelinating disorders patients, aged 8-18 yrs. (75% F; median = 15.22 yrs., SD = 2.8) and 34 age-matched controls (65% F; median = 15.26 yrs., SD = 2.3). Surprisingly, pro- and anti-saccade performance was comparable between patients and controls, whereas pupil control was altered in patients. Oculomotor latency measures were strongly associated with the number of optic neuritis episodes, including saccade reaction time, pupil response latency, and peak constriction time. Peak constriction time was associated with both retinal nerve fiber layer and ganglion cell inner plexiform layer thickness. Pupil response latency and peak constriction time were associated with visual acuity. Pupil velocity for both constriction and dilation was associated with Symbol Digit Modalities Test scores. CONCLUSION The strong associations between oculomotor measures with history of optic neuritis, structural, visual, and cognitive assessments in these cohorts demonstrates that quantitative eye-tracking can be useful for probing demyelinating injury of the brain and optic nerve. Future studies should evaluate their utility in discriminating between demyelinating disorders and tracking disease progression.
Collapse
Affiliation(s)
- Jeff Huang
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - Donald Brien
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - Brian C Coe
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - Giulia Longoni
- Department of Pediatrics (Neurology), The Hospital for Sick Children, Division of Neuroscience and Mental Health, SickKids Research Institute, University of Toronto, Toronto, Ontario, Canada
| | - Donald J Mabbott
- Department of Psychology, The Hospital for Sick Children, Division of Neuroscience and Mental Health, SickKids Research Institute, University of Toronto, Toronto, Ontario, Canada
| | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - E Ann Yeh
- Department of Pediatrics (Neurology), The Hospital for Sick Children, Division of Neuroscience and Mental Health, SickKids Research Institute, University of Toronto, Toronto, Ontario, Canada.
| |
Collapse
|
28
|
Alnawmasi MM, Khuu SK. Deficits in the pupillary response associated with abnormal visuospatial attention allocation in mild traumatic brain injury. J Clin Exp Neuropsychol 2023; 45:855-873. [PMID: 38368620 DOI: 10.1080/13803395.2024.2314727] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Accepted: 11/25/2023] [Indexed: 02/20/2024]
Abstract
INTRODUCTION The ability to allocate visual attention is known to be impaired in patients with mild traumatic brain injury (mTBI). In the present study, we investigated a possible neural correlate of this cognitive deficit by examining the pupil response of patients with mTBI whilst performing a modified Posner visual search task. METHOD Two experiments were conducted in which the target location was either not cued (Experiment 1) or cued (Experiment 2). Additionally, in Experiment 2, the type of cue (endogenous vs exogenous cue) and cue validity were treated as independent variables. In both experiments, search efficiency was varied by changing shape similarity between target and distractor patterns. The reaction time required to judge whether the target was present or absent and pupil dilation metrics, particularly the pupil dilation latency (PDL) and amplitude (PDA), were measured. Thirteen patients with chronic mTBI and 21 age-, sex-, and IQ -matched controls participated in the study. RESULTS In Experiment 1, patients with mTBI displayed a similar PDA for both efficient and inefficient search conditions, while control participants had a significantly larger PDA in inefficient search conditions compared to efficient search conditions. As cognitive load is positively correlated with PDA, our findings suggest that mTBI patients were unable to apply more mental effort whilst performing visual search, particularly if the task is difficult when visual search is inefficient. In Experiment 2, when the target location was cued, patients with mTBI displayed no significant pupil dilation response to the target regardless of the efficiency of the search, nor whether the cue was valid or invalid. These results contrasted with control participants, who were additionally sensitive to the validity of the cue in which PDA was smaller for cue-valid conditions than invalid conditions, particularly for efficient search conditions. CONCLUSION Pupillometry provided further evidence of attention allocation deficits following mTBI.
Collapse
Affiliation(s)
- Mohammed M Alnawmasi
- Department of Optometry, College of Applied Medical Sciences, Qassim University, Buraydah, Saudi Arabia
- School of Optometry and Vision Science, The University of New South Wales, Sydney, Australia
| | - Sieu K Khuu
- School of Optometry and Vision Science, The University of New South Wales, Sydney, Australia
| |
Collapse
|
29
|
Ney LJ, O'Donohue M, Wang Y, Richardson M, Vasarhelyi A, Lipp OV. The next frontier: Moving human fear conditioning research online. Biol Psychol 2023; 184:108715. [PMID: 37852526 DOI: 10.1016/j.biopsycho.2023.108715] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Revised: 10/10/2023] [Accepted: 10/12/2023] [Indexed: 10/20/2023]
Abstract
Fear conditioning is a significant area of research that has featured prominently among the topics published in Biological Psychology over the last 50 years. This work has greatly contributed to our understanding of human anxiety and stressor-related disorders. While mainly conducted in the laboratory, recently, there have been initial attempts to conduct fear conditioning experiments online, with around 10 studies published on the subject, primarily in the last two years. These studies have demonstrated the potential of online fear conditioning research, although challenges to ensure that this research meets the same methodological standards as in-person experimentation remain, despite recent progress. We expect that in the coming years new outcome measures will become available online including the measurement of eye-tracking, pupillometry and probe reaction time and that compliance monitoring will be improved. This exciting new approach opens new possibilities for large-scale data collection among hard-to-reach populations and has the potential to transform the future of fear conditioning research.
Collapse
Affiliation(s)
- Luke J Ney
- School of Psychology and Counselling, Faculty of Health, Queensland University of Australia, Brisbane, Australia
| | - Matthew O'Donohue
- School of Psychology and Counselling, Faculty of Health, Queensland University of Australia, Brisbane, Australia
| | - Yi Wang
- School of Psychology and Counselling, Faculty of Health, Queensland University of Australia, Brisbane, Australia
| | - Mikaela Richardson
- School of Psychology and Counselling, Faculty of Health, Queensland University of Australia, Brisbane, Australia
| | - Adam Vasarhelyi
- School of Psychology and Counselling, Faculty of Health, Queensland University of Australia, Brisbane, Australia
| | - Ottmar V Lipp
- School of Psychology and Counselling, Faculty of Health, Queensland University of Australia, Brisbane, Australia.
| |
Collapse
|
30
|
Kim JH, Yin C, Merriam EP, Roth ZN. Pupil Size Is Sensitive to Low-Level Stimulus Features, Independent of Arousal-Related Modulation. eNeuro 2023; 10:ENEURO.0005-23.2023. [PMID: 37699706 PMCID: PMC10585606 DOI: 10.1523/eneuro.0005-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2023] [Revised: 08/10/2023] [Accepted: 08/29/2023] [Indexed: 09/14/2023] Open
Abstract
Similar to a camera aperture, pupil size adjusts to the surrounding luminance. Unlike a camera, pupil size is additionally modulated both by stimulus properties and by cognitive processes, including attention and arousal, though the interdependence of these factors is unclear. We hypothesized that different stimulus properties interact to jointly modulate pupil size while remaining independent from the impact of arousal. We measured pupil responses from human observers to equiluminant stimuli during a demanding rapid serial visual presentation (RSVP) task at fixation and tested how response amplitude depends on contrast, spatial frequency, and reward level. We found that under constant luminance, unattended stimuli evoke responses that are separable from changes caused by general arousal or attention. We further uncovered a double-dissociation between task-related responses and stimulus-evoked responses, suggesting that different sources of pupil size modulation are independent of one another. Our results shed light on neural pathways underlying pupillary response.
Collapse
Affiliation(s)
- June Hee Kim
- Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, MD 20892
| | - Christine Yin
- Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, MD 20892
| | - Elisha P Merriam
- Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, MD 20892
| | - Zvi N Roth
- Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, MD 20892
| |
Collapse
|
31
|
Segala FG, Bruno A, Martin JT, Aung MT, Wade AR, Baker DH. Different rules for binocular combination of luminance flicker in cortical and subcortical pathways. eLife 2023; 12:RP87048. [PMID: 37750670 PMCID: PMC10522334 DOI: 10.7554/elife.87048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/27/2023] Open
Abstract
How does the human brain combine information across the eyes? It has been known for many years that cortical normalization mechanisms implement 'ocularity invariance': equalizing neural responses to spatial patterns presented either monocularly or binocularly. Here, we used a novel combination of electrophysiology, psychophysics, pupillometry, and computational modeling to ask whether this invariance also holds for flickering luminance stimuli with no spatial contrast. We find dramatic violations of ocularity invariance for these stimuli, both in the cortex and also in the subcortical pathways that govern pupil diameter. Specifically, we find substantial binocular facilitation in both pathways with the effect being strongest in the cortex. Near-linear binocular additivity (instead of ocularity invariance) was also found using a perceptual luminance matching task. Ocularity invariance is, therefore, not a ubiquitous feature of visual processing, and the brain appears to repurpose a generic normalization algorithm for different visual functions by adjusting the amount of interocular suppression.
Collapse
Affiliation(s)
| | - Aurelio Bruno
- School of Psychology and Vision Sciences, University of LeicesterLeicesterUnited Kingdom
| | - Joel T Martin
- Department of Psychology, University of YorkYorkUnited Kingdom
| | - Myat T Aung
- Department of Psychology, University of YorkYorkUnited Kingdom
| | - Alex R Wade
- Department of Psychology, University of YorkYorkUnited Kingdom
- York Biomedical Research Institute, University of YorkYorkUnited Kingdom
| | - Daniel H Baker
- Department of Psychology, University of YorkYorkUnited Kingdom
- York Biomedical Research Institute, University of YorkYorkUnited Kingdom
| |
Collapse
|
32
|
Mathôt S, Vilotijević A. Methods in cognitive pupillometry: Design, preprocessing, and statistical analysis. Behav Res Methods 2023; 55:3055-3077. [PMID: 36028608 PMCID: PMC10556184 DOI: 10.3758/s13428-022-01957-7] [Citation(s) in RCA: 21] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/12/2022] [Indexed: 11/08/2022]
Abstract
Cognitive pupillometry is the measurement of pupil size to investigate cognitive processes such as attention, mental effort, working memory, and many others. Currently, there is no commonly agreed-upon methodology for conducting cognitive-pupillometry experiments, and approaches vary widely between research groups and even between different experiments from the same group. This lack of consensus makes it difficult to know which factors to consider when conducting a cognitive-pupillometry experiment. Here we provide a comprehensive, hands-on guide to methods in cognitive pupillometry, with a focus on trial-based experiments in which the measure of interest is the task-evoked pupil response to a stimulus. We cover all methodological aspects of cognitive pupillometry: experimental design, preprocessing of pupil-size data, and statistical techniques to deal with multiple comparisons when testing pupil-size data. In addition, we provide code and toolboxes (in Python) for preprocessing and statistical analysis, and we illustrate all aspects of the proposed workflow through an example experiment and example scripts.
Collapse
Affiliation(s)
- Sebastiaan Mathôt
- Department of Psychology, University of Groningen, Grote Kruisstraat 2/1, 9712TS, Groningen, The Netherlands.
| | - Ana Vilotijević
- Department of Psychology, University of Groningen, Grote Kruisstraat 2/1, 9712TS, Groningen, The Netherlands
| |
Collapse
|
33
|
Michalczyk Ł. Fixation offset decreases pupillary inhibition of return. Brain Cogn 2023; 170:106058. [PMID: 37390691 DOI: 10.1016/j.bandc.2023.106058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Revised: 06/14/2023] [Accepted: 06/22/2023] [Indexed: 07/02/2023]
Abstract
Inhibition of return (IOR) is reflected as a slower manual or saccadic response to a cued rather than an uncued target (manual IOR and saccadic IOR, respectively), and as a pupillary dilation when a bright, relative to a dark side of a display is cued (pupillary IOR). The aim of this study was to investigate the relation between an IOR and oculomotor system. According to the predominant view, only the saccadic IOR is strictly related to the visuomotor process, and the manual and pupillary IORs depend on non-motor factors (e.g., short-term visual depression). Alternatively, the after-effect of the covert-orienting hypothesis postulates that IOR is strictly related to the oculomotor system. As fixation offset affects oculomotor processes, this study investigated whether fixation offset also affects pupillary and manual IORs. The results show that fixation offset decreased IOR in pupillary but not manual responses, and provides support for the hypothesis that at least the pupillary IOR is tightly linked to eye movement preparation.
Collapse
Affiliation(s)
- Łukasz Michalczyk
- Institute of Psychology, Jesuit University Ignatianum in Krakow, Krakow, Poland.
| |
Collapse
|
34
|
Klaver LMF, Brinkhof LP, Sikkens T, Casado-Román L, Williams AG, van Mourik-Donga L, Mejías JF, Pennartz CMA, Bosman CA. Spontaneous variations in arousal modulate subsequent visual processing and local field potential dynamics in the ferret during quiet wakefulness. Cereb Cortex 2023; 33:7564-7581. [PMID: 36935096 PMCID: PMC10267643 DOI: 10.1093/cercor/bhad061] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 02/11/2023] [Accepted: 02/14/2023] [Indexed: 03/21/2023] Open
Abstract
Behavioral states affect neuronal responses throughout the cortex and influence visual processing. Quiet wakefulness (QW) is a behavioral state during which subjects are quiescent but awake and connected to the environment. Here, we examined the effects of pre-stimulus arousal variability on post-stimulus neural activity in the primary visual cortex and posterior parietal cortex in awake ferrets, using pupil diameter as an indicator of arousal. We observed that the power of stimuli-induced alpha (8-12 Hz) decreases when the arousal level increases. The peak of alpha power shifts depending on arousal. High arousal increases inter- and intra-areal coherence. Using a simplified model of laminar circuits, we show that this connectivity pattern is compatible with feedback signals targeting infragranular layers in area posterior parietal cortex and supragranular layers in V1. During high arousal, neurons in V1 displayed higher firing rates at their preferred orientations. Broad-spiking cells in V1 are entrained to high-frequency oscillations (>80 Hz), whereas narrow-spiking neurons are phase-locked to low- (12-18 Hz) and high-frequency (>80 Hz) rhythms. These results indicate that the variability and sensitivity of post-stimulus cortical responses and coherence depend on the pre-stimulus behavioral state and account for the neuronal response variability observed during repeated stimulation.
Collapse
Affiliation(s)
- Lianne M F Klaver
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
| | - Lotte P Brinkhof
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
| | - Tom Sikkens
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
| | - Lorena Casado-Román
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
| | - Alex G Williams
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
| | - Laura van Mourik-Donga
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
| | - Jorge F Mejías
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
- Research Priority Program Brain and Cognition, University of Amsterdam, Amsterdam, The Netherlands
| | - Cyriel M A Pennartz
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
- Research Priority Program Brain and Cognition, University of Amsterdam, Amsterdam, The Netherlands
| | - Conrado A Bosman
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
- Research Priority Program Brain and Cognition, University of Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
35
|
Egan C, Payne JS, Jones MW. The impact of phonological relatedness on semantic congruency judgements in readers with dyslexia: Evidence from behavioural judgements, event related potentials and pupillometry. Neuropsychologia 2023; 184:108548. [PMID: 36967042 DOI: 10.1016/j.neuropsychologia.2023.108548] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Revised: 01/24/2023] [Accepted: 03/23/2023] [Indexed: 03/30/2023]
Abstract
Readers with developmental dyslexia are known to be impaired in representing and accessing phonology, but their ability to process meaning is generally considered to be intact. However, neurocognitive studies show evidence of a subtle semantic processing deficit in dyslexic readers, relative to their typically-developing peers. Here, we compared dyslexic and typical adult readers on their ability to judge semantic congruency (congruent vs. inconcongruent) in short, two-word phrases, which were further manipulated for phonological relatedness (alliterating vs. non-alliterating); "dazzling-diamond"; "sparkling-diamond"; "dangerous-diamond"; and "creepy-diamond". At the level of behavioural judgement, all readers were less accurate when evaluating incongruent alliterating items compared with incongruent non-aliterating, suggesting that phonological patterning creates the illusion of semantic congruency (as per Egan et al., 2020). Dyslexic readers showed a similar propensity for this form-meaning relationship despite a phonological processing impairment as evidenced in the cognitive and literacy indicative assessments. Dyslexic readers also showed an overall reduction in the ability to accurately judge semantic congruency, suggestive of a subtle semantic impairment. Whilst no group differences emerged in the electrophysiological measures, our pupil dilation measurements revealed a global tendency for dyslexic readers to manifest a reduced attentional response to these word stimuli, compared with typical readers. Our results show a broad manifestation of neurocognitive differences in adult dyslexic and typical readers' processing of print, at the level of autonomic arousal as well as in higher level semantic judgements.
Collapse
|
36
|
Bonmassar C, Scharf F, Widmann A, Wetzel N. On the relationship of arousal and attentional distraction by emotional novel sounds. Cognition 2023; 237:105470. [PMID: 37150156 DOI: 10.1016/j.cognition.2023.105470] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2022] [Revised: 04/23/2023] [Accepted: 04/24/2023] [Indexed: 05/09/2023]
Abstract
Unexpected and task-irrelevant sounds can impair performance in a task. It has been shown that highly arousing emotional distractor sounds impaired performance less compared to moderately arousing neutral distractor sounds. The present study tests whether these differential emotion-related distraction effects are directly related to an enhancement of arousal evoked by processing of emotional distractor sounds. We disentangled costs of orienting of attention and benefits of increased arousal levels during the presentation of highly arousing emotional and moderately arousing neutral novel sounds that were embedded in a sequence of repeated standard sounds. We used sound-related pupil dilation responses as a marker of arousal and RTs as a marker of distraction in a visual categorization task in 57 healthy young adults. Multilevel analyses revealed increased RT and increased pupil dilation in response to novel vs. standard sounds. Emotional novel sounds reduced distraction effects on the behavioral level and increased pupil dilation responses compared to neutral novel sounds. Bayes Factors revealed strong evidence against an inverse proportional relationship between behavioral distraction effects and sound-related pupil dilation responses for emotional sounds. Given that the activity of the locus coeruleus has been linked to both changes in pupil diameter and arousal, it may embody an indirect relationship as a common antecedent by the release of norepinephrine into brain networks involved in attention control and control of the pupil. The present study provides new insights into the relation of changes in arousal and attentional distraction during the processing of emotional task-irrelevant novel sounds.
Collapse
Affiliation(s)
| | | | - Andreas Widmann
- Leibniz Institute for Neurobiology, Magdeburg, Germany; Leipzig University, Germany
| | - Nicole Wetzel
- Leibniz Institute for Neurobiology, Magdeburg, Germany; Center for Behavioral Brain Sciences Magdeburg, Germany; University of Applied Sciences Magdeburg-, Stendal, Germany
| |
Collapse
|
37
|
Dercksen TT, Widmann A, Wetzel N. Salient omissions-pupil dilation in response to unexpected omissions of sound and touch. Front Psychiatry 2023; 14:1143931. [PMID: 37032955 PMCID: PMC10077953 DOI: 10.3389/fpsyt.2023.1143931] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Accepted: 02/21/2023] [Indexed: 04/11/2023] Open
Abstract
Introduction Recent theories describe perception as an inferential process based on internal predictive models adjusted by means of prediction violations (prediction error). To study and demonstrate predictive processing in the brain the use of unexpected stimulus omissions has been suggested as a promising approach as the evoked brain responses are uncontaminated by responses to stimuli. Here, we aimed to investigate the pupil's response to unexpected stimulus omissions in order to better understand surprise and orienting of attention resulting from prediction violation. So far only few studies have used omission in pupillometry research and results have been inconsistent. Methods This study adapted an EEG paradigm that has been shown to elicit omission responses in auditory and somatosensory modalities. Healthy adults pressed a button at their own pace, which resulted in the presentation of sounds or tactile stimuli in either 88%, 50% or 0% (motor-control) of cases. Pupil size was recorded continuously and averaged to analyze the pupil dilation response associated with each condition. Results Results revealed that omission responses were observed in both modalities in the 88%-condition compared to motor-control. Similar pupil omission responses were observed between modalities, suggesting modality-unspecific activation of the underlying brain circuits. Discussion In combination with previous omission studies using EEG, the findings demonstrate predictive models in brain processing and point to the involvement of subcortical structures in the omission response. Our pupillometry approach is especially suitable to study sensory prediction in vulnerable populations within the psychiatric field.
Collapse
Affiliation(s)
- Tjerk T. Dercksen
- Research Group Neurocognitive Development, Leibniz Institute for Neurobiology, Magdeburg, Germany
- Center for Behavioral Brain Sciences, Magdeburg, Germany
| | - Andreas Widmann
- Research Group Neurocognitive Development, Leibniz Institute for Neurobiology, Magdeburg, Germany
- Wilhelm Wundt Institute for Psychology, Leipzig University, Leipzig, Germany
| | - Nicole Wetzel
- Research Group Neurocognitive Development, Leibniz Institute for Neurobiology, Magdeburg, Germany
- Center for Behavioral Brain Sciences, Magdeburg, Germany
- University of Applied Sciences Magdeburg-Stendal, Stendal, Germany
| |
Collapse
|
38
|
Książek P, Zekveld AA, Fiedler L, Kramer SE, Wendt D. Time-specific Components of Pupil Responses Reveal Alternations in Effort Allocation Caused by Memory Task Demands During Speech Identification in Noise. Trends Hear 2023; 27:23312165231153280. [PMID: 36938784 PMCID: PMC10028670 DOI: 10.1177/23312165231153280] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/21/2023] Open
Abstract
Daily communication may be effortful due to poor acoustic quality. In addition, memory demands can induce effort, especially for long or complex sentences. In the current study, we tested the impact of memory task demands and speech-to-noise ratio on the time-specific components of effort allocation during speech identification in noise. Thirty normally hearing adults (15 females, mean age 42.2 years) participated. In an established auditory memory test, listeners had to listen to a list of seven sentences in noise, and repeat the sentence-final word after presentation, and, if instructed, recall the repeated words. We tested the effects of speech-to-noise ratio (SNR; -4 dB, +1 dB) and recall (Recall; Yes, No), on the time-specific components of pupil responses, trial baseline pupil size, and their dynamics (change) along the list. We found three components in the pupil responses (early, middle, and late). While the additional memory task (recall versus no recall) lowered all components' values, SNR (-4 dB versus +1 dB SNR) increased the middle and late component values. Increasing memory demands (Recall) progressively increased trial baseline and steepened decrease of the late component's values. Trial baseline increased most steeply in the condition of +1 dB SNR with recall. The findings suggest that adding a recall to the auditory task alters effort allocation for listening. Listeners are dynamically re-allocating effort from listening to memorizing under changing memory and acoustic demands. The pupil baseline and the time-specific components of pupil responses provide a comprehensive picture of the interplay of SNR and recall on effort.
Collapse
Affiliation(s)
- Patrycja Książek
- 26066Amsterdam UMC, Vrije Universiteit Amsterdam, Otolaryngology/Head and Neck Surgery, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
- 263099Eriksholm Research Centre, Snekkersten, Denmark
| | - Adriana A Zekveld
- 26066Amsterdam UMC, Vrije Universiteit Amsterdam, Otolaryngology/Head and Neck Surgery, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
| | | | - Sophia E Kramer
- 26066Amsterdam UMC, Vrije Universiteit Amsterdam, Otolaryngology/Head and Neck Surgery, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
| | - Dorothea Wendt
- 263099Eriksholm Research Centre, Snekkersten, Denmark
- Department of Health Technology, 5205Technical University of Denmark, Lyngby, Denmark
| |
Collapse
|
39
|
Alnawmasi MM, Walz JA, Khuu SK. Deficits in visuospatial attentional cueing following mild traumatic brain injury. Neuropsychologia 2022; 177:108422. [PMID: 36370825 DOI: 10.1016/j.neuropsychologia.2022.108422] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2022] [Revised: 08/31/2022] [Accepted: 11/07/2022] [Indexed: 11/10/2022]
Abstract
Visual attentional deficits are frequently reported in patients with mild traumatic brain injury (TBI). In the present study, the ability to orient visual attention (i.e., the use of endogenous and exogenous visual cues) was investigated using a modified Posner visual search task, in which the participant was required to search for a target shape (radial frequency patterns) amongst distractor shapes. Participants were required to determine whether a target radial frequency pattern was present or absent from an array of distractors. Attention to the target location was cued using central or peripheral cueing procedures to investigate endogenous or exogenous attention allocation. Predictability was not manipulated between central and peripheral cues. Search difficulty was varied by systematically changing the radial frequency difference between target and distractors (and thereby shape difference), and cues could be valid or invalid in that they correctly or incorrectly indicated the position of the target shape. Both target discriminability (i.e., identifying the presence or absence of the target) and reaction times were measured. Thirteen patients with chronic mild TBI and 21 age-, sex-, and IQ -matched healthy controls participated in the study. For control participants, both discrimination accuracy and reaction times improved with visual search efficiency, and they were sensitive to the type of cue, with performance worst for cue invalid conditions than valid conditions. However, the results for TBI patients were strikingly different; we find that discrimination accuracy slightly improved with visual search difficulty (compared to controls), but not reaction times, and TBI patients were largely insensitive to the type of visual cue, and did not show a selective deficit for central or peripheral cues, suggesting an impairment in both endogenous and exogenous visual attention. In conclusion, patients with mild TBI exhibit a poor ability to orient visual attention.
Collapse
Affiliation(s)
- Mohammed M Alnawmasi
- School of Optometry and Vision Science, The University of New South Wales, Sydney, Australia; College of Applied Medical Science, Department of Optometry, Qassim University, Saudi Arabia.
| | - Jacinta A Walz
- School of Optometry and Vision Science, The University of New South Wales, Sydney, Australia
| | - Sieu K Khuu
- School of Optometry and Vision Science, The University of New South Wales, Sydney, Australia
| |
Collapse
|
40
|
Viglione A, Sagona G, Carrara F, Amato G, Totaro V, Lupori L, Putignano E, Pizzorusso T, Mazziotti R. Behavioral impulsivity is associated with pupillary alterations and hyperactivity in CDKL5 mutant mice. Hum Mol Genet 2022; 31:4107-4120. [PMID: 35861639 DOI: 10.1093/hmg/ddac164] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2022] [Revised: 06/24/2022] [Accepted: 07/12/2022] [Indexed: 11/14/2022] Open
Abstract
Cyclin-dependent kinase-like 5 (Cdkl5) deficiency disorder (CDD) is a severe neurodevelopmental condition caused by mutations in the X-linked Cdkl5 gene. CDD is characterized by early-onset seizures in the first month of life, intellectual disability, motor and social impairment. No effective treatment is currently available and medical management is only symptomatic and supportive. Recently, mouse models of Cdkl5 disorder have demonstrated that mice lacking Cdkl5 exhibit autism-like phenotypes, hyperactivity and dysregulations of the arousal system, suggesting the possibility to use these features as translational biomarkers. In this study, we tested Cdkl5 male and female mutant mice in an appetitive operant conditioning chamber to assess cognitive and motor abilities, and performed pupillometry to assess the integrity of the arousal system. Then, we evaluated the performance of artificial intelligence models to classify the genotype of the animals from the behavioral and physiological phenotype. The behavioral results show that CDD mice display impulsivity, together with low levels of cognitive flexibility and perseverative behaviors. We assessed arousal levels by simultaneously recording pupil size and locomotor activity. Pupillometry reveals in CDD mice a smaller pupil size and an impaired response to unexpected stimuli associated with hyperlocomotion, demonstrating a global defect in arousal modulation. Finally, machine learning reveals that both behavioral and pupillometry parameters can be considered good predictors of CDD. Since early diagnosis is essential to evaluate treatment outcomes and pupillary measures can be performed easily, we proposed the monitoring of pupil size as a promising biomarker for CDD.
Collapse
Affiliation(s)
- Aurelia Viglione
- BIO@SNS Lab, Scuola Normale Superiore, via Moruzzi 1, 56124 Pisa, Italy
| | - Giulia Sagona
- Department of Developmental Neuroscience, IRCCS Stella Maris Foundation, viale del Tirreno 331, 56128 Pisa, Italy
| | - Fabio Carrara
- ISTI-Istituto di Scienza e Tecnologia dell'Informazione, National Research Council, via Moruzzi 1, 56124 Pisa, Italy
| | - Giuseppe Amato
- ISTI-Istituto di Scienza e Tecnologia dell'Informazione, National Research Council, via Moruzzi 1, 56124 Pisa, Italy
| | - Valentino Totaro
- BIO@SNS Lab, Scuola Normale Superiore, via Moruzzi 1, 56124 Pisa, Italy
| | - Leonardo Lupori
- Department of Developmental Neuroscience, IRCCS Stella Maris Foundation, viale del Tirreno 331, 56128 Pisa, Italy
| | - Elena Putignano
- Institute of Neuroscience, National Research Council, via Moruzzi 1, 56124 Pisa, Italy
| | - Tommaso Pizzorusso
- BIO@SNS Lab, Scuola Normale Superiore, via Moruzzi 1, 56124 Pisa, Italy.,Institute of Neuroscience, National Research Council, via Moruzzi 1, 56124 Pisa, Italy
| | - Raffaele Mazziotti
- Department of Developmental Neuroscience, IRCCS Stella Maris Foundation, viale del Tirreno 331, 56128 Pisa, Italy
| |
Collapse
|
41
|
Hsu TY, Wang HY, Chen JT, Wang CA. Investigating the role of human frontal eye field in the pupil light reflex modulation by saccade planning and working memory. Front Hum Neurosci 2022; 16:1044893. [DOI: 10.3389/fnhum.2022.1044893] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Accepted: 11/02/2022] [Indexed: 11/18/2022] Open
Abstract
The pupil constricts in response to an increase in global luminance level, commonly referred to as the pupil light reflex. Recent research has shown that these reflex responses are modulated by high-level cognition. There is larger pupil constriction evoked by a bright stimulus when the stimulus location spatially overlaps with the locus of attention, and these effects have been extended to saccade planning and working memory (here referred to as pupil local-luminance modulation). Although research in monkeys has further elucidated a central role of the frontal eye field (FEF) and superior colliculus in the pupil local-luminance modulation, their roles remain to be established in humans. Through applying continuous theta-burst transcranial magnetic stimulation over the right FEF (and vertex) to inhibit its activity, we investigated the role of the FEF in human pupil local-luminance responses. Pupil light reflex responses were transiently evoked by a bright patch stimulus presented during the delay period in the visual- and memory-delay tasks. In the visual-delay task, larger pupil constriction was observed when the patch location was spatially aligned with the target location in both stimulation conditions. More interestingly, after FEF stimulation, larger pupil constriction was obtained when the patch was presented in the contralateral, compared to the ipsilateral visual field of the stimulation. In contrast, FEF stimulation effects were absence in the memory-delay task. Linear mixed model results further found that stimulation condition, patch location consistency, and visual field significantly modulated observed pupil constriction responses. Together, our results constitute the first evidence of FEF modulation in human pupil local-luminance responses.
Collapse
|
42
|
Polzer L, Freitag CM, Bast N. Pupillometric measures of altered stimulus-evoked locus coeruleus-norepinephrine activity explain attenuated social attention in preschoolers with autism spectrum disorder. Autism Res 2022; 15:2167-2180. [PMID: 36111843 DOI: 10.1002/aur.2818] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2022] [Accepted: 08/23/2022] [Indexed: 12/15/2022]
Abstract
Attenuated social attention has been described as a reduced preference for social compared to geometric motion in preschoolers with autism spectrum disorder (ASD). The locus coeruleus-norpinephrine (LC-NE) system modulates sensory reactivity and is a promising underlying mechanism. LC-NE activity is indexed by a stimulus-evoked pupillary response (SEPR) and partially by a luminance-adaptation pupillary response (LAPR), which were both shown to be aberrant in ASD. We examined whether SEPR and LAPR explain an attenuated social motion preference. We applied pupillometry via video-based eye tracking in young children (18-65 months) with ASD (n = 57) and typically developing (TD) children (n = 39) during a preferential looking paradigm of competing social and geometric motion and a changing light condition paradigm. We found an attenuated social motion preference in the ASD compared to the TD group. This was accompanied by atypical pupillometry showing a smaller SEPR to social motion, a larger SEPR to geometric motion and a reduced LAPR to a dark screen. SEPR but not LAPR explained the group difference in social motion preference. An ASD diagnosis was statistically predicted by the social motion preference, while this effect was mediated by the inclusion of SEPR to geometric and social motion. Our findings suggest a decreased sensory reactivity to social and increased reactivity to non-social motion in ASD, which may concurrently contribute to an attenuated social attention. The LC-NE system is supported as a promising underlying mechanism of altered social attention in young children with ASD, while the specificity of findings remains to be addressed.
Collapse
Affiliation(s)
- Leonie Polzer
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Autism Research and Intervention Center of Excellence, University Hospital Frankfurt, Goethe-University, Frankfurt am Main, Germany
| | - Christine M Freitag
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Autism Research and Intervention Center of Excellence, University Hospital Frankfurt, Goethe-University, Frankfurt am Main, Germany
| | - Nico Bast
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Autism Research and Intervention Center of Excellence, University Hospital Frankfurt, Goethe-University, Frankfurt am Main, Germany
| |
Collapse
|
43
|
Hogan AL, Winston M, Barstein J, Losh M. Slower Peak Pupillary Response to Emotional Faces in Parents of Autistic Individuals. Front Psychol 2022; 13:836719. [PMID: 36304881 PMCID: PMC9595282 DOI: 10.3389/fpsyg.2022.836719] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Accepted: 05/31/2022] [Indexed: 11/23/2022] Open
Abstract
Background Atypical autonomic arousal has been consistently documented in autism spectrum disorder (ASD) and is thought to contribute to the social-communication phenotype of ASD. Some evidence suggests that clinically unaffected first-degree relatives of autistic individuals may also show subtle differences in indices of autonomic arousal, potentially implicating heritable pathophysiological mechanisms in ASD. This study examined pupillary responses in parents of autistic individuals to investigate evidence that atypical autonomic arousal might constitute a subclinical physiological marker of ASD heritability within families of autistic individuals. Methods Pupillary responses to emotional faces were measured in 47 ASD parents and 20 age-matched parent controls. Macro-level pupillary responses (e.g., mean, peak, latency to peak) and dynamic pupillary responses over the course of the stimulus presentation were compared between groups, and in relationship to subclinical ASD-related features in ASD parents. A small ASD group (n = 20) and controls (n = 17) were also included for exploratory analyses of parent–child correlations in pupillary response. Results Parents of autistic individuals differed in the time course of pupillary response, exhibiting a later primary peak response than controls. In ASD parents, slower peak response was associated with poorer pragmatic language and larger peak response was associated with poorer social cognition. Exploratory analyses revealed correlations between peak pupillary responses in ASD parents and mean and peak pupillary responses in their autistic children. Conclusion Differences in pupillary responses in clinically unaffected parents, together with significant correlations with ASD-related features and significant parent–child associations, suggest that pupillary responses to emotional faces may constitute an objective physiological marker of ASD genetic liability, with potential to inform the mechanistic underpinnings of ASD symptomatology.
Collapse
|
44
|
Fattal J, Brascamp JW, Slate RE, Lehet M, Achtyes ED, Thakkar KN. Blunted pupil light reflex is associated with negative symptoms and working memory in individuals with schizophrenia. Schizophr Res 2022; 248:254-262. [PMID: 36115190 PMCID: PMC9613610 DOI: 10.1016/j.schres.2022.09.019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/27/2021] [Revised: 08/21/2022] [Accepted: 09/05/2022] [Indexed: 10/14/2022]
Abstract
Two largely separate lines of research have documented altered pupillary dynamics in individuals diagnosed with schizophrenia. An older set of studies has demonstrated reductions in the pupillary light reflex (PLR) in individuals with schizophrenia; however, clinical and cognitive correlates of this blunted PLR have been relatively unexplored. More recently, a large body of work has demonstrated reductions in pupillary dilation in response to cognitive demands in individuals with schizophrenia, and the degree of this blunted pupil dilation has been related to more severe cognitive deficits and motivational negative symptoms. These clinically relevant alterations in the cognitive modulation of pupil size have been interpreted as reflecting insufficient information processing resources or inappropriate effort allocation. To begin to bridge these two lines of work, we investigated the PLR in 34 individuals with schizophrenia and 30 healthy controls and related the amplitude of the PLR to motivational negative symptoms and cognitive performance. Consistent with prior work, we found that the PLR was reduced in individuals with schizophrenia, and furthermore, that these measurements were highly reliable across individuals. Blunted constriction was associated with more severe motivational negative symptoms and poorer working memory among individuals with schizophrenia. These observed correlates provide a bridge between older literature documenting an altered PLR and more recent work reporting associations between negative symptoms, cognition, and blunted pupillary dilation in response to cognitive demands in individuals with schizophrenia. We provide possible mechanistic interpretations of our data and consider a parsimonious explanation for reduced cognitive- and light-related modulation of pupil size.
Collapse
Affiliation(s)
- Jessica Fattal
- Department of Psychology, Michigan State University, East Lansing, MI, United States of America
| | - Jan W Brascamp
- Department of Psychology, Michigan State University, East Lansing, MI, United States of America
| | - Rachael E Slate
- Department of Psychology, Michigan State University, East Lansing, MI, United States of America
| | - Matthew Lehet
- Department of Psychology, Michigan State University, East Lansing, MI, United States of America
| | - Eric D Achtyes
- Division of Psychiatry and Behavioral Medicine, Michigan State University, Grand Rapids, MI, United States of America; Cherry Health, Grand Rapids, MI, United States of America
| | - Katharine N Thakkar
- Department of Psychology, Michigan State University, East Lansing, MI, United States of America; Division of Psychiatry and Behavioral Medicine, Michigan State University, Grand Rapids, MI, United States of America.
| |
Collapse
|
45
|
Karpouzian-Rogers T, Sweeney JA, Rubin LH, McDowell J, Clementz BA, Gershon E, Keshavan MS, Pearlson GD, Tamminga CA, Reilly JL. Reduced task-evoked pupillary response in preparation for an executive cognitive control response among individuals across the psychosis spectrum. Schizophr Res 2022; 248:79-88. [PMID: 35963057 DOI: 10.1016/j.schres.2022.07.018] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/26/2020] [Revised: 04/29/2022] [Accepted: 07/25/2022] [Indexed: 11/19/2022]
Abstract
Task-evoked pupillary response (TEPR) is a measure of physiological arousal modulated by cognitive demand. Healthy individuals demonstrate greater TEPR prior to correct versus error antisaccade trials and correct antisaccade versus visually guided saccade (VGS) trials. The relationship between TEPR and antisaccade performance in individuals with psychotic disorders and their relatives has not been investigated. Probands with schizophrenia, schizoaffective disorder, psychotic bipolar disorder, their first-degree relatives, and controls from the B-SNIP study completed antisaccade and VGS tasks. TEPR prior to execution of responses on these tasks was evaluated among controls compared to probands and relatives according to diagnostic groups and neurobiologically defined subgroups (biotypes). Controls demonstrated greater TEPR on antisaccade correct versus error versus VGS trials. TEPR was not differentiated between antisaccade correct versus error trials in bipolar or schizophrenia probands, though was greater on antisaccade compared to prosaccade trials. There was no modulation of TEPR in schizoaffective probands. Relatives of schizophrenia and schizoaffective probands and those with elevated psychosis spectrum traits failed to demonstrate differential TEPR on antisaccade correct versus error trials. No proband or relative biotypes demonstrated differential TEPR on antisaccade correct versus error trials, and only proband biotype 3 and relative biotypes 3 and 2 demonstrated greater TEPR on antisaccade versus VGS trials. Our findings suggest that aberrant modulation of preparatory activity prior to saccade execution contributes to impaired executive cognitive control across the psychosis spectrum, including nonpsychotic relatives with elevated clinical risk. Reduced pupillary modulation under cognitive challenge may thus be a biomarker for the psychosis phenotype.
Collapse
Affiliation(s)
- Tatiana Karpouzian-Rogers
- Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States of America
| | - John A Sweeney
- Department of Psychiatry, University of Cincinnati College of Medicine, Cincinnati, OH, United States of America
| | - Leah H Rubin
- Departments of Neurology and Psychiatry, Johns Hopkins School of Medicine, Baltimore, MD, United States of America; Department of Epidemiology, Johns Hopkins University Bloomberg School of Public Health, Baltimore, MD, United States of America
| | - Jennifer McDowell
- Department of Psychology, University of Georgia, Athens, GA, United States of America
| | - Brett A Clementz
- Department of Psychology, University of Georgia, Athens, GA, United States of America
| | - Elliot Gershon
- Psychiatry, University of Chicago, Chicago, IL, United States of America
| | - Matcheri S Keshavan
- Department of Psychiatry, Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, MA, United States of America
| | - Godfrey D Pearlson
- Departments of Psychiatry and Neurobiology, Yale University and Olin Neuropsychiatric Research Center, Hartford, CT, United States of America
| | - Carol A Tamminga
- Department of Psychiatry, University of Texas Southwestern Medical Center, Dallas, TX, United States of America
| | - James L Reilly
- Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States of America.
| |
Collapse
|
46
|
Kaneko S, Niki Y, Yamada K, Nasukawa D, Ujihara Y, Toda K. Systemic injection of nicotinic acetylcholine receptor antagonist mecamylamine affects licking, eyelid size, and locomotor and autonomic activities but not temporal prediction in male mice. Mol Brain 2022; 15:77. [PMID: 36068635 PMCID: PMC9450238 DOI: 10.1186/s13041-022-00959-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Accepted: 08/05/2022] [Indexed: 12/26/2022] Open
Abstract
Nicotinic acetylcholine receptors are thought to be associated with a wide range of phenomena, such as movement, learning, memory, attention, and addiction. However, the causal relationship between nicotinic receptor activity and behavior remains unclear. Contrary to the studies that examined the functions of muscarinic acetylcholine receptors, the role of the nicotinic acetylcholine receptors on behavior has not been examined as extensively. Here, we examined the effects of intraperitoneal injection of mecamylamine, a nicotinic acetylcholine receptor antagonist, on the performance of male mice in a head-fixed temporal conditioning task and a free-moving open-field task. The head-fixed experimental setup allowed us to record and precisely quantify the licking response while the mice performed the behavioral task with no external cues. In addition, by combining the utility of the head-fixed experimental design with computer vision analysis based on deep learning algorithms, we succeeded in quantifying the eyelid size of awake mice. In the temporal conditioning task, we delivered a 10% sucrose solution every 10 s using a blunt-tipped needle placed within the licking distance of the mice. After the training, the mice showed increased anticipatory licking toward the timing of sucrose delivery, suggesting that the mice could predict the timing of the reward. Systemic injection of mecamylamine decreased licking behavior and caused eye closure but had no effect on learned conditioned predictive behavior in the head-fixed temporal conditioning task. In addition, the injection of mecamylamine decreased spontaneous locomotor activity in a dose-dependent manner in the free-moving open-field task. The results in the open-field experiments further revealed that the effect of mecamylamine on fecal output and urination, suggesting the effects on autonomic activities. Our achievement of successful eyelid size recording has potential as a useful approach in initial screening for drug discovery. Our study paves a way forward to understanding the role of nicotinic acetylcholine receptors on learning and behavior.
Collapse
Affiliation(s)
- Shohei Kaneko
- Department of Psychology, Keio University, Mita 2-15-45, Minato-ku, Tokyo, Japan
| | - Yasuyuki Niki
- Department of Psychology, Keio University, Mita 2-15-45, Minato-ku, Tokyo, Japan
| | - Kota Yamada
- Department of Psychology, Keio University, Mita 2-15-45, Minato-ku, Tokyo, Japan
- Japan Society for Promotion of Science, Tokyo, Japan
| | - Daiki Nasukawa
- Department of Psychology, Keio University, Mita 2-15-45, Minato-ku, Tokyo, Japan
| | - Yusuke Ujihara
- Department of Anatomy and Neurobiology, University of Tennessee Health Science Center, TN, Memphis, USA
| | - Koji Toda
- Department of Psychology, Keio University, Mita 2-15-45, Minato-ku, Tokyo, Japan.
| |
Collapse
|
47
|
Habibi M, Oertel WH, White BJ, Brien DC, Coe BC, Riek HC, Perkins J, Yep R, Itti L, Timmermann L, Best C, Sittig E, Janzen A, Munoz DP. Eye tracking identifies biomarkers in α-synucleinopathies versus progressive supranuclear palsy. J Neurol 2022; 269:4920-4938. [PMID: 35501501 PMCID: PMC9363304 DOI: 10.1007/s00415-022-11136-5] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2022] [Revised: 04/08/2022] [Accepted: 04/08/2022] [Indexed: 11/11/2022]
Abstract
OBJECTIVES This study (1) describes and compares saccade and pupil abnormalities in patients with manifest alpha-synucleinopathies (αSYN: Parkinson's disease (PD), Multiple System Atrophy (MSA)) and a tauopathy (progressive supranuclear palsy (PSP)); (2) determines whether patients with rapid-eye-movement sleep behaviour disorder (RBD), a prodromal stage of αSYN, already have abnormal responses that may indicate a risk for developing PD or MSA. METHODS Ninety (46 RBD, 27 PD, 17 MSA) patients with an αSYN, 10 PSP patients, and 132 healthy age-matched controls (CTRL) were examined with a 10-min video-based eye-tracking task (Free Viewing). Participants were free to look anywhere on the screen while saccade and pupil behaviours were measured. RESULTS PD, MSA, and PSP spent more time fixating the centre of the screen than CTRL. All patient groups made fewer macro-saccades (> 2◦ amplitude) with smaller amplitude than CTRL. Saccade frequency was greater in RBD than in other patients. Following clip change, saccades were temporarily suppressed, then rebounded at a slower pace than CTRL in all patient groups. RBD had distinct, although discrete saccade abnormalities that were more marked in PD, MSA, and even more in PSP. The vertical saccade rate was reduced in all patients and decreased most in PSP. Clip changes produced large increases or decreases in screen luminance requiring pupil constriction or dilation, respectively. PSP elicited smaller pupil constriction/dilation responses than CTRL, while MSA elicited the opposite. CONCLUSION RBD patients already have discrete but less pronounced saccade abnormalities than PD and MSA patients. Vertical gaze palsy and altered pupil control differentiate PSP from αSYN.
Collapse
Affiliation(s)
- Mahboubeh Habibi
- Department of Neurology, Philipps-University Marburg, 35043, Marburg, Germany.
- Centre for Neuroscience Studies, Queen's University, 18 Stuart Street, Kingston, ON, K7L 3N6, Canada.
| | - Wolfgang H Oertel
- Department of Neurology, Philipps-University Marburg, 35043, Marburg, Germany
| | - Brian J White
- Centre for Neuroscience Studies, Queen's University, 18 Stuart Street, Kingston, ON, K7L 3N6, Canada
| | - Donald C Brien
- Centre for Neuroscience Studies, Queen's University, 18 Stuart Street, Kingston, ON, K7L 3N6, Canada
| | - Brian C Coe
- Centre for Neuroscience Studies, Queen's University, 18 Stuart Street, Kingston, ON, K7L 3N6, Canada
| | - Heidi C Riek
- Centre for Neuroscience Studies, Queen's University, 18 Stuart Street, Kingston, ON, K7L 3N6, Canada
| | - Julia Perkins
- Centre for Neuroscience Studies, Queen's University, 18 Stuart Street, Kingston, ON, K7L 3N6, Canada
| | - Rachel Yep
- Centre for Neuroscience Studies, Queen's University, 18 Stuart Street, Kingston, ON, K7L 3N6, Canada
| | - Laurent Itti
- Department of Computer Science, University of Southern California, Los Angeles, CA, USA
| | - Lars Timmermann
- Department of Neurology, Philipps-University Marburg, 35043, Marburg, Germany
| | - Christoph Best
- Department of Neurology, Philipps-University Marburg, 35043, Marburg, Germany
| | - Elisabeth Sittig
- Department of Neurology, Philipps-University Marburg, 35043, Marburg, Germany
| | - Annette Janzen
- Department of Neurology, Philipps-University Marburg, 35043, Marburg, Germany
| | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, 18 Stuart Street, Kingston, ON, K7L 3N6, Canada.
- Department of Biomedical and Molecular Sciences, Queen's University, Kingston, ON, Canada.
| |
Collapse
|
48
|
Chen JT, Kuo YC, Hsu TY, Wang CA. Fatigue and Arousal Modulations Revealed by Saccade and Pupil Dynamics. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19159234. [PMID: 35954585 PMCID: PMC9367726 DOI: 10.3390/ijerph19159234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 07/25/2022] [Accepted: 07/27/2022] [Indexed: 11/16/2022]
Abstract
Saccadic eye movements are directed to the objects of interests and enable high-resolution visual images in the exploration of the visual world. There is a trial-to-trial variation in saccade dynamics even in a simple task, possibly attributed to arousal fluctuations. Previous studies have showed that an increase of fatigue level over time, also known as time-on-task, can be revealed by saccade peak velocity. In addition, pupil size, controlled by the autonomic nervous system, has long been used as an arousal index. However, limited research has been done with regards to the relation between pupil size and saccade behavior in the context of trial-to-trial variation. To investigate fatigue and arousal effects on saccadic and pupillary responses, we used bright and emotional stimuli to evoke pupillary responses in tasks requiring reactive and voluntary saccade generation. Decreased voluntary saccade peak velocities, reduced tonic pupil size and phasic pupillary responses were observed as time-on-task increased. Moreover, tonic pupil size affected saccade latency and dynamics, with steeper saccade main sequence slope as tonic pupil size increased. In summary, saccade dynamics and tonic pupil size were sensitive to fatigue and arousal level, together providing valuable information for the understanding of human behavior.
Collapse
Affiliation(s)
- Jui-Tai Chen
- Department of Anesthesiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei 110, Taiwan;
- Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City 235, Taiwan
| | - Ying-Chun Kuo
- Institute of Cognitive Neuroscience, College of Health Science and Technology, National Central University, Taoyuan City 320, Taiwan;
- Cognitive Intelligence and Precision Healthcare Research Center, National Central University, Taoyuan City 320, Taiwan
| | - Tzu-Yu Hsu
- Graduate Institute of Mind, Brain, and Consciousness (GIMBC), Taipei Medical University, Taipei 110, Taiwan;
- Brain and Consciousness Research Center (BCRC), TMU-Shuang Ho Hospital, New Taipei City 235, Taiwan
| | - Chin-An Wang
- Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City 235, Taiwan
- Institute of Cognitive Neuroscience, College of Health Science and Technology, National Central University, Taoyuan City 320, Taiwan;
- Cognitive Intelligence and Precision Healthcare Research Center, National Central University, Taoyuan City 320, Taiwan
- Graduate Institute of Mind, Brain, and Consciousness (GIMBC), Taipei Medical University, Taipei 110, Taiwan;
- Brain and Consciousness Research Center (BCRC), TMU-Shuang Ho Hospital, New Taipei City 235, Taiwan
- Correspondence:
| |
Collapse
|
49
|
Do pupillary responses during authentic slot machine use reflect arousal or screen luminance fluctuations? A proof-of-concept study. PLoS One 2022; 17:e0272070. [PMID: 35877672 PMCID: PMC9312385 DOI: 10.1371/journal.pone.0272070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2022] [Accepted: 07/12/2022] [Indexed: 12/03/2022] Open
Abstract
Modern slot machines are among the more harmful forms of gambling. Psychophysiological measures may provide a window into mental processes that underpin these harms. Here we investigated pupil dilation derived from eye tracking as a means of capturing changes in sympathetic nervous system arousal following outcomes on a real slot machine. We hypothesized that positively reinforcing slot machine outcomes would be associated with increases in arousal, reflected in larger pupil diameter. We further examined the contribution of game luminance fluctuations on pupil diameter. In Experiment 1A, experienced slot machine gamblers (N = 53) played a commercially-available slot machine in a laboratory for 20 minutes while wearing mobile eye tracking glasses. Analyses differentiated loss outcomes, wins, losses-disguised-as-wins, and (free-spin) bonus features. Bonus features were associated with rapid increases in pupil diameter following the onset of outcome-related audiovisual feedback, relative to losses. In Experiment 1B, luminance data were extracted from captured screen videos (derived from Experiment 1A) to characterize on-screen luminance changes that could modulate pupil diameter. Bonus features and wins were associated with pronounced and complex fluctuations in screen luminance (≈50 L and ≈25L, respectively). However, the pupil dilation that was observed to bonus features in Experiment 1A coincided temporally with only negligible changes in screen luminance, providing partial evidence that the pupil dilation to bonus features may be due to arousal. In Experiment 2, 12 participants viewed pairs of stimuli (scrambled slot machine images) at luminance difference thresholds of ≈25L, ≈50L, and ≈100L. Scrambled images presented at luminance differences of ≈25L and greater were sufficient to cause pupillary responses. Overall, pupillometry may detect event-related changes in sympathetic nervous system arousal following gambling outcomes, but researchers must pay careful attention to substantial in-game luminance changes that may confound arousal-based interpretations.
Collapse
|
50
|
Johnston R, Snyder AC, Khanna SB, Issar D, Smith MA. The eyes reflect an internal cognitive state hidden in the population activity of cortical neurons. Cereb Cortex 2022; 32:3331-3346. [PMID: 34963140 PMCID: PMC9340396 DOI: 10.1093/cercor/bhab418] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Revised: 10/19/2021] [Accepted: 10/20/2021] [Indexed: 01/01/2023] Open
Abstract
Decades of research have shown that global brain states such as arousal can be indexed by measuring the properties of the eyes. The spiking responses of neurons throughout the brain have been associated with the pupil, small fixational saccades, and vigor in eye movements, but it has been difficult to isolate how internal states affect the eyes, and vice versa. While recording from populations of neurons in the visual and prefrontal cortex (PFC), we recently identified a latent dimension of neural activity called "slow drift," which appears to reflect a shift in a global brain state. Here, we asked if slow drift is correlated with the action of the eyes in distinct behavioral tasks. We recorded from visual cortex (V4) while monkeys performed a change detection task, and PFC, while they performed a memory-guided saccade task. In both tasks, slow drift was associated with the size of the pupil and the microsaccade rate, two external indicators of the internal state of the animal. These results show that metrics related to the action of the eyes are associated with a dominant and task-independent mode of neural activity that can be accessed in the population activity of neurons across the cortex.
Collapse
Affiliation(s)
- Richard Johnston
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| | - Adam C Snyder
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, 14627, USA
- Department of Neuroscience, University of Rochester, Rochester, NY, 14642, USA
- Center for Visual Science, University of Rochester, Rochester, NY, 14627, USA
| | - Sanjeev B Khanna
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, 15261, USA
| | - Deepa Issar
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| | - Matthew A Smith
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
- Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, 15213, USA
| |
Collapse
|