1
|
Kafkas A. Eyes on Memory: Pupillometry in Encoding and Retrieval. Vision (Basel) 2024; 8:37. [PMID: 38922182 PMCID: PMC11209248 DOI: 10.3390/vision8020037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2024] [Revised: 06/04/2024] [Accepted: 06/08/2024] [Indexed: 06/27/2024] Open
Abstract
This review critically examines the contributions of pupillometry to memory research, primarily focusing on its enhancement of our understanding of memory encoding and retrieval mechanisms mainly investigated with the recognition memory paradigm. The evidence supports a close link between pupil response and memory formation, notably influenced by the type of novelty detected. This proposal reconciles inconsistencies in the literature regarding pupil response patterns that may predict successful memory formation, and highlights important implications for encoding mechanisms. The review also discusses the pupil old/new effect and its significance in the context of recollection and in reflecting brain signals related to familiarity or novelty detection. Additionally, the capacity of pupil response to serve as a true memory signal and to distinguish between true and false memories is evaluated. The evidence provides insights into the nature of false memories and offers a novel understanding of the cognitive mechanisms involved in memory distortions. When integrated with rigorous experimental design, pupillometry can significantly refine theoretical models of memory encoding and retrieval. Furthermore, combining pupillometry with neuroimaging and pharmacological interventions is identified as a promising direction for future research.
Collapse
Affiliation(s)
- Alex Kafkas
- School of Health Sciences, Division of Psychology, Communication and Human Neuroscience, University of Manchester, Manchester M13 9PL, UK
| |
Collapse
|
2
|
Kondziella D, Othman MH. Response to Letter to the Editor for: "Covert Consciousness in Acute Brain Injury Revealed by Automated Pupillometry and Cognitive Paradigms". Neurocrit Care 2024:10.1007/s12028-024-02024-z. [PMID: 38872032 DOI: 10.1007/s12028-024-02024-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2024] [Accepted: 05/23/2024] [Indexed: 06/15/2024]
Affiliation(s)
- Daniel Kondziella
- Department of Neurology, Copenhagen University Hospital -Rigshospitalet, Copenhagen, Denmark.
| | - Marwan H Othman
- Department of Neurology, Copenhagen University Hospital -Rigshospitalet, Copenhagen, Denmark
| |
Collapse
|
3
|
Pelegrino A, Guimaraes AL, Sena W, Emele N, Scoriels L, Panizzutti R. Dysregulated noradrenergic response is associated with symptom severity in individuals with schizophrenia. Front Psychiatry 2023; 14:1190329. [PMID: 38025452 PMCID: PMC10661901 DOI: 10.3389/fpsyt.2023.1190329] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Accepted: 10/23/2023] [Indexed: 12/01/2023] Open
Abstract
Introduction The locus coeruleus-noradrenaline (LC-NA) system is involved in a wide range of cognitive functions and may be altered in schizophrenia. A non-invasive method to indirectly measure LC activity is task-evoked pupillary response. Individuals with schizophrenia present reduced pupil dilation compared to healthy subjects, particularly when task demand increases. However, the extent to which alteration in LC activity contributes to schizophrenia symptomatology remains largely unexplored. We aimed to investigate the association between symptomatology, cognition, and noradrenergic response in individuals with schizophrenia. Methods We assessed task-evoked pupil dilation during a pro- and antisaccade task in 23 individuals with schizophrenia and 28 healthy subjects. Results Both groups showed similar preparatory pupil dilation during prosaccade trials, but individuals with schizophrenia showed significantly lower pupil dilation compared to healthy subjects in antisaccade trials. Importantly, reduced preparatory pupil dilation for antisaccade trials was associated with worse general symptomatology in individuals with schizophrenia. Discussion Our findings suggest that changes in LC-NA activity - measured by task-evoked pupil dilation - when task demand increases is associated with schizophrenia symptoms. Interventions targeting the modulation of noradrenergic responses may be suitable candidates to reduce schizophrenia symptomatology.
Collapse
Affiliation(s)
- Ana Pelegrino
- Instituto de Psiquiatria, Universidade Federal do Rio de Janeiro, Rio de Janeiro, Brazil
- Instituto de Ciências Biomédicas, Universidade Federal do Rio de Janeiro, Rio de Janeiro, Brazil
| | - Anna Luiza Guimaraes
- Instituto de Psiquiatria, Universidade Federal do Rio de Janeiro, Rio de Janeiro, Brazil
- Instituto de Ciências Biomédicas, Universidade Federal do Rio de Janeiro, Rio de Janeiro, Brazil
| | - Walter Sena
- Instituto de Psiquiatria, Universidade Federal do Rio de Janeiro, Rio de Janeiro, Brazil
- Instituto de Ciências Biomédicas, Universidade Federal do Rio de Janeiro, Rio de Janeiro, Brazil
| | - Nwabunwanne Emele
- Instituto de Psiquiatria, Universidade Federal do Rio de Janeiro, Rio de Janeiro, Brazil
- Instituto de Ciências Biomédicas, Universidade Federal do Rio de Janeiro, Rio de Janeiro, Brazil
| | - Linda Scoriels
- Instituto de Psiquiatria, Universidade Federal do Rio de Janeiro, Rio de Janeiro, Brazil
- Université Paris Cité, Institut de Psychiatrie et Neurosciences de Paris, Inserm, Paris, France
| | - Rogerio Panizzutti
- Instituto de Psiquiatria, Universidade Federal do Rio de Janeiro, Rio de Janeiro, Brazil
- Instituto de Ciências Biomédicas, Universidade Federal do Rio de Janeiro, Rio de Janeiro, Brazil
| |
Collapse
|
4
|
Hatsukawa H, Ishikawa M. Psychological states affecting initial pupil size changes after olfactory stimulation in healthy participants. Sci Rep 2023; 13:16050. [PMID: 37749199 PMCID: PMC10520065 DOI: 10.1038/s41598-023-43004-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Accepted: 09/18/2023] [Indexed: 09/27/2023] Open
Abstract
Odor perception affects physiological and psychological states. Pupillary light reflex (PLR) parameters can be affected by olfactory stimulation and psychological states, although it remains unclear whether the olfactory stimulation-induced psychological changes can associate with PLR parameter changes. This study aimed to investigate effects of olfactory stimulation-induced psychological changes on PLR parameter changes with repeated measurements. We collected data on six mood subscales of the profile of mood states, and on five PLR parameter measurements from 28 healthy participants. Participants underwent a 10-min olfactory stimulation on different days with six odorants available with the T&T olfactometer. As obtained data were clustered, we used linear mixed-effects models for statistical analyses. The olfactory stimulation using the no-odor liquid did not affect mood states and the initial pupil size (INIT). The sweat odorant worsened all mood subscales including fatigue-inertia (Fatigue)/Vigor-Activity (Vigor), and decreased INIT compared to the no-odor liquid. When comparing INIT responses related to changes in mood subscales between the no-odor liquid and the sweat odorant, worsened states of Fatigue/Vigor were associated with decreased INIT in the sweat odorant. Fatigue/Vigor can be used as mental fatigue indicators. Thus, mental fatigue can be associated with decreased INIT in the olfactory stimulation.
Collapse
Affiliation(s)
- Hiroatsu Hatsukawa
- Department of Otolaryngology, Head and Neck Surgery, Hyogo Prefectural Amagasaki General Medical Center, 2-17-77 Higashinaniwachou, Amagasaki, Hyogo Prefecture, 660-8550, Japan
| | - Masaaki Ishikawa
- Department of Otolaryngology, Head and Neck Surgery, Hyogo Prefectural Amagasaki General Medical Center, 2-17-77 Higashinaniwachou, Amagasaki, Hyogo Prefecture, 660-8550, Japan.
| |
Collapse
|
5
|
Bast N, Gaigg SB, Bowler DM, Roessner V, Freitag CM, Ring M. Arousal-modulated memory encoding and retrieval in adults with autism spectrum disorder. Autism Res 2022; 15:1609-1620. [PMID: 35906845 DOI: 10.1002/aur.2784] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2021] [Accepted: 07/15/2022] [Indexed: 11/08/2022]
Abstract
Recently, we have shown that pupil dilation during a recognition memory task can serve as an index of memory retrieval difficulties in autism. At the time of publication, we were unaware of specific data-analysis methods that can be used to shed further light on the origins of such memory related pupil dilation. Specifically, by distinguishing "tonic" from "phasic" changes in pupil dilation and considering their temporal progression, it is possible to draw inferences about the functional integrity of a locus coeruleus-norepinephrine system (LC-NE) that is known to play a key role in regulating memory encoding and retrieval processes. We therefore apply these analyses to our previously published eye-tracking data of adults with ASD (N = 24) and neurotypical development (TD, N = 30) during the recognition memory task. In this re-analysis, we related pupil dilation during encoding and retrieval to recognition accuracy in a per-trial analysis of linear mixed models. In ASD, we replicated attenuated recognition accuracy, which was accompanied by attenuated pupil dilation during encoding and retrieval. Group differences in pupil dilation during retrieval occurred late during the trial (after 1.75 s) and indicated an altered top-down processing like attenuated attribution of semantic salience in response to previously encoded stimuli. In addition, only in the ASD group were higher pupil dilation during encoding and lower pupil dilation during retrieval associated with decreased recognition accuracy. This supports altered modulation of memory encoding and retrieval in ASD, with LC-NE phasic activity as promising underlying mechanism. LAY SUMMARY: We investigated the changes of pupil size during memory testing in autism spectrum disorder. Adults with ASD remembered fewer items correctly than neurotypical individuals (TD). This reduced memory was related to increased pupillary responses at study and decreased pupil dilation at test only for adults with ASD indicating a different modulation of memory by the locus coeruleus.
Collapse
Affiliation(s)
- Nico Bast
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital, Goethe University Frankfurt am Main, Frankfurt, Germany
| | - Sebastian B Gaigg
- Autism Research Group, Department of Psychology, City, University of London, London, UK
| | - Dermot M Bowler
- Autism Research Group, Department of Psychology, City, University of London, London, UK
| | - Veit Roessner
- Department of Child and Adolescent Psychiatry, University Hospital Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
| | - Christine M Freitag
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital, Goethe University Frankfurt am Main, Frankfurt, Germany
| | - Melanie Ring
- Autism Research Group, Department of Psychology, City, University of London, London, UK.,Department of Child and Adolescent Psychiatry, University Hospital Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
| |
Collapse
|
6
|
Hu X, Hisakata R, Kaneko H. The relationship between pupillary baseline manipulated by mental effort or luminance and subsequent pupillary responses. J Vis 2022; 22:7. [PMID: 35758900 PMCID: PMC9248750 DOI: 10.1167/jov.22.7.7] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Measuring pupillary response is a prevalent technique to evaluate mental states. It is indispensable to conduct a correction procedure for the pupillary baseline to get a meaningful conclusion from the pupillary response. However, the relationship between pupillary baseline and subsequent stimulus-evoked pupillary response varies among studies. In this study, we used the subtractive and proportional baseline corrections to analyze the results. Furthermore, we manipulated the pupillary baseline through mental effort or luminance in the baseline period and investigated whether the subsequent stimulus-evoked pupillary responses were affected. We found that the mental effort–evoked pupillary response was attenuated with a larger pupillary baseline manipulated by a higher mental effort, whereas it was unaffected with the baseline manipulated by luminance. Also, the luminance-evoked pupillary response was attenuated with a smaller pupillary baseline manipulated by a brighter disk, whereas it was unaffected with the baseline manipulated by mental effort. The results could be obtained from subtractive and proportional baseline corrections. Our results suggest that mental effort manipulated pupillary baseline interacts with the subsequent mental effort elicited pupillary response, but not with the luminance elicited pupillary response; the luminance manipulated pupillary baseline interacts with the subsequent luminance elicited pupillary response, but not with the mental effort elicited pupillary response. It is important to consider the ways of controlling the pupillary baseline and subsequent pupillary response simultaneously.
Collapse
Affiliation(s)
- Xiaofei Hu
- School of Psychology, Shaanxi Normal University, Xi'an, China.,Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, Midori-Ku, Yokohama, Japan.,
| | - Rumi Hisakata
- Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, Midori-Ku, Yokohama, Japan.,
| | - Hirohiko Kaneko
- Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, Midori-Ku, Yokohama, Japan.,
| |
Collapse
|
7
|
Visual guidance can help with the use of a robotic exoskeleton during human walking. Sci Rep 2022; 12:3881. [PMID: 35273244 PMCID: PMC8913727 DOI: 10.1038/s41598-022-07736-w] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2021] [Accepted: 02/15/2022] [Indexed: 11/29/2022] Open
Abstract
Walking is an important activity that supports the health-related quality of life, and for those who need assistance, robotic devices are available to help. Recent progress in wearable robots has identified the importance of customizing the assistance provided by the robot to the individual, resulting in robot adaptation to the human. However, current implementations minimize the role of human adaptation to the robot, for example, by the users modifying their movements based on the provided robot assistance. This study investigated the effect of visual feedback to guide the users in adapting their movements in response to wearable robot assistance. The visual feedback helped the users reduce their metabolic cost of walking without any changes in robot assistance in a given time. In a case with the initially metabolic expensive (IMExp) exoskeleton condition, both training methods helped reduce the metabolic cost of walking. The results suggest that visual feedback training is helpful to use the exoskeleton for various conditions. Without feedback, the training is helpful only for the IMExp exoskeleton condition. This result suggests visual feedback training can be useful to facilitate the use of non-personalized, generic assistance, where the assistance is not tuned for each user, in a relatively short time.
Collapse
|
8
|
Wu F, Zhao Y, Zhang H. Ocular Autonomic Nervous System: An Update from Anatomy to Physiological Functions. Vision (Basel) 2022; 6:vision6010006. [PMID: 35076641 PMCID: PMC8788436 DOI: 10.3390/vision6010006] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2021] [Revised: 01/10/2022] [Accepted: 01/10/2022] [Indexed: 11/16/2022] Open
Abstract
The autonomic nervous system (ANS) confers neural control of the entire body, mainly through the sympathetic and parasympathetic nerves. Several studies have observed that the physiological functions of the eye (pupil size, lens accommodation, ocular circulation, and intraocular pressure regulation) are precisely regulated by the ANS. Almost all parts of the eye have autonomic innervation for the regulation of local homeostasis through synergy and antagonism. With the advent of new research methods, novel anatomical characteristics and numerous physiological processes have been elucidated. Herein, we summarize the anatomical and physiological functions of the ANS in the eye within the context of its intrinsic connections. This review provides novel insights into ocular studies.
Collapse
|
9
|
Tramonti Fantozzi MP, De Cicco V, De Cicco D, d'Ascanio P, Cataldo E, Bruschini L, Faraguna U, Manzoni D. Chewing and Cognitive Improvement: The Side Matters. Front Syst Neurosci 2022; 15:749444. [PMID: 35002642 PMCID: PMC8734061 DOI: 10.3389/fnsys.2021.749444] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2021] [Accepted: 11/24/2021] [Indexed: 11/13/2022] Open
Abstract
Chewing improves cognitive performance, which is impaired in subjects showing an asymmetry in electromyographic (EMG) masseter activity during clenching. In these subjects, the simultaneous presence of an asymmetry in pupil size (anisocoria) at rest indicates an imbalance in Ascending Reticular Activating System (ARAS) influencing arousal and pupil size. The aim of the present study was to verify whether a trigeminal EMG asymmetry may bias the stimulating effect of chewing on cognition. Cognitive performance and pupil size at rest were recorded before and after 1 min of unilateral chewing in 20 subjects with anisocoria, showing an EMG asymmetry during clenching. Unilateral chewing stimulated performance mainly when it occurred on the side of lower EMG activity (and smaller pupil size). Following chewing on the hypotonic side, changes in cognitive performance were negatively and positively correlated with those in anisocoria and pupil size, respectively. We propose that, following chewing on the hypotonic side, the arousing effects of trigeminal stimulation on performance are enhanced by a rebalancing of ARAS structures. At variance, following chewing on the hypertonic side, the arousing effect of trigeminal stimulation could be partially or completely prevented by the simultaneous increase in ARAS imbalance.
Collapse
Affiliation(s)
| | - Vincenzo De Cicco
- Department of Translational Research and of New Surgical and Medical Technologies, University of Pisa, Pisa, Italy
| | - Davide De Cicco
- Department of Neurosciences, Reproductive and Odontostomatological Sciences, University of Naples Federico II, Naples, Italy
| | - Paola d'Ascanio
- Department of Translational Research and of New Surgical and Medical Technologies, University of Pisa, Pisa, Italy
| | | | - Luca Bruschini
- Department of Surgical, Medical and Molecular Pathology and Critical Care Medicine, University of Pisa, Pisa, Italy
| | - Ugo Faraguna
- Department of Translational Research and of New Surgical and Medical Technologies, University of Pisa, Pisa, Italy.,Department of Developmental Neuroscience, IRCCS Fondazione Stella Maris, Pisa, Italy
| | - Diego Manzoni
- Department of Translational Research and of New Surgical and Medical Technologies, University of Pisa, Pisa, Italy
| |
Collapse
|
10
|
Ferencová N, Višňovcová Z, Bona Olexová L, Tonhajzerová I. Eye pupil – a window into central autonomic regulation via emotional/cognitive processing. Physiol Res 2021. [DOI: 10.33549//physiolres.934749] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Abstract
If the eyes are windows into the soul, then the pupils represent at least the gateway to the brain and can provide a unique insight into the human mind from several aspects. The changes in the pupil size primarily mediated by different lighting conditions are controlled by the autonomic nervous system regulated predominantly at the subcortical level. Specifically, parasympathetically-linked pupillary constriction is under the Edinger-Westphal nucleus control and sympathetically-mediated pupillary dilation is regulated from the posterior hypothalamic nuclei. However, the changes in the pupil size can be observed at resting state even under constant lighting, these pupillary changes are mediated by global arousal level as well as by various cognitive factors. In this context, autonomic pathways modulating changes in the pupil size in response to the different light levels can be influenced by multiple central descending inputs driving pupillary changes under steady lighting conditions. Moreover, as the pupillary response is involved in emotional (task-evoked pupillary dilation as an index of emotional arousal) and cognitive (task-evoked pupillary dilation as an index of cognitive workload) stimulation, it can be used to detect the impact of mutual subcortical and cortical structures (i.e. overlapping brain structures included in autonomic, emotional and cognitive regulation) on the pupillary innervation system. Thus, complex understanding of the baseline pupil size´ and pupillary dynamics´ mechanisms may provide an important insight into the central nervous system functioning pointing to the pupillometry as a promising tool in the clinical application.
Collapse
Affiliation(s)
| | | | | | - I Tonhajzerová
- Department of Physiology, Jessenius Faculty of Medicine in Martin, Comenius University in Bratislava, Martin, Slovak Republic.
| |
Collapse
|
11
|
Ferencová N, Višňovcová Z, Bona Olexová L, Tonhajzerová I. Eye pupil - a window into central autonomic regulation via emotional/cognitive processing. Physiol Res 2021; 70:S669-S682. [PMID: 35199551 DOI: 10.33549/physiolres.934749] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Abstract
If the eyes are windows into the soul, then the pupils represent at least the gateway to the brain and can provide a unique insight into the human mind from several aspects. The changes in the pupil size primarily mediated by different lighting conditions are controlled by the autonomic nervous system regulated predominantly at the subcortical level. Specifically, parasympathetically-linked pupillary constriction is under the Edinger-Westphal nucleus control and sympathetically-mediated pupillary dilation is regulated from the posterior hypothalamic nuclei. However, the changes in the pupil size can be observed at resting state even under constant lighting, these pupillary changes are mediated by global arousal level as well as by various cognitive factors. In this context, autonomic pathways modulating changes in the pupil size in response to the different light levels can be influenced by multiple central descending inputs driving pupillary changes under steady lighting conditions. Moreover, as the pupillary response is involved in emotional (task-evoked pupillary dilation as an index of emotional arousal) and cognitive (task-evoked pupillary dilation as an index of cognitive workload) stimulation, it can be used to detect the impact of mutual subcortical and cortical structures (i.e. overlapping brain structures included in autonomic, emotional and cognitive regulation) on the pupillary innervation system. Thus, complex understanding of the baseline pupil size´ and pupillary dynamics´ mechanisms may provide an important insight into the central nervous system functioning pointing to the pupillometry as a promising tool in the clinical application.
Collapse
Affiliation(s)
- N Ferencová
- Department of Physiology, Jessenius Faculty of Medicine in Martin, Comenius University in Bratislava, Martin, Slovak Republic.
| | | | | | | |
Collapse
|
12
|
Selezneva E, Brosch M, Rathi S, Vighneshvel T, Wetzel N. Comparison of Pupil Dilation Responses to Unexpected Sounds in Monkeys and Humans. Front Psychol 2021; 12:754604. [PMID: 35002851 PMCID: PMC8732861 DOI: 10.3389/fpsyg.2021.754604] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2021] [Accepted: 11/23/2021] [Indexed: 11/23/2022] Open
Abstract
Pupil dilation in response to unexpected stimuli has been well documented in human as well as in non-human primates; however, this phenomenon has not been systematically compared between the species. This analogy is also crucial for the role of non-human primates as an animal model to investigate neural mechanisms underlying the processing of unexpected stimuli and their evoked pupil dilation response. To assess this qualitatively, we used an auditory oddball paradigm in which we presented subjects a sequence of the same sounds followed by occasional deviants while we measured their evoked pupil dilation response (PDR). We used deviants (a frequency deviant, a pink noise burst, a monkey vocalization and a whistle sound) which differed in the spectral composition and in their ability to induce arousal from the standard. Most deviants elicited a significant pupil dilation in both species with decreased peak latency and increased peak amplitude in monkeys compared to humans. A temporal Principal Component Analysis (PCA) revealed two components underlying the PDRs in both species. The early component is likely associated to the parasympathetic nervous system and the late component to the sympathetic nervous system, respectively. Taken together, the present study demonstrates a qualitative similarity between PDRs to unexpected auditory stimuli in macaque and human subjects suggesting that macaques can be a suitable model for investigating the neuronal bases of pupil dilation. However, the quantitative differences in PDRs between species need to be investigated in further comparative studies.
Collapse
Affiliation(s)
- Elena Selezneva
- Research Group Neurocognitive Development, Leibniz Institute for Neurobiology, Magdeburg, Germany
- *Correspondence: Elena Selezneva,
| | - Michael Brosch
- Research Group Comparative Neuroscience, Leibniz Institute for Neurobiology, Magdeburg, Germany
| | - Sanchit Rathi
- Research Group Comparative Neuroscience, Leibniz Institute for Neurobiology, Magdeburg, Germany
| | - T. Vighneshvel
- Research Group Comparative Neuroscience, Leibniz Institute for Neurobiology, Magdeburg, Germany
| | - Nicole Wetzel
- Research Group Neurocognitive Development, Leibniz Institute for Neurobiology, Magdeburg, Germany
- Center for Behavioral Brain Sciences, Otto-von-Guericke University, Magdeburg, Germany
- Department of Applied Human Sciences, Magdeburg-Stendal University of Applied Sciences, Magdeburg, Germany
| |
Collapse
|
13
|
Peter A, Stauch BJ, Shapcott K, Kouroupaki K, Schmiedt JT, Klein L, Klon-Lipok J, Dowdall JR, Schölvinck ML, Vinck M, Schmid MC, Fries P. Stimulus-specific plasticity of macaque V1 spike rates and gamma. Cell Rep 2021; 37:110086. [PMID: 34879273 PMCID: PMC8674536 DOI: 10.1016/j.celrep.2021.110086] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2020] [Revised: 06/28/2021] [Accepted: 11/11/2021] [Indexed: 11/02/2022] Open
Abstract
When a visual stimulus is repeated, average neuronal responses typically decrease, yet they might maintain or even increase their impact through increased synchronization. Previous work has found that many repetitions of a grating lead to increasing gamma-band synchronization. Here, we show in awake macaque area V1 that both repetition-related reductions in firing rate and increases in gamma are specific to the repeated stimulus. These effects show some persistence on the timescale of minutes. Gamma increases are specific to the presented stimulus location. Further, repetition effects on gamma and on firing rates generalize to images of natural objects. These findings support the notion that gamma-band synchronization subserves the adaptive processing of repeated stimulus encounters.
Collapse
Affiliation(s)
- Alina Peter
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; International Max Planck Research School for Neural Circuits, 60438 Frankfurt, Germany.
| | - Benjamin Johannes Stauch
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; International Max Planck Research School for Neural Circuits, 60438 Frankfurt, Germany
| | - Katharine Shapcott
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; Frankfurt Institute for Advanced Studies, 60438 Frankfurt, Germany
| | - Kleopatra Kouroupaki
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany
| | - Joscha Tapani Schmiedt
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany
| | - Liane Klein
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; International Max Planck Research School for Neural Circuits, 60438 Frankfurt, Germany; Max Planck Institute for Brain Research, 60438 Frankfurt, Germany
| | - Johanna Klon-Lipok
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; Max Planck Institute for Brain Research, 60438 Frankfurt, Germany
| | - Jarrod Robert Dowdall
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; International Max Planck Research School for Neural Circuits, 60438 Frankfurt, Germany
| | - Marieke Louise Schölvinck
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany
| | - Martin Vinck
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; Donders Centre for Neuroscience, Department of Neuroinformatics, Radboud University Nijmegen, Nijmegen, the Netherlands
| | - Michael Christoph Schmid
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; University of Fribourg, Faculty of Science and Medicine, Chemin du Musée 5, 1700 Fribourg, Switzerland; Newcastle University, Biosciences Institute, Faculty of Medical Sciences, Framlington Place, Newcastle NE2 4HH, UK
| | - Pascal Fries
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, 60528 Frankfurt, Germany; International Max Planck Research School for Neural Circuits, 60438 Frankfurt, Germany; Donders Institute for Brain, Cognition and Behaviour, Radboud University, 6525 EN Nijmegen, the Netherlands.
| |
Collapse
|
14
|
Stauch BJ, Peter A, Schuler H, Fries P. Stimulus-specific plasticity in human visual gamma-band activity and functional connectivity. eLife 2021; 10:e68240. [PMID: 34473058 PMCID: PMC8412931 DOI: 10.7554/elife.68240] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2021] [Accepted: 08/11/2021] [Indexed: 11/13/2022] Open
Abstract
Under natural conditions, the visual system often sees a given input repeatedly. This provides an opportunity to optimize processing of the repeated stimuli. Stimulus repetition has been shown to strongly modulate neuronal-gamma band synchronization, yet crucial questions remained open. Here we used magnetoencephalography in 30 human subjects and find that gamma decreases across ≈10 repetitions and then increases across further repetitions, revealing plastic changes of the activated neuronal circuits. Crucially, increases induced by one stimulus did not affect responses to other stimuli, demonstrating stimulus specificity. Changes partially persisted when the inducing stimulus was repeated after 25 minutes of intervening stimuli. They were strongest in early visual cortex and increased interareal feedforward influences. Our results suggest that early visual cortex gamma synchronization enables adaptive neuronal processing of recurring stimuli. These and previously reported changes might be due to an interaction of oscillatory dynamics with established synaptic plasticity mechanisms.
Collapse
Affiliation(s)
- Benjamin J Stauch
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck SocietyFrankfurtGermany
- International Max Planck Research School for Neural CircuitsFrankfurtGermany
- Brain Imaging Center, Goethe University FrankfurtFrankfurtGermany
| | - Alina Peter
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck SocietyFrankfurtGermany
- International Max Planck Research School for Neural CircuitsFrankfurtGermany
| | - Heike Schuler
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck SocietyFrankfurtGermany
| | - Pascal Fries
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck SocietyFrankfurtGermany
- International Max Planck Research School for Neural CircuitsFrankfurtGermany
- Brain Imaging Center, Goethe University FrankfurtFrankfurtGermany
- Donders Institute for Brain, Cognition and Behaviour, Radboud University NijmegenNijmegenNetherlands
| |
Collapse
|
15
|
Fernández G, Parra MA. Oculomotor Behaviors and Integrative Memory Functions in the Alzheimer's Clinical Syndrome. J Alzheimers Dis 2021; 82:1033-1044. [PMID: 34151787 DOI: 10.3233/jad-201189] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
BACKGROUND Biological information drawn from eye-tracking metrics is providing evidence regarding drivers of cognitive decline in Alzheimer's disease. In particular, pupil size has proved useful to investigate cognitive performance during online activities. OBJECTIVE To investigate the oculomotor correlates of impaired performance of patients with mild Alzheimer's Clinical Syndrome (ACS) on a recently developed memory paradigm, namely the Short-Term Memory Binding Test (STMBT). METHODS We assessed a sample of eighteen healthy controls (HC) and eighteen patients with a diagnosis of mild ACS with the STMBT while we recorded their oculomotor behaviors using pupillometry and eye-tracking. RESULTS As expected, a group (healthy controls versus ACS) by condition (Unbound Colours versus Bound Colours) interaction was found whereby behavioral group differences were paramount in the Bound Colours condition. Healthy controls' pupils dilated significantly more in the Bound Colours than in the Unbound Colours condition, a discrepancy not observed in ACS patients. Furthermore, ROC analysis revealed the abnormal pupil behaviors distinguished ACS patients from healthy controls with values of sensitivity and specify of 100%, thus outperforming both recognition scores and gaze duration. CONCLUSION The biological correlates of Short-Term Memory Binding impairments appear to involve a network much wider than we have thought to date, which expands across cortical and subcortical structures. We discuss these findings focusing on their implications for our understanding of neurocognitive phenotypes in the preclinical stages of Alzheimer's disease and potential development of cognitive biomarkers that can support ongoing initiatives to prevent dementia.
Collapse
Affiliation(s)
- Gerardo Fernández
- Chief Scientific Officer, ViewMind Inc., New York, NY, USA.,Axis Neurociencias, Bahía Blanca, Argentina.,Instituto de Investigaciones en Ingeniería Eléctrica (IIIE) (UNS-CONICET), Bahía Blanca, Buenos Aires, Argentina
| | - Mario A Parra
- School of Psychological Sciences and Health, University of Strathclyde, Glasgow, UK
| |
Collapse
|
16
|
Sato Y, Kitazaki M, Itakura S, Morita T, Sakuraba Y, Tomonaga M, Hirata S. Great apes' understanding of biomechanics: eye-tracking experiments using three-dimensional computer-generated animations. Primates 2021; 62:735-747. [PMID: 34302253 DOI: 10.1007/s10329-021-00932-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2020] [Accepted: 06/30/2021] [Indexed: 11/27/2022]
Abstract
Visual processing of the body movements of other animals is important for adaptive animal behaviors. It is widely known that animals can distinguish articulated animal movements even when they are just represented by points of light such that only information about biological motion is retained. However, the extent to which nonhuman great apes comprehend the underlying structural and physiological constraints affecting each moving body part, i.e., biomechanics, is still unclear. To address this, we examined the understanding of biomechanics in bonobos (Pan paniscus) and chimpanzees (Pan troglodytes), following a previous study on humans (Homo sapiens). Apes underwent eye tracking while viewing three-dimensional computer-generated (CG) animations of biomechanically possible or impossible elbow movements performed by a human, robot, or nonhuman ape. Overall, apes did not differentiate their gaze between possible and impossible movements of elbows. However, some apes looked at elbows for longer when viewing impossible vs. possible robot movements, which indicates that they may have had knowledge of biomechanics and that this knowledge could be extended to a novel agent. These mixed results make it difficult to draw a firm conclusion regarding the extent to which apes understand biomechanics. We discuss some methodological features that may be responsible for the results, as well as implications for future nonhuman animal studies involving the presentation of CG animations or measurement of gaze behaviors.
Collapse
Affiliation(s)
- Yutaro Sato
- Wildlife Research Center, Kyoto University, 2-24 Tanakasekiden, Sakyo, Kyoto, 6068203, Japan.
| | - Michiteru Kitazaki
- Department of Computer Science and Engineering, Toyohashi University of Technology, 1-1 Hibarigaoka, Tempakucho, Toyohashi, Aichi, 441-8580, Japan
| | - Shoji Itakura
- Center for Baby Science, Doshisha University, 4-1-1 Kizugawadai, Kizugawa, Kyoto, 6190225, Japan
| | - Tomoyo Morita
- Institute for Open and Transdisciplinary Research Initiatives, Osaka University, 1-1 Yamadaoka, Suita, Osaka, 5650871, Japan
| | - Yoko Sakuraba
- Wildlife Research Center, Kyoto University, 2-24 Tanakasekiden, Sakyo, Kyoto, 6068203, Japan
- Center for Research and Education of Wildlife, Kyoto City Zoo, Okazaki Koen, Okazakihoshojicho, Sakyo, Kyoto, 6068333, Japan
| | | | - Satoshi Hirata
- Wildlife Research Center, Kyoto University, 2-24 Tanakasekiden, Sakyo, Kyoto, 6068203, Japan
| |
Collapse
|
17
|
Castellotti S, Francisci C, Del Viva MM. Pupillary response to real, illusory, and implied motion. PLoS One 2021; 16:e0254105. [PMID: 34197536 PMCID: PMC8248605 DOI: 10.1371/journal.pone.0254105] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Accepted: 06/21/2021] [Indexed: 11/19/2022] Open
Abstract
The perception of moving objects (real motion) is a critical function for interacting with a dynamic environment. Motion perception can be also induced by particular structural features of static images (illusory motion) or by photographic images of subjects in motion (implied motion, IM). Many cortical areas are involved in motion processing, particularly the medial temporal cortical area (MT), dedicated to the processing of real, illusory, and implied motion. Recently, there has been a growing interest in the influence of high-level visual processes on pupillary responses. However, just a few studies have measured the effect of motion processing on the pupil, and not always with consistent results. Here we systematically investigate the effects of real, illusory, and implied motion on the pupil diameter for the first time, by showing different types of stimuli (movies, illusions, and photos) with the same average luminance to the same observers. We find different pupillary responses depending on the nature of motion. Real motion elicits a larger pupillary dilation than IM, which in turn induces more dilation than control photos representing static subjects (No-IM). The pupil response is sensitive even to the strength of IM, as photos with enhanced IM (blur, motion streaks, speed lines) induce larger dilation than simple freezed IM (subjects captured in the instant they are moving). Also, the subject represented in the stimulus matters: human figures are interpreted as more dynamic and induce larger dilation than objects/animals. Interestingly, illusory motion induces much less dilation than all the other motion categories, despite being seen as moving. Overall, pupil responses depend on the individual perception of dynamicity, confirming that the pupil is modulated by the subjective interpretation of complex stimuli. We argue that the different pupillary responses to real, illusory, and implied motion reflect the top-down modulations of different cortical areas involved in their processing.
Collapse
Affiliation(s)
| | - Carlo Francisci
- Department of Neurofarba, University of Florence, Florence, Italy
| | | |
Collapse
|
18
|
Ocular measures during associative learning predict recall accuracy. Int J Psychophysiol 2021; 166:103-115. [PMID: 34052234 DOI: 10.1016/j.ijpsycho.2021.05.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2019] [Revised: 05/19/2021] [Accepted: 05/25/2021] [Indexed: 11/20/2022]
Abstract
The ability to form associations between stimuli and commit those associations to memory is a cornerstone of human cognition. Dopamine and noradrenaline are critical neuromodulators implicated in a range of cognitive functions, including learning and memory. Eye blink rate (EBR) and pupil diameter have been shown to index dopaminergic and noradrenergic activity. Here, we examined how these ocular measures relate to accuracy in a paired-associate learning task where participants (N = 73) learned consistent object-location associations over eight trials consisting of pre-trial fixation, encoding, delay, and retrieval epochs. In order to examine how within-subject changes and between-subject changes in ocular metrics related to accuracy, we mean centered individual metric values on each trial based on within-person and across-subject means for each epoch. Within-participant variation in EBR was positively related to accuracy in both encoding and delay epochs: faster EBR within the individual predicted better retrieval. Differences in EBR across participants was negatively related to accuracy in the encoding epoch and in early trials of the pre-trial fixation: faster EBR, relative to other subjects, predicted poorer retrieval. Visual scanning behavior in pre-trial fixation and delay epochs was also positively related to accuracy in early trials: more scanning predicted better retrieval. We found no relationship between pupil diameter and accuracy. These results provide novel evidence supporting the utility of ocular metrics in illuminating cognitive and neurobiological mechanisms of paired-associate learning.
Collapse
|
19
|
Castellotti S, Conti M, Feitosa-Santana C, Del Viva MM. Pupillary response to representations of light in paintings. J Vis 2021; 20:14. [PMID: 33052409 PMCID: PMC7571318 DOI: 10.1167/jov.20.10.14] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/02/2022] Open
Abstract
It is known that, although the level of light is the primary determinant of pupil size, cognitive factors can also affect pupil diameter. It has been demonstrated that photographs of the sun produce pupil constriction independently of their luminance and other low-level features, suggesting that high-level visual processing may also modulate pupil response. Here, we measure pupil response to artistic paintings of the sun, moon, or containing a uniform lighting, that, being mediated by the artist's interpretation of reality and his technical rendering, require an even higher level of interpretation compared with photographs. We also study how chromatic content and spatial layout affect the results by presenting grey-scale and inverted versions of each painting. Finally, we assess directly with a categorization test how subjective image interpretation affects pupil response. We find that paintings with the sun elicit a smaller pupil size than paintings with the moon, or paintings containing no visible light source. The effect produced by sun paintings is reduced by disrupting contextual information, such as by removing color or manipulating the relations between paintings features that make more difficult to identify the source of light. Finally, and more importantly, pupil diameter changes according to observers’ interpretation of the scene represented in the same stimulus. In conclusion, results show that the subcortical pupillary response to light is modulated by subjective interpretation of luminous objects, suggesting the involvement of cortical systems in charge of cognitive processes, such as attention, object recognition, familiarity, memory, and imagination.
Collapse
Affiliation(s)
| | - Martina Conti
- Department of Neurofarba, University of Florence, Florence, Italy.,
| | - Claudia Feitosa-Santana
- Federal University of ABC, Sao Bernardo do Campo, Brazil.,Neuroscience for Human Development, Sao Paulo, Brazil.,
| | | |
Collapse
|
20
|
Disentangling the Association between the Insula and the Autonomic Nervous System. J Neurosci 2021; 41:3051-3053. [PMID: 33827971 DOI: 10.1523/jneurosci.2225-20.2021] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2020] [Revised: 01/06/2020] [Accepted: 01/31/2020] [Indexed: 11/21/2022] Open
|
21
|
Kafkas A. Encoding-linked pupil response is modulated by expected and unexpected novelty: Implications for memory formation and neurotransmission. Neurobiol Learn Mem 2021; 180:107412. [PMID: 33609740 DOI: 10.1016/j.nlm.2021.107412] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2020] [Revised: 12/22/2020] [Accepted: 02/14/2021] [Indexed: 12/18/2022]
Abstract
Whether a novel stimulus is expected or unexpected may have implications for the kind of ensuing encoding and the type of subsequent memory. Pupil response was used in the present study to explore the way expected and unexpected stimuli are encoded and whether encoding-linked pupil response is modulated by expectation. Participants first established a contingency relationship between a series of symbols and the type of stimulus (man-made or natural) that followed each one. At encoding, some of the target stimuli violated the previously established relationship (i.e., unexpected), while the majority conformed to this relationship (i.e., expected). Expectation at encoding had opposite effects on familiarity and recollection, the two types of memory that support recognition, and modulated differently the way pupil response predicted subsequent memory. Encoding of unexpected novel stimuli was associated with increased pupil dilation as a predictor of subsequent memory type and strength. In contrast, encoding of expected novel stimuli was associated with decreased pupil response (constriction), which was predictive of subsequent memory type and strength. The findings support the close link between pupil response and memory formation, but critically indicate that this is modulated by the type of novelty as defined by expectation. These novel findings have important implications for the encoding mechanisms involved when different types of novelty are detected and is proposed to indicate the operation of different neurotransmitters during memory formation.
Collapse
Affiliation(s)
- Alex Kafkas
- University of Manchester, School of Biological Sciences, Division of Neuroscience and Experimental Psychology, Manchester, UK.
| |
Collapse
|
22
|
Zandi B, Khanh TQ. Deep learning-based pupil model predicts time and spectral dependent light responses. Sci Rep 2021; 11:841. [PMID: 33436693 PMCID: PMC7803766 DOI: 10.1038/s41598-020-79908-5] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Accepted: 12/11/2020] [Indexed: 01/29/2023] Open
Abstract
Although research has made significant findings in the neurophysiological process behind the pupillary light reflex, the temporal prediction of the pupil diameter triggered by polychromatic or chromatic stimulus spectra is still not possible. State of the art pupil models rested in estimating a static diameter at the equilibrium-state for spectra along the Planckian locus. Neither the temporal receptor-weighting nor the spectral-dependent adaptation behaviour of the afferent pupil control path is mapped in such functions. Here we propose a deep learning-driven concept of a pupil model, which reconstructs the pupil's time course either from photometric and colourimetric or receptor-based stimulus quantities. By merging feed-forward neural networks with a biomechanical differential equation, we predict the temporal pupil light response with a mean absolute error below 0.1 mm from polychromatic (2007 [Formula: see text] 1 K, 4983 [Formula: see text] 3 K, 10,138 [Formula: see text] 22 K) and chromatic spectra (450 nm, 530 nm, 610 nm, 660 nm) at 100.01 ± 0.25 cd/m2. This non-parametric and self-learning concept could open the door to a generalized description of the pupil behaviour.
Collapse
Affiliation(s)
- Babak Zandi
- Department of Electrical Engineering and Information Technology, Laboratory of Lighting Technology, Technical University of Darmstadt, 64289, Darmstadt, Germany.
| | - Tran Quoc Khanh
- Department of Electrical Engineering and Information Technology, Laboratory of Lighting Technology, Technical University of Darmstadt, 64289, Darmstadt, Germany
| |
Collapse
|
23
|
Martin JT, Whittaker AH, Johnston SJ. Component processes in free-viewing visual search: Insights from fixation-aligned pupillary response averaging. J Vis 2020; 20:5. [PMID: 32634226 PMCID: PMC7424908 DOI: 10.1167/jov.20.7.5] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2020] [Accepted: 05/09/2020] [Indexed: 12/30/2022] Open
Abstract
Pupil size changes during a visual search may reflect cognitive processes, such as effort and memory accumulation, but methodological confounds and the general lack of literature in this area leave the reliability of findings open to question. We used a novel synthesis of experimental methods and averaging techniques to explore how cognitive processing unfolds during free-viewing visual search for multiple targets. Twenty-seven participants completed 152 searches across two separate 1-hour sessions. The number of targets present (Targets: 0, 1, 2, and 3) in each trial was the main manipulation and the task was to "find all of the targets" and report the total via mouse-click at the end of the trial. Search time lasted for 10 seconds or until the participant purported to have found all of the targets, in which case they could terminate the search via keypress. Whole-trial pupil analysis revealed a significant effect of button pressing as well as a significant main effect of targets for trials that were not self-terminated via button press. Fixation-aligned pupil responses revealed transient modulations in pupil size following initial fixations on targets but not distractors and refixations on both targets and distractors. Owing to rigorous control over experimental confounds and a detailed analysis and correction of eye-movement-related measurement error, we confidently discuss these findings in terms of task-related processing and underlying brain activity.
Collapse
Affiliation(s)
- Joel T. Martin
- School of Human and Health Sciences, Department of Psychology, University of Swansea, Swansea, Wales, UK
- Institute of Biomedical Engineering, University of Oxford, UK
| | | | - Stephen J. Johnston
- School of Human and Health Sciences, Department of Psychology, University of Swansea, Swansea, Wales, UK
| |
Collapse
|
24
|
Hu X, Hisakata R, Kaneko H. Effects of stimulus size, eccentricity, luminance, and attention on pupillary light response examined by concentric stimulus. Vision Res 2020; 170:35-45. [PMID: 32244112 DOI: 10.1016/j.visres.2020.03.008] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Revised: 03/18/2020] [Accepted: 03/18/2020] [Indexed: 12/17/2022]
Abstract
Previous studies show that the amplitude of pupillary light response (PLR) depends on the corneal flux density (CFD), which is the product of stimulus area by luminance. However, the contribution of CFD has been investigated only when the stimulus was centered on the fovea, whereas perceived luminance to pupillary response would reduce with stimulus eccentricity. Additionally, it has been shown recently that attentional state modulates pupillary response. In this study, we aimed to clarify the complete mechanisms of PLR by manipulating the stimulus size, eccentricity, luminance, and the participants' attentional states. We focused on four indices to examine PLR, that is, pupillary latency (PL), maximum constriction velocity (MCV), maximum constriction (MC), and mean pupil change (MPC). Results showed that PL was a function of CFD, whereas MCV, MC, and MPC were functions of both CFD and stimulus eccentricity. Furthermore, the magnitude of effect due to stimulus eccentricity for MCV and MC was different from that for MPC. These results provided new evidence that the different processing systems in PLR existed.
Collapse
Affiliation(s)
- Xiaofei Hu
- Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, 4259-G2-3 Nagatsuta-Cho, Midori-Ku, Yokohama 226-8502, Japan.
| | - Rumi Hisakata
- Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, 4259-G2-3 Nagatsuta-Cho, Midori-Ku, Yokohama 226-8502, Japan
| | - Hirohiko Kaneko
- Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, 4259-G2-3 Nagatsuta-Cho, Midori-Ku, Yokohama 226-8502, Japan
| |
Collapse
|
25
|
Maza A, Moliner B, Ferri J, Llorens R. Visual Behavior, Pupil Dilation, and Ability to Identify Emotions From Facial Expressions After Stroke. Front Neurol 2020; 10:1415. [PMID: 32116988 PMCID: PMC7016192 DOI: 10.3389/fneur.2019.01415] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2019] [Accepted: 12/27/2019] [Indexed: 11/16/2022] Open
Abstract
Social cognition is the innate human ability to interpret the emotional state of others from contextual verbal and non-verbal information, and to self-regulate accordingly. Facial expressions are one of the most relevant sources of non-verbal communication, and their interpretation has been extensively investigated in the literature, using both behavioral and physiological measures, such as those derived from visual activity and visual responses. The decoding of facial expressions of emotion is performed by conscious and unconscious cognitive processes that involve a complex brain network that can be damaged after cerebrovascular accidents. A diminished ability to identify facial expressions of emotion has been reported after stroke, which has traditionally been attributed to impaired emotional processing. While this can be true, an alteration in visual behavior after brain injury could also negatively contribute to this ability. This study investigated the accuracy, distribution of responses, visual behavior, and pupil dilation of individuals with stroke while identifying emotional facial expressions. Our results corroborated impaired performance after stroke and exhibited decreased attention to the eyes, evidenced by a diminished time and number of fixations made in this area in comparison to healthy subjects and comparable pupil dilation. The differences in visual behavior reached statistical significance in some emotions when comparing individuals with stroke with impaired performance with healthy subjects, but not when individuals post-stroke with comparable performance were considered. The performance dependence of visual behavior, although not determinant, might indicate that altered visual behavior could be a negatively contributing factor for emotion recognition from facial expressions.
Collapse
Affiliation(s)
- Anny Maza
- Neurorehabilitation and Brain Research Group, Instituto de Investigación e Innovación en Bioingeniería, Universitat Politècnica de València, Valencia, Spain
| | - Belén Moliner
- NEURORHB, Servicio de Neurorrehabilitación de Hospitales Vithas, Valencia, Spain
| | - Joan Ferri
- NEURORHB, Servicio de Neurorrehabilitación de Hospitales Vithas, Valencia, Spain
| | - Roberto Llorens
- Neurorehabilitation and Brain Research Group, Instituto de Investigación e Innovación en Bioingeniería, Universitat Politècnica de València, Valencia, Spain.,NEURORHB, Servicio de Neurorrehabilitación de Hospitales Vithas, Valencia, Spain
| |
Collapse
|