1
|
Becker J, Viertler M, Korn CW, Blank H. The pupil dilation response as an indicator of visual cue uncertainty and auditory outcome surprise. Eur J Neurosci 2024; 59:2686-2701. [PMID: 38469976 DOI: 10.1111/ejn.16306] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Revised: 01/05/2024] [Accepted: 02/18/2024] [Indexed: 03/13/2024]
Abstract
In everyday perception, we combine incoming sensory information with prior expectations. Expectations can be induced by cues that indicate the probability of following sensory events. The information provided by cues may differ and hence lead to different levels of uncertainty about which event will follow. In this experiment, we employed pupillometry to investigate whether the pupil dilation response to visual cues varies depending on the level of cue-associated uncertainty about a following auditory outcome. Also, we tested whether the pupil dilation response reflects the amount of surprise about the subsequently presented auditory stimulus. In each trial, participants were presented with a visual cue (face image) which was followed by an auditory outcome (spoken vowel). After the face cue, participants had to indicate by keypress which of three auditory vowels they expected to hear next. We manipulated the cue-associated uncertainty by varying the probabilistic cue-outcome contingencies: One face was most likely followed by one specific vowel (low cue uncertainty), another face was equally likely followed by either of two vowels (intermediate cue uncertainty) and the third face was followed by all three vowels (high cue uncertainty). Our results suggest that pupil dilation in response to task-relevant cues depends on the associated uncertainty, but only for large differences in the cue-associated uncertainty. Additionally, in response to the auditory outcomes, the pupil dilation scaled negatively with the cue-dependent probabilities, likely signalling the amount of surprise.
Collapse
Affiliation(s)
- Janika Becker
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Marvin Viertler
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Christoph W Korn
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
- Section Social Neuroscience, Department of General Psychiatry, University of Heidelberg, Heidelberg, Germany
| | - Helen Blank
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
2
|
Becker J, Korn CW, Blank H. Pupil diameter as an indicator of sound pair familiarity after statistically structured auditory sequence. Sci Rep 2024; 14:8739. [PMID: 38627572 PMCID: PMC11021535 DOI: 10.1038/s41598-024-59302-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Accepted: 04/09/2024] [Indexed: 04/19/2024] Open
Abstract
Inspired by recent findings in the visual domain, we investigated whether the stimulus-evoked pupil dilation reflects temporal statistical regularities in sequences of auditory stimuli. We conducted two preregistered pupillometry experiments (experiment 1, n = 30, 21 females; experiment 2, n = 31, 22 females). In both experiments, human participants listened to sequences of spoken vowels in two conditions. In the first condition, the stimuli were presented in a random order and, in the second condition, the same stimuli were presented in a sequence structured in pairs. The second experiment replicated the first experiment with a modified timing and number of stimuli presented and without participants being informed about any sequence structure. The sound-evoked pupil dilation during a subsequent familiarity task indicated that participants learned the auditory vowel pairs of the structured condition. However, pupil diameter during the structured sequence did not differ according to the statistical regularity of the pair structure. This contrasts with similar visual studies, emphasizing the susceptibility of pupil effects during statistically structured sequences to experimental design settings in the auditory domain. In sum, our findings suggest that pupil diameter may serve as an indicator of sound pair familiarity but does not invariably respond to task-irrelevant transition probabilities of auditory sequences.
Collapse
Affiliation(s)
- Janika Becker
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Martinistr. 52, 20246, Hamburg, Germany.
| | - Christoph W Korn
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Martinistr. 52, 20246, Hamburg, Germany
- Section Social Neuroscience, Department of General Psychiatry, University of Heidelberg, 69115, Heidelberg, Germany
| | - Helen Blank
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Martinistr. 52, 20246, Hamburg, Germany
| |
Collapse
|
3
|
De Filippo R, Schmitz D. Synthetic surprise as the foundation of the psychedelic experience. Neurosci Biobehav Rev 2024; 157:105538. [PMID: 38220035 PMCID: PMC10839673 DOI: 10.1016/j.neubiorev.2024.105538] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 01/03/2024] [Accepted: 01/05/2024] [Indexed: 01/16/2024]
Abstract
Psychedelic agents, such as LSD and psilocybin, induce marked alterations in consciousness via activation of the 5-HT2A receptor (5-HT2ARs). We hypothesize that psychedelics enforce a state of synthetic surprise through the biased activation of the 5-HTRs system. This idea is informed by recent insights into the role of 5-HT in signaling surprise. The effects on consciousness, explained by the cognitive penetrability of perception, can be described within the predictive coding framework where surprise corresponds to prediction error, the mismatch between predictions and actual sensory input. Crucially, the precision afforded to the prediction error determines its effect on priors, enabling a dynamic interaction between top-down expectations and incoming sensory data. By integrating recent findings on predictive coding circuitry and 5-HT2ARs transcriptomic data, we propose a biological implementation with emphasis on the role of inhibitory interneurons. Implications arise for the clinical use of psychedelics, which may rely primarily on their inherent capacity to induce surprise in order to disrupt maladaptive patterns.
Collapse
Affiliation(s)
- Roberto De Filippo
- Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität Berlin, and Berlin Institute of Health, Neuroscience Research Center, 10117 Berlin, Germany.
| | - Dietmar Schmitz
- Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität Berlin, and Berlin Institute of Health, Neuroscience Research Center, 10117 Berlin, Germany; German Center for Neurodegenerative Diseases (DZNE) Berlin, 10117 Berlin, Germany; Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität Berlin, and Berlin Institute of Health, Einstein Center for Neuroscience, 10117 Berlin, Germany; Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität Berlin, and Berlin Institute of Health, NeuroCure Cluster of Excellence, 10117 Berlin, Germany; Humboldt-Universität zu Berlin, Bernstein Center for Computational Neuroscience, Philippstr. 13, 10115 Berlin, Germany
| |
Collapse
|
4
|
Novicky F, Parr T, Friston K, Mirza MB, Sajid N. Bistable perception, precision and neuromodulation. Cereb Cortex 2024; 34:bhad401. [PMID: 37950879 PMCID: PMC10793076 DOI: 10.1093/cercor/bhad401] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 10/04/2023] [Accepted: 10/05/2023] [Indexed: 11/13/2023] Open
Abstract
Bistable perception follows from observing a static, ambiguous, (visual) stimulus with two possible interpretations. Here, we present an active (Bayesian) inference account of bistable perception and posit that perceptual transitions between different interpretations (i.e. inferences) of the same stimulus ensue from specific eye movements that shift the focus to a different visual feature. Formally, these inferences are a consequence of precision control that determines how confident beliefs are and change the frequency with which one can perceive-and alternate between-two distinct percepts. We hypothesized that there are multiple, but distinct, ways in which precision modulation can interact to give rise to a similar frequency of bistable perception. We validated this using numerical simulations of the Necker cube paradigm and demonstrate the multiple routes that underwrite the frequency of perceptual alternation. Our results provide an (enactive) computational account of the intricate precision balance underwriting bistable perception. Importantly, these precision parameters can be considered the computational homologs of particular neurotransmitters-i.e. acetylcholine, noradrenaline, dopamine-that have been previously implicated in controlling bistable perception, providing a computational link between the neurochemistry and perception.
Collapse
Affiliation(s)
- Filip Novicky
- Department of Neurophysics, Radboud University, Heyendaalseweg 135, 6525 AJ, Nijmegen, Netherlands
- Faculty of Psychology and Neuroscience, Maastricht University, Universiteitssingel 406229 ER, Maastricht, Netherlands
| | - Thomas Parr
- Wellcome Centre for Human Neuroimaging, UCL, 12 Queen Square London WC1N 3AR, United Kingdom
| | - Karl Friston
- Wellcome Centre for Human Neuroimaging, UCL, 12 Queen Square London WC1N 3AR, United Kingdom
| | - Muammer Berk Mirza
- Department of Psychology, University of Cambridge, Downing Pl, Cambridge CB2 3EB, United Kingdom
| | - Noor Sajid
- Wellcome Centre for Human Neuroimaging, UCL, 12 Queen Square London WC1N 3AR, United Kingdom
| |
Collapse
|
5
|
Esmaily J, Zabbah S, Ebrahimpour R, Bahrami B. Interpersonal alignment of neural evidence accumulation to social exchange of confidence. eLife 2023; 12:e83722. [PMID: 38128085 PMCID: PMC10746141 DOI: 10.7554/elife.83722] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2022] [Accepted: 11/09/2023] [Indexed: 12/23/2023] Open
Abstract
Private, subjective beliefs about uncertainty have been found to have idiosyncratic computational and neural substrates yet, humans share such beliefs seamlessly and cooperate successfully. Bringing together decision making under uncertainty and interpersonal alignment in communication, in a discovery plus pre-registered replication design, we examined the neuro-computational basis of the relationship between privately held and socially shared uncertainty. Examining confidence-speed-accuracy trade-off in uncertainty-ridden perceptual decisions under social vs isolated context, we found that shared (i.e. reported confidence) and subjective (inferred from pupillometry) uncertainty dynamically followed social information. An attractor neural network model incorporating social information as top-down additive input captured the observed behavior and demonstrated the emergence of social alignment in virtual dyadic simulations. Electroencephalography showed that social exchange of confidence modulated the neural signature of perceptual evidence accumulation in the central parietal cortex. Our findings offer a neural population model for interpersonal alignment of shared beliefs.
Collapse
Affiliation(s)
- Jamal Esmaily
- Department of General Psychology and Education, Ludwig Maximillian UniversityMunichGermany
- Faculty of Computer Engineering, Shahid Rajaee Teacher Training UniversityTehranIslamic Republic of Iran
- Graduate School of Systemic Neurosciences, Ludwig Maximilian University MunichMunichGermany
| | - Sajjad Zabbah
- School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM)TehranIslamic Republic of Iran
- Wellcome Centre for Human Neuroimaging, University College LondonLondonUnited Kingdom
- Max Planck UCL Centre for Computational Psychiatry and Aging Research, University College LondonLondonUnited Kingdom
| | - Reza Ebrahimpour
- Institute for Convergent Science and Technology, Sharif University of TechnologyTehranIslamic Republic of Iran
| | - Bahador Bahrami
- Department of General Psychology and Education, Ludwig Maximillian UniversityMunichGermany
- Centre for Adaptive Rationality, Max Planck Institute for Human DevelopmentBerlinGermany
| |
Collapse
|
6
|
Brancucci A, Ferracci S, D'Anselmo A, Manippa V. Hemispheric functional asymmetries and sex effects in visual bistable perception. Conscious Cogn 2023; 113:103551. [PMID: 37429212 DOI: 10.1016/j.concog.2023.103551] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2023] [Revised: 07/03/2023] [Accepted: 07/05/2023] [Indexed: 07/12/2023]
Abstract
This study investigates bistable perception as a function of the presentation side of the ambiguous figures and of participants' sex, to evaluate left-right hemispheric (LH-RH) asymmetries related to consciousness. In two experiments using the divided visual field paradigm, two Rubin's vase-faces figures were projected simultaneously and continuously 180 s long to the left (LVF) and right (RVF; Experiment 1) or to the upper (UVF) and lower (DVF; Experiment 2) visual hemifields of 48 healthy subjects monitored with eye-tracker. Experiment 1 enables stimulus segregation from the LVF to the RH and from the RVF to the LH, whereas Experiment 2 does not. Results from Experiment 1 show that males perceived the face profiles for more time in the LVF than in the RVF, with an opposite trend for the vase, whereas females show a similar pattern of perception in the two hemifields. A related result confirmed the previously reported possibility to have simultaneously two different percepts (qualia) in the two hemifields elicited by the two identic ambiguous stimuli, which was here observed to occur more frequently in males. Similar effects were not observed in Experiment 2. These findings suggest that the percepts display the processing abilities of the hemisphere currently processing the stimulus eliciting them (e.g., RH-faces), and that females and males reflect in bistable perception, a genuine manifestation of consciousness, the well-known hemispheric asymmetry differences they show in ordinary perception.
Collapse
Affiliation(s)
- Alfredo Brancucci
- Department of Motor, Human and Health Sciences, University of Rome "Foro Italico", Italy.
| | - Sara Ferracci
- Department of Neurosciences, Imaging and Clinical Sciences, University of Chieti - Pescara "G. d'Annunzio", Italy
| | - Anita D'Anselmo
- Department of Psychological, Health and Territorial Sciences, University of Chieti - Pescara "G. d'Annunzio", Italy
| | - Valerio Manippa
- Department of Education, Psychology and Communication, University of Bari "Aldo Moro", Italy
| |
Collapse
|
7
|
Wilson M, Hecker L, Joos E, Aertsen A, Tebartz van Elst L, Kornmeier J. Spontaneous Necker-cube reversals may not be that spontaneous. Front Hum Neurosci 2023; 17:1179081. [PMID: 37323933 PMCID: PMC10268006 DOI: 10.3389/fnhum.2023.1179081] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Accepted: 04/28/2023] [Indexed: 06/17/2023] Open
Abstract
Introduction During observation of the ambiguous Necker cube, our perception suddenly reverses between two about equally possible 3D interpretations. During passive observation, perceptual reversals seem to be sudden and spontaneous. A number of theoretical approaches postulate destabilization of neural representations as a pre-condition for reversals of ambiguous figures. In the current study, we focused on possible Electroencephalogram (EEG) correlates of perceptual destabilization, that may allow prediction of an upcoming perceptual reversal. Methods We presented ambiguous Necker cube stimuli in an onset-paradigm and investigated the neural processes underlying endogenous reversals as compared to perceptual stability across two consecutive stimulus presentations. In a separate experimental condition, disambiguated cube variants were alternated randomly, to exogenously induce perceptual reversals. We compared the EEG immediately before and during endogenous Necker cube reversals with corresponding time windows during exogenously induced perceptual reversals of disambiguated cube variants. Results For the ambiguous Necker cube stimuli, we found the earliest differences in the EEG between reversal trials and stability trials already 1 s before a reversal occurred, at bilateral parietal electrodes. The traces remained similar until approximately 1100 ms before a perceived reversal, became maximally different at around 890 ms (p = 7.59 × 10-6, Cohen's d = 1.35) and remained different until shortly before offset of the stimulus preceding the reversal. No such patterns were found in the case of disambiguated cube variants. Discussion The identified EEG effects may reflect destabilized states of neural representations, related to destabilized perceptual states preceding a perceptual reversal. They further indicate that spontaneous Necker cube reversals are most probably not as spontaneous as generally thought. Rather, the destabilization may occur over a longer time scale, at least 1 s before a reversal event, despite the reversal event as such being perceived as spontaneous by the viewer.
Collapse
Affiliation(s)
- Mareike Wilson
- Department of Psychiatry and Psychotherapy, Medical Center – University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
- Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany
- Faculty of Biology, University of Freiburg, Freiburg, Germany
| | - Lukas Hecker
- Department of Psychiatry and Psychotherapy, Medical Center – University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
- Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany
- Faculty of Biology, University of Freiburg, Freiburg, Germany
- Department of Psychosomatic Medicine and Psychotherapy, Medical Center – University of Freiburg, Freiburg, Germany
| | - Ellen Joos
- INSERM U1114, Cognitive Neuropsychology and Pathophysiology of Schizophrenia, Strasbourg, France
| | - Ad Aertsen
- Faculty of Biology, University of Freiburg, Freiburg, Germany
- Bernstein Center Freiburg, University of Freiburg, Freiburg, Germany
| | - Ludger Tebartz van Elst
- Department of Psychiatry and Psychotherapy, Medical Center – University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Jürgen Kornmeier
- Department of Psychiatry and Psychotherapy, Medical Center – University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
- Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany
- Faculty of Biology, University of Freiburg, Freiburg, Germany
| |
Collapse
|
8
|
Diarra M, Marchitto M, Bressolle MC, Baccino T, Drai-Zerbib V. A narrative review of the interconnection between pilot acute stress, startle, and surprise effects in the aviation context: Contribution of physiological measurements. FRONTIERS IN NEUROERGONOMICS 2023; 4:1059476. [PMID: 38234477 PMCID: PMC10790839 DOI: 10.3389/fnrgo.2023.1059476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/01/2022] [Accepted: 01/30/2023] [Indexed: 01/19/2024]
Abstract
Aviation remains one of the safest modes of transportation. However, an inappropriate response to an unexpected event can lead to flight incidents and accidents. Among several contributory factors, startle and surprise, which can lead to or exacerbate the pilot's state of stress, are often cited. Unlike stress, which has been the subject of much study in the context of driving and piloting, studies on startle and surprise are less numerous and these concepts are sometimes used interchangeably. Thus, the definitions of stress, startle, and surprise are reviewed, and related differences are put in evidence. Furthermore, it is proposed to distinguish these notions in the evaluation and to add physiological measures to subjective measures in their study. Indeed, Landman's theoretical model makes it possible to show the links between these concepts and studies using physiological parameters show that they would make it possible to disentangle the links between stress, startle and surprise in the context of aviation. Finally, we draw some perspectives to set up further studies focusing specifically on these concepts and their measurement.
Collapse
Affiliation(s)
- Moussa Diarra
- LEAD-CNRS, UMR5022, Université Bourgogne, Dijon, France
| | | | | | - Thierry Baccino
- LEAD-CNRS, UMR5022, Université Bourgogne, Dijon, France
- Université Paris 8, Saint-Denis, France
| | | |
Collapse
|
9
|
Hershman R, Milshtein D, Henik A. The contribution of temporal analysis of pupillometry measurements to cognitive research. PSYCHOLOGICAL RESEARCH 2023; 87:28-42. [PMID: 35178621 DOI: 10.1007/s00426-022-01656-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2021] [Accepted: 01/26/2022] [Indexed: 01/27/2023]
Abstract
Reaction time (RT) is one of the most frequently used measures to detect cognitive processes. When tasks require more cognitive processes/resources, reaction is slower. However, RTs may provide only restricted information regarding the temporal characteristics of cognitive processes. Pupils respond reflexively to light but also to cognitive activation. The more cognitive resources a task requires, the more the pupil dilates. However, despite being able to use temporal changes in pupil size (advanced devices measure changes in pupil diameter with sampling rates of above 1000 samples per second), most past studies using pupil dilation have not investigated temporal changes in pupil response. In the current paper, we discuss the advantage of the temporal approach to analyze pupil changes compared to a more traditional perspective, specifically, singular value methods such as mean value and peak amplitude value. Using data from two recent studies conducted in our laboratory, we demonstrate the differences in findings arising from the various analyses. In particular, we focus on the advantage of temporal analysis in detecting hidden effects, investigating temporal characterizations of the effects, and validating the experimental manipulation.
Collapse
Affiliation(s)
- Ronen Hershman
- Department of Cognitive and Brain Sciences, Ben-Gurion University of the Negev, P.O.B. 653, Beer-Sheva, Israel.
- Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, Beer-Sheva, Israel.
| | - Dalit Milshtein
- Department of Cognitive and Brain Sciences, Ben-Gurion University of the Negev, P.O.B. 653, Beer-Sheva, Israel
- Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Avishai Henik
- Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, Beer-Sheva, Israel
- Department of Psychology, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| |
Collapse
|
10
|
Hvid-Hansen A, Bækgaard P, Jacobsen N, Hjortdal J, Møller F, Kessel L. Reproducibility of Mesopic and Photopic Pupil Sizes in Myopic Children Using a Dedicated Pupillometer with Human-Assisted or Automated Reading. J Pers Med 2023; 13:jpm13020273. [PMID: 36836507 PMCID: PMC9966540 DOI: 10.3390/jpm13020273] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Accepted: 01/30/2023] [Indexed: 02/04/2023] Open
Abstract
This study aimed to investigate the reproducibility of pupil size measurements over time and between reading methods when comparing human-assisted reading to automated reading. Pupillary data were analyzed on a subset of myopic children enrolled in a multicenter randomized clinical trial on myopia control with low-dose atropine. Pupil size measurements were obtained prior to randomization at two time points (screening and baseline visits) using a dedicated pupillometer under mesopic and photopic conditions. A customized algorithm was built to perform automated readings, allowing comparisons between human-assisted and automated readings. Reproducibility analyses followed the principles of Bland and Altman and included the calculation of the mean difference between measurements and limits of agreement (LOA). We included 43 children. Mean (standard deviation) age was 9.8 (1.7) years and 25 (58%) children were girls. Using human-assisted readings, reproducibility over time showed mesopic mean difference of 0.02 mm with LOA from -0.87 mm to 0.91 mm, whereas photopic mean difference was -0.01 mm with LOA from -0.25 mm to 0.23 mm. Reproducibility between human-assisted and automated readings was also higher under photopic conditions, with mean difference of 0.03 mm and LOA from -0.03 mm to 0.10 mm at screening and mean difference of 0.03 mm and LOA from -0.06 mm to 0.12 mm at baseline. Using a dedicated pupillometer, we found that examinations performed under photopic conditions demonstrated higher reproducibility over time and between reading methods. We speculate whether mesopic measurements are sufficiently reproducible to be monitored over time. Furthermore, photopic measurements may be of greater relevance when evaluating the side effects of atropine treatment, such as photophobia.
Collapse
Affiliation(s)
- Anders Hvid-Hansen
- Department of Ophthalmology, Copenhagen University Hospital—Rigshospitalet-Glostrup, DK-2600 Glostrup, Denmark
- Correspondence:
| | - Per Bækgaard
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, DK-2800 Kongens Lyngby, Denmark
| | - Nina Jacobsen
- Department of Ophthalmology, Copenhagen University Hospital—Rigshospitalet-Glostrup, DK-2600 Glostrup, Denmark
- Department of Clinical Medicine, University of Copenhagen, DK-2200 København N, Denmark
| | - Jesper Hjortdal
- Department of Ophthalmology, Aarhus University Hospital, DK-8200 Aarhus N, Denmark
| | - Flemming Møller
- Department of Ophthalmology, University Hospital of Southern Denmark—Vejle Hospital, DK-7100 Vejle, Denmark
| | - Line Kessel
- Department of Ophthalmology, Copenhagen University Hospital—Rigshospitalet-Glostrup, DK-2600 Glostrup, Denmark
- Department of Clinical Medicine, University of Copenhagen, DK-2200 København N, Denmark
| |
Collapse
|
11
|
Colantonio J, Bascandziev I, Theobald M, Brod G, Bonawitz E. Seeing the Error in My " Bayes": A Quantified Degree of Belief Change Correlates with Children's Pupillary Surprise Responses Following Explicit Predictions. ENTROPY (BASEL, SWITZERLAND) 2023; 25:211. [PMID: 36832578 PMCID: PMC9955423 DOI: 10.3390/e25020211] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/05/2022] [Revised: 01/13/2023] [Accepted: 01/19/2023] [Indexed: 06/18/2023]
Abstract
Bayesian models allow us to investigate children's belief revision alongside physiological states, such as "surprise". Recent work finds that pupil dilation (or the "pupillary surprise response") following expectancy violations is predictive of belief revision. How can probabilistic models inform the interpretations of "surprise"? Shannon Information considers the likelihood of an observed event, given prior beliefs, and suggests stronger surprise occurs following unlikely events. In contrast, Kullback-Leibler divergence considers the dissimilarity between prior beliefs and updated beliefs following observations-with greater surprise indicating more change between belief states to accommodate information. To assess these accounts under different learning contexts, we use Bayesian models that compare these computational measures of "surprise" to contexts where children are asked to either predict or evaluate the same evidence during a water displacement task. We find correlations between the computed Kullback-Leibler divergence and the children's pupillometric responses only when the children actively make predictions, and no correlation between Shannon Information and pupillometry. This suggests that when children attend to their beliefs and make predictions, pupillary responses may signal the degree of divergence between a child's current beliefs and the updated, more accommodating beliefs.
Collapse
Affiliation(s)
- Joseph Colantonio
- Graduate School of Education, Harvard University, Cambridge, MA 02138, USA
- Psychology Department, Rutgers University, Newark, NJ 07102, USA
| | - Igor Bascandziev
- Graduate School of Education, Harvard University, Cambridge, MA 02138, USA
| | - Maria Theobald
- DIPF|Leibniz Institute for Research and Information in Education, Rostocker Str. 6, 60323 Frankfurt am Main, Germany
| | - Garvin Brod
- DIPF|Leibniz Institute for Research and Information in Education, Rostocker Str. 6, 60323 Frankfurt am Main, Germany
| | - Elizabeth Bonawitz
- Graduate School of Education, Harvard University, Cambridge, MA 02138, USA
| |
Collapse
|
12
|
Dercksen TT, Widmann A, Wetzel N. Salient omissions-pupil dilation in response to unexpected omissions of sound and touch. Front Psychiatry 2023; 14:1143931. [PMID: 37032955 PMCID: PMC10077953 DOI: 10.3389/fpsyt.2023.1143931] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Accepted: 02/21/2023] [Indexed: 04/11/2023] Open
Abstract
Introduction Recent theories describe perception as an inferential process based on internal predictive models adjusted by means of prediction violations (prediction error). To study and demonstrate predictive processing in the brain the use of unexpected stimulus omissions has been suggested as a promising approach as the evoked brain responses are uncontaminated by responses to stimuli. Here, we aimed to investigate the pupil's response to unexpected stimulus omissions in order to better understand surprise and orienting of attention resulting from prediction violation. So far only few studies have used omission in pupillometry research and results have been inconsistent. Methods This study adapted an EEG paradigm that has been shown to elicit omission responses in auditory and somatosensory modalities. Healthy adults pressed a button at their own pace, which resulted in the presentation of sounds or tactile stimuli in either 88%, 50% or 0% (motor-control) of cases. Pupil size was recorded continuously and averaged to analyze the pupil dilation response associated with each condition. Results Results revealed that omission responses were observed in both modalities in the 88%-condition compared to motor-control. Similar pupil omission responses were observed between modalities, suggesting modality-unspecific activation of the underlying brain circuits. Discussion In combination with previous omission studies using EEG, the findings demonstrate predictive models in brain processing and point to the involvement of subcortical structures in the omission response. Our pupillometry approach is especially suitable to study sensory prediction in vulnerable populations within the psychiatric field.
Collapse
Affiliation(s)
- Tjerk T. Dercksen
- Research Group Neurocognitive Development, Leibniz Institute for Neurobiology, Magdeburg, Germany
- Center for Behavioral Brain Sciences, Magdeburg, Germany
- *Correspondence: Tjerk T. Dercksen,
| | - Andreas Widmann
- Research Group Neurocognitive Development, Leibniz Institute for Neurobiology, Magdeburg, Germany
- Wilhelm Wundt Institute for Psychology, Leipzig University, Leipzig, Germany
| | - Nicole Wetzel
- Research Group Neurocognitive Development, Leibniz Institute for Neurobiology, Magdeburg, Germany
- Center for Behavioral Brain Sciences, Magdeburg, Germany
- University of Applied Sciences Magdeburg-Stendal, Stendal, Germany
| |
Collapse
|
13
|
Task-evoked pupillary responses track precision-weighted prediction errors and learning rate during interceptive visuomotor actions. Sci Rep 2022; 12:22098. [PMID: 36543845 PMCID: PMC9772236 DOI: 10.1038/s41598-022-26544-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Accepted: 12/15/2022] [Indexed: 12/24/2022] Open
Abstract
In this study, we examined the relationship between physiological encoding of surprise and the learning of anticipatory eye movements. Active inference portrays perception and action as interconnected inference processes, driven by the imperative to minimise the surprise of sensory observations. To examine this characterisation of oculomotor learning during a hand-eye coordination task, we tested whether anticipatory eye movements were updated in accordance with Bayesian principles and whether trial-by-trial learning rates tracked pupil dilation as a marker of 'surprise'. Forty-four participants completed an interception task in immersive virtual reality that required them to hit bouncing balls that had either expected or unexpected bounce profiles. We recorded anticipatory eye movements known to index participants' beliefs about likely ball bounce trajectories. By fitting a hierarchical Bayesian inference model to the trial-wise trajectories of these predictive eye movements, we were able to estimate each individual's expectations about bounce trajectories, rates of belief updating, and precision-weighted prediction errors. We found that the task-evoked pupil response tracked prediction errors and learning rates but not beliefs about ball bounciness or environmental volatility. These findings are partially consistent with active inference accounts and shed light on how encoding of surprise may shape the control of action.
Collapse
|
14
|
Stemerding LE, van Ast VA, Gerlicher AM, Kindt M. Pupil dilation and skin conductance as measures of prediction error in aversive learning. Behav Res Ther 2022; 157:104164. [DOI: 10.1016/j.brat.2022.104164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Revised: 07/08/2022] [Accepted: 07/13/2022] [Indexed: 11/02/2022]
|
15
|
Strauch C, Wang CA, Einhäuser W, Van der Stigchel S, Naber M. Pupillometry as an integrated readout of distinct attentional networks. Trends Neurosci 2022; 45:635-647. [PMID: 35662511 DOI: 10.1016/j.tins.2022.05.003] [Citation(s) in RCA: 59] [Impact Index Per Article: 29.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Revised: 04/15/2022] [Accepted: 05/09/2022] [Indexed: 10/18/2022]
Abstract
The course of pupillary constriction and dilation provides an easy-to-access, inexpensive, and noninvasive readout of brain activity. We propose a new taxonomy of factors affecting the pupil and link these to associated neural underpinnings in an ascending hierarchy. In addition to two well-established low-level factors (light level and focal distance), we suggest two further intermediate-level factors, alerting and orienting, and a higher-level factor, executive functioning. Alerting, orienting, and executive functioning - including their respective underlying neural circuitries - overlap with the three principal attentional networks, making pupil size an integrated readout of distinct states of attention. As a now widespread technique, pupillometry is ready to provide meaningful applications and constitutes a viable part of the psychophysiological toolbox.
Collapse
Affiliation(s)
- Christoph Strauch
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands.
| | - Chin-An Wang
- Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan; Cognitive Intelligence and Precision Healthcare Center, National Central University, Taoyuan City, Taiwan
| | - Wolfgang Einhäuser
- Physics of Cognition Group, Chemnitz University of Technology, Chemnitz, Germany
| | | | - Marnix Naber
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
16
|
Cho VY, Hsiao JH, Chan AB, Ngo HC, King NM, Anthonappa RP. Understanding children's attention to traumatic dental injuries using eye-tracking. Dent Traumatol 2022; 38:410-416. [PMID: 35460595 PMCID: PMC9545470 DOI: 10.1111/edt.12751] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Revised: 03/29/2022] [Accepted: 03/30/2022] [Indexed: 11/30/2022]
Abstract
BACKGROUND/AIM Traumatic dental injuries (TDIs) in the primary dentition may result in tooth discolouration and fractures. The aim of this child-centred study was to explore the differences between preschool children's eye movement patterns and visual attention to typical outcomes following TDIs to primary teeth. MATERIALS AND METHODS An eye-tracker recorded 155 healthy preschool children's eye movements when they viewed clinical images of healthy teeth, tooth fractures and discolourations. The visual search pattern was analysed using the eye movement analysis with the Hidden Markov Models (EMHMM) approach and preference for the various regions of interest (ROIs). RESULTS Two different eye movement patterns (distributed and selective) were identified (p < .05). Children with the distributed pattern shifted their fixations between the presented images, while those with the selective pattern remained focused on the same image they first saw. CONCLUSIONS Preschool children noticed teeth. However, most of them did not have an attentional bias, implying that they did not interpret these TDI outcomes negatively. Only a few children avoided looking at images with TDIs indicating a potential negative impact. The EMHMM approach is appropriate for assessing inter-individual differences in children's visual attention to TDI outcomes.
Collapse
Affiliation(s)
- Vanessa Y Cho
- Dental School, The University of Western Australia, Perth, West Australia, Australia
| | - Janet H Hsiao
- Department of Psychology, University of Hong Kong, Hong Kong City, Hong Kong.,The State Key Laboratory of Brain and Cognitive Sciences, University of Hong Kong, Hong Kong City, Hong Kong
| | - Antoni B Chan
- Department of Computer Science, City University of Hong Kong, Hong Kong City, Hong Kong
| | - Hien C Ngo
- Dental School, The University of Western Australia, Perth, West Australia, Australia
| | - Nigel M King
- Dental School, The University of Western Australia, Perth, West Australia, Australia
| | - Robert P Anthonappa
- Dental School, The University of Western Australia, Perth, West Australia, Australia
| |
Collapse
|
17
|
Suzuki Y, Liao H, Furukawa S. Temporal dynamics of auditory bistable perception correlated with fluctuation of baseline pupil size. Psychophysiology 2022; 59:e14028. [PMID: 35226355 PMCID: PMC9541800 DOI: 10.1111/psyp.14028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2021] [Revised: 01/24/2022] [Accepted: 01/24/2022] [Indexed: 11/29/2022]
Abstract
A dynamic neural network change, accompanied by cognitive shifts such as internal perceptual alternation in bistable stimuli, is reconciled by the discharge of noradrenergic locus coeruleus neurons. Transient pupil dilation as a consequence of the reconciliation with the neural network in bistable perception has been reported to precede the reported perceptual alternation. Here, we found that baseline pupil size, an index of temporal fluctuation of arousal level over a longer range of timescales than that for the transient pupil changes, relates to the frequency of perceptual alternation in auditory bistability. Baseline pupil size was defined as the mean pupil diameter over a period of 1 s prior to the task requirement (i.e., before the observation period for counting the perceptual alternations in Experiment 1 and reporting whether participants experienced the perceptual alternations in Experiment 2). The results showed that the baseline pupil size monotonically increased with an increasing number of perceptual alternations and its occurrence probability. Furthermore, a cross‐correlation analysis indicates that baseline pupil size predicted perceptual alternation at least 35 s before the behavioral response and that the overall correspondence between pupil size and perceptual alternation was maintained over a sustained time window of 45 s at minimum. The overall results suggest that variability of baseline pupil size reflects the stochastic dynamics of arousal fluctuation in the brain related to bistable perception.
Collapse
Affiliation(s)
- Yuta Suzuki
- NTT Communication Science Laboratories NTT Corporation Atsugi Japan
| | - Hsin‐I Liao
- NTT Communication Science Laboratories NTT Corporation Atsugi Japan
| | - Shigeto Furukawa
- NTT Communication Science Laboratories NTT Corporation Atsugi Japan
| |
Collapse
|
18
|
The oculomotor signature of expected surprise. Sci Rep 2022; 12:2543. [PMID: 35169177 PMCID: PMC8847614 DOI: 10.1038/s41598-022-06403-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2021] [Accepted: 01/31/2022] [Indexed: 11/09/2022] Open
Abstract
Expected surprise, defined as the anticipation of uncertainty associated with the occurrence of a future event, plays a major role in gaze shifting and spatial attention. In the present study, we analyzed its impact on oculomotor behavior. We hypothesized that the occurrence of anticipatory saccades could decrease with increasing expected surprise and that its influence on visually-guided responses could be different given the presence of sensory information and perhaps competitive attentional effects. This hypothesis was tested in humans using a saccadic reaction time task in which a cue indicated the future stimulus position. In the ‘no expected surprise’ condition, the visual target could appear only at one previously cued location. In other conditions, more likely future positions were cued with increasing expected surprise. Anticipation was more frequent and pupil size was larger in the ‘no expected surprise’ condition compared with all other conditions, probably due to increased arousal. The latency of visually-guided saccades increased linearly with the logarithm of surprise (following Hick’s law) but their maximum velocity repeated the arousal-related pattern. Therefore, expected surprise affects anticipatory and visually-guided responses differently. Moreover, these observations suggest a causal chain linking surprise, attention and saccades that could be disrupted in attentional or impulse control disorders.
Collapse
|
19
|
The confounding effects of eye blinking on pupillometry, and their remedy. PLoS One 2021; 16:e0261463. [PMID: 34919586 PMCID: PMC8683032 DOI: 10.1371/journal.pone.0261463] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2021] [Accepted: 12/02/2021] [Indexed: 11/20/2022] Open
Abstract
Pupillometry, thanks to its strong relationship with cognitive factors and recent advancements in measuring techniques, has become popular among cognitive or neural scientists as a tool for studying the physiological processes involved in mental or neural processes. Despite this growing popularity of pupillometry, the methodological understanding of pupillometry is limited, especially regarding potential factors that may threaten pupillary measurements' validity. Eye blinking can be a factor because it frequently occurs in a manner dependent on many cognitive components and induces a pulse-like pupillary change consisting of constriction and dilation with substantive magnitude and length. We set out to characterize the basic properties of this "blink-locked pupillary response (BPR)," including the shape and magnitude of BPR and their variability across subjects and blinks, as the first step of studying the confounding nature of eye blinking. Then, we demonstrated how the dependency of eye blinking on cognitive factors could confound, via BPR, the pupillary responses that are supposed to reflect the cognitive states of interest. By building a statistical model of how the confounding effects of eye blinking occur, we proposed a probabilistic-inference algorithm of de-confounding raw pupillary measurements and showed that the proposed algorithm selectively removed BPR and enhanced the statistical power of pupillometry experiments. Our findings call for attention to the presence and confounding nature of BPR in pupillometry. The algorithm we developed here can be used as an effective remedy for the confounding effects of BPR on pupillometry.
Collapse
|
20
|
Ossmy O, Han D, Kaplan BE, Xu M, Bianco C, Mukamel R, Adolph KE. Children do not distinguish efficient from inefficient actions during observation. Sci Rep 2021; 11:18106. [PMID: 34518566 PMCID: PMC8438080 DOI: 10.1038/s41598-021-97354-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Accepted: 07/13/2021] [Indexed: 11/08/2022] Open
Abstract
Observation is a powerful way to learn efficient actions from others. However, the role of observers' motor skill in assessing efficiency of others is unknown. Preschoolers are notoriously poor at performing multi-step actions like grasping the handle of a tool. Preschoolers (N = 22) and adults (N = 22) watched video-recorded actors perform efficient and inefficient tool use. Eye tracking showed that preschoolers and adults looked equally long at the videos, but adults looked longer than children at how actors grasped the tool. Deep learning analyses of participants' eye gaze distinguished efficient from inefficient grasps for adults, but not for children. Moreover, only adults showed differential action-related pupil dilation and neural activity (suppressed oscillation power in the mu frequency) while observing efficient vs. inefficient grasps. Thus, children observe multi-step actions without "seeing" whether the initial step is efficient. Findings suggest that observer's own motor efficiency determines whether they can perceive action efficiency in others.
Collapse
Affiliation(s)
- Ori Ossmy
- Department of Psychology, Center for Neural Science, New York University, 6 Washington Place, Room 403, New York, NY, 10003, USA.
| | - Danyang Han
- Department of Psychology, Center for Neural Science, New York University, 6 Washington Place, Room 403, New York, NY, 10003, USA
| | - Brianna E Kaplan
- Department of Psychology, Center for Neural Science, New York University, 6 Washington Place, Room 403, New York, NY, 10003, USA
| | - Melody Xu
- Department of Psychology, Center for Neural Science, New York University, 6 Washington Place, Room 403, New York, NY, 10003, USA
| | - Catherine Bianco
- Department of Psychology, Center for Neural Science, New York University, 6 Washington Place, Room 403, New York, NY, 10003, USA
| | - Roy Mukamel
- School of Psychological Sciences, Sagol School of Neuroscience, Tel-Aviv University, Tel Aviv, Israel
| | - Karen E Adolph
- Department of Psychology, Center for Neural Science, New York University, 6 Washington Place, Room 403, New York, NY, 10003, USA
| |
Collapse
|
21
|
Brascamp JW, de Hollander G, Wertheimer MD, DePew AN, Knapen T. Separable pupillary signatures of perception and action during perceptual multistability. eLife 2021; 10:66161. [PMID: 34378532 PMCID: PMC8378849 DOI: 10.7554/elife.66161] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2020] [Accepted: 08/11/2021] [Indexed: 02/04/2023] Open
Abstract
The pupil provides a rich, non-invasive measure of the neural bases of perception and cognition and has been of particular value in uncovering the role of arousal-linked neuromodulation, which alters both cortical processing and pupil size. But pupil size is subject to a multitude of influences, which complicates unique interpretation. We measured pupils of observers experiencing perceptual multistability-an ever-changing subjective percept in the face of unchanging but inconclusive sensory input. In separate conditions, the endogenously generated perceptual changes were either task-relevant or not, allowing a separation between perception-related and task-related pupil signals. Perceptual changes were marked by a complex pupil response that could be decomposed into two components: a dilation tied to task execution and plausibly indicative of an arousal-linked noradrenaline surge, and an overlapping constriction tied to the perceptual transient and plausibly a marker of altered visual cortical representation. Constriction, but not dilation, amplitude systematically depended on the time interval between perceptual changes, possibly providing an overt index of neural adaptation. These results show that the pupil provides a simultaneous reading on interacting but dissociable neural processes during perceptual multistability, and suggest that arousal-linked neuromodulator release shapes action but not perception in these circumstances.
Collapse
Affiliation(s)
- Jan W Brascamp
- Michigan State University, Department of Psychology, East Lansing, United States.,Michigan State University, Neuroscience Program, East Lansing, United States
| | - Gilles de Hollander
- Zurich Center for Neuroeconomics, Department of Economics, University of Zurich, Zurich, Switzerland
| | - Michael D Wertheimer
- Michigan State University, Department of Psychology, East Lansing, United States
| | - Ashley N DePew
- Michigan State University, Department of Psychology, East Lansing, United States
| | - Tomas Knapen
- Vrije Universiteit Amsterdam, Amsterdam, Netherlands.,Spinoza Centre for Neuroimaging, Royal Academy of Sciences, Amsterdam, Netherlands
| |
Collapse
|
22
|
Remembering nothing: Encoding and memory processes involved in representing empty locations. Mem Cognit 2021; 50:129-143. [PMID: 34282565 DOI: 10.3758/s13421-021-01205-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/28/2021] [Indexed: 11/08/2022]
Abstract
Previous research has provided rich evidence that a set of visual objects can be encoded in isolation along with their exact coordinate positions as well as a global configuration that provides a network of interrelated spatial information. However, much less data is available on how unoccupied locations are encoded and maintained in memory. We tested this ability in adults using a novel paradigm that involved both empty and filled locations and required participants to monitor the addition or deletion of an item, which occurred 50% of the time. Crucially, a number of locations remained hidden to the participant-thus, information on the absence of an item at a location could not be inferred from the presence of items elsewhere. We used eye-tracking to measure the proportion of target looking during encoding and the amount of pupil dilation during memory retention. Participants looked significantly longer at filled compared with empty targets, and target looking during encoding only predicted accuracy in case of filled targets. Increased pupil dilation was observed in response to an increasing number of items, while pupil diameter was unaffected by the number of empty locations. In addition, participants made significantly more errors in the conditions that involved the representation of an empty location. Our findings support the view that human adults encode exact coordinates of items in memory. In contrast, we suggest that empty locations are represented as a property of the global configuration of items and empty space, and not as independent units of information.
Collapse
|
23
|
de Gee JW, Correa CMC, Weaver M, Donner TH, van Gaal S. Pupil Dilation and the Slow Wave ERP Reflect Surprise about Choice Outcome Resulting from Intrinsic Variability in Decision Confidence. Cereb Cortex 2021; 31:3565-3578. [PMID: 33822917 PMCID: PMC8196307 DOI: 10.1093/cercor/bhab032] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2020] [Revised: 01/27/2021] [Accepted: 01/27/2021] [Indexed: 12/01/2022] Open
Abstract
Central to human and animal cognition is the ability to learn from feedback in order to optimize future rewards. Such a learning signal might be encoded and broadcasted by the brain's arousal systems, including the noradrenergic locus coeruleus. Pupil responses and the positive slow wave component of event-related potentials reflect rapid changes in the arousal level of the brain. Here, we ask whether and how these variables may reflect surprise: the mismatch between one's expectation about being correct and the outcome of a decision, when expectations fluctuate due to internal factors (e.g., engagement). We show that during an elementary decision task in the face of uncertainty both physiological markers of phasic arousal reflect surprise. We further show that pupil responses and slow wave event-related potential are unrelated to each other and that prediction error computations depend on feedback awareness. These results further advance our understanding of the role of central arousal systems in decision-making under uncertainty.
Collapse
Affiliation(s)
- Jan Willem de Gee
- Department of Psychology, Amsterdam Brain & Cognition (ABC), University of Amsterdam, Nieuwe Achtergracht 129-B, 1018WS, Amsterdam, the Netherlands
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Building N43, Martinistraße 52, 20246, Hamburg, Germany
- Department of Neuroscience, Baylor College of Medicine, 1 Baylor Plaza, Houston, TX 77030, USA
- Jan and Dan Duncan Neurological Research Institute, Texas Children’s Hospital, 1250 Moursund St, Houston, TX 77030, USA
| | - Camile M C Correa
- Department of Psychology, Amsterdam Brain & Cognition (ABC), University of Amsterdam, Nieuwe Achtergracht 129-B, 1018WS, Amsterdam, the Netherlands
- Centre of Functionally Integrative Neuroscience, Aarhus University, 44 Nørrebrogade Building 1A, 8000 Aarhus, Denmark
| | - Matthew Weaver
- Department of Psychology, Amsterdam Brain & Cognition (ABC), University of Amsterdam, Nieuwe Achtergracht 129-B, 1018WS, Amsterdam, the Netherlands
| | - Tobias H Donner
- Department of Psychology, Amsterdam Brain & Cognition (ABC), University of Amsterdam, Nieuwe Achtergracht 129-B, 1018WS, Amsterdam, the Netherlands
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Building N43, Martinistraße 52, 20246, Hamburg, Germany
| | - Simon van Gaal
- Department of Psychology, Amsterdam Brain & Cognition (ABC), University of Amsterdam, Nieuwe Achtergracht 129-B, 1018WS, Amsterdam, the Netherlands
| |
Collapse
|
24
|
Theobald M, Brod G. Tackling Scientific Misconceptions: The Element of Surprise. Child Dev 2021; 92:2128-2141. [PMID: 33969879 DOI: 10.1111/cdev.13582] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
Misconceptions about scientific concepts often prevail even if learners are confronted with conflicting evidence. This study tested the facilitative role of surprise in children's revision of misconceptions regarding water displacement in a sample of German children (N = 94, aged 6-9 years, 46% female). Surprise was measured via the pupil dilation response. It was induced by letting children generate predictions before presenting them with outcomes that conflicted with their misconception. Compared to a control condition, generating predictions boosted children's surprise and led to a greater revision of misconceptions (d = 0.56). Surprise further predicted successful belief revision during the learning phase. These results suggest that surprise increases the salience of a cognitive conflict, thereby facilitating the revision of misconceptions.
Collapse
Affiliation(s)
- Maria Theobald
- DIPF, Leibniz Institute for Research and Information in Education.,Center for Individual Development and Adaptive Education of Children at Risk (IDeA)
| | - Garvin Brod
- DIPF, Leibniz Institute for Research and Information in Education.,Center for Individual Development and Adaptive Education of Children at Risk (IDeA).,Goethe University Frankfurt
| |
Collapse
|
25
|
Quent JA, Henson RN, Greve A. A predictive account of how novelty influences declarative memory. Neurobiol Learn Mem 2021; 179:107382. [PMID: 33476747 PMCID: PMC8024513 DOI: 10.1016/j.nlm.2021.107382] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2020] [Revised: 11/08/2020] [Accepted: 01/10/2021] [Indexed: 01/13/2023]
Abstract
A rich body of studies in the human and non-human literature has examined the question how novelty influences memory. For a variety of different stimuli, ranging from simple objects and words to vastly complex scenarios, the literature reports that novelty improves memory in some cases, but impairs memory in other cases. In recent attempts to reconcile these conflicting findings, novelty has been divided into different subtypes, such as relative versus absolute novelty, or stimulus versus contextual novelty. Nevertheless, a single overarching theory of novelty and memory has been difficult to attain, probably due to the complexities in the interactions among stimuli, environmental factors (e.g., spatial and temporal context) and level of prior knowledge (but see Duszkiewicz et al., 2019; Kafkas & Montaldi, 2018b; Schomaker & Meeter, 2015). Here we describe how a predictive coding framework might be able to shed new light on different types of novelty and how they affect declarative memory in humans. More precisely, we consider how prior expectations modulate the influence of novelty on encoding episodes into memory, e.g., in terms of surprise, and how novelty/surprise affect memory for surrounding information. By reviewing a range of behavioural findings and their possible underlying neurobiological mechanisms, we highlight where a predictive coding framework succeeds and where it appears to struggle.
Collapse
Affiliation(s)
| | - Richard N Henson
- MRC Cognition and Brain Sciences Unit, University of Cambridge, United Kingdom; Department of Psychiatry, University of Cambridge, United Kingdom
| | - Andrea Greve
- MRC Cognition and Brain Sciences Unit, University of Cambridge, United Kingdom
| |
Collapse
|
26
|
Kanari K, Kaneko H. Pupil response is modulated with optokinetic nystagmus in transparent motion. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2021; 38:149-156. [PMID: 33690525 DOI: 10.1364/josaa.409940] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/21/2020] [Accepted: 12/06/2020] [Indexed: 06/12/2023]
Abstract
When two visual patterns moving in opposite directions are superimposed on the same depth plane, they appear to have two transparent surfaces moving independently (transparent motion). Additionally, the direction of the slow phase of optokinetic nystagmus (OKN) corresponds to the direction of motion that dominates the perceptual appearance. This study examines whether pupil changes correspond to the luminance of the dominated objects related to the transition of the slow-phase direction in OKN following objects. Stimuli consisted of two random dot patterns of different luminance that moved in opposite directions. The results showed that pupil size changed in accordance with the luminance of the pattern in the slow phase of OKN immediately after OKN transition. This suggests that pupil size is modulated with OKN in transparent motion.
Collapse
|
27
|
Cazettes F, Reato D, Morais JP, Renart A, Mainen ZF. Phasic Activation of Dorsal Raphe Serotonergic Neurons Increases Pupil Size. Curr Biol 2021; 31:192-197.e4. [PMID: 33186549 PMCID: PMC7808753 DOI: 10.1016/j.cub.2020.09.090] [Citation(s) in RCA: 48] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2020] [Revised: 08/17/2020] [Accepted: 09/30/2020] [Indexed: 11/27/2022]
Abstract
Transient variations in pupil size (PS) under constant luminance are coupled to rapid changes in arousal state,1-3 which have been interpreted as vigilance,4 salience,5 or a surprise signal.6-8 Neural control of such fluctuations presumably involves multiple brain regions5,9-11 and neuromodulatory systems,3,12,13 but it is often associated with phasic activity of the noradrenergic system.9,12,14,15 Serotonin (5-HT), a neuromodulator also implicated in aspects of arousal16 such as sleep-wake transitions,17 motivational state regulation,18 and signaling of unexpected events,19 seems to affect PS,20-24 but these effects have not been investigated in detail. Here we show that phasic 5-HT neuron stimulation causes transient PS changes. We used optogenetic activation of 5-HT neurons in the dorsal raphe nucleus (DRN) of head-fixed mice performing a foraging task. 5-HT-driven modulations of PS were maintained throughout the photostimulation period and sustained for a few seconds after the end of stimulation. We found no evidence that the increase in PS with activation of 5-HT neurons resulted from interactions of photostimulation with behavioral variables, such as locomotion or licking. Furthermore, we observed that the effect of 5-HT on PS depended on the level of environmental uncertainty, consistent with the idea that 5-HT could report a surprise signal.19 These results advance our understanding of the neuromodulatory control of PS, revealing a tight relationship between phasic activation of 5-HT neurons and changes in PS.
Collapse
Affiliation(s)
- Fanny Cazettes
- Champalimaud Centre for the Unknown, 1400-038 Lisbon, Portugal.
| | - Davide Reato
- Champalimaud Centre for the Unknown, 1400-038 Lisbon, Portugal
| | - João P Morais
- Champalimaud Centre for the Unknown, 1400-038 Lisbon, Portugal
| | - Alfonso Renart
- Champalimaud Centre for the Unknown, 1400-038 Lisbon, Portugal
| | | |
Collapse
|
28
|
Abstract
Pupil size is an easily accessible, noninvasive online indicator of various perceptual and cognitive processes. Pupil measurements have the potential to reveal continuous processing dynamics throughout an experimental trial, including anticipatory responses. However, the relatively sluggish (~2 s) response dynamics of pupil dilation make it challenging to connect changes in pupil size to events occurring close together in time. Researchers have used models to link changes in pupil size to specific trial events, but such methods have not been systematically evaluated. Here we developed and evaluated a general linear model (GLM) pipeline that estimates pupillary responses to multiple rapid events within an experimental trial. We evaluated the modeling approach using a sample dataset in which multiple sequential stimuli were presented within 2-s trials. We found: (1) Model fits improved when the pupil impulse response function (PuRF) was fit for each observer. PuRFs varied substantially across individuals but were consistent for each individual. (2) Model fits also improved when pupil responses were not assumed to occur simultaneously with their associated trial events, but could have non-zero latencies. For example, pupil responses could anticipate predictable trial events. (3) Parameter recovery confirmed the validity of the fitting procedures, and we quantified the reliability of the parameter estimates for our sample dataset. (4) A cognitive task manipulation modulated pupil response amplitude. We provide our pupil analysis pipeline as open-source software (Pupil Response Estimation Toolbox: PRET) to facilitate the estimation of pupil responses and the evaluation of the estimates in other datasets.
Collapse
|
29
|
Csink V, Mareschal D, Gliga T. Does surprise enhance infant memory? Assessing the impact of the encoding context on subsequent object recognition. INFANCY 2021; 26:303-318. [PMID: 33405346 DOI: 10.1111/infa.12383] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2020] [Revised: 10/26/2020] [Accepted: 12/08/2020] [Indexed: 11/30/2022]
Abstract
A discrepancy between what was predicted and what is observed has been linked to increased looking times, changes in brain electrical activity, and increased pupil dilation in infants. These processes associated with heightened attention and readiness to learn might enhance the encoding and memory consolidation of the surprising object, as suggested by both the infant and the adult literature. We therefore investigated whether the presence of surprise during the encoding context enhances subsequent encoding and recognition memory processes for the items that violated infants' expectations. Seventeen-month-olds viewed 20 familiar objects, half of which were labeled correctly, while the other half were mislabeled. Subsequently, infants were presented with a silent recognition memory test where the previously labeled objects appeared along with new images. Pupil dilation was measured, with more dilated pupils indicating (1) surprise during those labeling events where the item was mislabeled and (2) successful retrieval processes during the memory test. Infants responded with more pupil dilation to mislabeling compared to correct labeling. Importantly, despite the presence of a surprise response during mislabeling, infants only differentiated between the previously seen and unseen items at the memory test, offering no evidence that surprise had facilitated the encoding of the mislabeled items.
Collapse
Affiliation(s)
- Viktoria Csink
- Department of Psychological Sciences, Birkbeck University of London, London, UK
| | - Denis Mareschal
- Department of Psychological Sciences, Birkbeck University of London, London, UK
| | - Teodora Gliga
- School of Psychology, Norwich Research Park, University of East Anglia, Norwich, UK
| |
Collapse
|
30
|
Influence of content and intensity of thought on behavioral and pupil changes during active mind-wandering, off-focus, and on-task states. Atten Percept Psychophys 2020; 82:1125-1135. [PMID: 31515772 PMCID: PMC7303097 DOI: 10.3758/s13414-019-01865-7] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Mind wandering (MW) is a pervasive phenomenon that occurs very frequently, regardless of the task. A content-based definition of MW holds that it occurs when the content of thought switches from an ongoing task and/or an external stimulus-driven event to self-generated or inner thoughts. A recent account suggests that the transition between these different states of attention occurs via an off-focus state. Following this suggestion, previous work relating MW to pupil size might have lumped attentional states that are critically different from each (i.e., off-focus and MW states). In the present study, both behavior and pupil size were measured during a sustained-attention-to-response task, to disentangle the content of thought (on task or MW) from an off-focus state of mind. The off-focus state was operationalized by probing the intensity with which participants were on task or mind-wandering. The results of two experiments showed that the behavioral and phasic pupillary responses were sensitive to changes related to the content of thought. The behavioral responses were furthermore related to the intensity of the thought. However, no clear relation between the different attentional states and tonic pupillary diameter was found, suggesting that it is an unreliable proxy for MW.
Collapse
|
31
|
Tan Q, Ng AL, Cheng GP, Woo VC, Cho P. Repeatability of pupil size measurements with NIDEK OPD-Scan III in myopic children. Ophthalmic Physiol Opt 2020; 41:431-436. [PMID: 33294971 DOI: 10.1111/opo.12774] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2020] [Accepted: 11/03/2020] [Indexed: 12/28/2022]
Abstract
OBJECTIVE To investigate the repeatability of pupil size measurements, determined from the NIDEK OPD-Scan III, of myopic eyes in children wearing single-vision spectacles (SVS), undergoing orthokeratology (OK) and receiving combined treatment of 0.01% atropine and orthokeratology (AOK). METHODS A single examiner took two sets of mesopic pupil size measurements from the right eyes of 80 children (SVS:16, OK: 34, AOK: 30) (mesopic 1 and mesopic 2) and two sets of photopic (photopic 1 and photopic 2) pupil size measurements (internal light source) using the NIDEK OPD-Scan III. Each set was taken at a single visit, 15 min apart. Subjects in the OK and AOK groups had undergone treatment for at least 6 months, and the SVS subjects had no previous myopia treatment other than wearing spectacles. Repeatability of measurements was analysed using intraclass correlation coefficient (ICC), Bland-Altman (BA) plot, and coefficient of repeatability (CoR). RESULTS Mesopic 1 and 2 values were not significantly different among the three groups (p = 0.56, 0.77), hence the data were pooled for each set of measurements (mean [±S.D.] values were 7.09 ± 0.61 and 7.12 ± 0.61 mm, respectively) for further analyses. ICC for repeated mesopic pupil size measurements was 0.98 (95% CI, 0.98-0.99). No significant correlation was found between the means of the mesopic 1 and 2 measurements and their differences (Pearson's r = -0.02, p = 0.83). A BA plot also demonstrated narrow 95% limits of agreement, with a CoR of 0.28 mm. Mean photopic 1 and 2 measurements for the AOK group (3.74 ± 0.46; 3.73 ± 0.43 mm, respectively) were significantly larger (p = 0.01; 0.009) than those of the SVS and OK groups, but no significant difference was found between the latter two groups (p > 0.05). Hence, photopic 1 and 2 measurements for the SVS and OK groups were pooled (SVS-OK) for further analyses. ICC for repeatability of the photopic measurements was 0.98 (95% CI, 0.96 to 0.99) for the SVS-OK and AOK groups. The differences between photopic 1 and 2 measurements were not significantly correlated with their means, either in the AOK group (Pearson's r = -0.25, p = 0.19), or in the pooled SVS-OK group (Pearson's r = -0.04, p = 0.78). BA plots also showed narrow 95% limits of agreement, and CoR was 0.25 mm and 0.23 mm in the AOK and pooled SVS-OK groups, respectively. CONCLUSION Mesopic and photopic pupil size measurement using the NIDEK OPD-Scan III was highly repeatable and suitable for use on children.
Collapse
Affiliation(s)
- Qi Tan
- School of Optometry, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Alex Lk Ng
- Department of Ophthalmology, The University of Hong Kong, Hong Kong SAR, China.,Hong Kong Ophthalmic Associates, Hong Kong SAR, China
| | | | - Victor Cp Woo
- Department of Ophthalmology, The University of Hong Kong, Hong Kong SAR, China.,Hong Kong Ophthalmic Associates, Hong Kong SAR, China
| | - Pauline Cho
- School of Optometry, The Hong Kong Polytechnic University, Hong Kong SAR, China
| |
Collapse
|
32
|
Pajkossy P, Szőllősi Á, Racsmány M. Pupil size changes signal hippocampus-related memory functions. Sci Rep 2020; 10:16393. [PMID: 33009460 PMCID: PMC7532445 DOI: 10.1038/s41598-020-73374-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2020] [Accepted: 09/14/2020] [Indexed: 11/08/2022] Open
Abstract
A major task of episodic memory is to create unique, distinguishable representations of highly overlapping perceptual inputs. Several studies on this basic function have shown that it is based on the intact functioning of certain subregions of the hippocampus and is among the most sensitive behavioral indicators of mild cognitive impairment (MCI) and dementia. Here we assessed pupil dilation associated with performance in a widely used recognition paradigm that aims to uncover the intactness of fine-graded mnemonic discrimination. A sample of healthy undergraduate students was used. First, we showed that the correct discrimination between highly similar lure items and target items elicit larger pupil response than correct target identification. Second, we found that mnemonic discrimination is associated with larger pupil response in general as compared to target identification, regardless of whether the response was correct or not. These results suggest the pupil changes differentiate mnemonic discrimination and memory identification processes in recognition performance.
Collapse
Affiliation(s)
- Péter Pajkossy
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Magyar tudósok körútja 2, 1117, Budapest, Hungary.
- Department of Cognitive Science, Budapest University of Technology and Economics, Egry József u. 1, 1111, Budapest, Hungary.
| | - Ágnes Szőllősi
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Magyar tudósok körútja 2, 1117, Budapest, Hungary
- Department of Cognitive Science, Budapest University of Technology and Economics, Egry József u. 1, 1111, Budapest, Hungary
| | - Mihály Racsmány
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Magyar tudósok körútja 2, 1117, Budapest, Hungary
- Department of Cognitive Science, Budapest University of Technology and Economics, Egry József u. 1, 1111, Budapest, Hungary
| |
Collapse
|
33
|
Becker M, Kühn S, Sommer T. Verbal insight revisited — dissociable neurocognitive processes underlying solutions accompanied by an AHA! experience with and without prior restructuring. JOURNAL OF COGNITIVE PSYCHOLOGY 2020. [DOI: 10.1080/20445911.2020.1819297] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Affiliation(s)
- Maxi Becker
- University Medical Centre Hamburg-Eppendorf, Clinic and Policlinic for Psychiatry and Psychotherapy, Hamburg, Germany
- Humboldt University, Department of Psychology, Berlin, Germany
| | - Simone Kühn
- University Medical Centre Hamburg-Eppendorf, Clinic and Policlinic for Psychiatry and Psychotherapy, Hamburg, Germany
- Max Planck Institute for Human Development, Center for Lifespan Psychology, Berlin, Germany
| | - Tobias Sommer
- University Medical Centre Hamburg-Eppendorf, Department of Systems Neuroscience, NeuroImage Nord, Hamburg, Germany
| |
Collapse
|
34
|
Ganea DA, Bexter A, Günther M, Gardères PM, Kampa BM, Haiss F. Pupillary Dilations of Mice Performing a Vibrotactile Discrimination Task Reflect Task Engagement and Response Confidence. Front Behav Neurosci 2020; 14:159. [PMID: 33088265 PMCID: PMC7494826 DOI: 10.3389/fnbeh.2020.00159] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2020] [Accepted: 08/11/2020] [Indexed: 11/23/2022] Open
Abstract
Pupillometry, the measure of pupil size and reactivity, has been widely used to assess cognitive processes. Changes in pupil size have been shown to correlate with various behavioral states, both externally and internally induced such as locomotion, arousal, cortical state, and decision-making processes. Besides, these pupillary responses have also been linked to the activity of neuromodulatory systems that modulate attention and perception such as the noradrenergic and cholinergic systems. Due to the extent of processes the pupil reflects, we aimed at further resolving pupillary responses in the context of behavioral state and task performance while recording pupillary transients of mice performing a vibrotactile two-alternative forced-choice task (2-AFC). We show that before the presentation of task-relevant information, pre-stimulus, pupil size differentiates between states of disengagement from task performance vs. engagement. Also, when subjects have to attend to task stimuli to attain a reward, post-stimulus, pupillary dilations exhibit a difference between correct and error responses with this difference reflecting an internal decision variable. We hypothesize that this internal decision variable relates to response confidence, the internal perception of the confidence the subject has in its choice. As opposed to this, we show that in a condition of passive performance, when the stimulus has no more task relevance due to reward being provided automatically, pupillary dilations reflect the occurrence of stimulation and reward provision but not decisional variables as under active performance. Our results provide evidence that in addition to reflecting attentiveness under task performance rather than arousal per se, pupil dilations also reflect the confidence of the subject in his ensuing response. This confidence coding is overlaid within a more pronounced pupil dilation that reflects post-decision components that are related to the response itself but not to the decision. We also provide evidence as to how different behavioral states, imposed by task demands, modulate what the pupil is reflecting, presumably showing what the underlying cognitive network is coding for.
Collapse
Affiliation(s)
- Dan Alin Ganea
- IZKF, Medical Faculty, RWTH Aachen University, Aachen, Germany.,Institute of Neuropathology, RWTH Aachen University, Aachen, Germany.,Department of Ophthalmology, RWTH Aachen University, Aachen, Germany
| | - Alexander Bexter
- Department of Neurophysiology, Institute of Zoology, RWTH Aachen University, Aachen, Germany.,Research Training Group 2416 MultiSenses-MultiScales, RWTH Aachen University, Aachen, Germany
| | - Mathias Günther
- IZKF, Medical Faculty, RWTH Aachen University, Aachen, Germany.,Institute of Neuropathology, RWTH Aachen University, Aachen, Germany.,Department of Ophthalmology, RWTH Aachen University, Aachen, Germany
| | - Pierre-Marie Gardères
- IZKF, Medical Faculty, RWTH Aachen University, Aachen, Germany.,Institute of Neuropathology, RWTH Aachen University, Aachen, Germany.,Department of Ophthalmology, RWTH Aachen University, Aachen, Germany.,Unit of Neural Circuits Dynamics and Decision Making, Institut Pasteur, Paris, France
| | - Björn M Kampa
- Department of Neurophysiology, Institute of Zoology, RWTH Aachen University, Aachen, Germany.,Research Training Group 2416 MultiSenses-MultiScales, RWTH Aachen University, Aachen, Germany.,JARA-BRAIN Institute Molecular Neuroscience and Neuroimaging, Jülich Forschungszentrum, Jülich, Germany
| | - Florent Haiss
- IZKF, Medical Faculty, RWTH Aachen University, Aachen, Germany.,Institute of Neuropathology, RWTH Aachen University, Aachen, Germany.,Department of Ophthalmology, RWTH Aachen University, Aachen, Germany.,Unit of Neural Circuits Dynamics and Decision Making, Institut Pasteur, Paris, France
| |
Collapse
|
35
|
Breitwieser J, Brod G. Cognitive Prerequisites for Generative Learning: Why Some Learning Strategies Are More Effective Than Others. Child Dev 2020; 92:258-272. [PMID: 32677082 DOI: 10.1111/cdev.13393] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
This study examined age-related differences in the effectiveness of two generative learning strategies (GLSs). Twenty-five children aged 9-11 and 25 university students aged 17-29 performed a facts learning task in which they had to generate either a prediction or an example before seeing the correct result. We found a significant Age × Learning Strategy interaction, with children remembering more facts after generating predictions rather than examples, whereas both strategies were similarly effective in adults. Pupillary data indicated that predictions stimulated surprise, whereas the effectiveness of example-based learning correlated with children's analogical reasoning abilities. These findings suggest that there are different cognitive prerequisites for different GLSs, which results in varying degrees of strategy effectiveness by age.
Collapse
Affiliation(s)
| | - Garvin Brod
- DIPF, Leibniz Institute for Research and Information in Education.,Goethe University Frankfurt
| |
Collapse
|
36
|
Martin JT, Whittaker AH, Johnston SJ. Component processes in free-viewing visual search: Insights from fixation-aligned pupillary response averaging. J Vis 2020; 20:5. [PMID: 32634226 PMCID: PMC7424908 DOI: 10.1167/jov.20.7.5] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2020] [Accepted: 05/09/2020] [Indexed: 12/30/2022] Open
Abstract
Pupil size changes during a visual search may reflect cognitive processes, such as effort and memory accumulation, but methodological confounds and the general lack of literature in this area leave the reliability of findings open to question. We used a novel synthesis of experimental methods and averaging techniques to explore how cognitive processing unfolds during free-viewing visual search for multiple targets. Twenty-seven participants completed 152 searches across two separate 1-hour sessions. The number of targets present (Targets: 0, 1, 2, and 3) in each trial was the main manipulation and the task was to "find all of the targets" and report the total via mouse-click at the end of the trial. Search time lasted for 10 seconds or until the participant purported to have found all of the targets, in which case they could terminate the search via keypress. Whole-trial pupil analysis revealed a significant effect of button pressing as well as a significant main effect of targets for trials that were not self-terminated via button press. Fixation-aligned pupil responses revealed transient modulations in pupil size following initial fixations on targets but not distractors and refixations on both targets and distractors. Owing to rigorous control over experimental confounds and a detailed analysis and correction of eye-movement-related measurement error, we confidently discuss these findings in terms of task-related processing and underlying brain activity.
Collapse
Affiliation(s)
- Joel T. Martin
- School of Human and Health Sciences, Department of Psychology, University of Swansea, Swansea, Wales, UK
- Institute of Biomedical Engineering, University of Oxford, UK
| | | | - Stephen J. Johnston
- School of Human and Health Sciences, Department of Psychology, University of Swansea, Swansea, Wales, UK
| |
Collapse
|
37
|
Risk prediction error signaling: A two-component response? Neuroimage 2020; 214:116766. [PMID: 32247756 DOI: 10.1016/j.neuroimage.2020.116766] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2018] [Revised: 03/17/2020] [Accepted: 03/18/2020] [Indexed: 01/10/2023] Open
Abstract
Organisms use rewards to navigate and adapt to (uncertain) environments. Error-based learning about rewards is supported by the dopaminergic system, which is thought to signal reward prediction errors to make adjustments to past predictions. More recently, the phasic dopamine response was suggested to have two components: the first rapid component is thought to signal the detection of a potentially rewarding stimulus; the second, slightly later component characterizes the stimulus by its reward prediction error. Error-based learning signals have also been found for risk. However, whether the neural generators of these signals employ a two-component coding scheme like the dopaminergic system is unknown. Here, using human high density EEG, we ask whether risk learning, or more generally speaking surprise-based learning under uncertainty, is similarly comprised of two temporally dissociable components. Using a simple card game, we show that the risk prediction error is reflected in the amplitude of the P3b component. This P3b modulation is preceded by an earlier component, that is modulated by the stimulus salience. Source analyses are compatible with the idea that both the early salience signal and the later risk prediction error signal are generated in insular, frontal, and temporal cortex. The identified sources are parts of the risk processing network that receives input from noradrenergic cells in the locus coeruleus. Finally, the P3b amplitude modulation is mirrored by an analogous modulation of pupil size, which is consistent with the idea that both the P3b and pupil size indirectly reflect locus coeruleus activity.
Collapse
|
38
|
Brod G, Breitwieser J, Hasselhorn M, Bunge SA. Being proven wrong elicits learning in children – but only in those with higher executive function skills. Dev Sci 2020; 23:e12916. [DOI: 10.1111/desc.12916] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2018] [Revised: 09/01/2019] [Accepted: 10/11/2019] [Indexed: 12/29/2022]
Affiliation(s)
- Garvin Brod
- Center for Individual Development and Adaptive Education of Children at Risk (IDeA) Frankfurt Germany
- DIPF
- Leibniz Institute for Research and Information in Education Frankfurt Germany
- Department of Psychology Goethe University Frankfurt Germany
| | - Jasmin Breitwieser
- Center for Individual Development and Adaptive Education of Children at Risk (IDeA) Frankfurt Germany
- DIPF
- Leibniz Institute for Research and Information in Education Frankfurt Germany
| | - Marcus Hasselhorn
- Center for Individual Development and Adaptive Education of Children at Risk (IDeA) Frankfurt Germany
- DIPF
- Leibniz Institute for Research and Information in Education Frankfurt Germany
- Department of Psychology Goethe University Frankfurt Germany
| | - Silvia A. Bunge
- Department of Psychology & Helen Wills Neuroscience Institute University of California, Berkeley Berkeley CA USA
| |
Collapse
|
39
|
Davidson MJ, Graafsma IL, Tsuchiya N, van Boxtel J. A multiple-response frequency-tagging paradigm measures graded changes in consciousness during perceptual filling-in. Neurosci Conscious 2020; 2020:niaa002. [PMID: 32296545 PMCID: PMC7151726 DOI: 10.1093/nc/niaa002] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2019] [Revised: 02/07/2020] [Accepted: 02/20/2020] [Indexed: 11/14/2022] Open
Abstract
Perceptual filling-in (PFI) occurs when a physically present visual target disappears from conscious perception, with its location filled-in by the surrounding visual background. These perceptual changes are complete, near instantaneous, and can occur for multiple separate locations simultaneously. Here, we show that contrasting neural activity during the presence or absence of multi-target PFI can complement other findings from multistable phenomena to reveal the neural correlates of consciousness (NCC). We presented four peripheral targets over a background dynamically updating at 20 Hz. While participants reported on target disappearances/reappearances via button press/release, we tracked neural activity entrained by the background during PFI using steady-state visually evoked potentials (SSVEPs) recorded in the electroencephalogram. We found background SSVEPs closely correlated with subjective report, and increased with an increasing amount of PFI. Unexpectedly, we found that as the number of filled-in targets increased, the duration of target disappearances also increased, suggesting that facilitatory interactions exist between targets in separate visual quadrants. We also found distinct spatiotemporal correlates for the background SSVEP harmonics. Prior to genuine PFI, the response at the second harmonic (40 Hz) increased before the first (20 Hz), which we tentatively link to an attentional effect, while no such difference between harmonics was observed for physically removed stimuli. These results demonstrate that PFI can be used to study multi-object perceptual suppression when frequency-tagging the background of a visual display, and because there are distinct neural correlates for endogenously and exogenously induced changes in consciousness, that it is ideally suited to study the NCC.
Collapse
Affiliation(s)
- Matthew J Davidson
- School of Psychological Sciences, Faculty of Medicine, Nursing and Health Sciences, Monash University, Melbourne, Australia
| | - Irene L Graafsma
- Department of Psychology, University of Amsterdam, Amsterdam 1001 NK, the Netherlands.,Department of Cognitive Science, Macquarie University, Sydney, Australia.,Center for Language and Cognition Groningen (CLCG), University of Groningen, the Netherlands
| | - Naotsugu Tsuchiya
- School of Psychological Sciences, Faculty of Medicine, Nursing and Health Sciences, Monash University, Melbourne, Australia.,Turner Institute for Brain and Mental Health, Faculty of Medicine, Nursing and Health Sciences, Monash University, Melbourne, Australia.,Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology (NICT), Suita, Osaka 565-0871, Japan.,Advanced Telecommunications Research Computational Neuroscience Laboratories, 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288, Japan
| | - Jeroen van Boxtel
- School of Psychological Sciences, Faculty of Medicine, Nursing and Health Sciences, Monash University, Melbourne, Australia.,Department of Psychology, Faculty of Health, University of Canberra, Canberra, Australia
| |
Collapse
|
40
|
Sato F, Laeng B, Nakauchi S, Minami T. Cueing the Necker cube: Pupil dilation reflects the viewing-from-above constraint in bistable perception. J Vis 2020; 20:7. [PMID: 32293651 PMCID: PMC7405692 DOI: 10.1167/jov.20.4.7] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
We hypothesized that a perceptually ambiguous or bistable object (Necker cube) can be more effectively biased to assume a point of view-from-above (VFA) than from below the object by cueing attention. Participants viewed a Necker cube in which one surface was temporarily shaded so as to prime a specific perspective on the cube. Subsequently, the standard (wireframe) Necker cube was viewed for 3 seconds, and participants reported what perspective they had seen initially and whether their perception shifted to the alternative perspective during the brief viewing. Concomitantly, pupil size was monitored with an eye-tracker to obtain an index of cognitive effort. There were two conditions: passive viewing and forced attention to sustain the initially primed perspective. We confirmed the presence of a VFA bias with forced attention, which was accompanied by reduced attentional effort, as indexed by a reduced pupil diameter, compared with the view-from-below. Participants showed no bias during passive viewing. We suggest that the level of intensive attention, when retrieving and maintaining a specific view from memory, is mirrored in the size of the eye pupils and may reflect ecological constraints on visual perception.
Collapse
|
41
|
Naber M, Murphy P. Pupillometric investigation into the speed-accuracy trade-off in a visuo-motor aiming task. Psychophysiology 2019; 57:e13499. [PMID: 31736089 PMCID: PMC7027463 DOI: 10.1111/psyp.13499] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2019] [Revised: 09/25/2019] [Accepted: 10/22/2019] [Indexed: 12/22/2022]
Abstract
Convergent lines of evidence suggest that fluctuations in the size of the pupil may be associated with the trade‐off between the speed (adrenergic, sympathetic) and accuracy (cholinergic, parasympathetic) of behavior across a variety of task contexts. Here, we explored whether pupil size was related to this trade‐off during a visuospatial motor aiming task. Participants were shown visual targets at random locations on a screen and were instructed and incentivized to move a computer mouse‐controlled cursor to the center of the targets, either as fast as possible, as accurately as possible, or to strike a balance between the two. Behavioral results showed that these instructions led to typical speed‐accuracy trade‐off effects on movement reaction times and hit distances to target centers. Pupillometric analyses revealed that movements were faster and less accurate when participants had relatively large baseline pupil sizes, as measured before target onset. Furthermore, trial‐evoked pupil dilation was related specifically to a bias toward speed in the trade‐off and the speed of the ballistic and error‐correction phases of the motor responses such that larger pupils predicted shorter latencies and higher movement speeds. Pupil responses were also associated with performance in a manner that may reflect the combined influence of a number of factors, including the generation of dynamic urgency and an arousal response to negative feedback. Our results generally support a role for pupil‐linked arousal in regulating the trade‐off between speed and accuracy, while also highlighting how the trial‐related pupil response can exhibit multifaceted, temporally discrete associations with behavior. The eye’s pupil has been considered a “window into the soul” as its dynamics are related to a wide variety of cognitive processes. Here, we present convergent evidence that both slow, prestimulus fluctuations and fast, event‐related changes in pupil diameter are sensitive to a fundamental trade‐off between the speed and accuracy of visuo‐motor actions—an association that holds for both instructed and endogenous variation in this trade‐off. This finding complements a growing literature linking pupil size to adaptive, contextually appropriate changes in behavior.
Collapse
Affiliation(s)
- Marnix Naber
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands.,Vision Sciences Laboratory, Harvard University, Cambridge, Massachusetts
| | - Peter Murphy
- Section Computational Cognitive Neuroscience, Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
42
|
Abstract
Pupil dilation is an effective indicator of cognitive and affective processes. Although several eyetracker systems on the market can provide effective solutions for pupil dilation measurement, there is a lack of tools for processing and analyzing the data provided by these systems. For this reason, we developed CHAP: open-source software written in MATLAB. This software provides a user-friendly graphical user interface for processing and analyzing pupillometry data. Our software creates uniform conventions for the preprocessing and analysis of pupillometry data and provides a quick and easy-to-use tool for researchers interested in pupillometry. To download CHAP or join our mailing list, please visit CHAP's website: http://in.bgu.ac.il/en/Labs/CNL/chap .
Collapse
|
43
|
Abstract
In conditions of constant illumination, the eye pupil diameter indexes the modulation of arousal state and responds to a large breadth of cognitive processes, including mental effort, attention, surprise, decision processes, decision biases, value beliefs, uncertainty, volatility, exploitation/exploration trade-off, or learning rate. Here, I propose an information theoretic framework that has the potential to explain the ensemble of these findings as reflecting pupillary response to information processing. In short, updates of the brain’s internal model, quantified formally as the Kullback–Leibler (KL) divergence between prior and posterior beliefs, would be the common denominator to all these instances of pupillary dilation to cognition. I show that stimulus presentation leads to pupillary response that is proportional to the amount of information the stimulus carries about itself and to the quantity of information it provides about other task variables. In the context of decision making, pupil dilation in relation to uncertainty is explained by the wandering of the evidence accumulation process, leading to large summed KL divergences. Finally, pupillary response to mental effort and variations in tonic pupil size are also formalized in terms of information theory. On the basis of this framework, I compare pupillary data from past studies to simple information-theoretic simulations of task designs and show good correspondance with data across studies. The present framework has the potential to unify the large set of results reported on pupillary dilation to cognition and to provide a theory to guide future research.
Collapse
|
44
|
Beukema S. The Pupillary Response to the Unknown: Novelty Versus Familiarity. Iperception 2019; 10:2041669519874817. [PMID: 31523417 PMCID: PMC6732862 DOI: 10.1177/2041669519874817] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2019] [Accepted: 08/12/2019] [Indexed: 11/15/2022] Open
Abstract
Object recognition is a type of perception that enables observers to recognize familiar shapes and categorize them into real-world identities. In this preregistered study, we aimed to determine whether pupil size changes occur during the perception and recognition of identifiable objects. We compared pupil size changes for familiar objects, nonobjects, and random noise. Nonobjects and noise produced greater pupil dilation than familiar objects. Contrary to previous evidence showing greater pupil dilation to stimuli with more perceptual and affective content, these results indicate a greater pupil dilation to stimuli that are unidentifiable. This is consistent with the relative salience of novelty compared to familiarity at the physiological level driving the pupil response.
Collapse
Affiliation(s)
- Steve Beukema
- McGill Vision Research, Department of
Ophthalmology, Montreal General Hospital, Montreal, Quebec, Canada
| |
Collapse
|
45
|
Zhang F, Emberson LL. Opposing Timing Constraints Severely Limit the Use of Pupillometry to Investigate Visual Statistical Learning. Front Psychol 2019; 10:1792. [PMID: 31447735 PMCID: PMC6691770 DOI: 10.3389/fpsyg.2019.01792] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2019] [Accepted: 07/18/2019] [Indexed: 11/18/2022] Open
Abstract
Majority of visual statistical learning (VSL) research uses only offline measures, collected after the familiarization phase (i.e., learning) has occurred. Offline measures have revealed a lot about the extent of statistical learning (SL) but less is known about the learning mechanisms that support VSL. Studies have shown that prediction can be a potential learning mechanism for VSL, but it is difficult to examine the role of prediction in VSL using offline measures alone. Pupil diameter is a promising online measure to index prediction in VSL because it can be collected during learning, requires no overt action or task and can be used in a wide-range of populations (e.g., infants and adults). Furthermore, pupil diameter has already been used to investigate processes that are part of prediction such as prediction error and updating. While the properties of pupil diameter have the potentially to powerfully expand studies in VSL, through a series of three experiments, we find that the two are not compatible with each other. Our results revealed that pupil diameter, used to index prediction, is not related to offline measures of learning. We also found that pupil differences that appear to be a result of prediction, are actually a result of where we chose to baseline instead. Ultimately, we conclude that the fast-paced nature of VSL paradigms make it incompatible with the slow nature of pupil change. Therefore, our findings suggest pupillometry should not be used to investigate learning mechanisms in fast-paced VSL tasks.
Collapse
Affiliation(s)
- Felicia Zhang
- Department of Psychology, Princeton University, Princeton, NJ, United States
| | - Lauren L Emberson
- Department of Psychology, Princeton University, Princeton, NJ, United States
| |
Collapse
|
46
|
Richter D, de Lange FP. Statistical learning attenuates visual activity only for attended stimuli. eLife 2019; 8:e47869. [PMID: 31442202 PMCID: PMC6731093 DOI: 10.7554/elife.47869] [Citation(s) in RCA: 46] [Impact Index Per Article: 9.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2019] [Accepted: 08/21/2019] [Indexed: 12/21/2022] Open
Abstract
Perception and behavior can be guided by predictions, which are often based on learned statistical regularities. Neural responses to expected stimuli are frequently found to be attenuated after statistical learning. However, whether this sensory attenuation following statistical learning occurs automatically or depends on attention remains unknown. In the present fMRI study, we exposed human volunteers to sequentially presented object stimuli, in which the first object predicted the identity of the second object. We observed a reliable attenuation of neural activity for expected compared to unexpected stimuli in the ventral visual stream. Crucially, this sensory attenuation was only apparent when stimuli were attended, and vanished when attention was directed away from the predictable objects. These results put important constraints on neurocomputational theories that cast perception as a process of probabilistic integration of prior knowledge and sensory information.
Collapse
Affiliation(s)
- David Richter
- Donders Institute for Brain, Cognition and BehaviourRadboud University NijmegenNijmegenNetherlands
| | - Floris P de Lange
- Donders Institute for Brain, Cognition and BehaviourRadboud University NijmegenNijmegenNetherlands
| |
Collapse
|
47
|
Pietrock C, Ebrahimi C, Katthagen TM, Koch SP, Heinz A, Rothkirch M, Schlagenhauf F. Pupil dilation as an implicit measure of appetitive Pavlovian learning. Psychophysiology 2019; 56:e13463. [PMID: 31424104 DOI: 10.1111/psyp.13463] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2019] [Revised: 07/20/2019] [Accepted: 07/22/2019] [Indexed: 12/27/2022]
Abstract
Appetitive Pavlovian conditioning is a learning mechanism of fundamental biological and pathophysiological significance. Nonetheless, its exploration in humans remains sparse, which is partly attributed to the lack of an established psychophysiological parameter that aptly represents conditioned responding. This study evaluated pupil diameter and other ocular response measures (gaze dwelling time, blink duration and count) as indices of conditioning. Additionally, a learning model was used to infer participants' learning progress on the basis of their pupil dilation. Twenty-nine healthy volunteers completed an appetitive differential delay conditioning paradigm with a primary reward, while the ocular response measures along with other psychophysiological (heart rate, electrodermal activity, postauricular and eyeblink reflex) and behavioral (ratings, contingency awareness) parameters were obtained to examine the relation among different measures. A significantly stronger increase in pupil diameter, longer gaze duration and shorter eyeblink duration was observed in response to the reward-predicting cue compared to the control cue. The Pearce-Hall attention model best predicted the trial-by-trial pupil diameter. This conditioned response was corroborated by a pronounced heart rate deceleration to the reward-predicting cue, while no conditioning effect was observed in the electrodermal activity or startle responses. There was no discernible correlation between the psychophysiological response measures. These results highlight the potential value of ocular response measures as sensitive indices for representing appetitive conditioning.
Collapse
Affiliation(s)
- Charlotte Pietrock
- Department of Psychiatry and Psychotherapy, Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
| | - Claudia Ebrahimi
- Department of Psychiatry and Psychotherapy, Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
| | - Teresa M Katthagen
- Department of Psychiatry and Psychotherapy, Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
| | - Stefan P Koch
- Department of Psychiatry and Psychotherapy, Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
| | - Andreas Heinz
- Department of Psychiatry and Psychotherapy, Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany.,Cluster of Excellence NeuroCure, Charité-Universitätsmedizin Berlin, Berlin, Germany.,Bernstein Center for Computational Neuroscience Berlin, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Marcus Rothkirch
- Department of Psychiatry and Psychotherapy, Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany
| | - Florian Schlagenhauf
- Department of Psychiatry and Psychotherapy, Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Berlin, Germany.,Bernstein Center for Computational Neuroscience Berlin, Humboldt-Universität zu Berlin, Berlin, Germany.,Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
48
|
Zhang F, Jaffe-Dax S, Wilson RC, Emberson LL. Prediction in infants and adults: A pupillometry study. Dev Sci 2019; 22:e12780. [PMID: 30506618 PMCID: PMC7294578 DOI: 10.1111/desc.12780] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2017] [Revised: 08/29/2018] [Accepted: 11/26/2018] [Indexed: 11/30/2022]
Abstract
Adults use both bottom-up sensory inputs and top-down signals to generate predictions about future sensory inputs. Infants have also been shown to make predictions with simple stimuli and recent work has suggested top-down processing is available early in infancy. However, it is unknown whether this indicates that top-down prediction is an ability that is continuous across the lifespan or whether an infant's ability to predict is different from an adult's, qualitatively or quantitatively. We employed pupillometry to provide a direct comparison of prediction abilities across these disparate age groups. Pupil dilation response (PDR) was measured in 6-month olds and adults as they completed an identical implicit learning task designed to help learn associations between sounds and pictures. We found significantly larger PDR for visual omission trials (i.e. trials that violated participants' predictions without the presentation of new stimuli to control for bottom-up signals) compared to visual present trials (i.e. trials that confirmed participants' predictions) in both age groups. Furthermore, a computational learning model that is closely linked to prediction error (Rescorla-Wagner model) demonstrated similar learning trajectories suggesting a continuity of predictive capacity and learning across the two age groups.
Collapse
Affiliation(s)
- Felicia Zhang
- Department of Psychology, Princeton University, Princeton, New Jersey
| | - Sagi Jaffe-Dax
- Department of Psychology, Princeton University, Princeton, New Jersey
| | - Robert C. Wilson
- Department of Psychology, University of Arizona, Tucson, Arizona
- Cognitive Science Program, University of Arizona, Tucson, Arizona
| | | |
Collapse
|
49
|
Scholz S, Dutke S. Investigating intentional forgetting using pupillometry: no evidence for the ongoing allocation of cognitive resources during forgetting. JOURNAL OF COGNITIVE PSYCHOLOGY 2019. [DOI: 10.1080/20445911.2019.1622548] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Affiliation(s)
- Sebastian Scholz
- Institute for Psychology in Education, University of Münster, Münster, Germany
| | - Stephan Dutke
- Institute for Psychology in Education, University of Münster, Münster, Germany
| |
Collapse
|
50
|
Peinkhofer C, Knudsen GM, Moretti R, Kondziella D. Cortical modulation of pupillary function: systematic review. PeerJ 2019; 7:e6882. [PMID: 31119083 PMCID: PMC6510220 DOI: 10.7717/peerj.6882] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2019] [Accepted: 03/26/2019] [Indexed: 12/25/2022] Open
Abstract
BACKGROUND The pupillary light reflex is the main mechanism that regulates the pupillary diameter; it is controlled by the autonomic system and mediated by subcortical pathways. In addition, cognitive and emotional processes influence pupillary function due to input from cortical innervation, but the exact circuits remain poorly understood. We performed a systematic review to evaluate the mechanisms behind pupillary changes associated with cognitive efforts and processing of emotions and to investigate the cerebral areas involved in cortical modulation of the pupillary light reflex. METHODOLOGY We searched multiple databases until November 2018 for studies on cortical modulation of pupillary function in humans and non-human primates. Of 8,809 papers screened, 258 studies were included. RESULTS Most investigators focused on pupillary dilatation and/or constriction as an index of cognitive and emotional processing, evaluating how changes in pupillary diameter reflect levels of attention and arousal. Only few tried to correlate specific cerebral areas to pupillary changes, using either cortical activation models (employing micro-stimulation of cortical structures in non-human primates) or cortical lesion models (e.g., investigating patients with stroke and damage to salient cortical and/or subcortical areas). Results suggest the involvement of several cortical regions, including the insular cortex (Brodmann areas 13 and 16), the frontal eye field (Brodmann area 8) and the prefrontal cortex (Brodmann areas 11 and 25), and of subcortical structures such as the locus coeruleus and the superior colliculus. CONCLUSIONS Pupillary dilatation occurs with many kinds of mental or emotional processes, following sympathetic activation or parasympathetic inhibition. Conversely, pupillary constriction may occur with anticipation of a bright stimulus (even in its absence) and relies on a parasympathetic activation. All these reactions are controlled by subcortical and cortical structures that are directly or indirectly connected to the brainstem pupillary innervation system.
Collapse
Affiliation(s)
- Costanza Peinkhofer
- Department of Neurology, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
- Medical Faculty, University of Trieste, Trieste, Italy
| | - Gitte M. Knudsen
- Department of Neurology, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
- Neurobiology Research Unit, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
- Faculty of Health and Medical Science, University of Copenhagen, Copenhagen, Denmark
| | - Rita Moretti
- Medical Faculty, University of Trieste, Trieste, Italy
- Department of Medical, Surgical and Health Sciences, Neurological Unit, Trieste University Hospital, Cattinara, Trieste, Italy
| | - Daniel Kondziella
- Department of Neurology, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
- Faculty of Health and Medical Science, University of Copenhagen, Copenhagen, Denmark
- Department of Neuroscience, Norwegian University of Technology and Science, Trondheim, Norway
| |
Collapse
|