51
|
Abstract
We measured the pupil response to a light stimulus subject to a size illusion and found that stimuli perceived as larger evoke a stronger pupillary response. The size illusion depends on combining retinal signals with contextual 3D information; contextual processing is thought to vary across individuals, being weaker in individuals with stronger autistic traits. Consistent with this theory, autistic traits correlated negatively with the magnitude of pupil modulations in our sample of neurotypical adults; however, psychophysical measurements of the illusion did not correlate with autistic traits, or with the pupil modulations. This shows that pupillometry provides an accurate objective index of complex perceptual processes, particularly useful for quantifying interindividual differences, and potentially more informative than standard psychophysical measures.
Collapse
|
52
|
Castellotti S, Francisci C, Del Viva MM. Pupillary response to real, illusory, and implied motion. PLoS One 2021; 16:e0254105. [PMID: 34197536 PMCID: PMC8248605 DOI: 10.1371/journal.pone.0254105] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Accepted: 06/21/2021] [Indexed: 11/19/2022] Open
Abstract
The perception of moving objects (real motion) is a critical function for interacting with a dynamic environment. Motion perception can be also induced by particular structural features of static images (illusory motion) or by photographic images of subjects in motion (implied motion, IM). Many cortical areas are involved in motion processing, particularly the medial temporal cortical area (MT), dedicated to the processing of real, illusory, and implied motion. Recently, there has been a growing interest in the influence of high-level visual processes on pupillary responses. However, just a few studies have measured the effect of motion processing on the pupil, and not always with consistent results. Here we systematically investigate the effects of real, illusory, and implied motion on the pupil diameter for the first time, by showing different types of stimuli (movies, illusions, and photos) with the same average luminance to the same observers. We find different pupillary responses depending on the nature of motion. Real motion elicits a larger pupillary dilation than IM, which in turn induces more dilation than control photos representing static subjects (No-IM). The pupil response is sensitive even to the strength of IM, as photos with enhanced IM (blur, motion streaks, speed lines) induce larger dilation than simple freezed IM (subjects captured in the instant they are moving). Also, the subject represented in the stimulus matters: human figures are interpreted as more dynamic and induce larger dilation than objects/animals. Interestingly, illusory motion induces much less dilation than all the other motion categories, despite being seen as moving. Overall, pupil responses depend on the individual perception of dynamicity, confirming that the pupil is modulated by the subjective interpretation of complex stimuli. We argue that the different pupillary responses to real, illusory, and implied motion reflect the top-down modulations of different cortical areas involved in their processing.
Collapse
Affiliation(s)
| | - Carlo Francisci
- Department of Neurofarba, University of Florence, Florence, Italy
| | | |
Collapse
|
53
|
Hu X, Hisakata R, Kaneko H. Pupillary dilation elicited by attending to two disks with different luminance. J Vis 2021; 21:11. [PMID: 33481992 PMCID: PMC7838548 DOI: 10.1167/jov.21.1.11] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Pupils become smaller when people attend to a bright disk as compared to a dark disk. However, people can divide their attention into several distinct positions, which is referred to as divided attention, and pupillary responses under such conditions have not been investigated. In this study, we examined how pupils would respond when people attended to two disks presented at two distinct positions by conducting three experiments. We found that the pupillary response when attending to two disks with different luminance was larger than when attending to a single brighter disk and was comparable to that when attending to a single darker disk, whereas the pupillary response when attending to two disks with identical luminance was not larger than when attending to a single disk (irrespective of the disk luminance). Furthermore, we found that the magnitude of pupillary dilation was determined by the magnitude of the luminance difference between two disks. These results make a useful contribution to the literature on human pupillary responses.
Collapse
Affiliation(s)
- Xiaofei Hu
- Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, Yokohama, Japan.,
| | - Rumi Hisakata
- Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, Yokohama, Japan.,
| | - Hirohiko Kaneko
- Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, Yokohama, Japan.,
| |
Collapse
|
54
|
Castellotti S, Conti M, Feitosa-Santana C, Del Viva MM. Pupillary response to representations of light in paintings. J Vis 2021; 20:14. [PMID: 33052409 PMCID: PMC7571318 DOI: 10.1167/jov.20.10.14] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/02/2022] Open
Abstract
It is known that, although the level of light is the primary determinant of pupil size, cognitive factors can also affect pupil diameter. It has been demonstrated that photographs of the sun produce pupil constriction independently of their luminance and other low-level features, suggesting that high-level visual processing may also modulate pupil response. Here, we measure pupil response to artistic paintings of the sun, moon, or containing a uniform lighting, that, being mediated by the artist's interpretation of reality and his technical rendering, require an even higher level of interpretation compared with photographs. We also study how chromatic content and spatial layout affect the results by presenting grey-scale and inverted versions of each painting. Finally, we assess directly with a categorization test how subjective image interpretation affects pupil response. We find that paintings with the sun elicit a smaller pupil size than paintings with the moon, or paintings containing no visible light source. The effect produced by sun paintings is reduced by disrupting contextual information, such as by removing color or manipulating the relations between paintings features that make more difficult to identify the source of light. Finally, and more importantly, pupil diameter changes according to observers’ interpretation of the scene represented in the same stimulus. In conclusion, results show that the subcortical pupillary response to light is modulated by subjective interpretation of luminous objects, suggesting the involvement of cortical systems in charge of cognitive processes, such as attention, object recognition, familiarity, memory, and imagination.
Collapse
Affiliation(s)
| | - Martina Conti
- Department of Neurofarba, University of Florence, Florence, Italy.,
| | - Claudia Feitosa-Santana
- Federal University of ABC, Sao Bernardo do Campo, Brazil.,Neuroscience for Human Development, Sao Paulo, Brazil.,
| | | |
Collapse
|
55
|
Tortelli C, Turi M, Burr DC, Binda P. Objective pupillometry shows that perceptual styles covary with autistic-like personality traits. eLife 2021; 10:67185. [PMID: 33749589 PMCID: PMC8016475 DOI: 10.7554/elife.67185] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Accepted: 03/07/2021] [Indexed: 11/23/2022] Open
Abstract
We measured the modulation of pupil size (in constant lighting) elicited by observing transparent surfaces of black and white moving dots, perceived as a cylinder rotating about its vertical axis. The direction of rotation was swapped periodically by flipping stereo-depth of the two surfaces. Pupil size modulated in synchrony with the changes in front-surface color (dilating when black). The magnitude of pupillary modulation was larger for human participants with higher Autism-Spectrum Quotient (AQ), consistent with a local perceptual style, with attention focused on the front surface. The modulation with surface color, and its correlation with AQ, was equally strong when participants passively viewed the stimulus. No other indicator, including involuntary pursuit eye movements, covaried with AQ. These results reinforce our previous report with a similar bistable stimulus (Turi, Burr, & Binda, 2018), and go on to show that bistable illusory motion is not necessary for the effect, or its dependence on AQ.
Collapse
Affiliation(s)
- Chiara Tortelli
- Department of Surgical Medical Molecular and Critical Area Pathology, University of Pisa, Pisa, Italy
| | - Marco Turi
- Fondazione Stella Maris Mediterraneo, Chiaromonte, Italy
| | - David Charles Burr
- Department of Neuroscience Psychology Pharmacology and Child Health, University of Firenze, Firenze, Italy
| | - Paola Binda
- Department of Translational Research on New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| |
Collapse
|
56
|
Sapir A, Hershman R, Henik A. Top-down effect on pupillary response: Evidence from shape from shading. Cognition 2021; 212:104664. [PMID: 33743516 DOI: 10.1016/j.cognition.2021.104664] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2020] [Revised: 01/13/2021] [Accepted: 03/08/2021] [Indexed: 11/25/2022]
Abstract
Shaded 2D images often create an illusion of depth, due to the shading information and assumptions regarding the location of the light source. Specifically, 2D images that are lighter on top usually appear convex while images that are darker on top, usually appear concave, reflecting the assumption that light is coming from above. The process of recovering the 3D shape of a shaded image is called Shape from Shading. Here we examined whether the pupil responds to the illusion of depth in a shape from shading task. In three experiments we show that pupil size is affected by the percept of depth, so that it dilates more when participants perceive the stimulus as concave, compared to when they perceive it as convex. This only happens if participants make a judgment regarding the shape of the stimulus or when they view it passively but are aware of the different shapes. No differences in pupil size were found with passive viewing if participants were not aware of the illusion, suggesting that some aspects of shape from shading require attention. All stimuli were equiluminant, and the percept of depth was created by manipulating the orientation of the shading, so that changes in pupil size could not be accounted by changes in the amount of light in the image. We posit, and confirmed it in a behavioral control experiment, that the perception of depth is translated to a subjective perception of darkness, due to the "darker is deeper" heuristic and conclude that the pupillary physiological response reflects the subjective perception of light.
Collapse
Affiliation(s)
- Ayelet Sapir
- School of Psychology, Bangor University, Bangor, UK.
| | - Ronen Hershman
- Department of Cognitive and Brain Sciences, Ben-Gurion University of the Negev, Beer-Sheva, Israel; Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Avishai Henik
- Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, Beer-Sheva, Israel; Department of Psychology, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| |
Collapse
|
57
|
Kanari K, Kaneko H. Pupil response is modulated with optokinetic nystagmus in transparent motion. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2021; 38:149-156. [PMID: 33690525 DOI: 10.1364/josaa.409940] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/21/2020] [Accepted: 12/06/2020] [Indexed: 06/12/2023]
Abstract
When two visual patterns moving in opposite directions are superimposed on the same depth plane, they appear to have two transparent surfaces moving independently (transparent motion). Additionally, the direction of the slow phase of optokinetic nystagmus (OKN) corresponds to the direction of motion that dominates the perceptual appearance. This study examines whether pupil changes correspond to the luminance of the dominated objects related to the transition of the slow-phase direction in OKN following objects. Stimuli consisted of two random dot patterns of different luminance that moved in opposite directions. The results showed that pupil size changed in accordance with the luminance of the pattern in the slow phase of OKN immediately after OKN transition. This suggests that pupil size is modulated with OKN in transparent motion.
Collapse
|
58
|
Abstract
Eye-tracking is widely used throughout the scientific community, from vision science and psycholinguistics to marketing and human-computer interaction. Surprisingly, there is little consistency and transparency in preprocessing steps, making replicability and reproducibility difficult. To increase replicability, reproducibility, and transparency, a package in R (a free and widely used statistical programming environment) called gazeR was created to read and preprocess two types of data: gaze position and pupil size. For gaze position data, gazeR has functions for reading in raw eye-tracking data, formatting it for analysis, converting from gaze coordinates to areas of interest, and binning and aggregating data. For data from pupillometry studies, the gazeR package has functions for reading in and merging multiple raw pupil data files, removing observations with too much missing data, eliminating artifacts, blink identification and interpolation, subtractive baseline correction, and binning and aggregating data. The package is open-source and freely available for download and installation: https://github.com/dmirman/gazer . We provide step-by-step analyses of data from two tasks exemplifying the package's capabilities.
Collapse
|
59
|
Liao HI, Kashino M, Shimojo S. Attractiveness in the Eyes: A Possibility of Positive Loop between Transient Pupil Constriction and Facial Attraction. J Cogn Neurosci 2020; 33:315-340. [PMID: 33166194 DOI: 10.1162/jocn_a_01649] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Contrary to the long-held belief of a close linkage between pupil dilation and attractiveness, we found an early and transient pupil constriction response when participants viewed an attractive face (and the effect of luminance/contrast was controlled). While human participants were making an attractiveness judgment on faces, their pupil constricted more for the more attractive (as-to-be-rated) faces. Further experiments showed that the effect of pupil constriction to attractiveness judgment extended to intrinsically esthetic visual objects such as natural scene images (as well as faces) but not to line-drawing geometric figures. When participants were asked to judge the roundness of faces, pupil constriction still correlated with their attractiveness but not the roundness rating score, indicating the automaticity of the pupil constriction to attractiveness. When pupillary responses were manipulated implicitly by relative background luminance changes (from the prestimulus screen), the facial attractiveness ratings were in accordance with the amount of pupil constriction, which could not be explained solely by simultaneous or sequential luminance contrast. The overall results suggest that pupil constriction not only reflects but, as a part of self-monitoring and attribution mechanisms, also possibly contributes to facial attractiveness implicitly.
Collapse
Affiliation(s)
| | - Makio Kashino
- NTT Corporation, Atsugi, Kanagawa, Japan.,Tokyo Institute of Technology
| | | |
Collapse
|
60
|
Portengen BL, Roelofzen C, Porro GL, Imhof SM, Fracasso A, Naber M. Blind spot and visual field anisotropy detection with flicker pupil perimetry across brightness and task variations. Vision Res 2020; 178:79-85. [PMID: 33161146 DOI: 10.1016/j.visres.2020.10.005] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2020] [Revised: 09/29/2020] [Accepted: 10/14/2020] [Indexed: 10/23/2022]
Abstract
The pupil can be used as an objective measure for testing sensitivities across the visual field (pupil perimetry; PP). The recently developed gaze-contingent flicker PP (gcFPP) is a promising novel form of PP, with improved sensitivity due to retinotopically stable and repeated flickering stimulations, in a short time span. As a diagnostic tool gcFPP has not yet been benchmarked in healthy individuals. The main aims of the current study were to investigate whether gcFPP has the sensitivity to detect the blind spot, and upper versus lower visual field differences that were found before in previous studies. An additional aim was to test for the effects of attentional requirements and background luminance. A total of thirty individuals were tested with gcFPP across two separate experiments. The results showed that pupil oscillation amplitudes were smaller for stimuli presented inside as compared to outside the blind spot. Amplitudes also decreased as a function of eccentricity (i.e., distance to fixation) and were larger for upper as compared to lower visual fields. We measured the strongest and most sensitive pupil responses to stimuli presented on dark- and mid-gray backgrounds, and when observers covertly focused their attention to the flickering stimulus. GcFPP thus evokes pupil responses that are sensitive enough to detect local, and global differences in pupil sensitivity. The findings further encourage (1) the use of a gray background to prevent straylight without affecting gcFPPs sensitivity and (2) the use of an attention task to enhance pupil sensitivity.
Collapse
Affiliation(s)
- Brendan L Portengen
- Ophthalmology Department, University Medical Center Utrecht, The Netherlands; Experimental Psychology, Helmholtz Institute, Utrecht University, The Netherlands.
| | - Carlien Roelofzen
- Experimental Psychology, Helmholtz Institute, Utrecht University, The Netherlands; Experimental and Applied Psychology, VU University Amsterdam, The Netherlands; Spinoza Centre for Neuroimaging, Amsterdam, The Netherlands
| | - Giorgio L Porro
- Ophthalmology Department, University Medical Center Utrecht, The Netherlands
| | - Saskia M Imhof
- Ophthalmology Department, University Medical Center Utrecht, The Netherlands
| | - Alessio Fracasso
- Experimental Psychology, Helmholtz Institute, Utrecht University, The Netherlands; Spinoza Centre for Neuroimaging, Amsterdam, The Netherlands; Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
| | - Marnix Naber
- Experimental Psychology, Helmholtz Institute, Utrecht University, The Netherlands
| |
Collapse
|
61
|
Resting and Functional Pupil Response Metrics Indicate Features of Reward Sensitivity and ASD in Children. J Autism Dev Disord 2020; 51:2416-2435. [PMID: 32978706 DOI: 10.1007/s10803-020-04721-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
The current study examined the relationship between quantitative measures of reward and punishment sensitivity, features of autism spectrum disorder (ASD), and resting and functional pupil response metrics across a clinically heterogeneous sample. Scores on a parent-report measure of punishment and reward sensitivity were correlated with ASD features. We also assessed whether pupil measurements could be used as a physiologic correlate of reward sensitivity and predictor of ASD diagnosis. In a logistic regression model, pupil dilation metrics, sex, and IQ, correctly classified 86.3% of participants as having an ASD diagnosis versus not. This research highlights individual differences of reward sensitivity associated with ASD features. Results support the use of pupil metrics and other patient-level variables as predictors of ASD diagnostic status.
Collapse
|
62
|
McGovern JE, Reddy LF, Reavis EA, Green MF. Pupillary change on a cognitive effort task in schizophrenia: Associations with cognition and motivation. Int J Psychophysiol 2020; 155:1-7. [DOI: 10.1016/j.ijpsycho.2020.05.003] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2019] [Revised: 04/28/2020] [Accepted: 05/06/2020] [Indexed: 10/24/2022]
|
63
|
Aminihajibashi S, Hagen T, Laeng B, Espeseth T. Pupillary and behavioral markers of alerting and orienting: An individual difference approach. Brain Cogn 2020; 143:105597. [PMID: 32673900 DOI: 10.1016/j.bandc.2020.105597] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2019] [Revised: 05/28/2020] [Accepted: 06/10/2020] [Indexed: 02/07/2023]
Abstract
Measuring task-evoked pupillary (TEP) responses as an index of phasic activity in the locus coeruleus (LC), we examined two competing hypotheses regarding the alerting and orienting mechanisms of attention. According to a dual mechanism account (Fernandez-Duque & Posner, 1997), two separate noradrenergic and cholinergic mechanisms modulate, respectively, the alerting and orienting effects. However, Corbetta and colleagues (2008) proposed that LC phasic activity may also be involved in orienting effect through its functional relationship with the ventral attentional network. We recruited seventy-five healthy Norwegian participants to perform a Posner cueing task. Both behavioral and pupillary responses revealed the alerting effect. Also, both behavioral and pupillary responses indicated that cued attention is affected by age. Behavioral responses also revealed orienting effect However, we found no TEP differences between valid, invalid, and neutral conditions, suggesting that TEP effects were driven by the alerting effect of cue presentation. Moreover, both behavioral and pupillary estimates of alertness and orienting were uncorrelated. Finally, individual differences in general cognitive abilities did not appear to affect the orienting and alerting mechanisms. This pattern of results is consistent with the dual mechanism account of attention. However, the LC involvement in the (re)orienting attention may be driven by state-specific factors.
Collapse
Affiliation(s)
| | - Thomas Hagen
- Department of Psychology, University of Oslo, Oslo, Norway
| | - Bruno Laeng
- Department of Psychology, University of Oslo, Oslo, Norway; RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
| | | |
Collapse
|
64
|
Abstract
Continuously tracking cognitive demands via pupil dilation is a desirable goal for the monitoring and investigation of cognitive performance in applied settings where the exact time point of mental engagement in a task is often unknown. Yet, hitherto no experimentally validated algorithm exists for continuously estimating cognitive demands based on pupil size. Here, we evaluated the performance of a continuously operating algorithm that is agnostic of the onset of the stimuli and derives them by way of retrospectively modeling attentional pulses (i.e., onsets of processing). We compared the performance of this algorithm to a standard analysis of stimulus-locked pupil data. The pupil data were obtained while participants performed visual search (VS) and visual working memory (VWM) tasks with varying cognitive demands. In Experiment 1, VS was performed during the retention interval of the VWM task to assess interactive effects between search and memory load on pupil dilation. In Experiment 2, the tasks were performed separately. The results of the stimulus-locked pupil data demonstrated reliable increases in pupil dilation due to high VWM load. VS difficulty only affected pupil dilation when simultaneous memory demands were low. In the single task condition, increased VS difficulty resulted in increased pupil dilation. Importantly, online modeling of pupil responses was successful on three points. First, there was good correspondence between the modeled and stimulus locked pupil dilations. Second, stimulus onsets could be approximated from the derived attentional pulses to a reasonable extent. Third, cognitive demands could be classified above chance level from the modeled pupil traces in both tasks.
Collapse
|
65
|
Joshi S, Gold JI. Pupil Size as a Window on Neural Substrates of Cognition. Trends Cogn Sci 2020; 24:466-480. [PMID: 32331857 PMCID: PMC7271902 DOI: 10.1016/j.tics.2020.03.005] [Citation(s) in RCA: 278] [Impact Index Per Article: 69.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2019] [Revised: 03/18/2020] [Accepted: 03/18/2020] [Indexed: 10/24/2022]
Abstract
Cognitively driven pupil modulations reflect certain underlying brain functions. What do these reflections tell us? Here, we review findings that have identified key roles for three neural systems: cortical modulation of the pretectal olivary nucleus (PON), which controls the pupillary light reflex; the superior colliculus (SC), which mediates orienting responses, including pupil changes to salient stimuli; and the locus coeruleus (LC)-norepinephrine (NE) neuromodulatory system, which mediates relationships between pupil-linked arousal and cognition. We discuss how these findings can inform the interpretation of pupil measurements in terms of activation of these neural systems. We also highlight caveats, open questions, and key directions for future experiments for improving these interpretations in terms of the underlying neural dynamics throughout the brain.
Collapse
Affiliation(s)
- Siddhartha Joshi
- Department of Neuroscience, University of Pennsylvania, Philadelphia, PA 19104, USA.
| | - Joshua I Gold
- Department of Neuroscience, University of Pennsylvania, Philadelphia, PA 19104, USA
| |
Collapse
|
66
|
Abstract
The pupil responds reflexively to changes in brightness and focal distance to maintain the smallest pupil (and thus the highest visual acuity) that still allows sufficient light to reach the retina. The pupil also responds to a wide variety of cognitive processes, but the functions of these cognitive responses are still poorly understood. In this review, I propose that cognitive pupil responses, like their reflexive counterparts, serve to optimize vision. Specifically, an emphasis on central vision over peripheral vision results in pupil constriction, and this likely reflects the fact that central vision benefits most from the increased visual acuity provided by small pupils. Furthermore, an intention to act with a bright stimulus results in preparatory pupil constriction, which allows the pupil to respond quickly when that bright stimulus is subsequently brought into view. More generally, cognitively driven pupil responses are likely a form of sensory tuning: a subtle adjustment of the eyes to optimize their properties for the current situation and the immediate future. Expected final online publication date for the Annual Review of Vision Science, Volume 6 is September 15, 2020. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
Collapse
Affiliation(s)
- Sebastiaan Mathôt
- Department of Psychology, University of Groningen, 9712TS Groningen, The Netherlands;
| |
Collapse
|
67
|
Pelagatti C, Binda P, Vannucci M. A closer look at the timecourse of mind wandering: Pupillary responses and behaviour. PLoS One 2020; 15:e0226792. [PMID: 32353028 PMCID: PMC7192427 DOI: 10.1371/journal.pone.0226792] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2019] [Accepted: 04/11/2020] [Indexed: 12/31/2022] Open
Abstract
Mind wandering (MW) refers to the shift of attention away from a primary task and/or external environment towards thoughts unrelated to the task. Recent evidence has shown that pupillometry can be used as an objective marker of the onset and maintenance of externally-driven MW episodes. In the present study we aimed to further investigate pupillary changes associated with the onset and duration of self-reported MW episodes. We used a modified version of the joint behavioural-pupillometry paradigm we recently introduced. Participants were asked to perform a monotonous vigilance task which was intermixed with task-irrelevant cue-phrases (visually presented verbal cues); they were instructed to interrupt the task whenever a thought came to mind (self-caught method) and to indicate the trigger of their thought, if any. We found systematic pupil dilation after the presentation of verbal cues reported to have triggered MW, compared with other verbal cues presented during a supposedly on-task period (i.e., the period immediately following the resuming of the task after a self-caught interruption and MW report). These results confirm that pupil diameter is sensitive to the changes associated with the onset of MW and its unfolding over time. Moreover, by computing the latency between the trigger presentation and the task interruption (self-catch), we could also estimate the duration of MW episodes triggered by verbal cues. However, a high variability was found, implying very large inter-event variability, which could not be explained by any of the MW properties we acquired (including: temporal focus, specificity, emotional valence). Our behavioural and pupillometry findings stress the need for objective measures about the temporal unfolding of MW (while most studies focus on arbitrary time-window preceding self-reports of MW).
Collapse
Affiliation(s)
- Claudia Pelagatti
- Department of NEUROFARBA-Section of Psychology, University of Florence, Florence, Italy
| | - Paola Binda
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
- * E-mail: (PB); (MV)
| | - Manila Vannucci
- Department of NEUROFARBA-Section of Psychology, University of Florence, Florence, Italy
- * E-mail: (PB); (MV)
| |
Collapse
|
68
|
de'Sperati C, Roatta S, Zovetti N, Baroni T. Decoding overt shifts of attention in depth through pupillary and cortical frequency tagging. J Neural Eng 2020; 18. [PMID: 32348980 DOI: 10.1088/1741-2552/ab8e8f] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2019] [Accepted: 04/29/2020] [Indexed: 11/11/2022]
Abstract
OBJECTIVE We have recently developed a prototype of a novel human-computer interface for assistive communication based on voluntary shifts of attention (gaze) from a far target to a near target associated with a decrease of pupil size (Pupillary Accommodative Response, PAR), an automatic vegetative response that can be easily recorded. We report here an extension of that approach based on pupillary and cortical frequency tagging. APPROACH In 18 healthy volunteers, we investigated the possibility of decoding attention shifts in depth by exploiting the evoked oscillatory responses of the pupil (Pupillary Oscillatory Response, POR, recorded through a low-cost device) and visual cortex (Steady-State Visual Evoked Potentials, SSVEP, recorded from 4 scalp electrodes). With a simple binary communication protocol (focusing on a far target meaning "No", focusing on the near target meaning "Yes"), we aimed at discriminating when observer's overt attention (gaze) shifted from the far to the near target, which were flickering at different frequencies. MAIN RESULTS By applying a binary linear classifier (Support Vector Machine, SVM, with leave-one-out cross validation) to POR and SSVEP signals, we found that, with only twenty trials and no subjects' behavioural training, the offline median decoding accuracy was 75% and 80% with POR and SSVEP signals, respectively. When the two signals were combined together, accuracy reached 83%. The number of observers for whom accuracy was higher than 70% was 11/18, 12/18 and 14/18 with POR, SVVEP and combined features, respectively. A signal detection analysis confirmed these results. SIGNIFICANCE The present findings suggest that exploiting frequency tagging with pupillary or cortical responses during an attention shift in the depth plane, either separately or combined together, is a promising approach to realize a device for communicating with Complete Locked-In Syndrome (CLIS) patients when oculomotor control is unreliable and traditional assistive communication, even based on PAR, is unsuccessful.
Collapse
Affiliation(s)
- Claudio de'Sperati
- Laboratory of Action, Perception and COgnition, Faculty of Psychology, Università Vita Salute San Raffaele, Milano, ITALY
| | - Silvestro Roatta
- Laboratory of Integrative Physiology, Department of Neuroscience, Università degli Studi di Torino, Torino, Piemonte, ITALY
| | - Niccolò Zovetti
- Section of Psychiatry, Department of Neurosciences, Biomedicine and Movement Sciences, Università degli Studi di Verona, Verona, Veneto, ITALY
| | - Tatiana Baroni
- Psychology, Università Vita Salute San Raffaele, Milano, ITALY
| |
Collapse
|
69
|
Hu X, Hisakata R, Kaneko H. Effects of stimulus size, eccentricity, luminance, and attention on pupillary light response examined by concentric stimulus. Vision Res 2020; 170:35-45. [PMID: 32244112 DOI: 10.1016/j.visres.2020.03.008] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Revised: 03/18/2020] [Accepted: 03/18/2020] [Indexed: 12/17/2022]
Abstract
Previous studies show that the amplitude of pupillary light response (PLR) depends on the corneal flux density (CFD), which is the product of stimulus area by luminance. However, the contribution of CFD has been investigated only when the stimulus was centered on the fovea, whereas perceived luminance to pupillary response would reduce with stimulus eccentricity. Additionally, it has been shown recently that attentional state modulates pupillary response. In this study, we aimed to clarify the complete mechanisms of PLR by manipulating the stimulus size, eccentricity, luminance, and the participants' attentional states. We focused on four indices to examine PLR, that is, pupillary latency (PL), maximum constriction velocity (MCV), maximum constriction (MC), and mean pupil change (MPC). Results showed that PL was a function of CFD, whereas MCV, MC, and MPC were functions of both CFD and stimulus eccentricity. Furthermore, the magnitude of effect due to stimulus eccentricity for MCV and MC was different from that for MPC. These results provided new evidence that the different processing systems in PLR existed.
Collapse
Affiliation(s)
- Xiaofei Hu
- Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, 4259-G2-3 Nagatsuta-Cho, Midori-Ku, Yokohama 226-8502, Japan.
| | - Rumi Hisakata
- Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, 4259-G2-3 Nagatsuta-Cho, Midori-Ku, Yokohama 226-8502, Japan
| | - Hirohiko Kaneko
- Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, 4259-G2-3 Nagatsuta-Cho, Midori-Ku, Yokohama 226-8502, Japan
| |
Collapse
|
70
|
Kanari K. Pupil response is modulated by attention shift in optokinetic nystagmus. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2020; 37:361-367. [PMID: 32118918 DOI: 10.1364/josaa.379598] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/03/2019] [Accepted: 12/26/2019] [Indexed: 06/10/2023]
Abstract
Pupil size is modulated not only by the luminance at the eye position but also by that at the attended location. This study aims to examine whether pupil changes also correspond to the luminance at the spatial location to which the attention is shifted in optokinetic nystagmus. The test stimulus consisted of randomly positioned dots that moved to the left or to the right on a display screen that was bright on one side of the centerline and dark on the other. The results show that pupil size changes in accordance with the luminance at the location to which participants' attention shifts as a result of optokinetic nystagmus (i.e., eye movements in the direction opposite to that of the motion stimulus). This study suggests that pupil size is modulated by the luminance at the location to which attention shifts through unidirectional field motion.
Collapse
|
71
|
Muto Y, Miyoshi H, Kaneko H. Eye-gaze information input based on pupillary response to visual stimulus with luminance modulation. PLoS One 2020; 15:e0226991. [PMID: 31917794 PMCID: PMC6952090 DOI: 10.1371/journal.pone.0226991] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2019] [Accepted: 12/10/2019] [Indexed: 11/18/2022] Open
Abstract
This study develops an information-input interface in which a visual stimulus targeted by a user's eye gaze is identified based on the pupillary light reflex to periodic luminance modulations of the object. Experiment 1 examines how pupil size changes in response to periodic luminance modulation of visual stimuli, and the results are used to develop an algorithm for information input. Experiment 2a examines the effectiveness of interfaces with two objects. The results demonstrate that 98% accurate identification of the gaze targeted object is possible if the luminance modulation frequencies of two objects differ by at least 0.12 Hz. Experiment 2b examines the accuracy of a gaze directed information input method based on a keyboard configuration with twelve responses. The results reveal that keyboard input is possible with an average accuracy of 85% for luminance modulation frequencies from 0.75 to 2.75 Hz. The proposed pupillometry based information-input interface offers several advantages, such as low burden on users, minimal invasiveness, no need for training or experience, high theoretical validity, and no need for calibration. Thus, the pupillometry method presented herein has advantages for practical use without requiring the eye's position to be calibrated. Additionally, this method has a potential for the design of interfaces that allow patients with severely limited motor function to communicate with others.
Collapse
Affiliation(s)
- Yumiko Muto
- Dept. of Information and Communications Engineering, Tokyo institute of Technology, Yokohama, Kanagawa, Japan
- Brain Science Institute, Tamagawa university, Tokyo, Japan
- * E-mail: (YM); (HK)
| | - Hideka Miyoshi
- Dept. of Information and Communications Engineering, Tokyo institute of Technology, Yokohama, Kanagawa, Japan
| | - Hirohiko Kaneko
- Dept. of Information and Communications Engineering, Tokyo institute of Technology, Yokohama, Kanagawa, Japan
- * E-mail: (YM); (HK)
| |
Collapse
|
72
|
Mathôt S, Ivanov Y. The effect of pupil size and peripheral brightness on detection and discrimination performance. PeerJ 2019; 7:e8220. [PMID: 31875153 PMCID: PMC6925951 DOI: 10.7717/peerj.8220] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2019] [Accepted: 11/15/2019] [Indexed: 01/19/2023] Open
Abstract
It is easier to read dark text on a bright background (positive polarity) than to read bright text on a dark background (negative polarity). This positive-polarity advantage is often linked to pupil size: A bright background induces small pupils, which in turn increases visual acuity. Here we report that pupil size, when manipulated through peripheral brightness, has qualitatively different effects on discrimination of fine stimuli in central vision and detection of faint stimuli in peripheral vision. Small pupils are associated with improved discrimination performance, consistent with the positive-polarity advantage, but only for very small stimuli that are at the threshold of visual acuity. In contrast, large pupils are associated with improved detection performance. These results are likely due to two pupil-size related factors: Small pupils increase visual acuity, which improves discrimination of fine stimuli; and large pupils increase light influx, which improves detection of faint stimuli. Light scatter is likely also a contributing factor: When a display is bright, light scatter creates a diffuse veil of retinal illumination that reduces perceived image contrast, thus impairing detection performance. We further found that pupil size was larger during the detection task than during the discrimination task, even though both tasks were equally difficult and similar in visual input; this suggests that the pupil may automatically assume an optimal size for the current task. Our results may explain why pupils dilate in response to arousal: This may reflect an increased emphasis on detection of unpredictable danger, which is crucially important in many situations that are characterized by high levels of arousal. Finally, we discuss the implications of our results for the ergonomics of display design.
Collapse
Affiliation(s)
- Sebastiaan Mathôt
- Department of Experimental Psychology, University of Groningen, Groningen, Netherlands
| | - Yavor Ivanov
- Department of Experimental Psychology, University of Groningen, Groningen, Netherlands.,Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, Noord Holland, Netherlands.,Institute for Brain and Behavior, Amsterdam, Netherlands
| |
Collapse
|
73
|
Venturoso L, Gabrieli G, Truzzi A, Azhari A, Setoh P, Bornstein MH, Esposito G. Effects of Baby Schema and Mere Exposure on Explicit and Implicit Face Processing. Front Psychol 2019; 10:2649. [PMID: 31849766 PMCID: PMC6895995 DOI: 10.3389/fpsyg.2019.02649] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2019] [Accepted: 11/11/2019] [Indexed: 11/13/2022] Open
Abstract
In an increasingly multicultural society, the way people perceive individuals from the same vs different ethnic groups greatly affects their own and societal well-being. Two psychological effects that influence these perceptions are the Mere-Exposure Effect (MRE), wherein familiarity with certain objects or persons suffices for people to develop a preference for them, and the Baby Schema (BS), a set of specific facial features that evokes caregiving behaviors and an affective orientation in adults. In the present study, we aimed to investigate whether these two effects play a role in implicit physiological responses to babies vs. adults faces belonging to participants in-group vs. out-group. In study 1, the pupillary diameter of 62 Caucasian participants (M = 31; F = 31) who observed adult and infant faces of different ethnic groups (Caucasian, Chinese) was measured. In study 2, brain waves of 38 Caucasian participants (M = 19; F = 19), who observed the same set of faces, were recorded using EEG. In both studies, adults explicit preferences (i.e., attitudes) toward faces were assessed using questionnaires. In Study 1, females showed greater attention to infant than adult faces (BS effect) in both pupils, regardless of the ethnic group of the face. By contrast, males attended to infant more than adult faces for out-group faces only (BS effect). In Study 2, greater left posterior-parietal alpha activation toward out-group compared to in-group adult faces was found in males (MRE). Participants with a low BS effect toward in-group baby faces exhibited greater left posterior alpha activation to out-group than in-group baby faces (MRE). These findings reveal how different levels of sensitivity to in-group infants may moderate perceptions of both in-group and out-group baby faces. Questionnaire measures on attitudes showed that males and females preferred in-group to out-group adult faces (MRE). Participants in Study 2 also reported a greater preference for infants than adults faces (BS effect). These findings explicate the roles of gender and the Baby Schema effect in moderating implicit processing of in-group and out-group faces, despite their lack in moderating explicit reports. Contradictory findings at the implicit (physiological) and explicit (self-report) levels suggest that differential processing of faces may occur at a non-conscious level.
Collapse
Affiliation(s)
- Leonardo Venturoso
- Department of Psychology and Cognitive Science, University of Trento, Trento, Italy
| | - Giulio Gabrieli
- Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore, Singapore
| | - Anna Truzzi
- Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin, Ireland
| | - Atiqah Azhari
- Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore, Singapore
| | - Peipei Setoh
- Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore, Singapore
| | - Marc H. Bornstein
- Institute for Fiscal Studies, London, United Kingdom
- National Institute of Child Health and Human Development, Bethesda, MD, United States
| | - Gianluca Esposito
- Department of Psychology and Cognitive Science, University of Trento, Trento, Italy
- Psychology Program, School of Social Sciences, Nanyang Technological University, Singapore, Singapore
| |
Collapse
|
74
|
Naber M, Murphy P. Pupillometric investigation into the speed-accuracy trade-off in a visuo-motor aiming task. Psychophysiology 2019; 57:e13499. [PMID: 31736089 PMCID: PMC7027463 DOI: 10.1111/psyp.13499] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2019] [Revised: 09/25/2019] [Accepted: 10/22/2019] [Indexed: 12/22/2022]
Abstract
Convergent lines of evidence suggest that fluctuations in the size of the pupil may be associated with the trade‐off between the speed (adrenergic, sympathetic) and accuracy (cholinergic, parasympathetic) of behavior across a variety of task contexts. Here, we explored whether pupil size was related to this trade‐off during a visuospatial motor aiming task. Participants were shown visual targets at random locations on a screen and were instructed and incentivized to move a computer mouse‐controlled cursor to the center of the targets, either as fast as possible, as accurately as possible, or to strike a balance between the two. Behavioral results showed that these instructions led to typical speed‐accuracy trade‐off effects on movement reaction times and hit distances to target centers. Pupillometric analyses revealed that movements were faster and less accurate when participants had relatively large baseline pupil sizes, as measured before target onset. Furthermore, trial‐evoked pupil dilation was related specifically to a bias toward speed in the trade‐off and the speed of the ballistic and error‐correction phases of the motor responses such that larger pupils predicted shorter latencies and higher movement speeds. Pupil responses were also associated with performance in a manner that may reflect the combined influence of a number of factors, including the generation of dynamic urgency and an arousal response to negative feedback. Our results generally support a role for pupil‐linked arousal in regulating the trade‐off between speed and accuracy, while also highlighting how the trial‐related pupil response can exhibit multifaceted, temporally discrete associations with behavior. The eye’s pupil has been considered a “window into the soul” as its dynamics are related to a wide variety of cognitive processes. Here, we present convergent evidence that both slow, prestimulus fluctuations and fast, event‐related changes in pupil diameter are sensitive to a fundamental trade‐off between the speed and accuracy of visuo‐motor actions—an association that holds for both instructed and endogenous variation in this trade‐off. This finding complements a growing literature linking pupil size to adaptive, contextually appropriate changes in behavior.
Collapse
Affiliation(s)
- Marnix Naber
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands.,Vision Sciences Laboratory, Harvard University, Cambridge, Massachusetts
| | - Peter Murphy
- Section Computational Cognitive Neuroscience, Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
75
|
Zokaei N, Board AG, Manohar SG, Nobre AC. Modulation of the pupillary response by the content of visual working memory. Proc Natl Acad Sci U S A 2019; 116:22802-22810. [PMID: 31636213 PMCID: PMC6842592 DOI: 10.1073/pnas.1909959116] [Citation(s) in RCA: 37] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Studies of selective attention during perception have revealed modulation of the pupillary response according to the brightness of task-relevant (attended) vs. -irrelevant (unattended) stimuli within a visual display. As a strong test of top-down modulation of the pupil response by selective attention, we asked whether changes in pupil diameter follow internal shifts of attention to memoranda of visual stimuli of different brightness maintained in working memory, in the absence of any visual stimulation. Across 3 studies, we reveal dilation of the pupil when participants orient attention to the memorandum of a dark grating relative to that of a bright grating. The effect occurs even when the attention-orienting cue is independent of stimulus brightness, and even when stimulus brightness is merely incidental and not required for the working-memory task of judging stimulus orientation. Furthermore, relative dilation and constriction of the pupil occurred dynamically and followed the changing temporal expectation that 1 or the other stimulus would be probed across the retention delay. The results provide surprising and consistent evidence that pupil responses are under top-down control by cognitive factors, even when there is no direct adaptive gain for such modulation, since no visual stimuli were presented or anticipated. The results also strengthen the view of sensory recruitment during working memory, suggesting even activation of sensory receptors. The thought-provoking corollary to our findings is that the pupils provide a reliable measure of what is in the focus of mind, thus giving a different meaning to old proverbs about the eyes being a window to the mind.
Collapse
Affiliation(s)
- Nahid Zokaei
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, OX3 7JX Oxford, United Kingdom;
- Department of Experimental Psychology, University of Oxford, OX1 3UD Oxford, United Kingdom
| | - Alexander G Board
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, OX3 7JX Oxford, United Kingdom
- Department of Experimental Psychology, University of Oxford, OX1 3UD Oxford, United Kingdom
| | - Sanjay G Manohar
- Department of Experimental Psychology, University of Oxford, OX1 3UD Oxford, United Kingdom
- Nuffield Department of Clinical Neurosciences, University of Oxford, OX3 9DU Oxford, United Kingdom
| | - Anna C Nobre
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, OX3 7JX Oxford, United Kingdom
- Department of Experimental Psychology, University of Oxford, OX1 3UD Oxford, United Kingdom
| |
Collapse
|
76
|
Abstract
Pupil dilation is an effective indicator of cognitive and affective processes. Although several eyetracker systems on the market can provide effective solutions for pupil dilation measurement, there is a lack of tools for processing and analyzing the data provided by these systems. For this reason, we developed CHAP: open-source software written in MATLAB. This software provides a user-friendly graphical user interface for processing and analyzing pupillometry data. Our software creates uniform conventions for the preprocessing and analysis of pupillometry data and provides a quick and easy-to-use tool for researchers interested in pupillometry. To download CHAP or join our mailing list, please visit CHAP's website: http://in.bgu.ac.il/en/Labs/CNL/chap .
Collapse
|
77
|
Yeshurun Y. The spatial distribution of attention. Curr Opin Psychol 2019; 29:76-81. [DOI: 10.1016/j.copsyc.2018.12.008] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2018] [Revised: 11/10/2018] [Accepted: 12/13/2018] [Indexed: 10/27/2022]
|
78
|
Brief Report: Pupillometry, Visual Perception, and ASD Features in a Task-Switching Paradigm. J Autism Dev Disord 2019; 49:5086-5099. [DOI: 10.1007/s10803-019-04213-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
|
79
|
Snell J, Grainger J. Readers Are Parallel Processors. Trends Cogn Sci 2019; 23:537-546. [DOI: 10.1016/j.tics.2019.04.006] [Citation(s) in RCA: 40] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2019] [Revised: 04/09/2019] [Accepted: 04/17/2019] [Indexed: 10/26/2022]
|
80
|
Colorful glares: Effects of colors on brightness illusions measured with pupillometry. Acta Psychol (Amst) 2019; 198:102882. [PMID: 31288107 DOI: 10.1016/j.actpsy.2019.102882] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2019] [Revised: 06/21/2019] [Accepted: 07/01/2019] [Indexed: 11/21/2022] Open
Abstract
We hypothesized that pupil constrictions to the glare illusion, where converging luminance gradients subjectively enhance the perception of brightness, would be stronger for 'blue' than for other colors. Such an expectation was based on reflections about the ecology of vision, where the experience of dazzling light is common when one happens to look directly at sunlight through some occluders. Thus, we hypothesized that pupil constrictions to 'blue' reflect an ecologically-based expectation of the visual system from the experience of sky's light and color, which also leads to interpret the blue gradients of illusory glare to act as effective cues to impending probable intense light. We therefore manipulated the gradients color of glare illusions and measured changes in subjective brightness of identical shape stimuli. We confirmed that the blue resulted in what was subjectively evaluated as the brightest condition, despite all colored stimuli were equiluminant. This enhanced brightness effect was observed both in a psychophysical adjustment task and in changes in pupil size, where the maximum pupil constriction peak was observed with the 'blue' converging gradients over and above to the pupil response to blue in other conditions (i.e., diverging gradients and homogeneous patches). Moreover, glare-related pupil constrictions for each participant were correlated to each individual's subjective brightness adjustments. Homogenous blue hues also constricted the pupil more than other hues, which represents a pupillometric analog of the Helmholtz-Kohlrausch effect on brightness perception. Together, these findings show that pupillometry constitutes an easy tool to assess individual differences in color brightness perception.
Collapse
|
81
|
Peinkhofer C, Knudsen GM, Moretti R, Kondziella D. Cortical modulation of pupillary function: systematic review. PeerJ 2019; 7:e6882. [PMID: 31119083 PMCID: PMC6510220 DOI: 10.7717/peerj.6882] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2019] [Accepted: 03/26/2019] [Indexed: 12/25/2022] Open
Abstract
BACKGROUND The pupillary light reflex is the main mechanism that regulates the pupillary diameter; it is controlled by the autonomic system and mediated by subcortical pathways. In addition, cognitive and emotional processes influence pupillary function due to input from cortical innervation, but the exact circuits remain poorly understood. We performed a systematic review to evaluate the mechanisms behind pupillary changes associated with cognitive efforts and processing of emotions and to investigate the cerebral areas involved in cortical modulation of the pupillary light reflex. METHODOLOGY We searched multiple databases until November 2018 for studies on cortical modulation of pupillary function in humans and non-human primates. Of 8,809 papers screened, 258 studies were included. RESULTS Most investigators focused on pupillary dilatation and/or constriction as an index of cognitive and emotional processing, evaluating how changes in pupillary diameter reflect levels of attention and arousal. Only few tried to correlate specific cerebral areas to pupillary changes, using either cortical activation models (employing micro-stimulation of cortical structures in non-human primates) or cortical lesion models (e.g., investigating patients with stroke and damage to salient cortical and/or subcortical areas). Results suggest the involvement of several cortical regions, including the insular cortex (Brodmann areas 13 and 16), the frontal eye field (Brodmann area 8) and the prefrontal cortex (Brodmann areas 11 and 25), and of subcortical structures such as the locus coeruleus and the superior colliculus. CONCLUSIONS Pupillary dilatation occurs with many kinds of mental or emotional processes, following sympathetic activation or parasympathetic inhibition. Conversely, pupillary constriction may occur with anticipation of a bright stimulus (even in its absence) and relies on a parasympathetic activation. All these reactions are controlled by subcortical and cortical structures that are directly or indirectly connected to the brainstem pupillary innervation system.
Collapse
Affiliation(s)
- Costanza Peinkhofer
- Department of Neurology, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
- Medical Faculty, University of Trieste, Trieste, Italy
| | - Gitte M. Knudsen
- Department of Neurology, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
- Neurobiology Research Unit, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
- Faculty of Health and Medical Science, University of Copenhagen, Copenhagen, Denmark
| | - Rita Moretti
- Medical Faculty, University of Trieste, Trieste, Italy
- Department of Medical, Surgical and Health Sciences, Neurological Unit, Trieste University Hospital, Cattinara, Trieste, Italy
| | - Daniel Kondziella
- Department of Neurology, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
- Faculty of Health and Medical Science, University of Copenhagen, Copenhagen, Denmark
- Department of Neuroscience, Norwegian University of Technology and Science, Trondheim, Norway
| |
Collapse
|
82
|
Brief Report: Visual Perception, Task-Induced Pupil Response Trajectories and ASD Features in Children. J Autism Dev Disord 2019; 49:3016-3030. [PMID: 31037428 DOI: 10.1007/s10803-019-04028-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
Abstract
We applied a trajectory-based analysis to eye tracking data in order to quantify individualized patterns of pupil response in the context of global-local processing that may be associated with autism spectrum disorder (ASD) features. Multiple pupil response trajectories across both global and local conditions were identified. Using the combined trajectory patterns for global and local conditions for each individual, we were able to identify three groups based on trajectory group membership that were thought to reflect perceptual strategy. Results indicated that the proportion of children with ASD was significantly greater in the group demonstrating a local-focus response. This research presents a novel analytic approach to the objective characterization of individualized pupil response patterns that are associated with ASD features.
Collapse
|
83
|
Using task effort and pupil size to track covert shifts of visual attention independently of a pupillary light reflex. Behav Res Methods 2019. [PMID: 29516414 DOI: 10.3758/s13428-018-1033-8] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
We tested the link between pupil size and the task effort involved in covert shifts of visual attention. The goal of this study was to establish pupil size as a marker of attentional shifting in the absence of luminance manipulations. In three experiments, participants evaluated two stimuli that were presented peripherally, appearing equidistant from and on opposite sides of eye fixation. The angle between eye fixation and the peripherally presented target stimuli varied from 12.5° to 42.5°. The evaluation of more distant stimuli led to poorer performance than did the evaluation of more proximal stimuli throughout our study, confirming that the former required more effort than the latter. In addition, in Experiment 1 we found that pupil size increased with increasing angle and that this effect could not be reduced to the operation of low-level visual processes in the task. In Experiment 2 the pupil dilated more strongly overall when participants evaluated the target stimuli, which required shifts of attention, than when they merely reported on the target's presence versus absence. Both conditions yielded larger pupils for more distant than for more proximal stimuli, however. In Experiment 3, we manipulated task difficulty more directly, by changing the contrast at which the target stimuli were presented. We replicated the results from Experiment 1 only with the high-contrast stimuli. With stimuli of low contrast, ceiling effects in pupil size were observed. Our data show that the link between task effort and pupil size can be used to track the degree to which an observer covertly shifts attention to or detects stimuli in peripheral vision.
Collapse
|
84
|
Lasaponara S, Fortunato G, Dragone A, Pellegrino M, Marson F, Silvetti M, Pinto M, D'Onofrio M, Doricchi F. Expectancy modulates pupil size both during endogenous orienting and during re‐orienting of spatial attention: A study with isoluminant stimuli. Eur J Neurosci 2019; 50:2893-2904. [DOI: 10.1111/ejn.14391] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2018] [Revised: 02/14/2019] [Accepted: 02/15/2019] [Indexed: 01/01/2023]
Affiliation(s)
- Stefano Lasaponara
- Laboratorio di Neuropsicologia dell'attenzione Fondazione Santa Lucia IRCCS Roma Italy
- Dipartimento di Scienze Umane Libera Università Maria Santissima Assunta – LUMSA Roma Italy
| | | | - Alessio Dragone
- Laboratorio di Neuropsicologia dell'attenzione Fondazione Santa Lucia IRCCS Roma Italy
- Dipartimento di Psicologia 39 Sapienza Università di Roma Roma Italy
| | - Michele Pellegrino
- Laboratorio di Neuropsicologia dell'attenzione Fondazione Santa Lucia IRCCS Roma Italy
- Dipartimento di Psicologia 39 Sapienza Università di Roma Roma Italy
| | - Fabio Marson
- Laboratorio di Neuropsicologia dell'attenzione Fondazione Santa Lucia IRCCS Roma Italy
- Dipartimento di Psicologia 39 Sapienza Università di Roma Roma Italy
| | - Massimo Silvetti
- Department of Experimental Psychology Ghent University Ghent Belgium
- Institute of Cognitive Sciences and Technologies (ISTC‐CNR) National Research Council Rome Italy
| | - Mario Pinto
- Laboratorio di Neuropsicologia dell'attenzione Fondazione Santa Lucia IRCCS Roma Italy
- Dipartimento di Psicologia 39 Sapienza Università di Roma Roma Italy
| | - Marianna D'Onofrio
- Laboratorio di Neuropsicologia dell'attenzione Fondazione Santa Lucia IRCCS Roma Italy
- Dipartimento di Psicologia 39 Sapienza Università di Roma Roma Italy
| | - Fabrizio Doricchi
- Laboratorio di Neuropsicologia dell'attenzione Fondazione Santa Lucia IRCCS Roma Italy
- Dipartimento di Psicologia 39 Sapienza Università di Roma Roma Italy
| |
Collapse
|
85
|
Ebitz RB, Moore T. Both a Gauge and a Filter: Cognitive Modulations of Pupil Size. Front Neurol 2019; 9:1190. [PMID: 30723454 PMCID: PMC6350273 DOI: 10.3389/fneur.2018.01190] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2018] [Accepted: 12/27/2018] [Indexed: 01/21/2023] Open
Abstract
Over 50 years of research have established that cognitive processes influence pupil size. This has led to the widespread use of pupil size as a peripheral measure of cortical processing in psychology and neuroscience. However, the function of cortical control over the pupil remains poorly understood. Why does visual attention change the pupil light reflex? Why do mental effort and surprise cause pupil dilation? Here, we consider these functional questions as we review and synthesize two literatures on cognitive effects on the pupil: how cognition affects pupil light response and how cognition affects pupil size under constant luminance. We propose that cognition may have co-opted control of the pupil in order to filter incoming visual information to optimize it for particular goals. This could complement other cortical mechanisms through which cognition shapes visual perception.
Collapse
Affiliation(s)
- R. Becket Ebitz
- Department of Neuroscience and Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, United States
| | - Tirin Moore
- Department of Neurobiology, Stanford University School of Medicine, Stanford, CA, United States
- Howard Hughes Medical Institute, Seattle, WA, United States
| |
Collapse
|
86
|
Sabatino DiCriscio A, Hu Y, Troiani V. Task-induced pupil response and visual perception in adults. PLoS One 2018; 13:e0209556. [PMID: 30586398 PMCID: PMC6306195 DOI: 10.1371/journal.pone.0209556] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2018] [Accepted: 12/08/2018] [Indexed: 01/14/2023] Open
Abstract
We assessed whether there are differences in pupil response that underlie the selection of local vs. global parts of a stimulus array in healthy adults. We designed a Navon Figures eyetracking paradigm (i.e. large figure composed of small figures), requiring an individual to vary only the information attended to within an image. We found that participants have a characteristic constriction of the pupil waveform during selection of local information relative to global information. Because stimuli and lighting conditions were identical across conditions, this indicates that pupil changes may serve in a visual filtering mechanism important for attentional selection. This work represents the first characterization of pupil response in the context of selective attention, suggesting that mechanisms underlying the earliest stages of visual processes could be relevant for perception and visual selection.
Collapse
Affiliation(s)
| | - Yirui Hu
- Geisinger Center for Health Research, Danville, PA, United States of America
| | - Vanessa Troiani
- Geisinger Autism & Developmental Medicine Institute, Lewisburg, PA, United States of America
| |
Collapse
|
87
|
Sperandio I, Bond N, Binda P. Pupil Size as a Gateway Into Conscious Interpretation of Brightness. Front Neurol 2018; 9:1070. [PMID: 30631301 PMCID: PMC6315169 DOI: 10.3389/fneur.2018.01070] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2018] [Accepted: 11/23/2018] [Indexed: 11/16/2022] Open
Abstract
Although retinal illumination is the main determinant of pupil size, evidence indicates that extra-retinal factors, including attention and contextual information, also modulate the pupillary response. For example, stimuli that evoke the idea of brightness (e.g., pictures of the sun) induce pupillary constriction compared to control stimuli of matched luminance. Is conscious appraisal of these stimuli necessary for the pupillary constriction to occur? Participants' pupil diameter was recorded while sun pictures and their phase-scrambled versions were shown to the left eye. A stream of Mondrian patterns was displayed to the right eye to produce continuous flash suppression, which rendered the left-eye stimuli invisible on some trials. Results revealed that when participants were aware of the sun pictures their pupils constricted relative to the control stimuli. This was not the case when the pictures were successfully suppressed from awareness, demonstrating that pupil size is highly sensitive to the contents of consciousness.
Collapse
Affiliation(s)
- Irene Sperandio
- The School of Psychology, University of East Anglia, Norwich, United Kingdom
| | - Nikki Bond
- The School of Psychology, University of East Anglia, Norwich, United Kingdom
| | - Paola Binda
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy.,Institute of Neuroscience, Consiglio Nazionale delle Ricerche (CNR), Pisa, Italy
| |
Collapse
|
88
|
Walle KM, Nordvik JE, Espeseth T, Becker F, Laeng B. Multiple object tracking and pupillometry reveal deficits in both selective and intensive attention in unilateral spatial neglect. J Clin Exp Neuropsychol 2018; 41:270-289. [DOI: 10.1080/13803395.2018.1536735] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Affiliation(s)
- Kjersti Mæhlum Walle
- Department of Research, Sunnaas Rehabilitation Hospital, Nesoddtangen, Norway
- Department of Psychology, University of Oslo, Oslo, Norway
| | - Jan Egil Nordvik
- Department of Research, Sunnaas Rehabilitation Hospital, Nesoddtangen, Norway
| | | | - Frank Becker
- Department of Research, Sunnaas Rehabilitation Hospital, Nesoddtangen, Norway
- Institute of Clinical Medicine, University of Oslo, Oslo, Norway
| | - Bruno Laeng
- Department of Psychology, University of Oslo, Oslo, Norway
| |
Collapse
|
89
|
Hybrid System for Engagement Recognition During Cognitive Tasks Using a CFS + KNN Algorithm. SENSORS 2018; 18:s18113691. [PMID: 30380784 PMCID: PMC6263401 DOI: 10.3390/s18113691] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/07/2018] [Revised: 10/15/2018] [Accepted: 10/29/2018] [Indexed: 11/17/2022]
Abstract
Engagement is described as a state in which an individual involved in an activity can ignore other influences. The engagement level is important to obtaining good performance especially under study conditions. Numerous methods using electroencephalograph (EEG), electrocardiograph (ECG), and near-infrared spectroscopy (NIRS) for the recognition of engagement have been proposed. However, the results were either unsatisfactory or required many channels. In this study, we introduce the implementation of a low-density hybrid system for engagement recognition. We used a two-electrode wireless EEG, a wireless ECG, and two wireless channels NIRS to measure engagement recognition during cognitive tasks. We used electrooculograms (EOG) and eye tracking to record eye movements for data labeling. We calculated the recognition accuracy using the combination of correlation-based feature selection and k-nearest neighbor algorithm. Following that, we did a comparative study against a stand-alone system. The results show that the hybrid system had an acceptable accuracy for practical use (71.65 ± 0.16%). In comparison, the accuracy of a pure EEG system was (65.73 ± 0.17%), pure ECG (67.44 ± 0.19%), and pure NIRS (66.83 ± 0.17%). Overall, our results demonstrate that the proposed method can be used to improve performance in engagement recognition.
Collapse
|
90
|
Ajasse S, Benosman RB, Lorenceau J. Effects of pupillary responses to luminance and attention on visual spatial discrimination. J Vis 2018; 18:6. [PMID: 30347093 DOI: 10.1167/18.11.6] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
The optic quality of the eyes is, at least in part, determined by pupil size. Large pupils let more light enter the eyes, but degrade the point spread function, and thus the spatial resolution that can be achieved (Campbell & Gregory, 1960). In natural conditions, the pupil is mainly driven by the luminance (and possibly the color and contrast) at the gazed location, but is also modulated by attention and cognitive factors. Whether changes in eyes' optics related to pupil size modulation by luminance and attention impacts visual processing was assessed in two experiments. In Experiment 1, we measured pupil size using a constantly visible display made of four disks with different luminance levels, with no other task than fixating the disks in succession. The results confirmed that pupil size depends on the luminance of the gazed stimulus. Experiment 2, using similar settings as Experiment 1, used a two-interval forced-choice design to test whether discriminating high spatial frequencies that requires covert attention to parafoveal stimuli is better during the fixation of bright disks that entails a small pupil size, and hence better eyes' optics, as compared to fixating dark disks that entails a large pupil size, and hence poorer eyes' optics. As in Experiment 1, we observed large modulations of pupil size depending on the luminance of the gazed stimulus, but pupil dynamics was more variable, with marked pupil dilation during stimulus encoding, presumably because the demanding spatial frequency discrimination task engaged attention. However, discrimination performance and mean pupil size were not correlated. Despite this lack of correlation, the slopes of pupil dilation during stimulus encoding were correlated to performance, while the slopes of pupil dilation during decision-making were not. We discuss these results regarding the possible functional roles of pupil size modulations.
Collapse
Affiliation(s)
- Suzon Ajasse
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, Paris, France
| | - Ryad B Benosman
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, Paris, France
| | - Jean Lorenceau
- Sorbonne Université, INSERM, CNRS, Institut de la Vision, Paris, France
| |
Collapse
|
91
|
Abstract
Spatial attention enables us to focus visual processing toward specific locations or stimuli before the next fixation. Recent evidence has suggested that local luminance at the spatial locus of attention or saccade preparation influences pupil size independent of global luminance levels. However, it remains to be determined which neural pathways produce this location-specific modulation of pupil size. The intermediate layers of the midbrain superior colliculus (SC) form part of the network of brain areas involved in spatial attention and modulation of pupil size. Here, we demonstrated that pupil size was altered according to local luminance level at the spatial location corresponding to a microstimulated location in the intermediate SC (SCi) map of monkeys. Moreover, local SCi inactivation through injection of lidocaine reversed this local luminance modulation. Our findings reveal a causal role of the SCi in preparing pupil size for local luminance conditions at the next saccadic goal.
Collapse
|
92
|
No supplementary evidence of attention to a spatial cue when saccadic facilitation is absent. Sci Rep 2018; 8:13289. [PMID: 30185930 PMCID: PMC6125402 DOI: 10.1038/s41598-018-31633-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2017] [Accepted: 08/23/2018] [Indexed: 11/16/2022] Open
Abstract
Attending a location in space facilitates responses to targets at that location when the time between cue and target is short. Certain types of exogenous cues – such as sudden peripheral onsets – have been described as reflexive and automatic. Recent studies however, have been showing many cases where exogenous cues are less automatic than previously believed and do not always result in facilitation. A lack of the behavioral facilitation, however, does not automatically necessitate a lack of underlying attention to that location. We test exogenous cueing in two experiments where facilitation is and is not likely to be observed with saccadic responses. We also test alternate measures linked to the allocation of attention such as saccadic curvature, microsaccades and pupil size. As expected, we find early facilitation as measured by saccadic reaction time when CTOAs are predictable but not when they are randomized within a block. We find no impact of the cue on microsaccade direction for either experiment, and only a slight dip in the frequency of microsaccades after the cue. We do find that change in pupil size to the cue predicts the magnitude of the validity effect, but only in the experiment where facilitation was observed. In both experiments, we observed a tendency for saccadic curvature to deviate away from the cued location and this was stronger for early CTOAs and toward vertical targets. Overall, we find that only change in pupil size is consistent with observed facilitation. Saccadic curvature is influenced by the onset of the cue, buts its direction is indicative of oculomotor inhibition whether we see RT facilitation or not. Microsaccades were not diagnostic in either experiment. Finally, we see little to no evidence of attention at the cued location in any additional measures when facilitation of saccadic responses is absent.
Collapse
|
93
|
Tkacz-Domb S, Yeshurun Y. The size of the attentional window when measured by the pupillary response to light. Sci Rep 2018; 8:11878. [PMID: 30089801 PMCID: PMC6082875 DOI: 10.1038/s41598-018-30343-7] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2018] [Accepted: 07/09/2018] [Indexed: 11/09/2022] Open
Abstract
This study measured the size of the attentional window when attention is narrowly focused, using attentional modulation of the pupillary light response - pupillary constriction when covertly attending a brighter than darker area. This allowed us to avoid confounds and biases involved in relying on observers' response (e.g., RT), which contaminated previous measurements of this window. We presented letters to the right and left of fixation, each surrounded by task-irrelevant disks with varying distances. The disks were bright on one side and dark on the other. A central cue indicated which letter to attend. Luminance levels were identical across trials. We found that pupil size was modulated by the disks' luminance when they were 1° away from the attended letter, but not when this distance was larger. This suggests that the diameter of the attentional window is at least 2°, which is twice as large as that established with behavioral measurements.
Collapse
Affiliation(s)
- Shira Tkacz-Domb
- Psychology Department and Institute of Information Processing and Decision Making, University of Haifa, Haifa, 3498838, Israel.
| | - Yaffa Yeshurun
- Psychology Department and Institute of Information Processing and Decision Making, University of Haifa, Haifa, 3498838, Israel
| |
Collapse
|
94
|
Thielen J, van Lier R, van Gerven M. No evidence for confounding orientation-dependent fixational eye movements under baseline conditions. Sci Rep 2018; 8:11644. [PMID: 30076355 PMCID: PMC6076314 DOI: 10.1038/s41598-018-30221-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2018] [Accepted: 07/24/2018] [Indexed: 11/20/2022] Open
Abstract
Decoding has become a standard analysis technique for contemporary cognitive neuroscience. Already more than a decade ago, it was shown that orientation information could be decoded from functional magnetic resonance imaging voxel time series. However, the underlying neural mechanism driving the decodable information is still under debate. Here, we investigated whether eye movements and pupil dilation during attempted fixation and passive viewing of visually presented square-wave grating stimuli could explain orientation decoding. We hypothesized that there are confounding orientation-dependent fixational eye movements (e.g., microsaccades), which systematically alter brain activity, and hence can be the source of decodable information. We repeated one of the original orientation decoding studies, but recorded eye movements instead of brain activity. We found no evidence that stimulus orientation can be decoded from eye movements under baseline conditions, but cannot rule out the potential confounding effect of eye movements under different conditions. With this study, we emphasize the importance, and show the implications of such potential confounding eye movements for decoding studies and cognitive neuroscience in general.
Collapse
Affiliation(s)
- Jordy Thielen
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands.
| | - Rob van Lier
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
| | - Marcel van Gerven
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
| |
Collapse
|
95
|
Abstract
Mind wandering (MW) refers to the shift of attention away from a primary task towards thoughts unrelated to the task. Here we show that significant new insight into the dynamics of this process can be gained by using pupillometry. Participants performed a monotonous vigilance task which was intermixed with task-irrelevant verbal cues. At fixed times, we interrupted them and asked what they were thinking about immediately prior to the probe and what had triggered their thought. We observed pupil dilation after the presentation of verbal cues reported to have triggered MW, compared with other verbal cues with similar emotional content. Thus, MW is associated with pupil dilation. We also analysed the pupil-constriction response to the task-stimuli (vertical and horizontal bars, to be categorized as targets and non-targets for the vigilance task), and found that this was unchanged during MW. We conclude that pupil size provides an index of MW, objective and covert and that this may be exploited in further studies to understand whether and how MW affects the processing of sensory stimuli.
Collapse
|
96
|
Abstract
Measurement of pupil size (pupillometry) has recently gained renewed interest from psychologists, but there is little agreement on how pupil-size data is best analyzed. Here we focus on one aspect of pupillometric analyses: baseline correction, i.e., analyzing changes in pupil size relative to a baseline period. Baseline correction is useful in experiments that investigate the effect of some experimental manipulation on pupil size. In such experiments, baseline correction improves statistical power by taking into account random fluctuations in pupil size over time. However, we show that baseline correction can also distort data if unrealistically small pupil sizes are recorded during the baseline period, which can easily occur due to eye blinks, data loss, or other distortions. Divisive baseline correction (corrected pupil size = pupil size/baseline) is affected more strongly by such distortions than subtractive baseline correction (corrected pupil size = pupil size - baseline). We discuss the role of baseline correction as a part of preprocessing of pupillometric data, and make five recommendations: (1) before baseline correction, perform data preprocessing to mark missing and invalid data, but assume that some distortions will remain in the data; (2) use subtractive baseline correction; (3) visually compare your corrected and uncorrected data; (4) be wary of pupil-size effects that emerge faster than the latency of the pupillary response allows (within ±220 ms after the manipulation that induces the effect); and (5) remove trials on which baseline pupil size is unrealistically small (indicative of blinks and other distortions).
Collapse
|
97
|
Naber M, Roelofzen C, Fracasso A, Bergsma DP, van Genderen M, Porro GL, Dumoulin SO. Gaze-Contingent Flicker Pupil Perimetry Detects Scotomas in Patients With Cerebral Visual Impairments or Glaucoma. Front Neurol 2018; 9:558. [PMID: 30042727 PMCID: PMC6048245 DOI: 10.3389/fneur.2018.00558] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2018] [Accepted: 06/21/2018] [Indexed: 11/27/2022] Open
Abstract
Background: The pupillary light reflex is weaker for stimuli presented inside as compared to outside absolute scotomas. Pupillograph perimetry could thus be an objective measure of impaired visual processing. However, the diagnostic accuracy in detecting scotomas has remained unclear. We quantitatively investigated the accuracy of a novel form of pupil perimetry. Methods: The new perimetry method, termed gaze-contingent flicker pupil perimetry, consists of the repetitive on, and off flickering of a bright disk (2 hz; 320 cd/m2; 4° diameter) on a gray background (160 cd/m2) for 4 seconds per stimulus location. The disk evokes continuous pupil oscillations at the same rate as its flicker frequency, and the oscillatory power of the pupil reflects visual sensitivity. We monocularly presented the disk at a total of 80 locations in the central visual field (max. 15°). The location of the flickering disk moved along with gaze to reduce confounds of eye movements (gaze-contingent paradigm). The test lasted ~5 min per eye and was performed on 7 patients with cerebral visual impairment (CVI), 8 patients with primary open angle glaucoma (age >45), and 14 healthy, age/gender-matched controls. Results: For all patients, pupil oscillation power (FFT based response amplitude to flicker) was significantly weaker when the flickering disk was presented in the impaired as compared to the intact visual field (CVI: 12%, AUC = 0.73; glaucoma: 9%, AUC = 0.63). Differences in power values between impaired and intact visual fields of patients were larger than differences in power values at corresponding locations in the visual fields of the healthy control group (CVI: AUC = 0.95; glaucoma: AUC = 0.87). Pupil sensitivity maps highlighted large field scotomas and indicated the type of visual field defect (VFD) as initially diagnosed with standard automated perimetry (SAP) fairly accurately in CVI patients but less accurately in glaucoma patients. Conclusions: We provide the first quantitative and objective evidence of flicker pupil perimetry's potential in detecting CVI-and glaucoma-induced VFDs. Gaze-contingent flicker pupil perimetry is a useful form of objective perimetry and results suggest it can be used to assess large VFDs with young CVI patients whom are unable to perform SAP.
Collapse
Affiliation(s)
- Marnix Naber
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, Netherlands
| | - Carlien Roelofzen
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, Netherlands.,Spinoza Centre for Neuroimaging, Royal Netherlands Academy for Arts and Sciences, Amsterdam, Netherlands
| | - Alessio Fracasso
- Spinoza Centre for Neuroimaging, Royal Netherlands Academy for Arts and Sciences, Amsterdam, Netherlands.,Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
| | - Douwe P Bergsma
- Department of Cognitive Neuroscience, University Medical Centre St. Radboud, Nijmegen, Netherlands
| | - Mies van Genderen
- Bartiméus Diagnostic Centre for complex visual disorders, Zeist, Netherlands
| | - Giorgio L Porro
- Ophthalmology, University Medical Center Utrecht, Utrecht, Netherlands
| | - Serge O Dumoulin
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, Netherlands.,Spinoza Centre for Neuroimaging, Royal Netherlands Academy for Arts and Sciences, Amsterdam, Netherlands.,Experimental and Applied Psychology, VU University Amsterdam, Amsterdam, Netherlands
| |
Collapse
|
98
|
Abstract
The signature of spatial attention effects has been demonstrated through saccade planning and working memory. Although saccade planning and working memory have been commonly linked to attention, the comparison of effects resulting from saccade planning and working memory is less explored. It has recently been shown that spatial attention interacts with local luminance at the attended location. When bright and dark patch stimuli are presented simultaneously in the periphery, thereby producing no change in global luminance, pupil size is nonetheless smaller when the locus of attention overlaps with the bright, compared to the dark patch stimulus (referred to as the local luminance modulation). Here, we used the local luminance modulation to directly compare the effects of saccade planning and spatial working memory. Participants were required to make a saccade towards a visual target location (visual-delay) or a remembered target location (memory-delay) after a variable delay, and the bright and dark patch stimuli were presented during the delay period between target onset and go signal. Greater pupil constriction was observed when the bright patch, compared to the dark patch, was spatially aligned with the target location in both tasks. However, the effects were diminished when there was no contingency implemented between the patch and target locations, particularly in the memory-delay task. Together, our results suggest the involvement of similar, but not identical, attentional mechanisms through saccade planning and working memory, and highlight a promising potential of local pupil luminance responses for probing visuospatial processing.
Collapse
|
99
|
Abstract
Recent scientific investigations suggest that people automatically mimic each other’s pupil sizes during interaction. However, instead of being a social mimicry effect, it could also be the result of brightness perception. When observers look at individuals with dilated pupils, little of the brighter iris is visible, leading to the perception of a relatively low-illuminated eye region. In the current study we tested whether pupil mimicry remains present when pupils and irises are equalized for luminance values across pupil sizes. We tested several stimulus sets, including faces with static pupils that varied in size across images and dynamic pupils that changed in size over time in videos. Results showed that for traditional, not-luminance-equalized videos, participants’ pupil sizes adapted to the observed pupils, showing a pattern that is roughly in line with pupil mimicry. However, no such pupil response in line with mimicry was seen for static images (regardless of whether they were equalized for luminance) nor for luminance-equalized videos. These findings suggest that only salient, dynamic stimuli attract enough attention to the luminance in the eye region to evoke a pupillary response. However, although such responses suggest pupil mimicry, the underlying factor is the change in brightness within the eye as a function of pupil size rather than social mimicry.
Collapse
|
100
|
Wang Y, Zekveld AA, Wendt D, Lunner T, Naylor G, Kramer SE. Pupil light reflex evoked by light-emitting diode and computer screen: Methodology and association with need for recovery in daily life. PLoS One 2018; 13:e0197739. [PMID: 29897946 PMCID: PMC5999086 DOI: 10.1371/journal.pone.0197739] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2017] [Accepted: 05/08/2018] [Indexed: 11/19/2022] Open
Abstract
OBJECTIVES Pupil light reflex (PLR) has been widely used as a method for evaluating parasympathetic activity. The first aim of the present study is to develop a PLR measurement using a computer screen set-up and compare its results with the PLR generated by a more conventional setup using light-emitting diode (LED). The parasympathetic nervous system, which is known to control the 'rest and digest' response of the human body, is considered to be associated with daily life fatigue. However, only few studies have attempted to test the relationship between self-reported daily fatigue and physiological measurement of the parasympathetic nervous system. Therefore, the second aim of this study was to investigate the relationship between daily-life fatigue, assessed using the Need for Recovery scale, and parasympathetic activity, as indicated by the PLR parameters. DESIGN A pilot study was conducted first to develop a PLR measurement set-up using a computer screen. PLRs evoked by light stimuli with different characteristics were recorded to confirm the influence of light intensity, flash duration, and color on the PLRs evoked by the system. In the subsequent experimental study, we recorded the PLR of 25 adult participants to light flashes generated by the screen set-up as well as by a conventional LED set-up. PLR parameters relating to parasympathetic and sympathetic activity were calculated from the pupil responses. We tested the split-half reliability across two consecutive blocks of trials, and the relationships between the parameters of PLRs evoked by the two set-ups. Participants rated their need for recovery prior to the PLR recordings. RESULTS PLR parameters acquired in the screen and LED set-ups showed good reliability for amplitude related parameters. The PLRs evoked by both set-ups were consistent, but showed systematic differences in absolute values of all parameters. Additionally, higher need for recovery was associated with faster and larger constriction of the PLR. CONCLUSIONS This study assessed the PLR generated by a computer screen and the PLR generated by a LED. The good reliability within set-ups and the consistency between the PLRs evoked by the set-ups indicate that both systems provides a valid way to evoke the PLR. A higher need for recovery was associated with faster and larger constricting PLRs, suggesting increased levels of parasympathetic nervous system activity in people experiencing higher levels of need for recovery on a daily basis.
Collapse
Affiliation(s)
- Yang Wang
- Section Ear & Hearing, Dept. of Otolaryngology-Head and Neck Surgery, VU University Medical Center and Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
- Eriksholm Research Centre, Oticon A/S, Snekkersten, Denmark
| | - Adriana A. Zekveld
- Section Ear & Hearing, Dept. of Otolaryngology-Head and Neck Surgery, VU University Medical Center and Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
- Department of Behavioral Sciences and Learning, Linköping University, Linköping, Sweden
- Linnaeus Centre HEAD, The Swedish Institute for Disability Research, Linköping and Örebro Universities, Linköping, Sweden
| | - Dorothea Wendt
- Eriksholm Research Centre, Oticon A/S, Snekkersten, Denmark
- Technical University of Denmark, Department of Electrical Engineering, Lyngby, Denmark
| | - Thomas Lunner
- Eriksholm Research Centre, Oticon A/S, Snekkersten, Denmark
- Department of Behavioral Sciences and Learning, Linköping University, Linköping, Sweden
- Linnaeus Centre HEAD, The Swedish Institute for Disability Research, Linköping and Örebro Universities, Linköping, Sweden
- Technical University of Denmark, Department of Electrical Engineering, Lyngby, Denmark
| | - Graham Naylor
- Medical Research Council/Chief Scientist Office Institute of Hearing Research—Scottish Section (Part of The University of Nottingham), Glasgow, United Kingdom
| | - Sophia E. Kramer
- Section Ear & Hearing, Dept. of Otolaryngology-Head and Neck Surgery, VU University Medical Center and Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| |
Collapse
|