1
|
Bennett D, Radulescu A, Zorowitz S, Felso V, Niv Y. Affect-congruent attention modulates generalized reward expectations. PLoS Comput Biol 2023; 19:e1011707. [PMID: 38127874 PMCID: PMC10781156 DOI: 10.1371/journal.pcbi.1011707] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 01/10/2024] [Accepted: 11/23/2023] [Indexed: 12/23/2023] Open
Abstract
Positive and negative affective states are respectively associated with optimistic and pessimistic expectations regarding future reward. One mechanism that might underlie these affect-related expectation biases is attention to positive- versus negative-valence features (e.g., attending to the positive reviews of a restaurant versus its expensive price). Here we tested the effects of experimentally induced positive and negative affect on feature-based attention in 120 participants completing a compound-generalization task with eye-tracking. We found that participants' reward expectations for novel compound stimuli were modulated in an affect-congruent way: positive affect induction increased reward expectations for compounds, whereas negative affect induction decreased reward expectations. Computational modelling and eye-tracking analyses each revealed that these effects were driven by affect-congruent changes in participants' allocation of attention to high- versus low-value features of compounds. These results provide mechanistic insight into a process by which affect produces biases in generalized reward expectations.
Collapse
Affiliation(s)
- Daniel Bennett
- School of Psychological Sciences, Monash University, Clayton, Australia
| | - Angela Radulescu
- Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, New York, United States of America
| | - Sam Zorowitz
- Princeton Neuroscience Institute, Princeton University, Princeton, New Jersey, United States of America
| | - Valkyrie Felso
- Max Planck Institute for Intelligent Systems, Tübingen, Germany
| | - Yael Niv
- Princeton Neuroscience Institute, Princeton University, Princeton, New Jersey, United States of America
- Department of Psychology, Princeton University, Princeton, New Jersey, United States of America
| |
Collapse
|
2
|
Capparini C, To MPS, Dardenne C, Reid VM. Offline Calibration for Infant Gaze and Head Tracking across a Wide Horizontal Visual Field. SENSORS (BASEL, SWITZERLAND) 2023; 23:972. [PMID: 36679775 PMCID: PMC9866781 DOI: 10.3390/s23020972] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Revised: 01/10/2023] [Accepted: 01/11/2023] [Indexed: 06/17/2023]
Abstract
Most well-established eye-tracking research paradigms adopt remote systems, which typically feature regular flat screens of limited width. Limitations of current eye-tracking methods over a wide area include calibration, the significant loss of data due to head movements, and the reduction of data quality over the course of an experimental session. Here, we introduced a novel method of tracking gaze and head movements that combines the possibility of investigating a wide field of view and an offline calibration procedure to enhance the accuracy of measurements. A 4-camera Smart Eye Pro system was adapted for infant research to detect gaze movements across 126° of the horizontal meridian. To accurately track this visual area, an online system calibration was combined with a new offline gaze calibration procedure. Results revealed that the proposed system successfully tracked infants' head and gaze beyond the average screen size. The implementation of an offline calibration procedure improved the validity and spatial accuracy of measures by correcting a systematic top-right error (1.38° mean horizontal error and 1.46° mean vertical error). This approach could be critical for deriving accurate physiological measures from the eye and represents a substantial methodological advance for tracking looking behaviour across both central and peripheral regions. The offline calibration is particularly useful for work with developing populations, such as infants, and for people who may have difficulties in following instructions.
Collapse
Affiliation(s)
- Chiara Capparini
- Center for Research in Cognition & Neuroscience (CRCN), Université Libre de Bruxelles, 1050 Brussels, Belgium
- Department of Psychology, Lancaster University, Lancaster LA1 4YF, UK
| | - Michelle P. S. To
- Department of Psychology, Lancaster University, Lancaster LA1 4YF, UK
| | | | - Vincent M. Reid
- School of Psychology, University of Waikato, Hamilton 3240, New Zealand
| |
Collapse
|
3
|
Current Challenges Supporting School-Aged Children with Vision Problems: A Rapid Review. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11209673] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Many children have undetected vision problems or insufficient visual information processing that may be a factor in lower academic outcomes. The aim of this paper is to contribute to a better understanding of the importance of vision screening for school-aged children, and to investigate the possibilities of how eye-tracking (ET) technologies can support this. While there are indications that these technologies can support vision screening, a broad understanding of how to apply them and by whom, and if it is possible to utilize them at schools, is lacking. We review interdisciplinary research on performing vision investigations, and discuss current challenges for technology support. The focus is on exploring the possibilities of ET technologies to better support screening and handling of vision disorders, especially by non-vision experts. The data orginate from a literature survey of peer-reviewed journals and conference articles complemented by secondary sources, following a rapid review methodology. We highlight current trends in supportive technologies for vision screening, and identify the involved stakeholders and the research studies that discuss how to develop more supportive ET technologies for vision screening and training by non-experts.
Collapse
|
4
|
Abstract
A common problem in eye-tracking research is vertical drift—the progressive displacement of fixation registrations on the vertical axis that results from a gradual loss of eye-tracker calibration over time. This is particularly problematic in experiments that involve the reading of multiline passages, where it is critical that fixations on one line are not erroneously recorded on an adjacent line. Correction is often performed manually by the researcher, but this process is tedious, time-consuming, and prone to error and inconsistency. Various methods have previously been proposed for the automated, post hoc correction of vertical drift in reading data, but these methods vary greatly, not just in terms of the algorithmic principles on which they are based, but also in terms of their availability, documentation, implementation languages, and so forth. Furthermore, these methods have largely been developed in isolation with little attempt to systematically evaluate them, meaning that drift correction techniques are moving forward blindly. We document ten major algorithms, including two that are novel to this paper, and evaluate them using both simulated and natural eye-tracking data. Our results suggest that a method based on dynamic time warping offers great promise, but we also find that some algorithms are better suited than others to particular types of drift phenomena and reading behavior, allowing us to offer evidence-based advice on algorithm selection.
Collapse
|
5
|
Maes P, Stercq F, Kissine M. Attention to intentional versus incidental pointing gestures in young autistic children: An eye-tracking study. J Exp Child Psychol 2021; 210:105205. [PMID: 34134019 DOI: 10.1016/j.jecp.2021.105205] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2021] [Revised: 05/17/2021] [Accepted: 05/17/2021] [Indexed: 11/29/2022]
Abstract
Whereas a reduced tendency to follow pointing gestures is described as an early sign of autism, the literature on response to joint attention indicates that autistic children perform better when a point is added to other social cues such as eye gaze. The purpose of this study was to explore pointing processing in autism when it is the only available cue and to investigate whether autistic children discriminate intentional pointing gestures from incidental pointing gestures. Eye movements of 58 autistic children (48 male) and 61 typically developing children (36 male) aged 3-5 years were recorded as the children were watching videos of a person uttering a pseudoword and pointing intentionally with one hand and incidentally with the other hand. After 3 s, two different potential referents for the pseudoword gradually emerged in both pointed-at corners. In comparison with typically developing children, autistic children's fixations were significantly farther away from both pointed-at zones. Upon hearing a novel word, typically developing children shifted their visual attention toward the zone pointed intentionally. This trend did not emerge in the group of autistic children regardless of their level of vocabulary. Autistic children, independently of their level of language, pay little attention to pointing when no other social cues are available and fail to discriminate intentional pointing gestures from incidental ones. They seem to grasp neither the spatial nor the social value of pointing.
Collapse
Affiliation(s)
- Pauline Maes
- ACTE (Autism in Context: Theory and Experiment) at LaDisco (Center for Linguistics Research) and ULB Neuroscience Institute, Université libre de Bruxelles, 1050 Brussels, Belgium.
| | - Fanny Stercq
- ACTE (Autism in Context: Theory and Experiment) at LaDisco (Center for Linguistics Research) and ULB Neuroscience Institute, Université libre de Bruxelles, 1050 Brussels, Belgium
| | - Mikhail Kissine
- ACTE (Autism in Context: Theory and Experiment) at LaDisco (Center for Linguistics Research) and ULB Neuroscience Institute, Université libre de Bruxelles, 1050 Brussels, Belgium
| |
Collapse
|
6
|
Attentional shifts and preference reversals: An eye-tracking study. JUDGMENT AND DECISION MAKING 2021. [DOI: 10.1017/s1930297500008305] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
AbstractThe classic preference reversal phenomenon, where monetary evaluations contradict risky choices, has been argued to arise due to a focus on outcomes during the evaluation of alternatives, leading to overpricing of long-shot options. Such an explanation makes the implicit assumption that attentional shifts drive the phenomenon. We conducted an eye-tracking study to causally test this hypothesis by comparing a treatment based on cardinal, monetary evaluations with a different treatment avoiding a monetary frame. We find a significant treatment effect in the form of a shift in attention toward outcomes (relative to probabilities) when evaluations are monetary. Our evidence suggests that attentional shifts resulting from the monetary frame of evaluations are a driver of preference reversals.
Collapse
|
7
|
Kolodny T, Schallmo MP, Gerdts J, Bernier RA, Murray SO. Response Dissociation in Hierarchical Cortical Circuits: a Unique Feature of Autism Spectrum Disorder. J Neurosci 2020; 40:2269-2281. [PMID: 32015023 PMCID: PMC7083290 DOI: 10.1523/jneurosci.2376-19.2020] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2019] [Revised: 01/11/2020] [Accepted: 01/22/2020] [Indexed: 01/03/2023] Open
Abstract
A prominent hypothesis regarding the pathophysiology of autism is that an increase in the balance between neural excitation and inhibition results in an increase in neural responses. However, previous reports of population-level response magnitude in individuals with autism have been inconsistent. Critically, network interactions have not been considered in previous neuroimaging studies of excitation and inhibition imbalance in autism. In particular, a defining characteristic of cortical organization is its hierarchical and interactive structure; sensory and cognitive systems are comprised of networks where later stages inherit and build upon the processing of earlier input stages, and also influence and shape earlier stages by top-down modulation. Here we used the well established connections of the human visual system to examine response magnitudes in a higher-order motion processing region [middle temporal area (MT+)] and its primary input region (V1). Simple visual stimuli were presented to adult individuals with autism spectrum disorders (ASD; n = 24, mean age 23 years, 8 females) and neurotypical controls (n = 24, mean age 22, 8 females) during fMRI scanning. We discovered a strong dissociation of fMRI response magnitude between region MT+ and V1 in individuals with ASD: individuals with high MT+ responses had attenuated V1 responses. The magnitude of MT+ amplification and of V1 attenuation was associated with autism severity, appeared to result from amplified suppressive feedback from MT+ to V1, and was not present in neurotypical controls. Our results reveal the potential role of altered hierarchical network interactions in the pathophysiology of ASD.SIGNIFICANCE STATEMENT An imbalance between neural excitation and inhibition, resulting in increased neural responses, has been suggested as a pathophysiological pathway to autism, but direct evidence from humans is lacking. In the current study we consider the role of interactions between stages of sensory processing when testing increased neural responses in individuals with autism. We used the well known hierarchical structure of the visual motion pathway to demonstrate dissociation in the fMRI response magnitude between adjacent stages of processing in autism: responses are attenuated in a primary visual area but amplified in a subsequent higher-order area. This response dissociation appears to rely on enhanced suppressive feedback between regions and reveals a previously unknown cortical network alteration in autism.
Collapse
Affiliation(s)
| | - Michael-Paul Schallmo
- Departments of Psychology
- Department of Psychiatry and Behavioral Science, University of Minnesota, Minneapolis, Minnesota 55455
| | - Jennifer Gerdts
- Psychiatry and Behavioral Sciences, University of Washington, Seattle, Washington 95195, and
| | - Raphael A Bernier
- Psychiatry and Behavioral Sciences, University of Washington, Seattle, Washington 95195, and
| | | |
Collapse
|
8
|
Kasprowski P, Harezlak K, Skurowski P. Implicit Calibration Using Probable Fixation Targets. SENSORS 2019; 19:s19010216. [PMID: 30626162 PMCID: PMC6339230 DOI: 10.3390/s19010216] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/08/2018] [Revised: 12/13/2018] [Accepted: 12/25/2018] [Indexed: 11/16/2022]
Abstract
Proper calibration of eye movement signal registered by an eye tracker seems to be one of the main challenges in popularizing eye trackers as yet another user-input device. Classic calibration methods taking time and imposing unnatural behavior on eyes must be replaced by intelligent methods that are able to calibrate the signal without conscious cooperation by the user. Such an implicit calibration requires some knowledge about the stimulus a user is looking at and takes into account this information to predict probable gaze targets. This paper describes a possible method to perform implicit calibration: it starts with finding probable fixation targets (PFTs), then it uses these targets to build a mapping-probable gaze path. Various algorithms that may be used for finding PFTs and mappings are presented in the paper and errors are calculated using two datasets registered with two different types of eye trackers. The results show that although for now the implicit calibration provides results worse than the classic one, it may be comparable with it and sufficient for some applications.
Collapse
Affiliation(s)
- Pawel Kasprowski
- Institute of Informatics, Silesian University of Technology, Akademicka 16, 44-100 Gliwice, Poland.
| | - Katarzyna Harezlak
- Institute of Informatics, Silesian University of Technology, Akademicka 16, 44-100 Gliwice, Poland.
| | - Przemysław Skurowski
- Institute of Informatics, Silesian University of Technology, Akademicka 16, 44-100 Gliwice, Poland.
| |
Collapse
|
9
|
Stupina E, Myachykov A, Shtyrov Y. Automatic Lexical Access in Visual Modality: Eye-Tracking Evidence. Front Psychol 2018; 9:1847. [PMID: 30333775 PMCID: PMC6176043 DOI: 10.3389/fpsyg.2018.01847] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2018] [Accepted: 09/10/2018] [Indexed: 11/13/2022] Open
Abstract
Language processing has been suggested to be partially automatic, with some studies suggesting full automaticity and attention independence of at least early neural stages of language comprehension, in particular, lexical access. Existing neurophysiological evidence has demonstrated early lexically specific brain responses (enhanced activation for real words) to orthographic stimuli presented parafoveally even under the condition of withdrawn attention. These studies, however, did not control participants’ eye movements leaving a possibility that they may have foveated the stimuli, leading to overt processing. To address this caveat, we recorded eye movements to words, pseudowords, and non-words presented parafoveally for a short duration while participants performed a dual non-linguistic feature detection task (color combination) foveally, in the focus of their visual attention. Our results revealed very few saccades to the orthographic stimuli or even to their previous locations. However, analysis of post-experimental recall and recognition performance showed above-chance memory performance for the linguistic stimuli. These results suggest that partial lexical access may indeed take place in the presence of an unrelated demanding task and in the absence of overt attention to the linguistic stimuli. As such, our data further inform automatic and largely attention-independent theories of lexical access.
Collapse
Affiliation(s)
- Ekaterina Stupina
- Center for Language and Brain, National Research University Higher School of Economics, Moscow, Russia.,Institute for Cognitive Neuroscience, National Research University Higher School of Economics, Moscow, Russia
| | - Andriy Myachykov
- Institute for Cognitive Neuroscience, National Research University Higher School of Economics, Moscow, Russia.,Department of Psychology, Northumbria University, Newcastle upon Tyne, United Kingdom
| | - Yury Shtyrov
- Institute for Cognitive Neuroscience, National Research University Higher School of Economics, Moscow, Russia.,Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| |
Collapse
|
10
|
Gavas R, Roy S, Chatterjee D, Tripathy SR, Chakravarty K, Sinha A, Lahiri U. Affordable sensor based gaze tracking for realistic psychological assessment. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2018; 2017:746-750. [PMID: 29059980 DOI: 10.1109/embc.2017.8036932] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Eye movement analysis finds tremendous usefulness in various medical screening applications and rehabilitation. Infrared sensor based eye trackers are becoming popular but these are expensive and need repeated calibration. Moreover, with multiple calibration also, there persists some noises called, variable and systematic, resulting in inaccurate gaze tracking. This study aims to build an one time calibration module to avoid the overhead of multiple calibration and to design an algorithm to remove both the types of errors effectively. The proposed approach is used for correcting the gaze tracking data for Digit Gazing task and standard recall-recognition test, where an accuracy of 90% and 82% are achieved respectively for detecting the gaze positions against the raw eye gaze data. Results also show that it is possible to perform accurate gaze tracking with one-time calibration method provided the experimental setup is not altered.
Collapse
|
11
|
Gavas RD, Roy S, Chatterjee D, Tripathy SR, Chakravarty K, Sinha A. Enhancing the usability of low-cost eye trackers for rehabilitation applications. PLoS One 2018; 13:e0196348. [PMID: 29856798 PMCID: PMC5983534 DOI: 10.1371/journal.pone.0196348] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2017] [Accepted: 04/11/2018] [Indexed: 11/19/2022] Open
Abstract
Eye tracking is one of the most widely used technique for assessment, screening and human-machine interaction related applications. There are certain issues which limit the usage of eye trackers in practical scenarios, viz., i) need to perform multiple calibrations and ii) presence of inherent noise in the recorded data. To address these issues, we have proposed a protocol for one-time calibration against the "regular" or the "multiple" calibration phases. It is seen that though it is always desirable to perform multiple calibration, the one-time calibration also produces comparable results and might be better for individuals who are not able to perform multiple calibrations. In that case, "One-time calibration" can also be done by a participant and the calibration results are used for the rest of the participants, provided the chin rest and the eye tracker positions are unaltered. The second major issue is the presence of the inherent noise in the raw gaze data, leading to systematic and variable errors. We have proposed a signal processing chain to remove these two types of errors. Two different psychological stimuli-based tasks, namely, recall-recognition test and number gazing task are used as a case study for the same. It is seen that the proposed approach gives satisfactory results even with one-time calibration. The study is also extended to test the effect of long duration task on the performance of the proposed algorithm and the results confirm that the proposed methods work well in such scenarios too.
Collapse
Affiliation(s)
- Rahul Dasharath Gavas
- Embedded Systems & Robotics, TCS Research and Innovation, Tata Consultancy Services, Kolkata, India
| | - Sangheeta Roy
- Embedded Systems & Robotics, TCS Research and Innovation, Tata Consultancy Services, Kolkata, India
| | - Debatri Chatterjee
- Embedded Systems & Robotics, TCS Research and Innovation, Tata Consultancy Services, Kolkata, India
| | - Soumya Ranjan Tripathy
- Embedded Systems & Robotics, TCS Research and Innovation, Tata Consultancy Services, Kolkata, India
| | - Kingshuk Chakravarty
- Embedded Systems & Robotics, TCS Research and Innovation, Tata Consultancy Services, Kolkata, India
| | - Aniruddha Sinha
- Embedded Systems & Robotics, TCS Research and Innovation, Tata Consultancy Services, Kolkata, India
| |
Collapse
|