1
|
Tan J, Zhan Y, Tang Y, Bao W, Tian Y. EEG decoding for effects of visual joint attention training on ASD patients with interpretable and lightweight convolutional neural network. Cogn Neurodyn 2024; 18:947-960. [PMID: 38826651 PMCID: PMC11143091 DOI: 10.1007/s11571-023-09947-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 01/13/2023] [Accepted: 02/16/2023] [Indexed: 04/08/2023] Open
Abstract
Visual joint attention, the ability to track gaze and recognize intent, plays a key role in the development of social and language skills in health humans, which is performed abnormally hard in autism spectrum disorder (ASD). The traditional convolutional neural network, EEGnet, is an effective model for decoding technology, but few studies have utilized this model to address attentional training in ASD patients. In this study, EEGNet was used to decode the P300 signal elicited by training and the saliency map method was used to visualize the cognitive properties of ASD patients during visual attention. The results showed that in the spatial distribution, the parietal lobe was the main region of classification contribution, especially for Pz electrode. In the temporal information, the time period from 300 to 500 ms produced the greatest contribution to the electroencephalogram (EEG) classification, especially around 300 ms. After training for ASD patients, the gradient contribution was significantly enhanced at 300 ms, which was effective only in social scenarios. Meanwhile, with the increase of joint attention training, the P300 latency of ASD patients gradually shifted forward in social scenarios, but this phenomenon was not obvious in non-social scenarios. Our results indicated that joint attention training could improve the cognitive ability and responsiveness of social characteristics in ASD patients.
Collapse
Affiliation(s)
- Jianling Tan
- Department of Biomedical Engineering, Chongqing University of Posts and Telecommunications, Chongqing, 400065 China
| | - Yichao Zhan
- College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, 400065 China
| | - Yi Tang
- Department of Biomedical Engineering, Chongqing University of Posts and Telecommunications, Chongqing, 400065 China
| | - Weixin Bao
- College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, 400065 China
| | - Yin Tian
- Department of Biomedical Engineering, Chongqing University of Posts and Telecommunications, Chongqing, 400065 China
- College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, 400065 China
| |
Collapse
|
2
|
Caldani S, Humeau E, Delorme R, Bucci MP. Inhibition functions can be improved in children with autism spectrum disorders: An eye-tracking study. Int J Dev Neurosci 2023; 83:431-441. [PMID: 37218472 DOI: 10.1002/jdn.10276] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 03/17/2023] [Accepted: 05/03/2023] [Indexed: 05/24/2023] Open
Abstract
Cognitive remediation therapy interventions could improve cognitive functioning in subjects with autism. To investigate the benefit of a short cognitive training rehabilitation in children with autism spectrum disorder (ASD) on pursuit and fixation performances. We recruited two groups (G1 and G2) of 30 children with ASD, sex-, IQ- and age-matched (mean 11.6 ± 0.5 years), and pursuit and fixation eye movements were recorded twice at T1 and T2. Between T1 and T2, a 10-min cognitive training was performed by the G1 group only, whereas the G2 group had a 10-min of rest. For all children with ASD enrolled in the study, there was a positive correlation between restricted and repetitive behaviour scores of both Autism Diagnostic Interview-Revised (ADI-R) and the Autism Diagnostic Observation Schedule (ADOS) and the number of saccades recorded during the fixation task at T1. At T1, oculomotor performances were similar for both groups of ASD children (G1 and G2). At T2, we observed a significant reduction in the number of saccades made during both pursuit and fixation tasks. Our findings underlined the importance to promote cognitive training rehabilitation for children with ASD, leading to a better performance in inhibitory and attention functioning responsible for pursuit and fixation eye movement's performance.
Collapse
Affiliation(s)
- Simona Caldani
- MoDyCo, UMR 7114 CNRS, Paris Nanterre University, Nanterre, France
- EFEE-Center for the Functional Exploration of Balance in Children, Robert Debré Hospital, Paris, France
| | - Elise Humeau
- Child and Adolescent Psychiatry Department, Robert Debré Hospital, Paris, France
- High Functioning Autism Expert Centre, Fundamental Fondation, Paris, France
- Paris University, Paris, France
| | - Richard Delorme
- Child and Adolescent Psychiatry Department, Robert Debré Hospital, Paris, France
- High Functioning Autism Expert Centre, Fundamental Fondation, Paris, France
- Paris University, Paris, France
| | - Maria Pia Bucci
- MoDyCo, UMR 7114 CNRS, Paris Nanterre University, Nanterre, France
- EFEE-Center for the Functional Exploration of Balance in Children, Robert Debré Hospital, Paris, France
| |
Collapse
|
3
|
Silva GM, Souto JJDS, Fernandes TP, Bolis I, Santos NA. Interventions with Serious Games and Entertainment Games in Autism Spectrum Disorder: A Systematic Review. Dev Neuropsychol 2021; 46:463-485. [PMID: 34595981 DOI: 10.1080/87565641.2021.1981905] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
The use of serious games and entertainment games was compared as adjuvant tools for intervention in Autism Spectrum Disorder (ASD). A comprehensive search was performed in the MEDLINE, PsycINFO, Scopus, and Web of Science databases. From 295 studies, 53 studies were selected and included in this review. Overall, studies showed improvement after intervention, regardless of the type of video games, mostly for social skills and behavior. However, these changes should be regarded with caution, as they are limited to the tests applied. Furthermore, neither the entertainment nor the serious approach had a therapeutic impact on emotional resilience, representing the current gap in the field. Thus, even considering the limitations, our study is important because it shows that both categories have strengths.
Collapse
Affiliation(s)
- Gabriella Medeiros Silva
- Department of Psychology, Federal University of Paraiba, Joao Pessoa, Brazil.,Perception, Neuroscience and Behaviour Laboratory, Department of Psychology, Federal University of Paraiba, Joao Pessoa, Brazil
| | - Jandirlly Julianna de Souza Souto
- Department of Psychology, Federal University of Paraiba, Joao Pessoa, Brazil.,Perception, Neuroscience and Behaviour Laboratory, Department of Psychology, Federal University of Paraiba, Joao Pessoa, Brazil
| | - Thiago P Fernandes
- Department of Psychology, Federal University of Paraiba, Joao Pessoa, Brazil.,Perception, Neuroscience and Behaviour Laboratory, Department of Psychology, Federal University of Paraiba, Joao Pessoa, Brazil
| | - Ivan Bolis
- Department of Psychology, Federal University of Paraiba, Joao Pessoa, Brazil
| | - Natanael A Santos
- Department of Psychology, Federal University of Paraiba, Joao Pessoa, Brazil.,Perception, Neuroscience and Behaviour Laboratory, Department of Psychology, Federal University of Paraiba, Joao Pessoa, Brazil
| |
Collapse
|
4
|
Amat AZ, Zhao H, Swanson A, Weitlauf AS, Warren Z, Sarkar N. Design of an Interactive Virtual Reality System, InViRS, for Joint Attention Practice in Autistic Children. IEEE Trans Neural Syst Rehabil Eng 2021; 29:1866-1876. [PMID: 34460376 PMCID: PMC8482411 DOI: 10.1109/tnsre.2021.3108351] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Many children with Autism Spectrum Disorder (ASD) exhibit atypical gaze behaviors related to joint attention, a fundamental social-communication skill. Specifically, children with ASD show differences in the skills of gaze sharing and gaze following. In this work we present a novel virtual reality (VR)-based system, called InViRS, in which children with ASD play games allowing them to practice gaze sharing and gaze following. InViRS has three main design contributions: (i) a closed-loop joint attention paradigm with real-time tracking of the participant’s eye gaze and game performance measures, (ii) an assistive feedback mechanism that provides guidance and hints in real time, and (iii) a controller that adaptively changes the avatar’s gaze prompts according to the performance measures. Results from a pilot study to evaluate the feasibility of InViRS with 9 autistic1 children and 9 typically developing (TD) children offered preliminary support for the feasibility of successful gameplay as well as positive impacts on the targeted skills of gaze sharing and gaze following.
Collapse
|
5
|
Jiménez-Muñoz L, Peñuelas-Calvo I, Calvo-Rivera P, Díaz-Oliván I, Moreno M, Baca-García E, Porras-Segovia A. Video Games for the Treatment of Autism Spectrum Disorder: A Systematic Review. J Autism Dev Disord 2021; 52:169-188. [PMID: 33651285 DOI: 10.1007/s10803-021-04934-9] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/15/2021] [Indexed: 12/28/2022]
Abstract
Video games are a promising area of intervention for children diagnosed with Autism Spectrum Disorders (ASD). However, reviews on this topic are scarce. This review on studies exploring video games for the treatment of ASD followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, and its protocol was registered in PROSPERO. PubMed, PsycInfo, Embase, WebOfScience and clinicaltrials.gov databases were searched. Twenty-four articles were included in the review. Video game-based interventions were effective for alleviating ASD symptoms, albeit with small effect sizes. High rates of acceptability and adherence to treatment were obtained. Conclusion: Video games are a promising area for improving the treatment of children with ASD. Exploring commercial video games is one of the lines for future research.
Collapse
Affiliation(s)
- Laura Jiménez-Muñoz
- Instituto de Investigación Sanitaria Fundación Jiménez Díaz, Madrid, Spain.,Departamento de Psiquiatria, Universidad Autónoma de Madrid, Madrid, Spain
| | - Inmaculada Peñuelas-Calvo
- Instituto de Investigación Sanitaria Fundación Jiménez Díaz, Madrid, Spain. .,Departamento de Psiquiatría Infantojuvenil, Hospital Universitario Fundación Jiménez Díaz, Madrid, Spain. .,Facultad de Psicología, Universidad Complutense de Madrid, Madrid, Spain.
| | - Pilar Calvo-Rivera
- Departamento de Psiquiatría Infantojuvenil, Hospital Reina Sofía de Córdoba, Córdoba, Spain
| | - Isaac Díaz-Oliván
- Instituto de Investigación Sanitaria Fundación Jiménez Díaz, Madrid, Spain.,Departamento de Psiquiatria, Universidad Autónoma de Madrid, Madrid, Spain
| | - Manon Moreno
- Instituto de Investigación Sanitaria Fundación Jiménez Díaz, Madrid, Spain.,Departamento de Psiquiatria, Universidad Autónoma de Madrid, Madrid, Spain
| | - Enrique Baca-García
- Instituto de Investigación Sanitaria Fundación Jiménez Díaz, Madrid, Spain.,Departamento de Psiquiatria, Universidad Autónoma de Madrid, Madrid, Spain.,Departamento de Psiquiatría Infantojuvenil, Hospital Universitario Fundación Jiménez Díaz, Madrid, Spain.,Departamento de Psiquiatría, Hospital Universitario Fundación Jiménez Díaz, Madrid, Spain.,Hospital Universitario de Valdemoro, Madrid, Spain.,Departamento de Psiquiatría, Hospital Universitario Central de Villalba, Madrid, Spain.,CIBERSAM, Madrid, Spain.,Université de Nîmes, Nîmes, France.,Departamento de Psiquiatría, Universidad Católica del Maule, Talca, Chile
| | - Alejandro Porras-Segovia
- Instituto de Investigación Sanitaria Fundación Jiménez Díaz, Madrid, Spain.,Hospital Universitario Rey Juan Carlos, Móstoles, Spain
| |
Collapse
|
6
|
Mash LE, Klein RM, Townsend J. Brief Report: A Gaming Approach to the Assessment of Attention Networks in Autism Spectrum Disorder and Typical Development. J Autism Dev Disord 2020; 50:2607-2615. [PMID: 29948528 DOI: 10.1007/s10803-018-3635-5] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
Attentional impairments are among the earliest identifiable features of autism spectrum disorders (ASDs). Three attention networks have been extensively studied using the attention network test (ANT), but this long and repetitive task may pose challenges for individuals with ASDs. The AttentionTrip was developed as a more engaging measure of attention network efficiency. In 20 adults with ASDs and 20 typically developing controls, both tasks produced typical network scores (all p < .003, all Cohen's d > 0.78). Reaction time was less variable in the AttentionTrip than the ANT, possibly reflecting improved task engagement. Although the AttentionTrip elicited more consistent responses throughout an experimental session, anomalously low split-half reliability for its executive control network suggests that some changes may be needed.
Collapse
Affiliation(s)
- Lisa E Mash
- San Diego State University/University of California, San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, USA.
| | - Raymond M Klein
- Department of Psychology and Neuroscience, Dalhousie University, Halifax, Canada
| | - Jeanne Townsend
- San Diego State University/University of California, San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, USA.,Department of Neurosciences, University of California, San Diego, La Jolla, CA, USA
| |
Collapse
|
7
|
Gomolka Z, Kordos D, Zeslawska E. The Application of Flexible Areas of Interest to Pilot Mobile Eye Tracking. SENSORS (BASEL, SWITZERLAND) 2020; 20:E986. [PMID: 32059455 PMCID: PMC7071422 DOI: 10.3390/s20040986] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/02/2020] [Revised: 02/04/2020] [Accepted: 02/08/2020] [Indexed: 11/16/2022]
Abstract
Recent progress in the development of mobile Eye Tracking (ET) systems shows that there is a demand for modern flexible solutions that would allow for dynamic tracking of objects in the video stream. The paper describes a newly developed tool for work with ET glasses, and its advantages are outlined with the example of a pilot study. A flight task is performed on the FNTP II MCC simulator, and the pilots are equipped with the Mobile Tobii Glasses. The proposed Smart Trainer tool performs dynamic object tracking in a registered video stream, allowing for an interactive definition of Area of Interest (AOI) with blurred contours for the individual cockpit instruments and for the construction of corresponding histograms of pilot attention. The studies are carried out on a group of experienced pilots with a professional pilot CPL(A) license with instrumental flight (Instrument Rating (IR)) certification and a group of pilots without instrumental training. The experimental section shows the differences in the perception of the flight process between two distinct groups of pilots with varying levels in flight training for the ATPL(A) line pilot license. The proposed Smart Trainer tool might be exploited in order to assess and improve the process of training operators of advanced systems with human machine interfaces.
Collapse
Affiliation(s)
- Zbigniew Gomolka
- Institute of Computer Science, University of Rzeszow, 35-959 Rzeszow, Poland
| | - Damian Kordos
- Faculty of Mechanical Engineering and Aeronautics, Rzeszow University of Technology, 35-959 Rzeszow, Poland;
| | - Ewa Zeslawska
- Department of Information Systems Applications, University of Information Technology and Management in Rzeszow, 35-225 Rzeszow, Poland;
| |
Collapse
|
8
|
Hocking MC, Parish-Morris J, Schultz RT, Minturn JE, Brodsky C, Shabason EK, Herrington JD. Diminished social attention in pediatric brain tumor survivors: Using eye tracking technology during naturalistic social perception. Neuropsychology 2020; 34:350-358. [PMID: 31999166 DOI: 10.1037/neu0000623] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023] Open
Abstract
OBJECTIVE The etiology of pediatric brain tumor survivor (PBTSs) social difficulties is not well understood. A model of social competence for youth with brain disorder and evidence from youth with autism spectrum disorder (ASD) suggests that diminished social attention may underlie social deficits in PBTSs. This study used eye tracking technology to compare visual social attention in PBTSs, youth with ASD, and typically developing (TD) youth. METHODS Participants included 90 age-, gender-, and IQ-matched youth (N = 30 per group). PBTSs were at least 5 years from diagnosis and 2 years from the completion of tumor-directed therapy. Participants' eye gaze patterns were recorded while watching an established social play paradigm that presented videos of children engaging in either interactive or parallel play. Group differences in proportional gaze duration toward social versus nonsocial areas of interest were compared. Medical correlates of social attention in PBTSs were evaluated. RESULTS Groups significantly differed in gaze preference across conditions, with PBTSs looking less at social areas of interest than TD youth and in a manner comparable to youth with ASD. Among PBTSs, multimodal tumor-directed therapy was associated with reduced gaze preference for faces. CONCLUSIONS This study provides the first evidence of disrupted social attention in PBTSs, with parallels to the social attention deficits observed in ASD. Findings offer a new way to conceptualize the social difficulties of PBTSs and could guide interventions aimed at improving PBTS social adjustment by increasing visual attention to socially relevant information during social interactions. (PsycINFO Database Record (c) 2020 APA, all rights reserved).
Collapse
|
9
|
Hsueh YP. Synaptic Formation, Neural Circuits and Neurodevelopmental Disorders Controlled by Signaling, Translation, and Epigenetic Regulation. Dev Neurobiol 2019; 79:2-7. [PMID: 30672130 DOI: 10.1002/dneu.22655] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2018] [Revised: 11/04/2018] [Accepted: 11/05/2018] [Indexed: 12/17/2022]
Affiliation(s)
- Yi-Ping Hsueh
- Institute of Molecular Biology, Academia Sinica, Taipei, 11529, Taiwan, Republic of China
| |
Collapse
|
10
|
Wade J, Nichols HS, Ichinose M, Bian D, Bekele E, Snodgress M, Amat AZ, Granholm E, Park S, Sarkar N. Extraction of Emotional Information via Visual Scanning Patterns: A Feasibility Study of Participants with Schizophrenia and Neurotypical Individuals. ACM TRANSACTIONS ON ACCESSIBLE COMPUTING 2018; 11. [PMID: 30627303 DOI: 10.1145/3282434] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
Abstract
Emotion recognition impairment is a core feature of schizophrenia (SZ), present throughout all stages of this condition, and leads to poor social outcome. However, the underlying mechanisms that give rise to such deficits have not been elucidated and hence, it has been difficult to develop precisely targeted interventions. Evidence supports the use of methods designed to modify patterns of visual attention in individuals with SZ in order to effect meaningful improvements in social cognition. To date, however, attention-shaping systems have not fully utilized available technology (e.g., eye tracking) to achieve this goal. The current work consisted of the design and feasibility testing of a novel gaze-sensitive social skills intervention system called MASI-VR. Adults from an outpatient clinic with confirmed SZ diagnosis (n=10) and a comparison sample of neurotypical participants (n=10) were evaluated on measures of emotion recognition and visual attention at baseline assessment, and a pilot test of the intervention system was evaluated on the SZ sample following five training sessions over three weeks. Consistent with the literature, participants in the SZ group demonstrated lower recognition of faces showing medium intensity fear, spent more time deliberating about presented emotions, and had fewer fixations in comparison to neurotypical peers. Furthermore, participants in the SZ group showed significant improvement in the recognition of fearful faces post-training. Preliminary evidence supports the feasibility of a gaze-sensitive paradigm for use in assessment and training of emotion recognition and social attention in individuals with SZ, thus warranting further evaluation of the novel intervention.
Collapse
Affiliation(s)
- Joshua Wade
- Department Of Mechanical Engineering, Vanderbilt University
| | | | | | - Dayi Bian
- Department Of Electrical Engineering & Computer Science, Vanderbilt University
| | - Esube Bekele
- Department Of Electrical Engineering & Computer Science, Vanderbilt University
| | | | - Ashwaq Zaini Amat
- Department Of Electrical Engineering & Computer Science, Vanderbilt University
| | - Eric Granholm
- Department Of Psychiatry, University Of California, San Diego
| | - Sohee Park
- Department Of Psychology, Vanderbilt University
| | | |
Collapse
|