Effectiveness of virtual reality and computerized training programs for enhancing emotion recognition in people with autism spectrum disorder: a systematic review and meta-analysis

Emotion Recognition Using EEG Signals through the Design of a Dry Electrode Based on the Combination of Type 2 Fuzzy Sets and Deep Convolutional Graph Networks

Emotion is an intricate cognitive state that, when identified, can serve as a crucial component of the brain-computer interface. This study examines the identification of two categories of positive and negative emotions through the development and implementation of a dry electrode electroencephalogram (EEG). To achieve this objective, a dry EEG electrode is created using the silver-copper sintering technique, which is assessed through Scanning Electron Microscope (SEM) and Energy Dispersive X-ray Analysis (EDXA) evaluations. Subsequently, a database is generated utilizing the designated electrode, which is based on the musical stimulus. The collected data are fed into an improved deep network for automatic feature selection/extraction and classification. The deep network architecture is structured by combining type 2 fuzzy sets (FT2) and deep convolutional graph networks. The fabricated electrode demonstrated superior performance, efficiency, and affordability compared to other electrodes (both wet and dry) in this study. Furthermore, the dry EEG electrode was examined in noisy environments and demonstrated robust resistance across a diverse range of Signal-To-Noise ratios (SNRs). Furthermore, the proposed model achieved a classification accuracy of 99% for distinguishing between positive and negative emotions, an improvement of approximately 2% over previous studies. The manufactured dry EEG electrode is very economical and cost-effective in terms of manufacturing costs when compared to recent studies. The proposed deep network, combined with the fabricated dry EEG electrode, can be used in real-time applications for long-term recordings that do not require gel.

Automatic Recognition of Multiple Emotional Classes from EEG Signals through the Use of Graph Theory and Convolutional Neural Networks

Emotion is a complex state caused by the functioning of the human brain in relation to various events, for which there is no scientific definition. Emotion recognition is traditionally conducted by psychologists and experts based on facial expressions-the traditional way to recognize something limited and is associated with errors. This study presents a new automatic method using electroencephalogram (EEG) signals based on combining graph theory with convolutional networks for emotion recognition. In the proposed model, firstly, a comprehensive database based on musical stimuli is provided to induce two and three emotional classes, including positive, negative, and neutral emotions. Generative adversarial networks (GANs) are used to supplement the recorded data, which are then input into the suggested deep network for feature extraction and classification. The suggested deep network can extract the dynamic information from the EEG data in an optimal manner and has 4 GConv layers. The accuracy of the categorization for two classes and three classes, respectively, is 99% and 98%, according to the suggested strategy. The suggested model has been compared with recent research and algorithms and has provided promising results. The proposed method can be used to complete the brain-computer-interface (BCI) systems puzzle.

The Impact of Virtual Reality Intervention on Emotion Regulation and Executive Functions in Autistic Children

Introduction: Autistic children may encounter difficulties in managing emotions and executive functions (EFs), which can contribute to mental and health challenges. Recognizing physical activities as a potential strategy for enhancing emotion regulation (ER), this study aims to investigate the efficacy of a virtual reality (VR)-based physical exercise program in improving ER and EFs among children with autism spectrum disorder (ASD). Materials and Methods: Forty boys diagnosed with ASD, aged 7 to 10 years, were randomly assigned to two groups: a VR intervention group (n = 20) and a control group (n = 20). The intervention group participated in a VR program, while the control group solely concentrated on engaging in sedentary and inactive video gaming. EFs were evaluated through the utilization of both the flanker task and the Wisconsin card sorting task, both administered initially at baseline and subsequently after an 8-week interval. In addition, the parents of the children completed the Emotion Regulation Checklist to evaluate their ER skills. Results: According to the results, a significant difference was observed between the two groups in terms of EFs and the ability to regulate emotion (P < 0.05). The intervention group demonstrated a notable improvement in ER skills and exhibited superior executive functioning abilities compared with the control group. Conclusion: It appears that VR exercises can serve as a preliminary trial to enhance EFs and ER in children with autism. In addition, they may prove effective as complementary interventions to traditional educational strategies in preventing future challenges associated with ASD.

Technologies for Supporting Individuals and Caregivers Living With Fetal Alcohol Spectrum Disorder: Scoping Review

Background

Fetal alcohol spectrum disorder (FASD) is a common developmental disability that requires lifelong and ongoing support but is often difficult to find due to the lack of trained professionals, funding, and support available. Technology could provide cost-effective, accessible, and effective support to those living with FASD and their caregivers.

Objective

In this review, we aimed to explore the use of technology available for supporting people living with FASD and their caregivers.

Methods

We conducted a scoping review to identify studies that included technology for people with FASD or their caregivers; focused on FASD; used an empirical study design; were published since 2005; and used technology for assessment, diagnosis, monitoring, or support for people with FASD. We searched MEDLINE, Web of Science, Scopus, Embase, APA PsycINFO, ACM Digital Library, JMIR Publications journals, the Cochrane Library, EBSCOhost, IEEE, study references, and gray literature to find studies. Searches were conducted in November 2022 and updated in January 2024. Two reviewers (CZC and HW) independently completed study selection and data extraction.

Results

In total, 17 studies exploring technology available for people with FASD showed that technology could be effective at teaching skills, supporting caregivers, and helping people with FASD develop skills.

Conclusions

Technology could provide support for people affected by FASD; however, currently there is limited technology available, and the potential benefits are largely unexplored.

The Association Between Emotion Recognition and Internalizing Problems in Children and Adolescents: A Three-Level Meta-Analysis

Numerous studies have explored the link between how well youth recognize emotions and their internalizing problems, but a consensus remains elusive. This study used a three-level meta-analysis model to quantitatively synthesize the findings of existing studies to assess the relationship. A moderation analysis was also conducted to explore the sources of research heterogeneity. Through a systematic literature search, a total of 42 studies with 201 effect sizes were retrieved for the current meta-analysis, and 7579 participants were included. Emotion recognition was negatively correlated with internalizing problems. Children and adolescents with weaker emotion recognition skills were more likely to have internalizing problems. In addition, this meta-analysis found that publication year had a significant moderating effect. The correlation between emotion recognition and internalizing problems decreased over time. The degree of internalizing problems was also found to be a significant moderator. The correlation between emotion recognition and internalizing disorders was higher than the correlation between emotion recognition and internalizing symptoms. Deficits in emotion recognition might be relevant for the development and/or maintenance of internalizing problems in children and adolescents. The overall effect was small and future research should explore the clinical relevance of the association.

Using Virtual Reality Interventions to Promote Social and Emotional Learning for Children and Adolescents: A Systematic Review and Meta-Analysis

This study provides a comprehensive review of the application of virtual reality (VR) in social and emotional learning (SEL) for children and adolescents over the past decade (January 2013-May 2023), with a specific interest in the relations between their technological and instructional design features. A search in Web of Science resulted in 32 relevant articles that were then manually screened. Coding analysis was conducted from four perspectives: participant characteristics, research design, technological features, and instructional design. The analysis provides insights into the VR literature regarding publication trends, target populations, technological features, instructional scenarios, and tasks. To test the effectiveness of VR interventions for promoting SEL, a meta-analysis was also conducted, which revealed an overall medium effect size and significant moderating effects of SEL disorder type and instructional task. Finally, based on the research results, the practical implications of and future research directions for applying VR in SEL were discussed.

Global trends and hotspots in the digital therapeutics of autism spectrum disorders: a bibliometric analysis from 2002 to 2022

Introduction

Autism spectrum disorder (ASD) is a severe neurodevelopmental disorder that has become a major cause of disability in children. Digital therapeutics (DTx) delivers evidence-based therapeutic interventions to patients that are driven by software to prevent, manage, or treat a medical disorder or disease. This study objectively analyzed the current research status of global DTx in ASD from 2002 to 2022, aiming to explore the current global research status and trends in the field.

Methods

The Web of Science database was searched for articles about DTx in ASD from January 2002 to October 2022. CiteSpace was used to analyze the co-occurrence of keywords in literature, partnerships between authors, institutions, and countries, the sudden occurrence of keywords, clustering of keywords over time, and analysis of references, cited authors, and cited journals.

Results

A total of 509 articles were included. The most productive country and institution were the United States and Vanderbilt University. The largest contributing authors were Warren, Zachary, and Sarkar, Nilanjan. The most-cited journal was the Journal of Autism and Developmental Disorders. The most-cited and co-cited articles were Brian Scarselati (Robots for Use in Autism Research, 2012) and Ralph Adolphs (Abnormal processing of social information from faces in autism, 2001). "Artificial Intelligence," "machine learning," "Virtual Reality," and "eye tracking" were common new and cutting-edge trends in research on DTx in ASD.

Discussion

The use of DTx in ASD is developing rapidly and gaining the attention of researchers worldwide. The publications in this field have increased year by year, mainly concentrated in the developed countries, especially in the United States. Both Vanderbilt University and Yale University are very important institutions in the field. The researcher from Vanderbilt University, Warren and Zachary, his dynamics or achievements in the field is also more worth our attention. The application of new technologies such as virtual reality, machine learning, and eye-tracking in this field has driven the development of DTx on ASD and is currently a popular research topic. More cross-regional and cross-disciplinary collaborations are recommended to advance the development and availability of DTx.

Evaluating the Feasibility of Emotion Expressions in Avatars Created From Real Person Photos: Pilot Web-Based Survey of Virtual Reality Software

BACKGROUND

The availability and potential of virtual reality (VR) has led to an increase of its application. VR is suggested to be helpful in training elements of social competence but with an emphasis on interventions being tailored. Recognizing facial expressions is an important social skill and thus a target for training. Using VR in training these skills could have advantages over desktop alternatives. Children with autism, for instance, appear to prefer avatars over real images when assessing facial expressions. Available software provides the opportunity to transform profile pictures into avatars, thereby giving the possibility of tailoring according to an individual's own environment. However, the emotions provided by such software should be validated before application.

OBJECTIVE

Our aim was to investigate whether available software is a quick, easy, and viable way of providing emotion expressions in avatars transformed from real images.

METHODS

A total of 401 participants from a general population completed a survey on the web containing 27 different images of avatars transformed, using a software, from real images. We calculated the reliability of each image and their level of difficulty using a structural equation modeling approach. We used Bayesian confirmatory factor analysis testing under a multidimensional first-order correlated factor structure where faces showing the same emotions represented a latent variable.

RESULTS

Few emotions were correctly perceived and rated as higher than other emotions. The factor loadings indicating the discrimination of the image were around 0.7, which means 49% shared variance with the latent factor that the face is linked with. The standardized thresholds indicating the difficulty level of the images are mostly around average, and the highest correlation is between faces showing happiness and anger.

CONCLUSIONS

Only using a software to transform profile pictures to avatars is not sufficient to provide valid emotion expressions. Adjustments are needed to increase faces' discrimination (eg, increasing reliabilities). The faces showed average levels of difficulty, meaning that they are neither very difficult nor very easy to perceive, which fits a general population. Adjustments should be made for specific populations and when applying this technology in clinical practice.

Digitally assisted diagnostics of autism spectrum disorder

Digital technologies have the potential to support psychiatric diagnostics and, in particular, differential diagnostics of autism spectrum disorder in the near future, making clinical decisions more objective, reliable and evidence-based while reducing clinical resources. Multimodal automatized measurement of symptoms at cognitive, behavioral, and neuronal levels combined with artificial intelligence applications offer promising strides toward personalized prognostics and treatment strategies. In addition, these new technologies could enable systematic and continuous assessment of longitudinal symptom development, beyond the usual scope of clinical practice. Early recognition of exacerbation and simplified, as well as detailed, progression control would become possible. Ultimately, digitally assisted diagnostics will advance early recognition. Nonetheless, digital technologies cannot and should not substitute clinical decision making that takes the comprehensive complexity of individual longitudinal and cross-section presentation of autism spectrum disorder into account. Yet, they might aid the clinician by objectifying decision processes and provide a welcome relief to resources in the clinical setting.