A Comparison of Virtual Reality Classroom Continuous Performance Tests to Traditional Continuous Performance Tests in Delineating ADHD: a Meta-Analysis

Assessment and treatment of mental health conditions in children and adolescents: A systematic scoping review of how virtual reality environments have been used

BACKGROUND

There is growing interest in the use of virtual reality environments (VREs) in psychological treatment and assessment. Most research has focused on the application of VREs in adult psychological disorders with fewer studies focusing on its applicability with children and adolescents. A systematic scoping review was undertaken of research assessing how VREs have been used in the treatment and assessment of childhood mental health disorders to provide an overview of the current state of the literature and identify future research directions.

METHOD

Systematic searches of online databases were conducted in PsycInfo, PubMed, Embase, Scopus, and Web of Science.

RESULTS

Eleven studies met eligibility criteria and were included in this review, with the majority focusing on VRE interventions for anxiety-related disorders. There is also emerging support for VRE deep breathing training for anxiety, VRE assisted treatment of internet gaming disorder and anorexia nervosa, and VRE assessment of body image evaluation in anorexia nervosa. Most studies were pilot and feasibility studies with only three randomised-controlled trials (RCT).

CONCLUSIONS

The current literature shows some promise for the use of VRE assessments and interventions of childhood mental health problems, particularly for anxiety-related disorders such as social anxiety and specific phobias. However, high-quality RCTs are now needed to establish effectiveness of VREs in this population, and how it compares to existing evidence-based approaches, given its promise to improve both engagement and outcomes.

Diagnosis of ADHD using virtual reality and artificial intelligence: an exploratory study of clinical applications

Introduction

Diagnosis of Attention Deficit/Hyperactivity Disorder (ADHD) is based on clinical evaluation of symptoms by a psychiatrist, referencing results of psychological tests. When diagnosing ADHD, the child's behavior and functionality in real-life situations are critical components. However, direct observation by a clinician is often not feasible in practice. Therefore, such information is typically gathered from primary caregivers or teachers, which can introduce subjective elements. To overcome these limitations, we developed AttnKare-D, an innovative digital diagnostic tool that could analyze children's behavioral data in Virtual Reality using Artificial Intelligence. The purpose of this study was to explore the utility and safety of AttnKare-D for clinical application.

Method

A total of 21 children aged between 6 and 12 years were recruited for this study. Among them, 15 were children diagnosed with ADHD, 5 were part of a normal control group, and 1 child was excluded due to withdrawal of consent. Psychological assessments, including K-WISC, Conners CPT, K-ARS, and K-CBCL, were conducted for participants and their primary caregivers. Diagnoses of ADHD were confirmed by child and adolescent psychiatrists based on comprehensive face-to-face evaluations and results of psychological assessments. Participants underwent VR diagnostic assessment by performing various cognitive and behavioral tasks in a VR environment. Collected data were analyzed using an AI model to assess ADHD diagnosis and the severity of symptoms.

Results

AttnKare-D demonstrated diagnostic performance with an AUC of 0.893 when compared to diagnoses made by child and adolescent psychiatrist, showing a sensitivity of 0.8 and a specificity of 1.0 at a cut-off score of 18.44. AttnKare-D scores showed a high correlation with K-ARS scores rated by parents and experts, although the correlation was relatively low for inattention scores.

Conclusion

Results of this study suggest that AttnKare-D can be a useful tool for diagnosing ADHD in children. This approach has potential to overcome limitations of current diagnostic methods, enhancing the accuracy and objectivity of ADHD diagnoses. This study lays the groundwork for further improvement and research on diagnostic tools integrating VR and AI technologies. For future clinical applications, it is necessary to conduct clinical trials involving a sufficient number of participants to ensure reliable use.

Use of virtual reality in children in a broad range of medical settings: a systematic narrative review of recent meta-analyses

Virtual reality (VR) is an emerging method that can be used in many scenarios involving children. VR has been increasingly studied as it has become cheaper, more widely available, and of better quality. In this review of current meta-analyses on the use of VR in children in the medical setting, we examined its role in 5 broad settings where it is used to alleviate pain and anxiety as well as in therapeutic scenarios. The study scope was purposefully broad to highlight a wide range of cases. We searched the ScienceDirect, SpringerLink, Cochrane Library, PubMed, and PMC databases for meta-analyses using VR in pediatric populations in medical settings. The National Institutes of Health quality assessment tool and Quality of Reporting of Meta-analyses statement checklist were used to verify study quality. Six hundred fifty-three articles were retrieved; after the application of the inclusion and exclusion criteria, 11 remained. These meta-analyses included cerebral palsy (4 meta-analyses), attention deficit/hyperactivity disorder (2 meta-analyses), burn care (1 meta-analysis), preoperative anxiety (2 meta-analyses), and needle-involving procedures (2 meta-analyses). The meta-analyses showed broadly positive results, with VR being useful in the areas in which it was applied. This study had several limitations. The meta-analyses consistently highlighted a high level of heterogeneity, making it challenging to draw clear conclusions. Most meta-analyses across all fields yielded encouraging results. However, further studies are required to confirm these findings. Guidelines must be established for future experiments to provide a standard and uniform procedure for reducing the heterogeneity of experimental methods.

Data-driven profiles of attention-deficit/hyperactivity disorder using objective and ecological measures of attention, distractibility, and hyperactivity

In the past two decades, the traditional nosology of attention-deficit/hyperactivity disorder (ADHD) has been criticized for having insufficient discriminant validity. In line with current trends, in the present study, we combined a data-driven approach with the advantages of virtual reality aiming to identify novel behavioral profiles of ADHD based on ecological and performance-based measures of inattention, impulsivity, and hyperactivity. One hundred and ten Spanish-speaking participants (6-16 years) with ADHD (medication-naïve, n = 57) and typically developing participants (n = 53) completed AULA, a continuous performance test embedded in virtual reality. We performed hybrid hierarchical k-means clustering methods over the whole sample on the normalized t-scores of AULA main indices. A five-cluster structure was the most optimal solution. We did not replicate ADHD subtypes. Instead, we identified two clusters sharing clinical scores on attention indices, susceptibility to distraction, and head motor activity, but with opposing scores on mean reaction time and commission errors; two clusters with good performance; and one cluster with average scores but increased response variability and slow RT. DSM-5 subtypes cut across cluster profiles. Our results suggest that latency of response and response inhibition could serve to distinguish among ADHD subpopulations and guide neuropsychological interventions. Motor activity, in contrast, seems to be a common feature among ADHD subgroups. This study highlights the poor feasibility of categorical systems to parse ADHD heterogeneity and the added value of data-driven approaches and VR-based assessments to obtain an accurate characterization of cognitive functioning in individuals with and without ADHD.

Examining the Use of VR as a Study Aid for University Students with ADHD

Attention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental condition characterized by patterns of inattention and impulsivity, which lead to difficulties maintaining concentration and motivation while completing academic tasks. University settings, characterized by a high student-to-staff ratio, make treatments relying on human monitoring challenging. One potential replacement is Virtual Reality (VR) technology, which has shown potential to enhance learning outcomes and promote flow experience. In this study, we investigate the usage of VR with 27 university students with ADHD in an effort to improve their performance in ctableompleting homework, including an exploration of automated feedback via a technology probe. Quantitative results show significant increases in concentration, motivation, and effort levels during these VR sessions and qualitative data offers insight into considerations like comfort and deployment. Together, the results suggest that VR can be a valuable tool in leveling the playing field for university students with ADHD.

Neurophysiological Patterns of Attention and Distraction during Realistic Virtual-Reality Classroom Learning in Adults with and without ADHD

Many people, and particularly those diagnosed with ADHD, report difficulties maintaining attention and proneness to distraction during classroom learning. However, the behavioral, neural and physiological basis of attention in realistic learning contexts is not well understood, since current clinical and scientific tools used for evaluating and quantifying the constructs of "distractibility" and "inattention", are removed from the real-life experience in organic classrooms. Here we introduce a novel Virtual Reality (VR) platform for studying students' brain activity and physiological responses as they immerse in realistic frontal classroom learning. Using this approach, we studied whether adults with and without ADHD (N=49) exhibit differences in neurophysiological metrics associated with sustained attention, such as speech-tracking of the teacher's voice, power of alpha-oscillations and levels of arousal, as well as responses to potential disturbances by background sound-events in the classroom. Under these ecological conditions, we find that adults with ADHD exhibit higher auditory neural response to background sounds relative to their control-peers, which also contributed to explaining variance in the severity of ADHD symptoms, together with higher power of alpha-oscillations and more frequent gaze-shifts around the classroom. These results are in-line with higher sensitivity to irrelevant stimuli in the environment and increased mind-wandering/boredom. At the same time, both groups exhibited similar learning outcomes and showed similar neural tracking of the teacher's speech. This suggests that in this context, attention may not operate as a zero-sum game and that allocating some resources to irrelevant stimuli does not always detract from performing the task at hand. Given the dire need for more objective, dimensional and ecologically-valid measures of attention and its real-life deficits, this work provides new insights into the neurophysiological manifestations of attention and distraction experienced in real-life contexts, while challenging some prevalent notions regarding the nature of attentional challenges experienced by those with ADHD.

A systematic review of the utility of continuous performance tests among adults with ADHD

OBJECTIVE

The clinical utility of continuous performance tests (CPTs) among adults with attention-deficit/hyperactivity disorder (ADHD) has increasingly been brought under question. Therefore, the objective of this study was to systematically review the literature to investigate the clinical utility of various commercially available CPTs, including the Conner's Continuous Performance Test (CCPT), Test of Variables of Attention (TOVA), Gordon Diagnostic System (GDS), and Integrated Visual and Auditory Continuous Performance Test (IVA) in the adult ADHD population.

METHODS

This systematic review followed the a priori PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Articles were gathered from PsycINFO, PsycARTICLES, Academic Search Complete, and Google Scholar on 11 April 2022. Sixty-nine articles were included in the final review. Risk of bias was assessed using the National Institute of Health Quality Assessment Took for Observational Cohort and Cross-Sectional Studies.

RESULTS

Most articles demonstrated high risk of bias, and there was substantial heterogeneity across studies. Overall, the reviewed CPTs appeared to have limited diagnostic utility and classification accuracy. Although many studies showed differing scores between adults with ADHD and comparison groups, findings were not consistent. Characteristics of CPT performances among adults with ADHD were mixed, with little consistency and no evidence of a clear profile of performances; however, CCPT commission errors appeared to have the most utility when used a treatment or experimental outcome measure, compared to other CCPT scores.

CONCLUSION

Overall, CPTs should not be used in isolation as a diagnostic test but may be beneficial when used as a component of a comprehensive assessment.

Systematic Review and Meta-Analysis: Clinical Utility of Continuous Performance Tests for the Identification of Attention-Deficit/Hyperactivity Disorder

OBJECTIVE

We aimed to quantify the clinical utility of continuous performance tests (CPTs) for the diagnosis of attention-deficit/hyperactivity disorder (ADHD) compared to a clinical diagnosis in children and adolescents.

METHOD

Four databases (MEDLINE, PsycINFO, EMBASE, and PubMed) were screened until January 2023. Risk of bias of included results was judged with the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2). We statistically pooled the area under the curve, the sensitivity, and the specificity of 3 commonly used CPTs subscales: omission/inattention, commission/impulsivity, and total number of errors/ADHD subscales (PROSPERO registration: CRD42020168091).

RESULTS

A total of 19 studies using commercially available CPTs were identified. Results from up to 835 control individuals and 819 cases were combined in the summary receiver operating characteristic (ROC) curve analyses (sensitivity and specificity pooling), and up to 996 cases and 1,083 control individuals in the area under the curve (AUC) analyses. Clinical utility as measured by AUCs could be considered as barely acceptable (between 0.7 and 0.8) for the most part, with the best results for the total/ADHD score, followed by omissions/inattention, and poorest for commission/impulsivity scores. A similar pattern was found when pooling sensitivity and specificity: 0.75 (95% CI = 0.66-0.82) and 0.71 (0.62-0.78) for the total/ADHD score; 0.63 (0.49-0.75) and 0.74 (0.65-0.81) for omissions; and 0.59 (0.38-0.77) and 0.66 (CI = 0.50-0.78) for commissions.

CONCLUSION

At the clinical level, CPTs as a stand-alone tool have only a modest to moderate ability to differentiate ADHD from non-ADHD samples. Hence, they should be used only within a more comprehensive diagnostic process.

STUDY PREREGISTRATION INFORMATION

A systematic review of screening tools for ADHD in children and adolescents; https://www.crd.york.ac.uk/prospero/; CRD42020168091.

Attention and impulsivity assessment using virtual reality games

The assessment of cognitive functions is mainly based on standardized neuropsychological tests, widely used in various fields such as personnel recruitment, education, or health. This paper presents a virtual reality game that allows collecting continuous measurements of both the performance and behaviour of the subject in an immersive, controllable, and naturalistic experience. The application registers variables related to the user's eye movements through the use of virtual reality goggles, as well as variables of the game performance. We study how virtual reality can provide data to help predict scores on the Attention Control Scale Test and the Barratt Impulsiveness Scale. We design the application and test it with a pilot group. We build a random forest regressor model to predict the attention and impulsivity scales' total score. When evaluating the performance of the model, we obtain a positive correlation with attention (0.434) and with impulsivity (0.382). In addition, our model identified that the most significant variables are the time spent looking at the target or at distractors, the eye movements variability, the number of blinks and the pupil dilation in both attention and impulsivity. Our results are consistent with previous results in the literature showing that it is possible to use data collected in virtual reality to predict the degree of attention and impulsivity.

Performance on a virtual environment shopping task and adaptive functioning among older adults

Neuropsychologists are often asked to evaluate patients' functional capacities, yet traditional neuropsychological tests have limited correspondence with real-world outcomes. The Virtual Environment Grocery Store (VEGS) is a virtual environment that simulates shopping tasks. The purpose of this study was to investigate the relationship between older adults' performance on the VEGS in relation to their self-reported adaptive functioning as well as performance on a performance-based adaptive functioning measure. Older adults (n = 98; age 65-90, M = 75.82, SD = 6.27) were administered the VEGS, the Instrumental Activities of Daily Living Scale (IADLS), and the Texas Functional Living Scale (TFLS). Neither premorbid functioning nor the VEGS variables were associated with self-rated adaptive functioning. However, all three VEGS variables were associated with performance-based adaptive functioning (i.e., the TFLS). Performance on the VEGS measure of correct items in the shopping cart explained 13.9% of the variance in performance on the performance-based adaptive functioning task. Whether the participant picked up the VEGS prescription explained 12.6% of the variance in performance on the performance-based adaptive functioning task. Performance on VEGS long delay free recall explained 35.1% of the variance in performance on the performance-based adaptive functioning task. These results suggest that the VEGS demonstrates value in predicting older adults' functional capacities.

Presence and simulator sickness predict the usability of a virtual reality attention task

Attention is the ability to actively process specific information within one's environment over longer periods of time while disregarding other details. Attention is an important process that contributes to overall cognitive performance from performing every day basic tasks to complex work activities. The use of virtual reality (VR) allows study of the attention processes in realistic environments using ecological tasks. To date, research has focused on the efficacy of VR attention tasks in detecting attention impairment, while the impact of the combination of variables such as mental workload, presence and simulator sickness on both self-reported usability and objective attention task performance in immersive VR has not been examined. The current study tested 87 participants on an attention task in a virtual aquarium using a cross-sectional design. The VR task followed the continuous performance test paradigm where participants had to respond to correct targets and ignore non-targets over 18 min. Performance was measured using three outcomes: omission (failing to respond to correct targets), commission errors (incorrect responses to targets) and reaction time to correct targets. Measures of self-reported usability, mental workload, presence and simulator sickness were collected. The results showed that only presence and simulator sickness had a significant impact on usability. For performance outcomes, simulator sickness was significantly and weakly associated with omission errors, but not with reaction time and commission errors. Mental workload and presence did not significantly predict performance. Our results suggest that usability is more likely to be negatively impacted by simulator sickness and lack of presence than performance and that usability and attention performance are linked. They highlight the importance of considering factors such as presence and simulator sickness in attention tasks as these variables can impact usability.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10055-023-00782-3.

Immersive virtual reality for improving cognitive deficits in children with ADHD: a systematic review and meta-analysis

Virtual reality (VR) shows great potential in treating and managing various mental health conditions. This includes using VR for training or rehabilitation purposes. For example, VR is being used to improve cognitive functioning (e.g. attention) among children with attention/deficit-hyperactivity disorder (ADHD). The aim of the current review and meta-analysis is to evaluate the effectiveness of immersive VR-based interventions for improving cognitive deficits in children with ADHD, to investigate potential moderators of the effect size and assess treatment adherence and safety. The meta-analysis included seven randomised controlled trials (RCTs) of children with ADHD comparing immersive VR-based interventions with controls (e.g. waiting list, medication, psychotherapy, cognitive training, neurofeedback and hemoencephalographic biofeedback) on measures of cognition. Results indicated large effect sizes in favour of VR-based interventions on outcomes of global cognitive functioning, attention, and memory. Neither intervention length nor participant age moderated the effect size of global cognitive functioning. Control group type (active vs passive control group), ADHD diagnostic status (formal vs. informal) and novelty of VR technology were not significant moderators of the effect size of global cognitive functioning. Treatment adherence was similar across groups and there were no adverse effects. Results should be cautiously interpreted given the poor quality of included studies and small sample.

Virtual reality in the diagnostic and therapy for mental disorders: A systematic review

BACKGROUND

Virtual reality (VR) technologies are playing an increasingly important role in the diagnostics and treatment of mental disorders.

OBJECTIVE

To systematically review the current evidence regarding the use of VR in the diagnostics and treatment of mental disorders.

DATA SOURCE

Systematic literature searches via PubMed (last literature update: 9^th of May 2022) were conducted for the following areas of psychopathology: Specific phobias, panic disorder and agoraphobia, social anxiety disorder, generalized anxiety disorder, posttraumatic stress disorder (PTSD), obsessive-compulsive disorder, eating disorders, dementia disorders, attention-deficit/hyperactivity disorder, depression, autism spectrum disorder, schizophrenia spectrum disorders, and addiction disorders.

ELIGIBILITY CRITERIA

To be eligible, studies had to be published in English, to be peer-reviewed, to report original research data, to be VR-related, and to deal with one of the above-mentioned areas of psychopathology.

STUDY EVALUATION

For each study included, various study characteristics (including interventions and conditions, comparators, major outcomes and study designs) were retrieved and a risk of bias score was calculated based on predefined study quality criteria.

RESULTS

Across all areas of psychopathology, k = 9315 studies were inspected, of which k = 721 studies met the eligibility criteria. From these studies, 43.97% were considered assessment-related, 55.48% therapy-related, and 0.55% were mixed. The highest research activity was found for VR exposure therapy in anxiety disorders, PTSD and addiction disorders, where the most convincing evidence was found, as well as for cognitive trainings in dementia and social skill trainings in autism spectrum disorder.

CONCLUSION

While VR exposure therapy will likely find its way successively into regular patient care, there are also many other promising approaches, but most are not yet mature enough for clinical application.

REVIEW REGISTRATION

PROSPERO register CRD42020188436.

FUNDING

The review was funded by budgets from the University of Bonn. No third party funding was involved.

Eye movement behavior in a real-world virtual reality task reveals ADHD in children

Eye movements and other rich data obtained in virtual reality (VR) environments resembling situations where symptoms are manifested could help in the objective detection of various symptoms in clinical conditions. In the present study, 37 children with attention deficit hyperactivity disorder and 36 typically developing controls (9-13 y.o) played a lifelike prospective memory game using head-mounted display with inbuilt 90 Hz eye tracker. Eye movement patterns had prominent group differences, but they were dispersed across the full performance time rather than associated with specific events or stimulus features. A support vector machine classifier trained on eye movement data showed excellent discrimination ability with 0.92 area under curve, which was significantly higher than for task performance measures or for eye movements obtained in a visual search task. We demonstrated that a naturalistic VR task combined with eye tracking allows accurate prediction of attention deficits, paving the way for precision diagnostics.

EPELI: a novel virtual reality task for the assessment of goal-directed behavior in real-life contexts

A recently developed virtual reality task, EPELI (Executive Performance in Everyday LIving), quantifies goal-directed behavior in naturalistic conditions. Participants navigate a virtual apartment, performing household chores given by a virtual character. EPELI aims to tap attention, executive function, and prospective memory. To ensure its applicability to further research and clinical work and to study its relationship to relevant background factors, we examined several key properties of EPELI in 77 typically developing 9–13-year-old children. These included EPELI’s internal consistency, age and gender differences, sensitivity to gaming experience, head-mounted display (HMD) type, and verbal recall ability, as well as its relationships with parent-rated everyday executive problems. Of the eight EPELI measures, the following six showed acceptable internal consistency: task and navigation efficacy, number of correctly performed tasks and overall actions, time monitoring, and controller movement. Some measures were associated with age, gender, or verbal encoding ability. Moreover, EPELI performance was associated with parent-rated everyday executive problems. There were no significant associations of gaming background, task familiarity, or HMD type with the EPELI measures. These results attest to the reliability and ecological validity of this new virtual reality tool for the assessment of attention, executive functions, and prospective memory in children.

Efficacy of Continuous Performance Testing in Adult ADHD in a Clinical Sample Using QbTest

OBJECTIVE

Continuous performance tests are widely used to aid diagnostic decision making and measure symptom reduction in adult ADHD clinical populations. The diagnostic accuracy of the Quantified Behavior Test plus (QbTest+), developed to identify ADHD populations as an objective measure of ADHD symptoms, was explored.

METHODS

The utility of the QbTest+ was investigated in a clinical cohort of 69 adult patients referred to a specialist ADHD clinic in the UK.

RESULTS

Scores from the QbTest+ failed to differentiate between patients diagnosed with ADHD and those who did not receive a diagnosis after full clinical assessment.

CONCLUSIONS

Based on our findings, we recommend clinicians are cautious when interpreting results of the QbTest+ in clinical populations. This study highlights the need for investigation into the lack of validation of commonly used objective measures in ADHD populations.

Quantifying ADHD Symptoms in Open-Ended Everyday Life Contexts With a New Virtual Reality Task

OBJECTIVE

To quantify goal-directed behavior and ADHD symptoms in naturalistic conditions, we developed a virtual reality task, EPELI (Executive Performance in Everyday LIving), and tested its predictive, discriminant and concurrent validity.

METHOD

We collected EPELI data, conventional neuropsychological task data, and parent-ratings of executive problems and symptoms in 38 ADHD children and 38 typically developing controls.

RESULTS

EPELI showed predictive validity as the ADHD group exhibited higher percentage of irrelevant actions reflecting lower attentional-executive efficacy and more controller movements and total game actions, both indicative of hyperactivity-impulsivity. Further, the five combined EPELI measures showed excellent discriminant validity (area under curve 88 %), while the correlations of the EPELI efficacy measure with parent-rated executive problems (r = .57) and ADHD symptoms (r = .55) pointed to its concurrent validity.

CONCLUSION

We provide a proof-of-concept validation for a new virtual reality tool for ecologically valid assessment of ADHD symptoms.

Attention Deficit Hyperactivity Disorder Assessment Based on Patient Behavior Exhibited in a Car Video Game: A Pilot Study

Symptoms of Attention Deficit Hyperactivity Disorder (ADHD) include excessive activity, difficulty sustaining attention, and inability to act in a reflective manner. Early diagnosis and treatment of ADHD is key but may be influenced by the observation and communication skills of caregivers, and the experience of the medical professional. Attempts to obtain additional measures to support the medical diagnosis, such as reaction time when performing a task, can be found in the literature. We propose an information recording system that allows to study in detail the behavior shown by children already diagnosed with ADHD during a car driving video game. We continuously record the participants’ activity throughout the task and calculate the error committed. Studying the trajectory graphs, some children showed uniform patterns, others lost attention from one point onwards, and others alternated attention/inattention intervals. Results show a dependence between the age of the children and their performance. Moreover, by analyzing the positions by age over time using clustering, we show that it is possible to classify children according to their performance. Future studies will examine whether this detailed information about each child’s performance pattern can be used to fine-tune treatment.

Do we over-diagnose ADHD in North America? A critical review and clinical recommendations

There has been a marked increase in the prevalence of attention-deficit/hyperactivity disorder (ADHD) in the last 25 years in North America. Some see this trend as positive and believe that it reflects a better identification of ADHD and even think that the disorder is still under-diagnosed. Others, however, contend that ADHD is over-diagnosed. To help mental health clinicians to maintain an informed and nuanced perspective on this debate, this critical review aims to (1) summarize empirical results on factors that might contribute to increase the number of ADHD diagnoses and (2) propose clinical recommendations coherent with these findings to improve clinical practices for ADHD assessment and treatment. We conclude that artifactual factors such as current formulation of diagnostic criteria, clinical practices, and inordinate focus on performance, which is rampant in North America, likely contribute to inflated prevalence rates.

Measuring Attentional Distraction in Children With ADHD Using Virtual Reality Technology With Eye-Tracking

Objective

Distractions inordinately impair attention in children with Attention-Deficit Hyperactivity Disorder (ADHD) but examining this behavior under real-life conditions poses a challenge for researchers and clinicians. Virtual reality (VR) technologies may mitigate the limitations of traditional laboratory methods by providing a more ecologically relevant experience. The use of eye-tracking measures to assess attentional functioning in a VR context in ADHD is novel. In this proof of principle project, we evaluate the temporal dynamics of distraction via eye-tracking measures in a VR classroom setting with 20 children diagnosed with ADHD between 8 and 12 years of age.

Method

We recorded continuous eye movements while participants performed math, Stroop, and continuous performance test (CPT) tasks with a series of "real-world" classroom distractors presented. We analyzed the impact of the distractors on rates of on-task performance and on-task, eye-gaze (i.e., looking at a classroom whiteboard) versus off-task eye-gaze (i.e., looking away from the whiteboard).

Results

We found that while children did not always look at distractors themselves for long periods of time, the presence of a distractor disrupted on-task gaze at task-relevant whiteboard stimuli and lowered rates of task performance. This suggests that children with attention deficits may have a hard time returning to tasks once those tasks are interrupted, even if the distractor itself does not hold attention. Eye-tracking measures within the VR context can reveal rich information about attentional disruption.

Conclusions

Leveraging virtual reality technology in combination with eye-tracking measures is well-suited to advance the understanding of mechanisms underlying attentional impairment in naturalistic settings. Assessment within these immersive and well-controlled simulated environments provides new options for increasing our understanding of distractibility and its potential impact on the development of interventions for children with ADHD.

Characterizing Underlying Cognitive Components of ADHD Presentations and Co-morbid Diagnoses: A Diffusion Decision Model Analysis

OBJECTIVE

To Explore whether subtypes and comorbidities of attention-deficit hyperactivity disorder (ADHD) induce distinct biases in cognitive components involved in information processing.

METHOD

Performance on the Integrated Visual and Auditory Continuous Performance Test (IVA-CPT) was compared between 150 children (aged 7 to 10) with ADHD, grouped by DSM-5 presentation (ADHD-C, ADHD-I) or co-morbid diagnoses (anxiety, oppositional defiant disorder [ODD], both, neither), and 60 children without ADHD. Diffusion decision modeling decomposed performance into cognitive components.

RESULTS

Children with ADHD had poorer information integration than controls. Children with ADHD-C were more sensitive to changes in presentation modality (auditory/visual) than those with ADHD-I and controls. Above and beyond these results, children with ADHD+anxiety+ODD had larger increases in response biases when targets became frequent than children with ADHD-only or with ADHD and one comorbidity.

CONCLUSION

ADHD presentations and comorbidities have distinct cognitive characteristics quantifiable using DDM and IVA-CPT. We discuss implications for tailored cognitive-behavioral therapy.

A novel approach to diagnose ADHD using virtual reality

Purpose

The current golden standard for attention deficit hyperactivity disorder (ADHD) diagnosis is clinical diagnosis based on psychiatric interviews and psychological examinations. This is suboptimal, as clinicians are unable to view potential patients in multiple natural settings – a necessary condition for objective diagnosis. The purpose of this paper is to improve the objective diagnosis of ADHD by analyzing a quantified representation of the actions of potential patients in multiple natural environments.

Design/methodology/approach

The authors use both virtual reality (VR) and artificial intelligence (AI) to create an objective ADHD diagnostic test. Diagnostic and statistical manual of mental disorders, 5th Edition (DSM-5) and ADHD Rating Scale are used to create a rule-based system of quantifiable VR-observable actions. As a potential patient completes tasks within multiple VR scenes, certain actions trigger an increase in the severity measure of the corresponding ADHD symptom. The resulting severity measures are input to an AI model, which classifies the potential patient as having ADHD in the form inattention, hyperactivity-impulsivity, combined or neither.

Findings

The result of this study shows that VR-observed actions can be extracted as quantified data, and classification of this quantified data achieves near-perfect sensitivity and specificity with a 98.3% accuracy rate on a convolutional neural network model.

Originality/value

To the best of the authors’ knowledge, this is the first study to incorporate VR and AI into an objective DSM-5-based ADHD diagnostic test. By including stimulation to the visual, auditory and equilibrium senses and tracking movement and recording voice, we present a method to further the research of objective ADHD diagnosis.

Ethical Challenges of Using Virtual Environments in the Assessment and Treatment of Psychopathological Disorders

Clinicians are increasingly interested in the potential of virtual environments for research and praxes. Virtual environments include both immersive and non-immersive simulations of everyday activities. Moreover, algorithmic devices and adaptive virtual environments allow clinicians a medium for personalizing technologies to their patients. There is also increasing recognition of social virtual environments that connect virtual environments to social networks. Although there has been a great deal of deliberation on these novel technologies for assessment and treatment, less discourse has occurred around the ethical challenges that may ensue when these technologies are applied clinically. In this paper, some of the ethical issues involved in the clinical use of novel technologies are discussed.

A Within-Sample Comparison of Two Innovative Neuropsychological Tests for Assessing ADHD

New innovative neuropsychological tests in attention deficit hyperactivity disorder ADHD have been proposed as objective measures for diagnosis and therapy. The current study aims to investigate two different commercial continuous performance tests (CPT) in a head-to-head comparison regarding their comparability and their link with clinical parameters. The CPTs were evaluated in a clinical sample of 29 adult patients presenting in an ADHD outpatient clinic. Correlational analyses were performed between neuropsychological data, clinical rating scales, and a personality-based measure. Though inattention was found to positively correlate between the two tests (r = 0.49, p = 0.01), no association with clinical measures and inattention was found for both tests. While hyperactivity did not correlate between both tests, current ADHD symptoms were positively associated with Nesplora Aquarium’s motor activity (r = 0.52 to 0.61, p < 0.05) and the Qb-Test’s hyperactivity (r = 0.52 to 0.71, p < 0.05). Conclusively, the overall comparability of the tests was limited and correlation with clinical parameters was low. While our study shows some interesting correlation between clinical symptoms and sub-scales of these tests, usage in clinical practice is not recommended.

Paradigm Shift Toward Digital Neuropsychology and High-Dimensional Neuropsychological Assessments: Review

Neuropsychologists in the digital age have increasing access to emerging technologies. The National Institutes of Health (NIH) initiatives for behavioral and social sciences have emphasized these developing scientific and technological potentials (eg, novel sensors) for augmented characterization of neurocognitive, behavioral, affective, and social processes. Perhaps these innovative technologies will lead to a paradigm shift from disintegrated and data-poor behavioral science to cohesive and data-rich science that permits improved translation from bench to bedside. The 4 main advances influencing the scientific priorities of a recent NIH Office of Behavioral and Social Sciences Research strategic plan include the following: integration of neuroscience into behavioral and social sciences, transformational advances in measurement science, digital intervention platforms, and large-scale population cohorts and data integration. This paper reviews these opportunities for novel brain-behavior characterizations. Emphasis is placed on the increasing concern of neuropsychology with these topics and the need for development in these areas to maintain relevance as a scientific discipline and advance scientific developments. Furthermore, the effects of such advancements necessitate discussion and modification of training as well as ethical and legal mandates for neuropsychological research and praxes.

Extended Reality for the Clinical, Affective, and Social Neurosciences

Brain science research often involves the use of low-dimensional tools and stimuli that lack several of the potentially valuable features of everyday activities and interactions. Although this research has provided important information about cognitive, affective, and social processes for both clinical and nonclinical populations, there is growing interest in high-dimensional simulations that extend reality. These high-dimensional simulations involve dynamic stimuli presented serially or concurrently to permit the assessment and training of perceivers' integrative processes over time. Moreover, high-dimensional simulation platforms can contextually restrain interpretations of cues about a target's internal states. Extended reality environments extend assessment and training platforms that balance experimental control with emotionally engaging background narratives aimed at extending the affective experience and social interactions. Herein, we highlight the promise of extended reality platforms for greater ecological validity in the clinical, affective, and social neurosciences.

A Four-Step Method for the Development of an ADHD-VR Digital Game Diagnostic Tool Prototype for Children Using a DL Model

Attention-deficit/hyperactivity disorder (ADHD) is a common neurodevelopmental disorder among children resulting in disturbances in their daily functioning. Virtual reality (VR) and machine learning technologies, such as deep learning (DL) application, are promising diagnostic tools for ADHD in the near future because VR provides stimuli to replace real stimuli and recreate experiences with high realism. It also creates a playful virtual environment and reduces stress in children. The DL model is a subset of machine learning that can transform input and output data into diagnostic values using convolutional neural network systems. By using a sensitive and specific ADHD-VR diagnostic tool prototype for children with DL model, ADHD can be diagnosed more easily and accurately, especially in places with few mental health resources or where tele-consultation is possible. To date, several virtual reality-continuous performance test (VR-CPT) diagnostic tools have been developed for ADHD; however, they do not include a machine learning or deep learning application. A diagnostic tool development study needs a trustworthy and applicable study design and conduct to ensure the completeness and transparency of the report of the accuracy of the diagnostic tool. The proposed four-step method is a mixed-method research design that combines qualitative and quantitative approaches to reduce bias and collect essential information to ensure the trustworthiness and relevance of the study findings. Therefore, this study aimed to present a brief review of a ADHD-VR digital game diagnostic tool prototype with a DL model for children and the proposed four-step method for its development.

The Use of Virtual Reality in Psychiatry: A Review

With the advancement in modern information technology, virtual reality (VR) is being increasingly used for the diagnosis, assessment, and treatment of mental disorders. Recently, a VR-based cognitive behavioral therapy for social phobia has been recognized as a new medical technology in South Korea. This might lead to an increase in the use of VR in the field of psychiatry. The present review provides an overview of the status of VR therapies in various psychiatric conditions such as anxiety disorder, post-traumatic stress disorder, psychosis, addiction, and eating disorder. Besides, it summarizes the role of VR therapy in the management of disorders associated with child and adolescence psychiatry as well as various other clinical applications. Additionally, we discuss the merits and limitations of VR therapy, which might serve as a useful reference for researchers. In the current environment wherein novel medical models consisting of a combination of digital devices and medicine are being developed; understanding new technologies such as VR could open new doors to mental health treatments.