1
|
Bellato A, Hall CL, Groom MJ, Simonoff E, Thapar A, Hollis C, Cortese S. Practitioner Review: Clinical utility of the QbTest for the assessment and diagnosis of attention-deficit/hyperactivity disorder - a systematic review and meta-analysis. J Child Psychol Psychiatry 2024; 65:845-861. [PMID: 37800347 DOI: 10.1111/jcpp.13901] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 08/04/2023] [Indexed: 10/07/2023]
Abstract
BACKGROUND Several computerised cognitive tests (e.g. continuous performance test) have been developed to support the clinical assessment of attention-deficit/hyperactivity disorder (ADHD). Here, we appraised the evidence-base underpinning the use of one of these tests - the QbTest - in clinical practice, by conducting a systematic review and meta-analysis investigating its accuracy and clinical utility. METHODS Based on a preregistered protocol (CRD42022377671), we searched PubMed, Medline, Ovid Embase, APA PsycINFO and Web of Science on 15th August 2022, with no language/type of document restrictions. We included studies reporting accuracy measures (e.g. sensitivity, specificity, or Area under the Receiver Operating Characteristics Curve, AUC) for QbTest in discriminating between people with and without DSM/ICD ADHD diagnosis. Risk of bias was assessed with the Quality Assessment of Diagnostic Accuracy Studies tool (QUADAS-2). A generic inverse variance meta-analysis was conducted on AUC scores. Pooled sensitivity and specificity were calculated using a random-effects bivariate model in R. RESULTS We included 15 studies (2,058 participants; 48.6% with ADHD). QbTest Total scores showed acceptable, rather than good, sensitivity (0.78 [95% confidence interval: 0.69; 0.85]) and specificity (0.70 [0.57; 0.81]), while subscales showed low-to-moderate sensitivity (ranging from 0.48 [0.35; 0.61] to 0.65 [0.52; 0.75]) and moderate-to-good specificity (from 0.65 [0.48; 0.78] to 0.83 [0.60; 0.94]). Pooled AUC scores suggested moderate-to-acceptable discriminative ability (Q-Total: 0.72 [0.57; 0.87]; Q-Activity: 0.67 [0.58; 0.77); Q-Inattention: 0.66 [0.59; 0.72]; Q-Impulsivity: 0.59 [0.53; 0.64]). CONCLUSIONS When used on their own, QbTest scores available to clinicians are not sufficiently accurate in discriminating between ADHD and non-ADHD clinical cases. Therefore, the QbTest should not be used as stand-alone screening or diagnostic tool, or as a triage system for accepting individuals on the waiting-list for clinical services. However, when used as an adjunct to support a full clinical assessment, QbTest can produce efficiencies in the assessment pathway and reduce the time to diagnosis.
Collapse
Affiliation(s)
- Alessio Bellato
- School of Psychology, University of Nottingham, Nottingham, Malaysia
- Mind & Neurodevelopment (MiND) Research Cluster, University of Nottingham, Nottingham, Malaysia
| | - Charlotte L Hall
- NIHR MindTech MedTech Co-operative, Institute of Mental Health, School of Medicine, University of Nottingham, Nottingham, UK
- NIHR Nottingham Biomedical Research Centre, Institute of Mental Health, University of Nottingham, Nottingham, UK
- Mental Health and Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, UK
| | - Madeleine J Groom
- NIHR MindTech MedTech Co-operative, Institute of Mental Health, School of Medicine, University of Nottingham, Nottingham, UK
- NIHR Nottingham Biomedical Research Centre, Institute of Mental Health, University of Nottingham, Nottingham, UK
- Mental Health and Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, UK
| | - Emily Simonoff
- Department of Child and Adolescent Psychiatry, King's College London, Institute of Psychiatry, Psychology and Neuroscience, London, UK
| | - Anita Thapar
- Division of Psychological Medicine and Clinical Neurosciences, Wolfson Centre for Young People's Mental Health, Cardiff University School of Medicine, Cardiff, UK
| | - Chris Hollis
- NIHR MindTech MedTech Co-operative, Institute of Mental Health, School of Medicine, University of Nottingham, Nottingham, UK
- NIHR Nottingham Biomedical Research Centre, Institute of Mental Health, University of Nottingham, Nottingham, UK
- Mental Health and Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, UK
| | - Samuele Cortese
- Mental Health and Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, UK
- Centre for Innovation in Mental Health, School of Psychology, Faculty of Environmental and Life Sciences, University of Southampton, Southampton, UK
- Solent NHS Trust, Southampton, UK
- Clinical and Experimental Sciences (CNS and Psychiatry), Faculty of Medicine, University of Southampton, Southampton, UK
- Hassenfeld Children's Hospital at NYU Langone, New York University Child Study Center, New York, NY, USA
| |
Collapse
|
2
|
Gustafsson U, Hansen M. QbTest for Monitoring Medication Treatment Response in ADHD: A Systematic Review. Clin Pract Epidemiol Ment Health 2023; 19:e17450179276630. [PMID: 38164455 PMCID: PMC10758132 DOI: 10.2174/0117450179276630231030093814] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2023] [Revised: 09/27/2023] [Accepted: 10/10/2023] [Indexed: 01/03/2024]
Abstract
Introduction Attention deficit hyperactivity disorder (ADHD) is considered one of the most common neurodevelopmental disorders in childhood and adolescence. Pharmacological treatment plays an important part in the therapy of the disorder and verifying the effectiveness of ADHD medication is essential throughout the course of treatment. QbTest is a computerized test, for which intended use is to provide healthcare professionals with objective measurements of hyperactivity, impulsivity, and inattention to aid in the clinical assessment of ADHD and the evaluation of treatment interventions. Methods A systematic review of relevant articles was conducted for which QbTest was used for monitoring medication treatment response in ADHD. Literature published between 2004 and 2023 was appraised. Results A total of 15 studies were included in the review. Thirteen articles involved subjects diagnosed with ADHD and two studies that were related to the disorder, which evaluated QbTest in medication treatment response. Changes in QbTest data such as Q-scores, effect size, or improvement/deterioration of QbTest variables were evaluated. A clinically relevant decrease in QbTest Q-scores was found in the majority of the studies when treated with any type of ADHD medication in therapeutic doses, both in comparison to placebo and when compared from baseline to endpoint treatment. Conclusion QbTest can distinguish pharmacological treatment effects within hours of pharmacological titration and can be used for monitoring of long-term treatment of ADHD. A need for optimization and individualization of medication treatment response could be addressed with access to objective measures in ADHD management.
Collapse
Affiliation(s)
- Urban Gustafsson
- Qbtech AB, Medical Department, Cardellgatan 1, 11436 Stockholm, Sweden
| | - Mikkel Hansen
- Qbtech AB, Medical Department, Cardellgatan 1, 11436 Stockholm, Sweden
| |
Collapse
|
3
|
Stevanovic D, Nasic S, Doric A, Wentz E, Knez R. The Structure and Diagnostic Accuracy of the QbTest in Pediatric ADHD: A Retrospective Clinical Study. J Atten Disord 2023; 27:1296-1305. [PMID: 37199293 DOI: 10.1177/10870547231174035] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 05/19/2023]
Abstract
OBJECTIVE The QbTest that combines a continuous performance task (CPT) with a motion-tracking system may help identify attention deficit hyperactivity disorder (ADHD). This study examined the structure and diagnostic ability of the QbTest in children and adolescents. METHOD Retrospective data from 1,274 children and adolescents were analyzed. The study assessed data on a principal component analysis (PCA), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). RESULTS The QbActivity component included the variables micro-events, distance, area, and time active; the QbImpulsivity included normalized commissions and commissions (anticipatory errors were added in a version for 6-12-year-olds only); and the QbInattention included omissions, reaction time, and reaction time variation. Sensitivity ranged between 22% and 50%, specificity 79% and 96%, PPVs 40% and 95%, and NPVs 24% and 66%. CONCLUSION The structure of the QbTest with three cardinal parameters and nine/ten CPT and motion analysis variables was supported. The diagnostic accuracy was found to be poor to moderate. Given that this is a retrospective study, the interpretation of diagnostic accuracy should be considered within this context.
Collapse
Affiliation(s)
- Dejan Stevanovic
- Clinic for Neurology and Psychiatry for Children and Youth, Belgrade, Serbia
- University of Gothenburg, Sweden
| | - Salmir Nasic
- University of Gothenburg, Sweden
- Skaraborgs Hospital, Skövde, Sweden
| | - Ana Doric
- University of Rijeka, Croatia
- IntechOpen Limited, Rijeka, Croatia
| | | | - Rajna Knez
- University of Gothenburg, Sweden
- Skaraborgs Hospital, Skövde, Sweden
| |
Collapse
|