Time-Related Changes in Conners' CPT-II Scores: A Replication Study

Machine learning-enabled detection of attention-deficit/hyperactivity disorder with multimodal physiological data: a case-control study

BACKGROUND

Attention-Deficit/Hyperactivity Disorder (ADHD) is a multifaceted neurodevelopmental psychiatric condition that typically emerges during childhood but often persists into adulthood, significantly impacting individuals' functioning, relationships, productivity, and overall quality of life. However, the current diagnostic process exhibits limitations that can significantly affect its overall effectiveness. Notably, its face-to-face and time-consuming nature, coupled with the reliance on subjective recall of historical information and clinician subjectivity, stand out as key challenges. To address these limitations, objective measures such as neuropsychological evaluations, imaging techniques and physiological monitoring of the Autonomic Nervous System functioning, have been explored.

METHODS

The main aim of this study was to investigate whether physiological data (i.e., Electrodermal Activity, Heart Rate Variability, and Skin Temperature) can serve as meaningful indicators of ADHD, evaluating its utility in distinguishing adult ADHD patients. This observational, case-control study included a total of 76 adult participants (32 ADHD patients and 44 healthy controls) who underwent a series of Stroop tests, while their physiological data was passively collected using a multi-sensor wearable device. Univariate feature analysis was employed to identify the tests that triggered significant signal responses, while the Informative k-Nearest Neighbors (KNN) algorithm was used to filter out less informative data points. Finally, a machine-learning decision pipeline incorporating various classification algorithms, including Logistic Regression, KNN, Random Forests, and Support Vector Machines (SVM), was utilized for ADHD patient detection.

RESULTS

Results indicate that the SVM-based model yielded the optimal performance, achieving 81.6% accuracy, maintaining a balance between the experimental and control groups, with sensitivity and specificity of 81.4% and 81.9%, respectively. Additionally, integration of data from all physiological signals yielded the best results, suggesting that each modality captures unique aspects of ADHD.

CONCLUSIONS

This study underscores the potential of physiological signals as valuable diagnostic indicators of adult ADHD. For the first time, to the best of our knowledge, our findings demonstrate that multimodal physiological data collected via wearable devices can complement traditional diagnostic approaches. Further research is warranted to explore the clinical applications and long-term implications of utilizing physiological markers in ADHD diagnosis and management.

Critical Item Analysis Enhances the Classification Accuracy of the Logical Memory Recognition Trial as a Performance Validity Indicator

OBJECTIVE

: Replicate previous research on Logical Memory Recognition (LM_Recog) and perform a critical item analysis.

METHOD

: Performance validity was psychometrically operationalized in a mixed clinical sample of 213 adults. Classification of the LM_Recog and nine critical items (CR-9) was computed.

RESULTS

: LM_Recog ≤20 produced a good combination of sensitivity (.30-.35) and specificity (.89-.90). CR-9 ≥5 and ≥6 had comparable classification accuracy. CR-9 ≥5 increased sensitivity by 4% over LM_Recog ≤20; CR-9 ≥6 increased specificity by 6-8% over LM_Recog ≤20; CR-9 ≥7 increased specificity by 8-15%.

CONCLUSIONS

: Critical item analysis enhances the classification accuracy of the optimal LM_Recog cutoff (≤20).

The emotion word fluency test as an embedded performance validity indicator - Alone and in a multivariate validity composite

OBJECTIVE

This project was designed to cross-validate existing performance validity cutoffs embedded within measures of verbal fluency (FAS and animals) and develop new ones for the Emotion Word Fluency Test (EWFT), a novel measure of category fluency.

METHOD

The classification accuracy of the verbal fluency tests was examined in two samples (70 cognitively healthy university students and 52 clinical patients) against psychometrically defined criterion measures.

RESULTS

A demographically adjusted T-score of ≤31 on the FAS was specific (.88-.97) to noncredible responding in both samples. Animals T ≤ 29 achieved high specificity (.90-.93) among students at .27-.38 sensitivity. A more conservative cutoff (T ≤ 27) was needed in the patient sample for a similar combination of sensitivity (.24-.45) and specificity (.87-.93). An EWFT raw score ≤5 was highly specific (.94-.97) but insensitive (.10-.18) to invalid performance. Failing multiple cutoffs improved specificity (.90-1.00) at variable sensitivity (.19-.45).

CONCLUSIONS

Results help resolve the inconsistency in previous reports, and confirm the overall utility of existing verbal fluency tests as embedded validity indicators. Multivariate models of performance validity assessment are superior to single indicators. The clinical utility and limitations of the EWFT as a novel measure are discussed.

Does the Continuous Performance Test Predict ADHD Symptoms Severity and ADHD Presentation in Adults?

Objective: Our study aimed to provide empirical evidence on the usefulness of one of the most popular neuropsychological tests, the Continuous Performance Test (CPT), as a marker of ADHD severity and presentations among adults. Method: ADHD participants were recruited in a specialized center for the diagnosis and treatment of adults suffering from ADHD (n = 201). Measures included the CPT3™ and ADHD symptoms using a clinical interview and self-reported measures. Results: Only 51.7% of the participants were classified as likely to have a disorder characterized by attention deficit, such as ADHD, by the CPT. The relationships between CPT variables and ADHD symptoms were small. The classification error was 80.3% for the inattentive presentation and 22.5% for the hyperactive presentation when using the CPT to identify ADHD presentations. Conclusion: There was no evidence of the clinical utility of the CPT to assess or monitor ADHD in adult populations diagnosed and treated for ADHD.

Gender Differences in Objective and Subjective Measures of ADHD Among Clinic-Referred Children

Attention deficit hyperactivity disorder (ADHD), one of the most prevalent childhood disorders today, is generally more likely to be diagnosed and treated in boys than in girls. However, gender differences in ADHD are currently poorly understood, partly because previous research included only a limited proportion of girls and relied mainly on subjective measures of ADHD, which are highly vulnerable to reporter's bias. To further examine gender differences in ADHD and to address some of the shortcomings of previous studies, this study examined gender differences in subjective and objective measures of ADHD among clinic-referred children with ADHD. Participants were 204 children aged 6-17 years-old with ADHD (129 boys, 75 girls). A retrospective analysis was conducted using records of a clinical database. Obtained data included parent and teacher forms of the Conners ADHD rating scales, Child Behavior Checklist (CBCL), Teacher's Report Form (TRF), and child's continuous performance test (CPT) scores. Results showed that according to parents' and teachers' reports of ADHD-related symptoms (Conners ADHD rating scales), girls had more inattention problems than boys, but no differences were identified in the level of hyperactivity and impulsivity symptoms. CPT data, however, revealed higher impulsivity among boys. We did not find gender differences in the level of distractibility during CPT performance. Specifically, the effects of distractors type (visual environmental stimuli, auditory stimuli, or a combination of them) and distractors load (one or two distracting stimuli at a time) on CPT performance did not differ between boys and girls with ADHD. These findings suggest that gender effects on ADHD symptoms may differ between subjective and objective measures. Understanding gender differences in ADHD may lead to improved identification of girls with the disorder, helping to reduce the gender gap in diagnosis and treatment.

Short-term effects of cannabis consumption on cognitive performance in medical cannabis patients

This observational study examined the acute cognitive effects of cannabis. We hypothesized that cognitive performance would be negatively affected by acute cannabis intoxication. Twenty-two medical cannabis patients from Southwestern Ontario completed the study. The majority (n = 13) were male. Mean age was 36.0 years, and mean level of education was 13.7 years. Participants were administered the same brief neurocognitive battery three times during a six-hour period: at baseline ("Baseline"), once after they consumed a 20% THC cannabis product ("THC"), and once again several hours later ("Recovery"). The average self-reported level of cannabis intoxication prior to the second assessment (i.e., during THC) was 5.1 out of 10. Contrary to expectations, performance on neuropsychological tests remained stable or even improved during the acute intoxication stage (THC; d: .49-.65, medium effect), and continued to increase during Recovery (d: .45-.77, medium-large effect). Interestingly, the failure rate on performance validity indicators increased during THC. Contrary to our hypothesis, there was no psychometric evidence for a decline in cognitive ability following THC intoxication. There are several possible explanations for this finding but, in the absence of a control group, no definitive conclusion can be reached at this time.

Using environmental distractors in the diagnosis of ADHD

This study examined the effect of the incorporation of environmental distractors in computerized continuous performance test (CPT) on the ability of the test in distinguishing ADHD from non-ADHD children. It was hypothesized that children with ADHD would display more distractibility than controls while performing CPT as measured by omission errors in the presence of pure visual, pure auditory, and a combination of visual and auditory distracting stimuli. Participants were 663 children aged 7–12 years, of them 345 diagnosed with ADHD and 318 without ADHD. Results showed that ADHD children demonstrated more omission errors than their healthy peers in all CPT conditions (no distractors, pure visual or auditory distractors and combined distractors). However, ADHD and non-ADHD children differed in their reaction to distracting stimuli; while all types of distracting stimuli increased the rate of omission errors in ADHD children, only combined visual and auditory distractors increased it in non-ADHD children. Given the low ecological validity of many CPT, these findings suggest that incorporating distractors in CPT improves the ability to distinguish ADHD from non-ADHD children.