1
|
Finley JCA, Tufty LM, Abalos SA, Keszycki R, Woloszyn M, Shapiro G, Cerny BM, Ulrich DM, Phillips MS, Robinson AD, Soble JR. Identifying Factors that Increase False-Positive Rates on Embedded Performance Validity Testing in ADHD Evaluations. Arch Clin Neuropsychol 2024:acae099. [PMID: 39492660 DOI: 10.1093/arclin/acae099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2024] [Revised: 09/10/2024] [Accepted: 10/14/2024] [Indexed: 11/05/2024] Open
Abstract
OBJECTIVE This study investigated why certain embedded performance validity indicators (EVIs) are prone to higher false-positive rates (FPRs) in attention-deficit/hyperactivity disorder (ADHD) evaluations. The first aim was to establish the relationship between FPRs and 15 EVIs derived from six cognitive tests when used independently and together among adults with ADHD who have valid test performance. The second aim was to determine which specific EVIs increase the FPRs in this population. METHOD Participants were 517 adult ADHD referrals with valid neurocognitive test performance as determined by multiple performance validity tests and established empirical criteria. FPRs were defined by the proportion of participants who scored below an empirically established EVI cutoff with ≥0.90 specificity. RESULTS EVIs derived from two of the six tests exhibited unacceptably high FPRs (>10%) when used independently, but the total FPR decreased to 8.1% when the EVIs were aggregated. Several EVIs within a sustained attention test were associated with FPRs around 11%. EVIs that did not include demographically adjusted cutoffs, specifically for race, were associated with higher FPRs around 14%. Conversely, FPRs did not significantly differ based on whether EVIs included timed versus untimed, verbal versus nonverbal, or graphomotor versus non-graphomotor components, nor whether they had raw versus standardized cut scores. CONCLUSIONS Findings suggest that practitioners should consider both the type of test from which an EVI is derived and the aggregate number of EVIs employed to minimize the FPRs in ADHD evaluations. Findings also indicate that more nuanced approaches to validity test selection and development are needed.
Collapse
Affiliation(s)
- John-Christopher A Finley
- Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, 420 E Superior St, Chicago, IL, 60611, USA
| | - Logan M Tufty
- Department of Psychology, University of Illinois Chicago College of Medicine, 1853 W Polk St, Chicago, IL, 60612, USA
- Department of Psychiatry, University of Illinois College of Medicine, 1853 W Polk St, Chicago, IL, 60612, USA
| | - Steven A Abalos
- Department of Psychiatry, University of Illinois College of Medicine, 1853 W Polk St, Chicago, IL, 60612, USA
| | - Rachel Keszycki
- Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, 420 E Superior St, Chicago, IL, 60611, USA
| | - Mary Woloszyn
- Department of Psychology, University of Illinois Chicago College of Medicine, 1853 W Polk St, Chicago, IL, 60612, USA
- Department of Psychiatry, University of Illinois College of Medicine, 1853 W Polk St, Chicago, IL, 60612, USA
| | - Greg Shapiro
- Department of Psychiatry, University of Illinois College of Medicine, 1853 W Polk St, Chicago, IL, 60612, USA
- Department of Clinical Psychology, The Chicago School, 325 N Wells St, Chicago, IL, 60654, USA
| | - Brian M Cerny
- Department of Psychiatry, University of Illinois College of Medicine, 1853 W Polk St, Chicago, IL, 60612, USA
- Department of Psychology, Illinois Institute of Technology, 10 W 35th St, Chicago, IL, 60616, USA
| | - Devin M Ulrich
- Department of Psychiatry, University of Illinois College of Medicine, 1853 W Polk St, Chicago, IL, 60612, USA
| | - Matthew S Phillips
- Department of Psychiatry, University of Illinois College of Medicine, 1853 W Polk St, Chicago, IL, 60612, USA
| | - Anthony D Robinson
- Department of Psychiatry, University of Illinois College of Medicine, 1853 W Polk St, Chicago, IL, 60612, USA
| | - Jason R Soble
- Department of Psychiatry, University of Illinois College of Medicine, 1853 W Polk St, Chicago, IL, 60612, USA
- Department of Neurology, University of Illinois College of Medicine, 1853 W Polk St, Chicago, IL, 60612, USA
| |
Collapse
|
2
|
Finley JCA, Robinson AD, Cerny BM, Ovsiew GP, Pliskin NH, Calamia M, Ulrich DM, Phillips MS, Soble JR. Examining the utility of the BAARS-IV scales as embedded symptom validity indicators for adult attention-deficit/hyperactivity disorder evaluations. Clin Neuropsychol 2024:1-17. [PMID: 39465583 DOI: 10.1080/13854046.2024.2420376] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2024] [Accepted: 10/19/2024] [Indexed: 10/29/2024]
Abstract
Objective: This study investigated whether extreme cut-scores on the Barkley Adult Attention-Deficit/Hyperactivity Disorder (ADHD) Rating Scale-Fourth Edition (BAARS-IV) self-report scales could serve as symptom overreporting indicators in adult ADHD evaluations. Method: The sample consisted of 162 adults who underwent a neuropsychological evaluation for ADHD. Patients were classified into valid (n = 115) and invalid (n = 47) groups based on multiple criterion symptom validity tests. Results: Overreporting cut-scores identified for each of the BAARS-IV scales demonstrated acceptable classification accuracy or better. The Current Total scale yielded the highest classification accuracy (area under the curve of .83). An optimal raw cut-score of ≥56 for this scale yielded 47% sensitivity when upholding ≥90% specificity. A cut-score of ≥31 for the Current Inattention scale (90% specificity; 47% sensitivity) and ≥29 for the Current Sluggish Cognitive Tempo scale (88% specificity; 46% sensitivity) were also relatively strong indicators of overreporting. The Current Total and Current Sluggish Cognitive Tempo scales captured nonredundant aspects of symptom validity, and using them together increased sensitivity to 57% while maintaining ≥90% specificity. Conclusions: Findings provide preliminary support for the criterion and construct validity of extreme cut-scores on the BAARS-IV Current Sluggish Cognitive Tempo, Current Inattention, and Current Total scales as indicators of ADHD symptom overreporting. However, employing the cut-scores from the Current Sluggish Cognitive Tempo (≥29) and Current Total (≥56) together may be the most promising way to detect overreporting. Scores above both of these cut-points should, at a minimum, prompt further investigation into the validity of a patient's reported symptoms.
Collapse
Affiliation(s)
- John-Christopher A Finley
- Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Anthony D Robinson
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychology, Louisiana State University, Baton Rouge, LA, USA
| | - Brian M Cerny
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Psychology, Illinois Institute of Technology Chicago, IL, USA
| | - Gabriel P Ovsiew
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Neil H Pliskin
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Neurology, University of Illinois College of Medicine, Chicago, IL, USA
| | - Matthew Calamia
- Department of Psychology, Louisiana State University, Baton Rouge, LA, USA
| | - Devin M Ulrich
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Matthew S Phillips
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
| | - Jason R Soble
- Department of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA
- Department of Neurology, University of Illinois College of Medicine, Chicago, IL, USA
| |
Collapse
|
3
|
Fuermaier ABM, Tucha L, Merten T, Fathollah Gol M, Tucha O. Symptom validity testing in adults with clinically diagnosed ADHD: comparison of the Conner's Adult ADHD Rating Scale (CAARS) and the Self-Report Symptom Inventory (SRSI). J Clin Exp Neuropsychol 2024:1-14. [PMID: 39383110 DOI: 10.1080/13803395.2024.2411365] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2024] [Accepted: 09/26/2024] [Indexed: 10/11/2024]
Abstract
OBJECTIVES Compared to the number of performance validity measures, the range of available symptom validity measures is limited. The Self-Report Symptom Inventory (SRSI) is a recently developed freestanding symptom validity test with promising psychometric characteristics for use on non-criminal forensic and a range of clinical populations. The goal of this study was to evaluate the utility of the SRSI for symptom validity testing in the clinical evaluation of adults with attention-deficit/hyperactivity disorder (ADHD). METHODS This analogue study compared 76 German patients diagnosed with ADHD (age range 19-63 years) with typically developing individuals from the Netherlands/Germany who were assigned to either a control group (N = 58; age range 18-73 years) or a simulation group (N = 46; age range 18-57 years). All participants completed the Conners' Adult ADHD Rating Scale (CAARS) with its two embedded validity indicators Infrequency Index (CII) and ADHD Credibility Index (ACI), the SRSI, and the Digit Span (to derive the Reliable Digit Span). RESULTS Specificity in controls was perfect for the CAARS, but reached only about 90% for the SRSI. In contrast, sensitivity in experimental simulators ranged from 24% to 65% for the CAARS, but reached high rates of 69% to 82% for the SRSI. In the sample of patients with ADHD, the failure rate ranged from 8% to 34% (CAARS), and 33% to 47% (SRSI). Further, we found limited classification agreement between the validity measures. CONCLUSION The divergent results on the different validity indicators reflects the ongoing discussion on poor construct unity and clarity, and calls for more research addressing the heterogeneous construct. The utility of the SRSI to reliably distinguish between valid and invalid symptom report in the clinical evaluation of adult ADHD has to be investigated by more refined studies including both symptom and performance validity indicators.
Collapse
Affiliation(s)
- Anselm B M Fuermaier
- Department of Clinical and Developmental Neuropsychology, Faculty of Behavioral and Social Sciences, University of Groningen, Groningen, The Netherlands
| | - Lara Tucha
- Department of Psychiatry and Psychotherapy, University Medical Center Rostock, Rostock, Germany
| | - Thomas Merten
- Department of Neurology, Vivantes Klinikum im Friedrichshain, Berlin, Germany
| | - Maryam Fathollah Gol
- Department of Psychiatry and Psychotherapy, University Medical Center Rostock, Rostock, Germany
| | - Oliver Tucha
- Department of Psychiatry and Psychotherapy, University Medical Center Rostock, Rostock, Germany
- Department of Psychology, National University of Ireland, Maynooth, Ireland
| |
Collapse
|
4
|
Fuermaier ABM, Gontijo-Santos Lima C, Tucha O. Impairment Assessment in Adult ADHD and Related Disorders: Current Opinions From Clinic and Research. J Atten Disord 2024; 28:1529-1541. [PMID: 38898706 PMCID: PMC11408967 DOI: 10.1177/10870547241261598] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/21/2024]
Abstract
OBJECTIVES Assessing functional impairment is one of the essential components in the clinical evaluation of ADHD in adulthood, serving both diagnostic and outcome evaluation purposes. However, clinicians and researchers may face challenges in selecting suitable instruments due to variations in accessibility and quality of instruments. METHODS We conducted an online survey involving an international group of 92 respondents engaged in clinical practice and/or research on ADHD. The survey aimed to evaluate current practices in assessing impairment in adult ADHD and related disorders, while also identifying areas requiring adaptation or potential new developments. RESULTS Our findings revealed that clinicians and researchers utilize a diverse range of instruments for assessing impairment in adults with ADHD, including some that may lack adequate properties for this purpose. Notably, dissatisfaction with current practice standards was expressed, underscoring the need for novel assessment approaches and improved psychometric properties. CONCLUSION It is evident that research endeavors are warranted to either refine existing measures or devise new ones for assessing functional impairment in adult ADHD. Emphasis should be placed on disseminating instruments that enhance accessibility in both research and clinical settings, and facilitate streamlined administration and interpretation.
Collapse
Affiliation(s)
| | | | - Oliver Tucha
- University Medical Center Rostock, Germany
- National University of Ireland, Maynooth, Ireland
| |
Collapse
|
5
|
Alarachi A, Merrifield C, Rowa K, McCabe RE. Are We Measuring ADHD or Anxiety? Examining the Factor Structure and Discriminant Validity of the Adult ADHD Self-Report Scale in an Adult Anxiety Disorder Population. Assessment 2024; 31:1508-1524. [PMID: 38288573 PMCID: PMC11409565 DOI: 10.1177/10731911231225190] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/18/2024]
Abstract
Adults with clinical anxiety have significant symptom overlap and above average rates of attention-deficit/hyperactivity disorder (ADHD). Despite this, ADHD remains a vastly under-detected disorder among this population, indicating the need for a screener with well-understood symptom dimensions and good discriminant validity. The current study compared competing models of ADHD as well as discriminant properties of self-reported ADHD symptoms as measured by the Adult ADHD Self-Report Scale (ASRS-v1.1) in 618 adults with clinical anxiety. A three-factor correlated model of Inattention, Impulsivity, and Hyperactivity, with the movement of one item, talks excessively, to a factor of Impulsivity from Hyperactivity fit better than the one-factor, two-factor, and traditional three-factor models of ADHD. Discriminant properties of the screener were fair to good against measures of clinical anxiety and distress; however, some items within the Hyperactivity factor (e.g., difficulty relaxing; feeling driven by a motor) loaded more strongly onto factors of clinical anxiety than ADHD when measures were pooled together. These results suggest that clinicians making differential diagnoses between adult ADHD and anxiety or related disorders should look for evidence of ADHD beyond the overlapping symptoms, particularly for those within the Hyperactivity factor.
Collapse
Affiliation(s)
- Arij Alarachi
- Anxiety Treatment and Research Clinic, St. Joseph's Healthcare Hamilton, Ontario, Canada
- Department of Psychology, Neuroscience, & Behaviour, McMaster University, Hamilton, Ontario, Canada
| | - Colleen Merrifield
- Anxiety Treatment and Research Clinic, St. Joseph's Healthcare Hamilton, Ontario, Canada
- Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, Ontario, Canada
| | - Karen Rowa
- Anxiety Treatment and Research Clinic, St. Joseph's Healthcare Hamilton, Ontario, Canada
- Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, Ontario, Canada
| | - Randi E McCabe
- Anxiety Treatment and Research Clinic, St. Joseph's Healthcare Hamilton, Ontario, Canada
- Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, Ontario, Canada
| |
Collapse
|
6
|
Xiao LR, Zhao G, Zhang P, Tian X, Wu XX, Li JR, Liu SY, Wu HM. A Psychometric Evaluation of the Revised Version of the Adult ADHD Self-Report Scale in Chinese Adolescents. J Atten Disord 2024:10870547241285971. [PMID: 39344019 DOI: 10.1177/10870547241285971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/01/2024]
Abstract
BACKGROUND Adolescent-specific ADHD self-report screening measures can greatly increase the likelihood of correct diagnosis and timely treatment of ADHD in adolescents. This study provides preliminary evidence for evaluating the reliability and validity of the Adult ADHD Self-Report Scale-Revised (ASRS-R) in a school-based sample of Chinese adolescents. METHODS The ASRS-R and the Strengths and Difficulties Questionnaire (SDQ) were administered to 867 adolescents aged 12 to 16 years (Mage = 13.08 years). Construct validity was assessed using correlation analysis of the ASRS-R with the SDQ. Moreover, confirmatory factor analysis (CFA), internal consistency, retest reliability, and measurement invariance of the scales were examined by gender. RESULTS CFA showed a two-dimensional factor structure of the ASRS-R, and the model fitted the data well (χ2/df = 4.370, RMSEA = 0.062, TLI = 0.932, CFI = 0.940, GFI = 0.927, AGFI = 0.907, and SRMR = 0.038). The ASRS-R scale was invariant across gender and had satisfactory internal consistency (Cronbach's alpha = .934) and test-retest reliability (intraclass correlation coefficient = .874). The construct validity, as calculated using the SDQ, was also acceptable. CONCLUSION The ASRS-R can be a psychometrically reliable self-report instrument and provide preliminary support as a simple tool for identifying ADHD symptoms in Chinese adolescents. The findings provide evidence for extending the application of the ASRS, previously limited to adults, to the adolescent populations.
Collapse
Affiliation(s)
| | - Gang Zhao
- Maternity and Child Healthcare Hospital, Nanshan, China
| | - Pei Zhang
- Harbin Medical University, Daqing, China
| | - Xian Tian
- Harbin Medical University, Daqing, China
| | | | - Jun-Ru Li
- Harbin Medical University, Daqing, China
| | - Si-Yan Liu
- Harbin Medical University, Daqing, China
| | | |
Collapse
|
7
|
Adamou M, Arif M, Asherson P, Cubbin S, Leaver L, Sedgwick-Müller J, Müller-Sedgwick U, van Rensburg K, Kustow J. The adult ADHD assessment quality assurance standard. Front Psychiatry 2024; 15:1380410. [PMID: 39156609 PMCID: PMC11327143 DOI: 10.3389/fpsyt.2024.1380410] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/01/2024] [Accepted: 07/08/2024] [Indexed: 08/20/2024] Open
Abstract
Background Attention Deficit Hyperactivity Disorder (ADHD) frequently persists into adulthood. There are practice guidelines that outline the requirements for the assessment and treatment of adults. Nevertheless, guidelines specifying what constitutes a good quality diagnostic assessment and report and the competencies required to be a specialist assessor are lacking. This can lead to variation in the quality and reliability of adult ADHD assessments. Poor quality assessments may not be accepted as valid indicators of the presence of ADHD by other clinicians or services, resulting in wasteful re-assessments and delays in providing treatment. To address this issue the UK Adult ADHD Network (UKAAN) proposes a quality framework for adult ADHD assessments - the Adult ADHD Assessment Quality Assurance Standard (AQAS). Methods The co-authors agreed on five questions or themes that then guided the development of a set of consensus statements. An initial draft was reviewed and amended in an iterative process to reach a final consensus. Results What constitutes a high-quality diagnostic assessment and report was agreed by consensus of the co-authors. The resulting guideline emphasises the need to evaluate impairment, describes core competencies required by the assessor and highlights the importance of linking the diagnosis to an appropriate post-diagnostic discussion. Assessments should be completed in the context of a full psychiatric and neurodevelopmental review, and need good interview skills, using a semi-structured interview with open questioning and probing to elicit real life examples of symptoms and impairments. It is recommended that 2 hours or more is required for an adequate assessment including both the diagnostic assessment and initial post-assessment discussions. Conclusion The AQAS has been developed as a practical resource to support reliable and valid diagnostic assessments of adult ADHD. It is intended to complement formal training. A secondary objective is to empower patients by providing them with evidence-based information on what to expect from an assessment and assessment report.
Collapse
Affiliation(s)
- Marios Adamou
- School of Human and Health Sciences, University of Huddersfield, Huddersfield, United Kingdom
- Adult ADHD Clinic, South West Yorkshire Partnership National Health Service (NHS) Foundation Trust, Huddersfield, United Kingdom
| | - Muhammad Arif
- Adult ADHD Clinic, Leicestershire Partnership National Health Service (NHS) Trust, Leicester, United Kingdom
| | - Philip Asherson
- Social Genetic and Developmental Psychiatry, King’s College London, London, United Kingdom
| | - Sally Cubbin
- Adult ADHD Clinic, Manor Hospital, Oxford, United Kingdom
| | | | - Jane Sedgwick-Müller
- Health and Community Services, Government of Jersey, St Helier, Jersey
- Faculty of Nursing, Midwifery and Palliative Care, King’s College London, London, United Kingdom
| | - Ulrich Müller-Sedgwick
- Health and Community Services, Government of Jersey, St Helier, Jersey
- Department of Psychiatry, University of Cambridge, Cambridge, United Kingdom
- Adult ADHD Service, Barnet, Enfield and Haringey Mental Health National Health Service (NHS) Trust, London, United Kingdom
| | | | - James Kustow
- Adult ADHD Service, Barnet, Enfield and Haringey Mental Health National Health Service (NHS) Trust, London, United Kingdom
| |
Collapse
|
8
|
Kwan D, Davin N, Harrison AG, Gillie S. Determining cutoff scores on the Conners' adult ADHD rating scales that can definitively rule out the presence of ADHD in a clinical sample. APPLIED NEUROPSYCHOLOGY. ADULT 2024:1-11. [PMID: 38569190 DOI: 10.1080/23279095.2024.2336204] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/05/2024]
Abstract
In recent years, the prevalence of Attention Deficit/Hyperactivity Disorder (ADHD) and the number of individuals seeking ADHD assessments has risen significantly, leading to an increased demand for accurate diagnostic tools. This study aimed to identify cutoff scores on the Conners' Adult ADHD Rating Scales (CAARS-S:L) that can definitively rule out the presence of ADHD. Among 102 clinically diagnosed adult ADHD participants and 448 non-ADHD participants who completed the CAARS-S:L, a receiver operating characteristic curve analysis established a perfectly discriminant cutoff T-score of <44 on the ADHD Symptoms Total subscale when looking at any ADHD diagnosis and <54 on the Inattentive Symptoms subscale when looking at individuals diagnosed with the inattentive subtype of ADHD. Alternative cutoffs of <54 (ADHD Symptoms Total subscale) and <63 (Inattentive Symptoms subscale) were also identified, both with a sensitivity of 0.95 or higher. Furthermore, the analysis found the ADHD Index to be a poor predictor of a negative ADHD diagnosis, suggesting against the use of this scale for cutoff determination. Despite this limitation, these findings indicate that with specific cutoffs, the CAARS-S:L may have the potential to conclusively rule out ADHD, effectively streamlining the diagnostic process and reducing unnecessary comprehensive assessments in clear negative cases.
Collapse
Affiliation(s)
- Dylan Kwan
- Regional Assessment & Resource Centre, Queens University, Kingston, ON, Canada
| | - Nathaniel Davin
- Regional Assessment & Resource Centre, Queens University, Kingston, ON, Canada
| | - Allyson G Harrison
- Regional Assessment & Resource Centre, Queens University, Kingston, ON, Canada
| | - Sienna Gillie
- Regional Assessment & Resource Centre, Queens University, Kingston, ON, Canada
| |
Collapse
|
9
|
Callen EF, Clay T, Alai J, Goodman DW, Adler LA, Faraone SV. The Role of Age in Adult ADHD Quality Care: A Longitudinal Analysis of Electronic Health Record Data. J Atten Disord 2024; 28:913-922. [PMID: 38156704 DOI: 10.1177/10870547231218042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/03/2024]
Abstract
OBJECTIVE Several studies have shown that Adult ADHD presents differently in younger and older adults. We sought to assess the difference in care between these two groups using previously identified quality measures (QMs). METHODS Using electronic health record data, we matched a younger group of ADHD patients to an older group. We then assessed the achievement of the QMs using probit models with and without interaction terms. RESULTS The majority of QMs shown an increase in achievement for both groups over time. However, significant differences in quality of care between younger and older adult ADHD patients persisted. By the end of the study period, with the exception of three QMs, younger patients achieved the QMs more. CONCLUSION While, in general, the quality of care for adult ADHD increased from 2010 to 2020, there were still differences in care between younger and older adult ADHD patients.
Collapse
Affiliation(s)
- Elisabeth F Callen
- American Academy of Family Physicians, Leawood, KS, USA
- DARTNet Institute, Aurora, CO, USA
| | - Tarin Clay
- American Academy of Family Physicians, Leawood, KS, USA
- DARTNet Institute, Aurora, CO, USA
| | - Jillian Alai
- American Academy of Family Physicians, Leawood, KS, USA
- DARTNet Institute, Aurora, CO, USA
| | - David W Goodman
- Johns Hopkins School of Medicine, Baltimore, MD, USA
- SUNY Upstate Medical University, Syracuse, USA
| | | | | |
Collapse
|
10
|
Dong H, Koerts J, Pijnenborg GHM, Scherbaum N, Müller BW, Fuermaier ABM. Cognitive Underperformance in a Mixed Neuropsychiatric Sample at Diagnostic Evaluation of Adult ADHD. J Clin Med 2023; 12:6926. [PMID: 37959391 PMCID: PMC10647211 DOI: 10.3390/jcm12216926] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Revised: 10/31/2023] [Accepted: 11/02/2023] [Indexed: 11/15/2023] Open
Abstract
(1) Background: The clinical assessment of attention-deficit/hyperactivity disorder (ADHD) in adulthood is known to show non-trivial base rates of noncredible performance and requires thorough validity assessment. (2) Objectives: The present study estimated base rates of noncredible performance in clinical evaluations of adult ADHD on one or more of 17 embedded validity indicators (EVIs). This study further examines the effect of the order of test administration on EVI failure rates, the association between cognitive underperformance and symptom overreporting, and the prediction of cognitive underperformance by clinical information. (3) Methods: A mixed neuropsychiatric sample (N = 464, ADHD = 227) completed a comprehensive neuropsychological assessment battery on the Vienna Test System (VTS; CFADHD). Test performance allows the computation of 17 embedded performance validity indicators (PVTs) derived from eight different neuropsychological tests. Further, all participants completed several self- and other-report symptom rating scales assessing depressive symptoms and cognitive functioning. The Conners' Adult ADHD Rating Scale and the Beck Depression Inventory-II were administered to derive embedded symptom validity measures (SVTs). (4) Results and conclusion: Noncredible performance occurs in a sizeable proportion of about 10% up to 30% of individuals throughout the entire battery. Tests for attention and concentration appear to be the most adequate and sensitive for detecting underperformance. Cognitive underperformance represents a coherent construct and seems dissociable from symptom overreporting. These results emphasize the importance of performing multiple PVTs, at different time points, and promote more accurate calculation of the positive and negative predictive values of a given validity measure for noncredible performance during clinical assessments. Future studies should further examine whether and how the present results stand in other clinical populations, by implementing rigorous reference standards of noncredible performance, characterizing those failing PVT assessments, and differentiating between underlying motivations.
Collapse
Affiliation(s)
- Hui Dong
- Department of Clinical and Developmental Neuropsychology, Faculty of Behavioral and Social Sciences, University of Groningen, 9712 TS Groningen, The Netherlands; (H.D.); (J.K.); (G.H.M.P.)
| | - Janneke Koerts
- Department of Clinical and Developmental Neuropsychology, Faculty of Behavioral and Social Sciences, University of Groningen, 9712 TS Groningen, The Netherlands; (H.D.); (J.K.); (G.H.M.P.)
| | - Gerdina H. M. Pijnenborg
- Department of Clinical and Developmental Neuropsychology, Faculty of Behavioral and Social Sciences, University of Groningen, 9712 TS Groningen, The Netherlands; (H.D.); (J.K.); (G.H.M.P.)
| | - Norbert Scherbaum
- LVR University Hospital, Department of Psychiatry and Psychotherapy, Faculty of Medicine, University of Duisburg-Essen, 45147 Essen, Germany; (N.S.); (B.W.M.)
| | - Bernhard W. Müller
- LVR University Hospital, Department of Psychiatry and Psychotherapy, Faculty of Medicine, University of Duisburg-Essen, 45147 Essen, Germany; (N.S.); (B.W.M.)
- Department of Psychology, University of Wuppertal, 42119 Wuppertal, Germany
| | - Anselm B. M. Fuermaier
- Department of Clinical and Developmental Neuropsychology, Faculty of Behavioral and Social Sciences, University of Groningen, 9712 TS Groningen, The Netherlands; (H.D.); (J.K.); (G.H.M.P.)
| |
Collapse
|
11
|
Harrison AG, Edwards MJ. The Ability of Self-Report Methods to Accurately Diagnose Attention Deficit Hyperactivity Disorder: A Systematic Review. J Atten Disord 2023; 27:1343-1359. [PMID: 37366274 DOI: 10.1177/10870547231177470] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/28/2023]
Abstract
OBJECTIVE To identify and analyze all studies validating rating scales or interview-based screeners commonly used to evaluate ADHD in adults. METHOD A systematic literature search identified all studies providing diagnostic accuracy statistics, including sensitivity and specificity, supplemented by relevant articles or test manuals referenced in reviewed manuscripts. RESULTS Only 20 published studies or manuals provided data regarding sensitivity and specificity when tasked with differentiating those with and without ADHD. While all screening measures have excellent ability to correctly classify non-ADHD individuals (with negative predictive values exceeding 96%), false positive rates were high. At best, positive predictive values in clinical samples reached 61%, but most fell below 20%. CONCLUSION Clinicians cannot rely on scales alone to diagnose ADHD and must undertake more rigorous evaluation of clients who screen positive. Furthermore, relevant classification statistics must be included in publications to help clinicians make statistically defensible decisions. Otherwise, clinicians risk inappropriately diagnosing ADHD.
Collapse
|
12
|
Guo N, Fuermaier ABM, Koerts J, Tucha O, Scherbaum N, Müller BW. Networks of Neuropsychological Functions in the Clinical Evaluation of Adult ADHD. Assessment 2023; 30:1719-1736. [PMID: 36031877 PMCID: PMC10363951 DOI: 10.1177/10731911221118673] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
This study applied network analysis to explore the relations between neuropsychological functions of individuals in the clinical evaluation of attention-deficit/hyperactivity disorder (ADHD) in adulthood. A total of 319 participants from an outpatient referral context, that is, 173 individuals with ADHD (ADHD group) and 146 individuals without ADHD (n-ADHD group), took part in this study and completed a comprehensive neuropsychological assessment. A denser network with stronger global connectivity was observed in the ADHD group compared to the n-ADHD group. The strongest connections were consistent in both networks, that is, the connections between selective attention and vigilance, and connections between processing speed, fluency, and flexibility. Further centrality estimation revealed attention-related variables to have the highest expected influence in both networks. The observed relationships between neuropsychological functions, and the high centrality of attention, may help identify neuropsychological profiles that are specific to ADHD and optimize neuropsychological assessment and treatment planning of individuals with cognitive impairment.
Collapse
Affiliation(s)
- Nana Guo
- University of Groningen, The Netherlands
| | | | | | - Oliver Tucha
- University of Groningen, The Netherlands
- University Medical Center Rostock, Germany
- Maynooth University, Ireland
| | | | | |
Collapse
|
13
|
Muhammad N, Murugesan BG, Singal P, Antai A, Jain L. Diagnostic Dilemma of Differentiating Attention-Deficit/Hyperactivity Disorder (ADHD) From Mood Disorders and Other Common Psychiatric Illnesses in Substance Use Patient Population. Cureus 2023; 15:e37372. [PMID: 37041853 PMCID: PMC10084797 DOI: 10.7759/cureus.37372] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/10/2023] [Indexed: 04/13/2023] Open
Abstract
To raise awareness of attention-deficit/hyperactivity disorder (ADHD) as an underdiagnosed, undertreated disorder in adult patients with comorbid substance use disorder (SUD) who are misdiagnosed with other common psychiatric illnesses and to reduce fear and hesitancy in prescribing stimulants as treatment in such a patient population. ADHD diagnosis is easier in the child and adolescent population than the adults due to comorbidities of other psychiatric illnesses and SUD. However, diagnosing ADHD appropriately in an increasing number of adult patients presents challenges. Even if they get diagnosed appropriately, the stigma of substance use disorder holds the providers prescribing stimulant medications for such patient populations due to the high comorbidity of ADHD with SUD. Accurate diagnosis of ADHD in adults is a worthwhile endeavor as this diagnosis is comorbidly present in many mood and substance use disorders patients. Treating ADHD in this population can improve clinical symptoms and overall quality of life.
Collapse
Affiliation(s)
- Nazar Muhammad
- Psychiatry, Cornerstone Family Healthcare, New York, USA
| | - Bhavani G Murugesan
- Psychiatry and Behavioral Sciences, State University of New York (SUNY) Upstate Medical University, Syracuse, USA
| | - Prakamya Singal
- Psychiatry, All India Institute of Medical Sciences, New Delhi, IND
| | - Angelica Antai
- Radiology, University of Uyo Teaching Hospital, Uyo, NGA
| | - Lakshit Jain
- Psychiatry, University of Connecticut, Hartford, USA
| |
Collapse
|
14
|
Becke M, Tucha L, Butzbach M, Aschenbrenner S, Weisbrod M, Tucha O, Fuermaier ABM. Feigning Adult ADHD on a Comprehensive Neuropsychological Test Battery: An Analogue Study. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2023; 20:4070. [PMID: 36901080 PMCID: PMC10001580 DOI: 10.3390/ijerph20054070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Revised: 02/18/2023] [Accepted: 02/21/2023] [Indexed: 06/18/2023]
Abstract
The evaluation of performance validity is an essential part of any neuropsychological evaluation. Validity indicators embedded in routine neuropsychological tests offer a time-efficient option for sampling performance validity throughout the assessment while reducing vulnerability to coaching. By administering a comprehensive neuropsychological test battery to 57 adults with ADHD, 60 neurotypical controls, and 151 instructed simulators, we examined each test's utility in detecting noncredible performance. Cut-off scores were derived for all available outcome variables. Although all ensured at least 90% specificity in the ADHD Group, sensitivity differed significantly between tests, ranging from 0% to 64.9%. Tests of selective attention, vigilance, and inhibition were most useful in detecting the instructed simulation of adult ADHD, whereas figural fluency and task switching lacked sensitivity. Five or more test variables demonstrating results in the second to fourth percentile were rare among cases of genuine adult ADHD but identified approximately 58% of instructed simulators.
Collapse
Affiliation(s)
- Miriam Becke
- Department of Clinical and Developmental Neuropsychology, University of Groningen, 9712 TS Groningen, The Netherlands
| | - Lara Tucha
- Department of Psychiatry and Psychotherapy, University Medical Center Rostock, Gehlsheimer Str. 20, 18147 Rostock, Germany
| | - Marah Butzbach
- Department of Clinical and Developmental Neuropsychology, University of Groningen, 9712 TS Groningen, The Netherlands
| | - Steffen Aschenbrenner
- Department of Clinical Psychology and Neuropsychology, SRH Clinic Karlsbad-Langensteinbach, 76307 Karlsbad, Germany
| | - Matthias Weisbrod
- Department of Psychiatry and Psychotherapy, SRH Clinic Karlsbad-Langensteinbach, 76307 Karlsbad, Germany
- Department of General Psychiatry, Center of Psychosocial Medicine, University of Heidelberg, 69115 Heidelberg, Germany
| | - Oliver Tucha
- Department of Clinical and Developmental Neuropsychology, University of Groningen, 9712 TS Groningen, The Netherlands
- Department of Psychiatry and Psychotherapy, University Medical Center Rostock, Gehlsheimer Str. 20, 18147 Rostock, Germany
- Department of Psychology, National University of Ireland, W23 F2K8 Maynooth, Ireland
| | - Anselm B. M. Fuermaier
- Department of Clinical and Developmental Neuropsychology, University of Groningen, 9712 TS Groningen, The Netherlands
| |
Collapse
|
15
|
Skeel RL, Lesica S, Fust B, Garnett A, Bolen L. Validation of an adult ADHD measure of feigning in a sample including individuals with depression and anxiety symptoms. APPLIED NEUROPSYCHOLOGY. ADULT 2022:1-7. [PMID: 36548522 DOI: 10.1080/23279095.2022.2158335] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Few studies of measures or techniques designed to detect feigning of Attention-Deficit/Hyperactivity Disorder (ADHD) have included groups reporting symptoms of depression and anxiety. Based on the high rate of comorbidity between ADHD and mood disorders, inclusion of such groups is important to mimic clinical referral patterns. The current study evaluated the validity of the ADHD Symptom Infrequency Scale (ASIS), a measure designed to detect malingered symptoms of ADHD, in a four-known groups design that included a group consisting of subjects with symptoms of anxiety and depression. Four groups were included in the current study: (1) control, (2) simulator, (3) ADHD diagnosed, (4) individuals with elevated symptoms of depression/anxiety. The ASIS Infrequency scale showed strong internal consistency (α = .83). Discriminant validity for the Infrequency Scale was established through a low correlation between the ASIS scale assessing feigning and a measure of anxiety and depression (r = -.02). Sensitivity was high for detection of simulation (.71), while specificity was high across comparisons, ranging from .86 to .99. Results support the ASIS as a reliable and valid measure of ADHD that is sensitive to feigning, even when including a sample of individuals reporting symptoms of depression and anxiety.
Collapse
Affiliation(s)
- Reid L Skeel
- Department of Psychology, Central Michigan University, Mount Pleasant, MI, USA
| | - Sofia Lesica
- Department of Psychology, Central Michigan University, Mount Pleasant, MI, USA
| | - Brittany Fust
- Department of Psychology, Central Michigan University, Mount Pleasant, MI, USA
| | - Ashley Garnett
- Department of Psychology, Central Michigan University, Mount Pleasant, MI, USA
| | - Lianna Bolen
- Department of Psychology, Central Michigan University, Mount Pleasant, MI, USA
| |
Collapse
|
16
|
Guo N, Koerts J, Tucha L, Fetter I, Biela C, König M, Bossert M, Diener C, Aschenbrenner S, Weisbrod M, Tucha O, Fuermaier ABM. Stability of Attention Performance of Adults with ADHD over Time: Evidence from Repeated Neuropsychological Assessments in One-Month Intervals. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:15234. [PMID: 36429952 PMCID: PMC9690645 DOI: 10.3390/ijerph192215234] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Revised: 11/15/2022] [Accepted: 11/16/2022] [Indexed: 06/16/2023]
Abstract
Neuropsychological assessments of attention are valuable sources of information in the clinical evaluation of adults with attention-deficit/hyperactivity disorder (ADHD). However, it is unclear whether the attention performance of adults with ADHD is stable or fluctuates over time, which is of great importance in the interpretation of clinical assessments. This study aimed to explore the stability of attention performance of adults with ADHD in repeated assessments at one-month intervals. Twenty-one adults diagnosed with ADHD took part in this study by completing selective attention and vigilance tests three times, each one month apart. Test scores of participants were compared with and interpreted based on test norms. A considerable proportion of 'below average' performance scores were observed in most of the variables of selective attention and vigilance in all three assessments. Further, selective attention and vigilance performance scores did not differ significantly between the three repeated assessments. Finally, the majority of participants received consistent test score interpretations across the three repeated assessments. This study confirms previous research and highlights abnormal selective attention and vigilance performance in adults with ADHD. Further, this study preliminarily demonstrates relatively stable attention performance across repeated assessments, which has the potential to support clinical assessment, treatment planning, and evaluation.
Collapse
Affiliation(s)
- Nana Guo
- Department of Clinical and Developmental Neuropsychology, Faculty of Behavioral and Social Sciences, University of Groningen, 9712 TS Groningen, The Netherlands
| | - Janneke Koerts
- Department of Clinical and Developmental Neuropsychology, Faculty of Behavioral and Social Sciences, University of Groningen, 9712 TS Groningen, The Netherlands
| | - Lara Tucha
- Department of Clinical and Developmental Neuropsychology, Faculty of Behavioral and Social Sciences, University of Groningen, 9712 TS Groningen, The Netherlands
- Department of Psychiatry and Psychotherapy, University Medical Center Rostock, 18147 Rostock, Germany
| | - Isabel Fetter
- Department of Psychiatry and Psychotherapy, SRH Clinic Karlsbad-Langensteinbach, 76307 Karlsbad-Langensteinbach, Germany
- Department of Clinical Psychology and Neuropsychology, SRH Clinic Karlsbad-Langensteinbach, 76307 Karlsbad-Langensteinbach, Germany
| | - Christina Biela
- Department of Psychiatry and Psychotherapy, SRH Clinic Karlsbad-Langensteinbach, 76307 Karlsbad-Langensteinbach, Germany
- Department of Clinical Psychology and Neuropsychology, SRH Clinic Karlsbad-Langensteinbach, 76307 Karlsbad-Langensteinbach, Germany
| | - Miriam König
- Department of Psychiatry and Psychotherapy, SRH Clinic Karlsbad-Langensteinbach, 76307 Karlsbad-Langensteinbach, Germany
- Department of Clinical Psychology and Neuropsychology, SRH Clinic Karlsbad-Langensteinbach, 76307 Karlsbad-Langensteinbach, Germany
| | - Magdalena Bossert
- Department of Psychiatry and Psychotherapy, SRH Clinic Karlsbad-Langensteinbach, 76307 Karlsbad-Langensteinbach, Germany
- Department of Clinical Psychology and Neuropsychology, SRH Clinic Karlsbad-Langensteinbach, 76307 Karlsbad-Langensteinbach, Germany
| | - Carsten Diener
- Department of Applied Psychology, SRH University Heidelberg, 69123 Heidelberg, Germany
| | - Steffen Aschenbrenner
- Department of Psychiatry and Psychotherapy, SRH Clinic Karlsbad-Langensteinbach, 76307 Karlsbad-Langensteinbach, Germany
- Department of Clinical Psychology and Neuropsychology, SRH Clinic Karlsbad-Langensteinbach, 76307 Karlsbad-Langensteinbach, Germany
| | - Matthias Weisbrod
- Department of Psychiatry and Psychotherapy, SRH Clinic Karlsbad-Langensteinbach, 76307 Karlsbad-Langensteinbach, Germany
- Department of General Psychiatry, Center of Psychosocial Medicine, University of Heidelberg, 69115 Heidelberg, Germany
| | - Oliver Tucha
- Department of Clinical and Developmental Neuropsychology, Faculty of Behavioral and Social Sciences, University of Groningen, 9712 TS Groningen, The Netherlands
- Department of Psychiatry and Psychotherapy, University Medical Center Rostock, 18147 Rostock, Germany
- Department of Psychology, National University of Ireland, Maynooth, W23 F2H6 Maynooth, County Kildare, Ireland
| | - Anselm B. M. Fuermaier
- Department of Clinical and Developmental Neuropsychology, Faculty of Behavioral and Social Sciences, University of Groningen, 9712 TS Groningen, The Netherlands
| |
Collapse
|
17
|
Robinson A, Huber M, Breaux E, Pugh E, Calamia M. Failing The b Test: The influence of cutoff scores and criterion group approaches in a sample of adults referred for psychoeducational evaluation. J Clin Exp Neuropsychol 2022; 44:619-626. [PMID: 36727266 DOI: 10.1080/13803395.2022.2153805] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
OBJECTIVE Previous research has shown that both criterion grouping approaches and cutoff scores can impact PVT classification accuracy statistics. This study aimed to examine the influence of cutoff scores and criterion grouping approaches on The b Test, a measure designed to identify feigned impairment in visual scanning, processing speed, and letter identification. METHOD Two hundred ninety-seven adults referred for psychoeducational testing were included with the majority of individuals seeking academic accommodations (n = 215). Cutoff scores of ≥82, ≥90, and ≥120 were utilized along with two different criterion group approaches, 0 PVT failures vs. ≥2 PVT failures and 0 PVT failures versus ≥ 1 PVT failures. RESULTS Failure rates for The b Test in the overall sample ranged from 12.5% to 16.2%. Subgroup analyses in those referred specifically for ADHD revealed failure rates for The b Test ranging from 10.5% to 14.2%. ROC curves within the full sample and ADHD subsample demonstrated significant AUCs utilizing both criterion group approaches (AUC = .66 - .78). Sensitivity and specificity varied as a function of criterion group approach and cutoff score, with 0 PVT failures vs. ≥ 2 PVT failures resulting in the greatest sensitivity when maximizing specificity at ≥.90 in the full sample and ADHD sample. CONCLUSIONS The results demonstrate that criterion approaches and cutoff scores impact classification accuracy of The b Test with 0 PVT vs. ≥ 2 PVT failures demonstrating the greatest classification accuracy. Special considerations should be made with regard to clinical decision making in the context of psychoeducational evaluations given that a large portion of individuals seeking accommodations fail only one PVT. Limitations of this study are also discussed.
Collapse
Affiliation(s)
- Anthony Robinson
- Department of Psychology, Louisiana State University, Baton Rouge, LA, USA
| | - Marissa Huber
- Department of Psychology, Louisiana State University, Baton Rouge, LA, USA
| | - Eathan Breaux
- Department of Psychology, Louisiana State University, Baton Rouge, LA, USA
| | - Erika Pugh
- Department of Psychology, Louisiana State University, Baton Rouge, LA, USA
| | - Matthew Calamia
- Department of Psychology, Louisiana State University, Baton Rouge, LA, USA
| |
Collapse
|
18
|
Potts HE, Lewandowski LJ, Lovett BJ. Identifying Feigned ADHD in College Students: Comparing the Multidimensional ADHD Rating Scale to Established Validity Measures. J Atten Disord 2022; 26:1622-1630. [PMID: 35466735 DOI: 10.1177/10870547221092095] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
OBJECTIVE There is increased concern for malingering in ADHD evaluations due to presence of incentives such as accommodations and medications. Although several validity tests are available to classify malingering in non-ADHD populations, there is no test with proven effectiveness to detect feigned ADHD. This study investigated the ability of the MARS Symptom Validity Index 4 (MARS SV-index 4) and two published validity tests (the Word Memory Test [WMT] and Clinical Assessment of Attention Deficit-Adult [CAT-A] Infrequency scale) to detect malingered ADHD. METHOD The participants consisted of 68 young adults, 34 with ADHD. Participants completed the MARS, CAT-A, and WMT validity measures. RESULTS The MARS SV index-4 demonstrated higher sensitivity rates for simulated malingering (61.8%) at close to optimal specificity (88.2%) compared to two published tests (which had sensitivity <42% at specificity >90%). CONCLUSION The MARS shows good ability to detect feigned ADHD and appears to be useful for adult ADHD assessments.
Collapse
|
19
|
Hirsch O, Fuermaier ABM, Tucha O, Albrecht B, Chavanon ML, Christiansen H. Symptom and performance validity in samples of adults at clinical evaluation of ADHD: a replication study using machine learning algorithms. J Clin Exp Neuropsychol 2022; 44:171-184. [PMID: 35906728 DOI: 10.1080/13803395.2022.2105821] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/16/2022]
Abstract
INTRODUCTION Research has shown non-trivial base rates of noncredible symptom report and performance in the clinical evaluation of attention-deficit/hyperactivity disorder (ADHD) in adulthood. The goal of this study is to estimate and replicate base rates of symptom and performance validity test failure in the clinical evaluation of adult ADHD and derive prediction models based on routine clinical measures. METHODS This study reuses data of a previous publication of 196 adults seeking ADHD assessment and replicates the findings on an independent sample of 700 adults recruited in the same referral context. Measures of symptom and performance validity (one SVT, two PVTs) were applied to estimate base rates. Prediction models were developed using machine learning. RESULTS Both samples showed substantial rates of noncredible symptom report (one SVT failure: 35.7% - 36.6%), noncredible test performance (one PVT failure: 32.1% - 49.3%; two PVT failures: 18.9% - 27.3%), or both (each one SVT and PVT failure: 13.3% - 22.4%; one SVT and two PVT failures: 9.7% - 13.7%). Machine learning algorithms resulted in generally moderate to weak prediction models, with advantages of the reused sample compared to the independent replication sample. Associations between measures of symptom and performance validity were negligible to small. CONCLUSIONS This study highlights the necessity to include measures of symptom and performance validity in the clinical evaluation of adult ADHD. Further, this study demonstrates the difficulty to characterize the group failing symptom or performance validity assessment.
Collapse
Affiliation(s)
- Oliver Hirsch
- Department of Psychology, FOM University of Applied Sciences, Siegen, Germany
| | - Anselm B M Fuermaier
- Department of Clinical and Developmental Neuropsychology, Faculty of Behavioral and Social Sciences, University of Groningen, Groningen, The Netherlands
| | - Oliver Tucha
- Department of Psychiatry and Psychotherapy, University Medical Center Rostock, Rostock, Germany.,Department of Psychology, Maynooth University, National University of Ireland, Maynooth, Ireland
| | - Björn Albrecht
- Department of Psychology, Clinical Child and Adolescent Psychology/Philipps University Marburg, Marburg, Germany
| | - Mira-Lynn Chavanon
- Department of Psychology, Clinical Child and Adolescent Psychology/Philipps University Marburg, Marburg, Germany
| | - Hanna Christiansen
- Department of Psychology, Clinical Child and Adolescent Psychology/Philipps University Marburg, Marburg, Germany
| |
Collapse
|
20
|
Di Lonardo Burr SM, LeFevre JA, Arnold LE, Epstein JN, Hinshaw SP, Molina BSG, Hechtman L, Hoza B, Jensen PS, Vitiello B, Pelham WE, Howard AL. Paths to postsecondary education enrollment among adolescents with and without childhood attention-deficit/hyperactivity disorder (ADHD): A longitudinal analysis of symptom and academic trajectories. Child Dev 2022; 93:e563-e580. [PMID: 35635061 DOI: 10.1111/cdev.13807] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
We examined developmental trajectories of attention-deficit/hyperactivity disorder (ADHD) symptoms, standardized achievement, and school performance for adolescents with and without ADHD who did and did not enroll in postsecondary education (PSE; N = 749; 79% boys; 63% White, 17% non-Hispanic Black, 10% Hispanic, and 10% other ethnicities). In a multisite study (recruitment based in New York, North Carolina, Pennsylvania, California, and Quebec), participants were originally enrolled between 1994 and 1998 at ages 7 to 9.9 and followed up through 2012 (Mage = 25 at final follow-up). Adolescents who eventually enrolled in PSE had less severe symptoms, but differences were modest and trajectories were similar over time. For all adolescents, standardized achievement trajectories declined up to two thirds of a standard deviation from ages 9 to 17. By the end of high school, the average GPA of adolescents with ADHD was three quarters of a point higher for those who eventually enrolled in PSE compared to those who did not. Overall, school performance mattered more than academic achievement for understanding eventual enrollment of adolescents with ADHD.
Collapse
Affiliation(s)
- Sabrina M Di Lonardo Burr
- Department of Psychology, University of British Columbia, Vancouver, British Columbia, Canada.,Department of Cognitive Science, Carleton University, Ottawa, Ontario, Canada
| | - Jo-Anne LeFevre
- Department of Cognitive Science, Carleton University, Ottawa, Ontario, Canada.,Department of Psychology, Carleton University, Ottawa, Ontario, Canada
| | - L Eugene Arnold
- Department of Psychiatry and Behavioral Health, Ohio State University, Columbus, Ohio, USA
| | - Jeffrey N Epstein
- Division of Behavioral Medicine and Clinical Psychology, Cincinnati Children's Hospital, Cincinnati, Ohio, USA
| | - Stephen P Hinshaw
- Department of Psychology, University of California, Berkeley, California, USA
| | - Brooke S G Molina
- Department of Pediatrics, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Lily Hechtman
- Department of Psychiatry, McGill University, Montreal, Quebec, Canada
| | - Betsy Hoza
- Department of Psychological Science, University of Vermont, Burlington, Vermont, USA
| | - Peter S Jensen
- The REACH Institute, New York, New York, USA.,Department of Psychiatry, University of Arkansas for the Medical Sciences, Little Rock, Arkansas, USA
| | - Benedetto Vitiello
- Department of Public Health and Pediatrics, University of Torino, Torino, Italy
| | - William E Pelham
- College of Arts, Sciences, and Education, Florida International University, Miami, Florida, USA
| | - Andrea L Howard
- Department of Psychology, Carleton University, Ottawa, Ontario, Canada
| |
Collapse
|
21
|
Babinski DE, Saunders EFH, He F, Liao D, Pearl AM, Waschbusch DA. Screening for ADHD in a general outpatient psychiatric sample of adults. Psychiatry Res 2022; 311:114524. [PMID: 35349861 DOI: 10.1016/j.psychres.2022.114524] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/04/2021] [Revised: 03/18/2022] [Accepted: 03/20/2022] [Indexed: 11/28/2022]
Abstract
Adults (n = 805) seeking outpatient psychiatric care completed the Adult ADHD Self-Report Scale (ASRS) and measures of impairment and co-occurring psychopathology as part of a measurement-based care initiative. Diagnostic indicators of ADHD (i.e., formal diagnosis and/or medication treatment) were recorded from the electronic medical record (EMR). Agreement between screening positive for ADHD and EMR indicators for the diagnosis was explored, and clinical characteristics of adults identified with ADHD using these indicators were examined. Lastly, the contribution of ADHD to functional impairment was examined, controlling for the contribution of other demographic and psychiatric comorbidities. In the full sample, 54.78% of adults screened positive for ADHD based on the ASRS, and using EMR indicators, only 11.93% of adults were identified with ADHD. Agreement emerged between self-reported ADHD and ADHD EMR indicators, although adults screening positive for ADHD generally reported greater psychiatric complexity relative to adults identified with ADHD in the EMR. ADHD was associated with clinical impairment even when controlling for other psychiatric comorbidities. The considerable difference in prevalence of ADHD based on self-report screening versus EMR indicators suggests that ADHD may be overlooked in adult psychiatric care. Findings point to the importance of assessing adult ADHD in routine psychiatric care.
Collapse
Affiliation(s)
- Dara E Babinski
- Department of Psychiatry and Behavioral Health, Penn State College of Medicine and Penn State Milton S. Hershey Medical Center, Hershey, PA, USA.
| | - Erika F H Saunders
- Department of Psychiatry and Behavioral Health, Penn State College of Medicine and Penn State Milton S. Hershey Medical Center, Hershey, PA, USA
| | - Fan He
- Department of Public Health Sciences, Penn State College of Medicine, Hershey, PA, USA
| | - Duanping Liao
- Department of Public Health Sciences, Penn State College of Medicine, Hershey, PA, USA
| | - Amanda M Pearl
- Department of Psychiatry and Behavioral Health, Penn State College of Medicine and Penn State Milton S. Hershey Medical Center, Hershey, PA, USA
| | - Daniel A Waschbusch
- Department of Psychiatry and Behavioral Health, Penn State College of Medicine and Penn State Milton S. Hershey Medical Center, Hershey, PA, USA
| |
Collapse
|
22
|
Becke M, Tucha L, Weisbrod M, Aschenbrenner S, Tucha O, Fuermaier ABM. Joint Consideration of Validity Indicators Embedded in Conners’ Adult ADHD Rating Scales (CAARS). PSYCHOLOGICAL INJURY & LAW 2022. [DOI: 10.1007/s12207-022-09445-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
AbstractA decade of research has both illustrated the need for accurate clinical assessment of adult ADHD and brought forward a series of validity indicators assisting this diagnostic process. Several of these indicators have been embedded into Conners’ Adult ADHD Rating Scales (CAARS). As their different theoretical underpinnings offer the opportunity of possible synergy effects, the present study sought to examine whether the item- or index-wise combination of multiple validity indicators benefits classification accuracy. A sample of controls (n = 856) and adults with ADHD (n = 72) answered the CAARS, including the ADHD Credibility Index (ACI) honestly, while a group of instructed simulators (n = 135) completed the instrument as though they had ADHD. First, original CAARS items, which are part of the CAARS Infrequency Index (CII), and items drawn from the ACI were combined into a new CII-ACI-Compound Index. Secondly, existing validity indicators, including suspect T-score elevations and the CII, were considered in combination. Both approaches were evaluated in terms of sensitivity and specificity. The combination of four CII and five ACI items into the CII-ACI-Compound Index yielded a sensitivity between 41 and 51% and an estimated specificity above 87%. Suspect T-score elevations on all three DSM scales emerged as another potentially useful validity indicator with a sensitivity of 45 to 46% and a specificity > 90%. Deeming examinees non-credible whenever two or more validity indicators showed suspect results ensured low false-positive rates (< 10%), but reduced sensitivity significantly. Classifying respondents as non-credible as soon as any given indicator fell into the suspect range resulted in frequent false positives (> 11% of misclassified adults with ADHD). Depending on whether high specificity or high sensitivity is prioritized, such combined considerations offer valuable additions to individual validity indicators. High sensitivity provided by “either/or” combinations could prove useful in screening settings, whereas high stakes settings could benefit from “and” combinations.
Collapse
|
23
|
Becker S, Sharma MJ, Callahan BL. ADHD and Neurodegenerative Disease Risk: A Critical Examination of the Evidence. Front Aging Neurosci 2022; 13:826213. [PMID: 35145394 PMCID: PMC8822599 DOI: 10.3389/fnagi.2021.826213] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2021] [Accepted: 12/28/2021] [Indexed: 11/29/2022] Open
Abstract
In this review, we undertake a critical appraisal of eight published studies providing first evidence that a history of attention-deficit/hyperactivity disorder (ADHD) may increase risk for the later-life development of a neurodegenerative disease, in particular Lewy body diseases (LBD), by up to five-fold. Most of these studies have used data linked to health records in large population registers and include impressive sample sizes and adequate follow-up periods. We identify a number of methodological limitations as well, including potential diagnostic inaccuracies arising from the use of electronic health records, biases in the measurement of ADHD status and symptoms, and concerns surrounding the representativeness of ADHD and LBD cohorts. Consequently, previously reported risk associations may have been underestimated due to the high likelihood of potentially missed ADHD cases in groups used as “controls”, or alternatively previous estimates may be inflated due to the inclusion of confounding comorbidities or non-ADHD cases within “exposed” groups that may have better accounted for dementia risk. Prospective longitudinal studies involving well-characterized cases and controls are recommended to provide some reassurance about the validity of neurodegenerative risk estimates in ADHD.
Collapse
Affiliation(s)
- Sara Becker
- Department of Psychology, University of Calgary, Calgary, AB, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
| | - Manu J. Sharma
- Department of Psychology, University of Calgary, Calgary, AB, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
| | - Brandy L. Callahan
- Department of Psychology, University of Calgary, Calgary, AB, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
- *Correspondence: Brandy L. Callahan
| |
Collapse
|
24
|
Ceroni M, Rossi S, Zerboni G, Biglia E, Soldini E, Izzo A, Morellini L, Sacco L. Attentive-executive functioning and compensatory strategies in adult ADHD: A retrospective case series study. Front Psychol 2022; 13:1015102. [PMID: 36312151 PMCID: PMC9606327 DOI: 10.3389/fpsyg.2022.1015102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Accepted: 09/05/2022] [Indexed: 11/13/2022] Open
Abstract
Background Adults with ADHD exhibit a neuropsychological profile that may present deficits in many cognitive domains, particularly attention and executive functions (EFs). However, some authors do not consider executive disfunction as an important part of the clinical profile of the syndrome; this could be related to the use of inappropriate neuropsychological tests, probably not adapted and not sufficiently ecological. Moreover, new data are required on specific correlation of attentive-executive symptoms with socio-demographic factors. Therefore, the aim of this study is to analyze the neuropsychological performance of a group of adults with ADHD, also evaluating the influence of gender, age and education level. Methods We retrospectively collected health-related personal data of 40 adult ADHD patients, clinically diagnosed and evaluated via a battery of 4 neuropsychological tests and 1 self-administered questionnaire. Gender, age and years of education differences were assessed. Results Attention and EFs deficits have been highlighted mainly on the d2-R and 5-point neuropsychological tests, which therefore seem to be more sensitive in measuring the attention-executive dysfunction in an adult ADHD population, than TAP Go/No-go and ROCFT. ADHD patients also manifested subjective behavioral impulsivity disorders on BIS-11. There were no statistically significant gender differences in cognitive performance. On the contrary, younger patients performed worse on subscales TAP Go/No-go errors and 5-points number of drawings, while participants with a higher education level performed better on subscales d2-R speed of execution and d2-R errors. This supports a reduction in the number of errors and the execution time as a function of older age and a higher level of education. Finally, patients with higher education also self-reported greater impulsivity in planning. Conclusion Our preliminary findings suggest that adult ADHD is not a lifelong stable disorder, but it may change over time. Moreover, attention-executive deficits may be influenced and partially counterbalanced by experience (i.e., advancing age) and a higher level of education. This could underlie the development of specific psycho-behavioral and cognitive compensatory strategies. The use of self-administered questionnaires is therefore recommended to highlight attentional and executive difficulties that may not result in neuropsychological tests.
Collapse
Affiliation(s)
- Martino Ceroni
- Neuropsychological and Speech Therapy Unit, Neurocenter of Southern Switzerland, EOC, Lugano, Switzerland
| | - Stefania Rossi
- Neuropsychological and Speech Therapy Unit, Neurocenter of Southern Switzerland, EOC, Lugano, Switzerland
| | - Giorgia Zerboni
- Neuropsychological and Speech Therapy Unit, Neurocenter of Southern Switzerland, EOC, Lugano, Switzerland
| | - Elena Biglia
- Neuropsychological and Speech Therapy Unit, Neurocenter of Southern Switzerland, EOC, Lugano, Switzerland
| | - Emiliano Soldini
- Competence Centre for Healthcare Practices and Policies, Department of Business Economics, Health, and Social Care (DEASS), University of Applied Sciences and Arts of Southern Switzerland, Manno, Switzerland
| | - Alessia Izzo
- Faculty of Biomedical Sciences, Università della Svizzera italiana, Lugano, Switzerland
| | - Lucia Morellini
- Neuropsychological and Speech Therapy Unit, Neurocenter of Southern Switzerland, EOC, Lugano, Switzerland
- Faculty of Biomedical Sciences, Università della Svizzera italiana, Lugano, Switzerland
- *Correspondence: Lucia Morellini,
| | - Leonardo Sacco
- Neuropsychological and Speech Therapy Unit, Neurocenter of Southern Switzerland, EOC, Lugano, Switzerland
| |
Collapse
|