1
|
Fuermaier ABM, Gontijo-Santos Lima C, Tucha O. Impairment Assessment in Adult ADHD and Related Disorders: Current Opinions From Clinic and Research. J Atten Disord 2024; 28:1529-1541. [PMID: 38898706 PMCID: PMC11408967 DOI: 10.1177/10870547241261598] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/21/2024]
Abstract
OBJECTIVES Assessing functional impairment is one of the essential components in the clinical evaluation of ADHD in adulthood, serving both diagnostic and outcome evaluation purposes. However, clinicians and researchers may face challenges in selecting suitable instruments due to variations in accessibility and quality of instruments. METHODS We conducted an online survey involving an international group of 92 respondents engaged in clinical practice and/or research on ADHD. The survey aimed to evaluate current practices in assessing impairment in adult ADHD and related disorders, while also identifying areas requiring adaptation or potential new developments. RESULTS Our findings revealed that clinicians and researchers utilize a diverse range of instruments for assessing impairment in adults with ADHD, including some that may lack adequate properties for this purpose. Notably, dissatisfaction with current practice standards was expressed, underscoring the need for novel assessment approaches and improved psychometric properties. CONCLUSION It is evident that research endeavors are warranted to either refine existing measures or devise new ones for assessing functional impairment in adult ADHD. Emphasis should be placed on disseminating instruments that enhance accessibility in both research and clinical settings, and facilitate streamlined administration and interpretation.
Collapse
Affiliation(s)
| | | | - Oliver Tucha
- University Medical Center Rostock, Germany
- National University of Ireland, Maynooth, Ireland
| |
Collapse
|
2
|
Bucherbeam TR, Lovett BJ, Harrison AG. ADHD and Anxiety Symptoms: Does Construct or Assessment Type Matter More? J Atten Disord 2024; 28:1152-1157. [PMID: 38323532 DOI: 10.1177/10870547231220905] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/08/2024]
Abstract
OBJECTIVE This study examined the relationships between self-reported ADHD symptoms, self-reported anxiety, and continuous performance test (CPT) performance. METHOD 128 postsecondary students referred for clinical evaluation for possible ADHD and related conditions completed the Conners Adult ADHD Rating Scale, the Behavior Assessment Scale for Children, Third Edition, and either of two CPTs. RESULTS Multiple regression models found that when self-reported anxiety and CPT performance were used to simultaneously predict self-reported ADHD symptoms, CPT performance was not a significant predictor, whereas self-reported anxiety was. This finding was replicated across two different subsamples that took different CPTs. CONCLUSION Self-reported anxiety and ADHD symptoms are strongly related, but neither of these variables is significantly related to CPT performance. Implications for clinical practice and future research are discussed.
Collapse
|
3
|
Blume F, Buhr L, Kühnhausen J, Köpke R, Weber LA, Fallgatter AJ, Ethofer T, Gawrilow C. Validation of the Self-Report Version of the German Strengths and Weaknesses of ADHD Symptoms and Normal Behavior Scale (SWAN-DE-SB). Assessment 2024:10731911241236699. [PMID: 38523357 DOI: 10.1177/10731911241236699] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/26/2024]
Abstract
Adults with attention-deficit/hyperactivity disorder (ADHD) experience impairing levels of inattention and/or hyperactivity-impulsivity, while individuals without ADHD experience these symptoms to a lesser extent. Yet, ADHD self-report scales so far hardly captured continuous distributions across the general population. In addition, they focused on weaknesses and ignored strengths. To address these shortcomings, we present here the Strengths and Weaknesses of ADHD and Normal-Behavior Scale Self-Report (SWAN-DE-SB). The normal distribution of the data collected and the scale's internal consistency, and factorial and convergent validity were assessed using data from a general population sample. Its clinical utility was evaluated by comparing scores from a clinical sample and a sample of individuals without ADHD and by calculating optimal cut-off values for specificity and sensitivity. The SWAN-DE-SB demonstrated normal distribution of the data collected, high internal consistency, and factorial and convergent validity. It reliably discriminated individuals with and without ADHD, with high specificity and sensitivity. It should therefore be considered a psychometrically convincing measure to assess strengths and weaknesses of ADHD symptoms and normal behavior in clinical and general population samples.
Collapse
Affiliation(s)
- Friederike Blume
- DIPF | Leibniz Institute for Research and Information in Education, Frankfurt/Main, Germany
- Center for Research on Individual Development and Adaptive Education of Children at Risk (IDeA), Frankfurt/Main, Germany
- University of Tübingen, LEAD Graduate School & Research Network, Germany
| | - Lilly Buhr
- Center for Research on Individual Development and Adaptive Education of Children at Risk (IDeA), Frankfurt/Main, Germany
- University of Tübingen, LEAD Graduate School & Research Network, Germany
- University of Tübingen, Department of Psychology, School Psychology, Germany
| | - Jan Kühnhausen
- University of Tübingen, LEAD Graduate School & Research Network, Germany
- University Hospital Tübingen, Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, Germany
| | - Rieke Köpke
- University of Tübingen, Department of Psychology, School Psychology, Germany
| | - Lydia A Weber
- University Hospital Tübingen, Department of Psychiatry and Psychotherapy, Germany
| | - Andreas J Fallgatter
- University of Tübingen, LEAD Graduate School & Research Network, Germany
- University Hospital Tübingen, Department of Psychiatry and Psychotherapy, Germany
- German Center for Mental Health (DZPG), partner site Tübingen, Germany
| | - Thomas Ethofer
- University Hospital Tübingen, Department of Psychiatry and Psychotherapy, Germany
- German Center for Mental Health (DZPG), partner site Tübingen, Germany
| | - Caterina Gawrilow
- Center for Research on Individual Development and Adaptive Education of Children at Risk (IDeA), Frankfurt/Main, Germany
- University of Tübingen, LEAD Graduate School & Research Network, Germany
- University of Tübingen, Department of Psychology, School Psychology, Germany
- German Center for Mental Health (DZPG), partner site Tübingen, Germany
| |
Collapse
|
4
|
Harrison AG, Edwards MJ. The Ability of Self-Report Methods to Accurately Diagnose Attention Deficit Hyperactivity Disorder: A Systematic Review. J Atten Disord 2023; 27:1343-1359. [PMID: 37366274 DOI: 10.1177/10870547231177470] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/28/2023]
Abstract
OBJECTIVE To identify and analyze all studies validating rating scales or interview-based screeners commonly used to evaluate ADHD in adults. METHOD A systematic literature search identified all studies providing diagnostic accuracy statistics, including sensitivity and specificity, supplemented by relevant articles or test manuals referenced in reviewed manuscripts. RESULTS Only 20 published studies or manuals provided data regarding sensitivity and specificity when tasked with differentiating those with and without ADHD. While all screening measures have excellent ability to correctly classify non-ADHD individuals (with negative predictive values exceeding 96%), false positive rates were high. At best, positive predictive values in clinical samples reached 61%, but most fell below 20%. CONCLUSION Clinicians cannot rely on scales alone to diagnose ADHD and must undertake more rigorous evaluation of clients who screen positive. Furthermore, relevant classification statistics must be included in publications to help clinicians make statistically defensible decisions. Otherwise, clinicians risk inappropriately diagnosing ADHD.
Collapse
|
5
|
Vizgaitis AL, Bottini S, Polizzi CP, Barden E, Krantweiss AR. Self-Reported Adult ADHD Symptoms: Evidence Supporting Cautious Use in an Assessment-Seeking Sample. J Atten Disord 2023:10870547231172764. [PMID: 37158158 DOI: 10.1177/10870547231172764] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
OBJECTIVE Self-report symptom inventories are commonly used in adult ADHD assessment, and research indicates they should be interpreted with caution. This study investigated one self-report symptom inventory for adult ADHD in a clinical sample. METHOD Archival data were used to evaluate diagnostic utility of the Conners Adult ADHD Rating Scale-Self-Report: Long Version (CAARS-S:L) in a sample of 122 adults seeking ADHD assessment. RESULTS Overall, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) estimates for the ADHD Index and other CAARS-S:L scales demonstrated weak accuracy. Anxiety and depression were the most common diagnoses present when a false positive on the ADHD Index was observed. PPV and specificity for the ADHD Index were higher in males compared to females. CONCLUSION The CAARS-S:L may be useful for screening purposes in some cases, but should not be the main method used for diagnostic purposes. Clinical implications of findings are discussed.
Collapse
Affiliation(s)
| | | | | | - Eileen Barden
- Boston University School of Medicine, MA, USA
- State University of New York at Binghamton, NY, USA
| | | |
Collapse
|
6
|
Maffly-Kipp J, Morey LC. Detecting Attention Deficit Hyperactivity Disorder and its feigning using the Personality Assessment Inventory. APPLIED NEUROPSYCHOLOGY. ADULT 2023:1-10. [PMID: 37155738 DOI: 10.1080/23279095.2023.2207215] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
Attention Deficit Hyperactivity Disorder is a relatively common and often disabling disorder in adults. However, feigning ADHD symptomatology is both easy and potentially common. We explored the most effective strategies for A) identifying individuals who had been diagnosed with ADHD based on existing PAI symptom indicators, and B), discriminating between feigned and genuine ADHD symptoms using PAI negative distortion indicators. Our sample consisted of 463 college aged participants who had been diagnosed with ADHD (n = 60), were asked to feign ADHD (n = 71), and a control group (n = 333). Self-reported diagnosis and successful feigning were corroborated by the CAARS-S: E scale. We first compared two PAI-derived ADHD indicators to determine which best differentiated between our ADHD and Control groups. Next, we compared seven negative distortion indicators to determine which could best distinguish between real and feigned ADHD symptoms. Our results revealed that the PAI-ADHD scale was the most effective symptom indicator. Further, the Negative Distortion Scale (NDS) and the Item-FAA scale were the most effective for identifying feigners. When assessing ADHD based on the PAI, the PAI-ADHD scale appears promising as an indicator of symptomatology, while the NDS and Item-FAA appear useful to rule-out feigning.
Collapse
Affiliation(s)
- Joseph Maffly-Kipp
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX, USA
| | - Leslie C Morey
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX, USA
| |
Collapse
|
7
|
Evidence-Based Accommodations for Postsecondary Students with Disabilities: Beware the Base Rate Fallacy. PSYCHOLOGICAL INJURY & LAW 2023. [DOI: 10.1007/s12207-023-09471-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/16/2023]
|
8
|
Harrison AG, Armstrong I. Accommodation Decision-Making for Postsecondary Students with ADHD: Treating the Able as Disabled. PSYCHOLOGICAL INJURY & LAW 2022; 15:367-384. [PMID: 36068830 PMCID: PMC9437389 DOI: 10.1007/s12207-022-09461-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Accepted: 08/23/2022] [Indexed: 11/26/2022]
Abstract
Students with attention-deficit/hyperactivity disorder (ADHD) may be entitled to academic accommodations in postsecondary education. Disability Services Offices (DSOs) in Canada say that objective evidence of functional impairment is required prior to providing academic accommodations. This study set out to determine if postsecondary disability service providers use objective, third-party data when making accommodation decisions. Providers were asked if they would grant extra time accommodations to a fictitious prospective student. The student self-reported attention and academic problems that emerged during COVID restrictions, and that extra time helped her earn better grades and reduced her anxiety. While her neuropsychological report suggested superficial similarity to ADHD and contained accommodation recommendations, it lacked any objective evidence supporting either an ADHD diagnosis or functional impairments that would support extra time accommodation. Despite the lack of current or historical functional impairment, 100% of all DSO decision makers confirmed that they would grant extra time accommodations to this student. Results suggest that DSOs’ accommodation decisions are not based on evidence of functional impairment but rely mainly on student self-report and the recommendations of a professional. As such, the current system of determining reasonable accommodations is flawed and inequitable, offering non-impaired individuals access to supports and services that may privilege them over their similarly abled peers. Postsecondary institutions must either develop more defensible methods of disability determination or provide all students with access to accommodations to create a more equitable learning environment.
Collapse
|
9
|
Suhr JA, Johnson EEH. First Do No Harm: Ethical Issues in Pathologizing Normal Variations in Behavior and Functioning. PSYCHOLOGICAL INJURY & LAW 2022. [DOI: 10.1007/s12207-022-09455-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
10
|
|
11
|
College Students’ Access to Academic Accommodations Over Time: Evidence of a Matthew Effect in Higher Education. PSYCHOLOGICAL INJURY & LAW 2021. [DOI: 10.1007/s12207-021-09429-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
12
|
Potts HE, Lewandowski LJ, Lovett BJ. The Multidimensional ADHD Rating Scale: A measure of symptoms, impairment, and symptom validity. J Clin Exp Neuropsychol 2021; 43:426-436. [PMID: 34233579 DOI: 10.1080/13803395.2021.1942795] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
Objective: Two studies examined the psychometric properties of the Multidimensional ADHD Rating Scale (MARS), which assesses ADHD symptoms, related functional impairment, and symptom validity (SV). Method: Study 1 used MARS item responses from college students with and without ADHD (with some of the latter group assigned to feign ADHD) to create an SV-index, and to identify optimal cut scores for the clinical (symptom and impairment) indexes. Study 2 cross-validated the findings on a new sample. Results: In both studies, malingerers reported more symptoms and impairment than participants with ADHD, who reported more symptoms and impairment than controls. Receiver operating characteristic analyses found very good discrimination of genuine ADHD from control cases by the clinical MARS indexes, and very good discrimination of genuine ADHD from malingered ADHD by the SV-index. Conclusion: This research provides initial support for the effectiveness of the MARS to detect simulated cases of malingering, and to differentiate ADHD from non-ADHD cases in college students.
Collapse
Affiliation(s)
- Heather E Potts
- Department of Psychiatry, Boston Children's Hospital, Boston, MA, USA
| | | | - Benjamin J Lovett
- School Psychology Program, Teachers College, Columbia University, New York, NY, USA
| |
Collapse
|
13
|
Affiliation(s)
- Benjamin J Lovett
- School Psychology Program,Teachers College, Columbia University, New York, NY, USA
| | - Allyson G Harrison
- Regional Assessment and Resource Centre, Queen's University, Kingston, Canada
| |
Collapse
|
14
|
Johnson EEH, Suhr J. Self-reported functional impairment in college students: relationship to noncredible reporting, ADHD, psychological disorders, and other psychological factors. J Clin Exp Neuropsychol 2021; 43:399-411. [PMID: 34078250 DOI: 10.1080/13803395.2021.1935490] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
INTRODUCTION Both symptoms and functional impairment should be assessed in college students seeking evaluations for Attention Deficit Hyperactivity Disorder (ADHD). However, impairment is not specific to ADHD. Although it is well documented that self-reported symptoms can be reported noncredibly, there is less research examining credibility of self-reported impairment, and few clinicians rule out alternative causes for impairment. METHOD Participants (N = 428) completed self-report measures of functional impairment, sleep, perceived stress, and in an ADHD symptom measure with embedded validity indicators. RESULTS Noncredible reporters endorsed greater functional impairment than credible reporters in several domains, but impairment was reported at a high rate even in credible responders (N = 323) in several domains. Participants who reported prior ADHD and participants who reported prior psychiatric diagnoses reported greater impairment and higher rates of clinically significant impairment than those who reported no prior diagnoses. Few differences in reported impairment emerged between those who reported ADHD and psychiatric diagnoses. Sleep and stress accounted for significant variance in impairment, and the ADHD group reported greater impairment than the psychiatric diagnosis and no diagnosis groups after controlling for these variables. CONCLUSIONS Results reinforce the importance of considering the validity of, and alternative sources for, self-reported impairment in college students with ADHD concerns.
Collapse
Affiliation(s)
| | - Julie Suhr
- Department of Psychology, Ohio University, Athens, OH, USA
| |
Collapse
|
15
|
Weis R, Hombosky ML, Schafer KK, Shulman D, Tull JK. Accommodation decision-making for postsecondary students with ADHD: Implications for neuropsychologists. J Clin Exp Neuropsychol 2021; 43:370-383. [PMID: 33899673 DOI: 10.1080/13803395.2021.1918645] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
Neuropsychologists are often asked to evaluate students for attention-deficit/hyperactivity disorder (ADHD) and to provide documentation to support their requests for academic accommodations in college. Research points to the importance of multi-method, multi-informant data when evaluating ADHD and determining the need for accommodations. However, the Association on Higher Education and Disability (AHEAD) directs disability service providers to give primacy to students' self-reports and their own impressions of students' narratives over objective, third-party data when rendering accommodation decisions. The organization asserts that in many cases information from parents, teachers, and psychologists is not needed to confirm the existence of a disability or students' need for accommodations. In this article, we describe the way disability service providers are directed to evaluate accommodation requests, the limitations of these procedures, and the dangers of well-intentioned, but indiscriminate accommodation-granting. We then provide recommendations for neuropsychologists who conduct ADHD evaluations for college students in light of these professional guidelines.
Collapse
Affiliation(s)
- Robert Weis
- Department of Psychology, Denison University, Granville, OH, USA
| | | | - Kendra K Schafer
- Department of Psychology, Denison University, Granville, OH, USA
| | - Darcy Shulman
- Department of Psychology, Denison University, Granville, OH, USA
| | - Jessica K Tull
- Department of Psychology, Denison University, Granville, OH, USA
| |
Collapse
|
16
|
Harrison AG, Armstrong IT. A comparison of the self-report patterns of analog versus real-world malingerers of attention deficit hyperactivity disorder. J Neural Transm (Vienna) 2020; 128:1065-1077. [PMID: 33151414 DOI: 10.1007/s00702-020-02273-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2020] [Accepted: 10/14/2020] [Indexed: 11/26/2022]
Abstract
Much of what we know about malingering of attention deficit hyperactivity disorder (ADHD) has been learned from the performance of analog malingerers, typically first-year psychology students given credit for study participation. It is not clear, however, whether their performance is similar to that found in actual clinical settings. Indeed, past research suggests that analog malingerers may overexaggerate deficits relative to real-world malingerers, making them easier to identify in controlled studies. The purpose of the current study was, therefore, to compare the performance of analog malingers to post-secondary students strongly suspected of malingering ADHD on a self-report measure of ADHD symptoms. Their scores were, in turn, compared to those returned by students with genuine ADHD and clinical controls. Results demonstrated that, apart from analog subjects overexaggerating symptoms of hyperactivity, few differences exist between the scores returned by analog malingerers relative to clinical malingerers. While newly devised symptom validity measures show promise in identifying malingered ADHD, neither the analog nor the clinical malingers consistently failed these symptom validity scales. Furthermore, a good portion in both malingering groups failed to endorse high levels of ADHD symptoms in general. Clinical implications are discussed.
Collapse
Affiliation(s)
- Allyson G Harrison
- Regional Assessment and Resource Centre, Queens University, Kingston, ON, Canada.
| | - Irene T Armstrong
- Regional Assessment and Resource Centre, Queens University, Kingston, ON, Canada
| |
Collapse
|
17
|
Suhr JA, Lee GJ, Harrison AG. Susceptibility of functional impairment ratings to noncredible reporting in postsecondary students undergoing screening for ADHD. Clin Neuropsychol 2020; 36:1493-1505. [DOI: 10.1080/13854046.2020.1817564] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Affiliation(s)
- Julie A. Suhr
- Department of Psychology, Ohio University, Athens, OH, USA
| | - Grace J. Lee
- Department of Psychology, Ohio University, Athens, OH, USA
| | - Allyson G. Harrison
- Regional Assessment and Resource Centre, Queen’s University, Kingston, Ontario, Canada
| |
Collapse
|
18
|
Harrison AG, Armstrong IT. Differences in performance on the test of variables of attention between credible vs. noncredible individuals being screened for attention deficit hyperactivity disorder. APPLIED NEUROPSYCHOLOGY-CHILD 2020; 9:314-322. [DOI: 10.1080/21622965.2020.1750115] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Affiliation(s)
- Allyson G. Harrison
- Regional Assessment and Resource Centre, Queens University, Kingston, Canada
| | - Irene T. Armstrong
- Regional Assessment and Resource Centre, Queens University, Kingston, Canada
| |
Collapse
|