Incremental validity of neuropsychological assessment in the identification and treatment of youth with ADHD

Review of Studies on Incremental Validity of Assessment Measures Used in Psychological Assessment of Attention-Deficit Hyperactivity Disorder

Few studies have summarized the literature relevant to the incremental validity of tools and procedures for the assessment of attention-deficit hyperactivity disorder (ADHD). The current project reviewed such studies published in the prior 18 years. Results from studies on the incremental validity of measures used in the assessment of ADHD were reviewed. Measures included symptom reports, clinical interviews, behavioral observation, continuous performance and other psychomotor tasks, intelligence tests, and measures of executive function. Twenty-nine published studies and two reviews were identified from 2004 to 2022. Incremental validity was determined using various statistics including R2, classification metrics, odds ratios, and post-test probabilities. Findings suggest that symptom reports from a collateral source and continuous performance test measures have incremental validity over self-reports and clinical interviews. Measures of intellectual and executive functioning did not show incremental validity in the diagnosis of ADHD. Findings are relevant to the practitioner, as they bear on the optimization of both the cost-effectiveness and the diagnostic accuracy of combined procedures in the assessment of ADHD.

Explaining the Prospective Association of Positive and Negative Parenting Behaviors and Child ADHD Symptoms: Pathways Through Child Executive Function and Reward Responsivity

Objective: Parenting behavior is a well-established correlate of offspring ADHD. However, little is known about how parenting exerts its effects on offspring ADHD symptomatology. We examined whether prospective associations between positive and negative parenting behaviors and child ADHD symptoms are mediated by deficits in child executive function (EF) and reward responsivity (RR). Method: One hundred and thirty-five children with and without ADHD were assessed across two Waves, when children were mean ages 6 and 8 respectively. Children completed tasks on EF, and parents completed questionnaires about their parenting behaviors and their children's RR and ADHD symptoms. Results: Negative parenting behavior at Wave 1 was indirectly associated with offspring ADHD symptoms at Wave 2 via offspring EF. Conclusion: Individual differences in EF, but not RR, during early childhood may constitute a potential pathway by which negative parenting behaviors exerts its effects on subsequent offspring ADHD symptomatology. Treatment implications are discussed.

Neurocognitive risk in sickle cell disease: Utilizing neuropsychology services to manage cognitive symptoms and functional limitations

Sickle cell disease (SCD) is an inherited blood disorder that is associated with developmental delays and neurocognitive deficits. This review details key findings related to neurocognitive outcomes for children and adults with emphasis on the impact of neurological correlates and disease severity. Associations between neurocognition, demographic factors and social determinants of health are also reviewed. Emerging literature has reported on the neurocognitive impact of SCD in children and adolescents in Africa and Europe, including children from immigrant communities. Neurocognitive deficits are linked to poor functional outcomes, including transition from paediatric to adult care, medication adherence and unemployment. Integrating neuropsychology into multidisciplinary care for individuals with SCD can assist with identification and management of neurocognitive concerns, intervention development, individualized care plan development and continued multidisciplinary research.

What's race got to do with it? Informant rating discrepancies in neuropsychological evaluations for children with ADHD

OBJECTIVE

To evaluate race-based discrepancies in informant ratings and in rates of Attention-Deficit/Hyperactivity Disorder (ADHD) diagnosis among a clinically referred sample of Black and White children.

METHOD

Demographic information and ratings of inattention, hyperactivity/impulsivity, and conduct were collected from caregivers and teachers as part of neuropsychological evaluations at an outpatient clinic. The final sample included 3,943 children (6-18 years), of which 70% were White and 30% were Black.

RESULTS

Teachers, but not caregivers, endorsed more inattentive symptoms and conduct problems for Black than for White children, irrespective of ADHD diagnostic status and socioeconomic status (SES), and after controlling for child sex, child age, and learning difficulties. Teachers endorsed more hyperactive/impulsive symptoms for Black children with ADHD of lower SES than for White children with these characteristics. Caregivers of Black children of higher SES reported fewer hyperactive/impulsive symptoms than caregivers of White children of higher SES. Despite differences in teachers' ratings by race, diagnostic rates of ADHD in the context of neuropsychological evaluations were comparable for Black and White children.

CONCLUSIONS

Consistent with previous literature, teachers endorsed more ADHD and conduct problems in Black children. Within our clinically referred sample, this may reflect teacher bias rather than actual prevalence differences by rafce, given that Black caregivers endorsed fewer or similar numbers of symptoms relative to White caregivers. This lack of racial disparities in rates of ADHD diagnosis is inconsistent with findings in community- and population-based samples, and reflectspossible benefit of the use of neuropsychological evaluations in diagnostic decision-making for ADHD.

Psychological and neuropsychological underpinnings of attention-deficit/hyperactivity disorder assessment

The identification and diagnosis of attention-deficit/hyperactivity disorder (ADHD) is extremely important in order to help change the trajectory of an individual's life outcomes. A review of the current state of evidence-based assessment of ADHD is dominated by the DSM-5's conceptualization of behaviorally-oriented diagnostic criteria. This assumption that the DSM-5's method for identifying ADHD is the gold standard underlies the research base that evaluates the incremental validity of measures and methods for diagnosing it. That is, when evaluating whether a measure is useful in the identification of ADHD, the 'right answer' is based on the DSM-5's behaviorally-oriented definition. An alternative model for considering the fact that ADHD is a neurodevelopmental disorder, with its roots in executive dysfunction, is proposed. Using neuropsychological and cognitive tests to identify executive functioning problems can be combined with rating scales and interviews to diagnose ADHD in a way that does not ascribe entirely to a behavioral definition of the disorder.

Examining parent and clinician views of a hospital-based pediatric neuropsychological service: a Canadian perspective

Understanding how pediatric neuropsychological evaluations support families and the child's medical team is an important component of ensuring evidence-based care. For the first time within a Canadian context, we investigated the impact of neuropsychological assessments on parent knowledge, advocacy, and stress and the role of socioeconomic factors in parents' perceptions of the assessment. Responses from referring clinicians were also examined. As part of a hospital quality improvement project, 91 parents of children between the ages of 3 and 17 years (M = 8y7m; SD = 4y1m) and 45 clinician consumers (clinical staff who use neuropsychological services) completed one of two online questionnaires in English: Parent Overall Assessment of Supports and Testing, or Clinician Overall Assessment of Supports and Testing. Most parents indicated the neuropsychological evaluation promoted understanding of their child's cognitive profile and improved their ability to support their child at home and at school or in the community. Families characterized as being at higher social risk indicated that the evaluation led to more changes in how they approached their child at home than families with lower social risk status. Referring clinicians indicated neuropsychological reports were effective in communicating findings to them and patients/families. The most valuable sections of the report according to referring clinicians included the diagnosis/impression and recommendations sections. Parents and referral providers reported many benefits from the neuropsychological evaluation but also identified areas for service delivery improvement. Parent perceptions varied based on family and socio environmental factors, offering important targets for future research and clinical consideration.

A Scoping Review of Communicating Neuropsychological Test Results to Patients and Family Members

Feedback of neuropsychological test results to patients and family members include psychoeducation and implications for daily life. This scoping review aimed to provide an overview of the literature on neuropsychological feedback and to offer clinical recommendations. In accordance with formal scoping review methodology, PubMed, PsycInfo, Web of Science, CINAHL, and Embase databases were searched. Studies were included if they reported on neuropsychological feedback, if full papers were available, and if they included human participants. All languages were included, and no limit was placed on the year of publication. Of the 2,173 records screened, 34 publications met the inclusion criteria. Five additional publications were included after cross-referencing. An update of the search led to the inclusion of two additional papers. Of these 41 publications, 26 were research papers. Neuropsychological feedback is provided for a wide spectrum of diagnoses and usually given in-person and has been related to optimal a positive effect on patient outcomes (e.g. increase the quality of life). Most papers reported on satisfaction and found that satisfaction with an NPA increased when useful feedback was provided. However, information retention was found to be low, but communication aids, such as written information, were found to be helpful in improving retention. The current review demonstrated the benefits of neuropsychological feedback and that this should be part of standard clinical procedures when conducting a neuropsychological assessment. Further research on the benefits of neuropsychological feedback and how to improve information provision would enrich the neuropsychological literature.

[Formula: see text]Parent perceptions of pediatric neuropsychological evaluations: a systematic review

To synthesize current knowledge of the impact of pediatric neuropsychological evaluations on child functioning, we conducted a systematic review of the literature on parents' overall satisfaction with their child's evaluation and perceptions of how helpful the evaluation was for understanding their child's abilities and how useful the evaluation was for providing actionable information to elicit change. Parent satisfaction is important in this context because studies on healthcare consumption indicate a substantial relationship between patient satisfaction with services and implementation of recommendations and follow-up care. We followed PRISMA guidelines to conduct a systematic review of the literature on parent perception of pediatric neuropsychological evaluations for children aged 3-21 years. Using a set of predefined search terms, we identified 1,163 abstracts across PubMed, PsycINFO, Cochrane Library, and Web of Science electronic databases and included 12 studies in our qualitative synthesis. In general, parents reported high levels of satisfaction with their child's evaluation. Feedback from the evaluation was helpful for understanding their child's pattern of strengths and weaknesses and included useful information for obtaining support. Although parents did report improvement in their child's functional participation in home, school, and community settings, they tended to rate the usefulness of the evaluation for eliciting change lower than their overall satisfaction with the evaluation or how helpful the evaluation was for understanding their child's abilities. Additional effort appears to be needed for pediatric neuropsychological evaluations recommendations to result in durable, meaningful change in child functioning.

Outcomes of pediatric neuropsychological services: A systematic review

OBJECTIVE

The primary aim of this project was to apply systematic review methods to synthesize the literature on outcomes of pediatric neuropsychological services. The secondary aim was to use the results of the systematic review to identify gaps in the extant literature and describe priorities for future research. Method: We identified the relevant studies using a rigorous search strategy, collected data on methodological variables, assessed the risk of bias in the studies, summarized findings by topic and subtopic areas, identified strengths and weaknesses of the literature, and provided recommendations for future research. The outcomes measured were satisfaction, changes in resource or strategy utilization, and changes in symptoms or functioning (i.e. changes in child emotional, behavioral, cognitive, or academic problems, parent stress, or family functioning). Results: The final sources of data were 26 records, pertaining to a total of 974 children who received neuropsychological services. Parents were generally satisfied with services and reported high clinician empathy and increased level of knowledge, based on the evaluation. However, they reported less often that the neuropsychologist provided actual help. Informal home and school-based strategies were implemented more often than other types of recommendations. The research on changes in child symptoms and functioning was limited, but suggests improvements. Conclusions: This is the first systematic review of outcomes of pediatric neuropsychological services. Larger studies involving data collection at multiple time points are needed in order to further clarify mechanisms leading to outcomes and potential targets for improving them.

Barriers to Schooling in Survivorship: The Role of Neuropsychological Assessment

PURPOSE

Pediatric cancer survivorship rates continue to improve, although disease- and treatment-related neurocognitive impacts substantively affect survivors' educational access and availability for learning. Receiving formal educational supports substantially improves survivors' academic progress and graduation rates; however, parents of survivors report obtaining such support is stressful, in part due to limited knowledge on their part and that of their oncology providers.

METHODS

Parents (N = 195) of pediatric survivors across the United States were surveyed to explore specific barriers to obtaining appropriate educational supports and the facilitating role of the oncologist.

RESULTS

Parent-reported barriers included limited access to formal educational supports, under-referral to neuropsychology services, and need for more information about available supports and how best to advocate for these, when needed. Not only were few survivors (35.4%) referred for neuropsychological evaluation, standard of care for many pediatric survivors, but survivors were more than five times more likely to be retained in grade compared with the national retention rate. When obtained, parents reported that the neuropsychological consultation and associated report were helpful in increasing their own understanding and addressing barriers to obtaining adequate supports for their children.

CONCLUSION

Given the important role of neuropsychological evaluation for survivors and their families, bringing referral rates more in line with national guidelines represents a critical target for oncologists. With adequate training in relevant issues, the oncologist is positioned to be a key support to survivors and their families in ensuring access to neuropsychological services and reducing barriers to an appropriate education.

Do parents implement pediatric neuropsychological report recommendations?

OBJECTIVE

We explored parent-reported implementation rates of medical, home/community, and school recommendations following a pediatric neuropsychological evaluation, as well as demographic group differences in, and potential barriers to, recommendation implementation.

METHOD

Participants were 55 parents of children and adolescents who completed an outpatient neuropsychological evaluation in a university-based hospital neuropsychology clinic within 4 to 6 months prior to study participation. Participants were contacted by phone to complete a short interview regarding implementation of report recommendations.

RESULTS

Slightly over half (52%) of all recommendations were implemented, with higher implementation rates of school (62%) and home/community recommendations (53%) than medical recommendations (40%). Results indicated significantly lower recommendation implementation for households with low income (particularly for medical recommendations). Reported reasons for not implementing recommendations included lack of time, lack of resources (geographical and financial), ambivalence about the need to implement the recommendation, not remembering the recommendation, confusion about how to implement the recommendation, and resistance from schools and teachers.

CONCLUSIONS

The results for this study provide information for pediatric neuropsychologists regarding rates of recommendation implementation, with differences identified based on type of recommendation and demographic factors. Further empirical investigation is indicated in order to determine practical, concrete steps to improve recommendation implementation.

Integrated psychology support and comprehensive cognitive evaluation improves access to special education services for children with sickle cell disease

BACKGROUND

Children with sickle cell disease (SCD) are at risk for cognitive deficits. Limited data describe whether comprehensive cognitive evaluation improves education resources and whether caregivers perceive the assessment as beneficial. We tested our two hypotheses: (a) an integrated comprehensive cognitive evaluation program in children with SCD results in increased special education services allocation; and (b) caregivers will value comprehensive cognitive evaluation services provided.

PROCEDURE

In a tertiary care medical facility, as part of quality improvement project, in a before-and-after evaluation between March 2011 and July 2014, we examined the impact of targeted comprehensive cognitive evaluation on change in special education services. We also evaluated the caregiver's perception regarding the utility of the provided services.

RESULTS

A total of 21% (42 of 196) students (median age 11 years, range 3-18) with SCD were referred for cognitive assessment due to overt stroke (n = 11), silent stroke (n = 14), or concerns about cognitive or academic functioning without evidence of strokes (n = 17). At baseline, 45.2% received special education services and after the comprehensive cognitive evaluation 86.7% received special education services (P < 0.001). Among 33 caregivers who completed the survey, 97% reported that the assessment was helpful and 60% indicated that assessment led to beneficial changes for their children at school.

CONCLUSION

Education advocacy coupled with comprehensive cognitive assessment in students with SCD improved access to special education services, and caregivers uniformly endorse this service as having added value.

The incremental value of neuropsychological assessment: A critical review

Objective: The purpose of this critical review was to evaluate the current state of research regarding the incremental value of neuropsychological assessment in clinical practice, above and beyond what can be accounted for on the basis of demographic, medical, and other diagnostic variables. The focus was on neurological and other medical conditions across the lifespan where there is known risk for presence or future development of cognitive impairment.Method: Eligible investigations were group studies that had been published after 01/01/2000 in English in peer-reviewed journals and that had used standardized neuropsychological measures and reported on objective outcome criterion variables. They were identified through PubMed and PsychInfo electronic databases on the basis of predefined specific selection criteria. Reference lists of identified articles were also reviewed to identify potential additional sources. The Grades of Recommendation, Assessment, Development and Evaluation Working Group's (GRADE) criteria were used to evaluate quality of studies.Results: Fifty-six studies met the final selection criteria, including 2 randomized-controlled trials, 9 prospective cohort studies, 12 retrospective cohort studies, 21 inception cohort studies, 2 case control studies, and 10 case series studies. The preponderance of the evidence was strongly supportive with regard to the incremental value of neuropsychological assessment in the care of persons with mild cognitive impairment/dementia and traumatic brain injury. Evidence was moderately supportive with regard to stroke, epilepsy, multiple sclerosis, and attention-deficit/hyperactivity disorder. Participation in neuropsychological evaluations was also associated with cost savings.Conclusions: Neuropsychological assessment can improve both diagnostic classification and prediction of long-term daily-life outcomes in patients across the lifespan. Future high-quality prospective cohort studies and randomized-controlled trials are necessary to demonstrate more definitively the incremental value of neuropsychological assessment in the management of patients with various neurological and other medical conditions.

Integration of neuropsychology services in a sickle cell clinic and subsequent healthcare use for pain crises

Objective: Growing literature has documented the clinical utility of neuropsychological evaluations for predicting functional outcomes, including reduced healthcare service utilization, in a variety of clinical samples. The present study investigates the relationship between the integration of clinical neuropsychology services into an existing outpatient sickle cell clinic and frequency of emergency department (ED) visits and hospitalizations for pain crises. Method: Participants included 144 adults diagnosed with sickle cell disease (SCD) who either underwent neuropsychological evaluation (NP+), including interview, neuropsychological testing, and feedback, or treatment as usual (NP-). Medical records were reviewed for a two-year period, one year prior to study enrollment (pre-assessment) and one year post-study enrollment (post-assessment), to track the number of ED visits and hospitalizations related to sickle cell pain crises. Results: When examining pain crises ED visits prior to and following neuropsychological evaluation, there was a significant decrease in ED visits for the NP + group, but no change for the NP - group. No significant changes in pain crises hospitalizations were observed for the NP + and NP - groups. For the NP + group, the decreased incidence of pain crises ED visits and hospitalizations was associated with an estimated total cost savings of $994,821. Discussion: Results highlight that integration of neuropsychology services into an existing outpatient sickle cell clinic may reduce healthcare costs, particularly use of pain crises ED services, for adults with SCD.

Toward patient-centered outcomes for cognitive evaluations: the perspective of those affected by Parkinson's disease

OBJECTIVE

Patient-centered outcomes research is predicated on the idea that the opinions, attitudes, and preferences of patients should help inform study design and interpretation. To date, little is known about what defines patient-centered outcomes from cognitive evaluations. The current evaluation sought to explore this issue in persons with Parkinson's disease (PwPD) and their care partners (CP).

METHOD

Focus groups of 22 PwPD/CP dyads were conducted to identify potential consumer oriented endpoints from cognitive evaluations. These endpoints were utilized to create a Patient-Centered Cognitive Assessment Outcomes Scale, which was administered to a different group of 50 PwPD/CP dyads who rated the importance of each outcome and identified their top three priority outcomes.

RESULTS

Three themes emerged from the focus groups: improved knowledge, advice, and planning. Both PwPD and CP rated items in all three domains as being very important outcomes. Priorities for outcomes in both groups favored treatment planning information slightly above knowledge based outcomes.

CONCLUSIONS

The PwPD and CP identified improved knowledge, advice for daily activities, and knowledge they could use to plan for future eventualities as very important. This information can be used as a framework for future studies aimed at demonstrating patient-centered outcomes from neuropsychological evaluations. Implications for future research are discussed.

Sex differences and the interaction of age and sleep issues in neuropsychological testing performance across the lifespan in an ADD/ADHD sample from the years 1989 to 2009

Chart review of population (9 to 80 years) neuropsychological test battery for ADHD diagnosis, questionnaires with multiple responders were evaluated in outpatient setting from 1989-2009. The focus was gender differences across age, diagnostic group (ADHD-Inattentive/ADHD plus), neuropsychological test performance, and reported sleep symptoms over the lifespan. Individuals were assigned to ADHD-I group or ADHD plus group (based upon secondary diagnosis of sleep, behavioral, emotional disturbance); ADHD not primary was excluded (brain insult, psychosis). Among these were 1,828 children (ages 9 to 14), adolescents (ages 15 to 17), and adults (ages 18 and above); 446 children (312 diagnosed ADHD-I), 218 adolescents (163 diagnosed ADHD-I), and 1,163 adults (877 ADHD-I). Sleep was problematic regardless of age, ADHD subtype, and gender. The type and number of sleep problems and fatigue were age dependent. ADHD subtype, gender, fatigue, age, and sleep (sleep onset, unrefreshing sleep, sleep maintenance) were significant variables affecting neuropsychological test performance (sequencing, cognitive flexibility, slow- and fast-paced input, divided attention, whole brain functioning). Findings suggest that ADHD involves numerous factors and symptoms beyond attention, such as sleep which interacts differently dependent upon age.