Assessment of executive functioning in children and young adults treated for frontal lobe tumours using ecologically valid tests

Conceptualization of the term "ecological validity" in neuropsychological research on executive function assessment: a systematic review and call to action

OBJECTIVE

"Ecological validity" (EV) is classically defined as test's ability to predict real-world functioning, either alone or together with test's similarity to real-world tasks. In neuropsychological literature on assessment of executive functions (EF), EV is conceptualized inconsistently, leading to misconceptions about the utility of tests. The goal of this systematic review was to examine how EV is conceptualized in studies of EF tests described as ecologically valid.

METHOD

MEDLINE and PsychINFO Databases were searched. PRISMA guidelines were observed. After applying inclusion and exclusion criteria, this search yielded 90 articles. Deductive content analysis was employed to determine how the term EV was used.

RESULTS

About 1/3 of the studies conceptualized EV as the test's ability to predict functional outcomes, 1/3 as both the ability to predict functional outcome and similarity to real-world tasks, and 1/3 were either unclear about the meaning of the term or relied on notions unrelated to classical definitions (e.g., similarity to real-world tasks alone, association with other tests, or the ability to discriminate between populations).

CONCLUSIONS

Conceptualizations of the term EV in literature on EF assessment vary grossly, subsuming the notions of criterion, construct, and face validity, as well as sensitivity/specificity. Such inconsistency makes it difficult to interpret clinical utility of tests that are described as ecologically valid. We call on the field to require that, at minimum, the term EV be clearly defined in all publications, or replaced with more concrete terminology (e.g., criterion validity).

Six elements test vs D-KEFS: what does "Ecological Validity" tell us?

OBJECTIVE

Extensive research shows that tests of executive functioning (EF) predict instrumental activities of daily living (IADLs) but are nevertheless often criticized for having poor ecological validity. The Modified Six Elements Test (MSET) is a pencil-and-paper test that was developed to mimic the demands of daily life, with the assumption that this would result in a more ecologically valid test. Although the MSET has been extensively validated in its ability to capture cognitive deficits in various populations, support for its ability to predict functioning in daily life is mixed. This study aimed to examine the MSET's ability to predict IADLs assessed via three different modalities relative to traditional EF measures.

METHOD

Participants (93 adults aged 60 - 85) completed the MSET, traditional measures of EF (Delis-Kaplan Executive Function System; D-KEFS), and self-reported and performance-based IADLs in the lab. Participants then completed three weeks of IADL tasks at home, using the Daily Assessment of Independent Living and Executive Skills (DAILIES) protocol.

RESULTS

The MSET predicted only IADLs completed at home, while the D-KEFS predicted IADLs across all three modalities. Further, the D-KEFS predicted home-based IADLs beyond the MSET when pitted against each other, whereas the MSET did not contribute beyond the D-KEFS.

CONCLUSIONS

Traditional EF tests (D-KEFS) appear to be superior to the MSET in predicting IADLs in community-dwelling older adults. The present results argue against replacing traditional measures with the MSET when addressing functional independence of generally high-functioning and cognitive healthy older adult patients.

Identifying Suitable Cognitive Assessments for Children and Adolescents with Acquired Brain Injury for use by Occupational Therapists in Acute and Subacute Hospital Contexts: A Scoping Review

AIM

To appraise the literature evaluating psychometric properties and clinical utility of cognitive assessments available for use by occupational therapists in acute and subacute hospital contexts with children aged 4-18 years diagnosed with an acquired brain injury.

METHODS

Scoping review. Assessments and associated studies were evaluated for their methodologic quality using the COnsensus-based standard for the Selection of health Measurement INstruments (COSMIN) strategy.

RESULTS

Forty-one studies evaluated 49 different assessments and reported on assessment psychometrics (n = 40), clinical utility (n = 1) and five reported on both. Fourteen assessments with the strongest psychometric properties and clinical utility were shortlisted.

CONCLUSION

A gold standard assessment was not identified. Instead, a shortlist of functional, performance-based, technology-based, and self-report assessments were identified as relevant for the setting and population, but requiring further investigation. Future development of a cognitive assessment in partnership with therapists working in tertiary pediatric settings will ensure optimal clinical utility and validity.

White matter hyperintensities relate to executive dysfunction, apathy, but not disinhibition in long-term adult survivors of pediatric cerebellar tumor

•

Pediatric brain tumor survivors have more executive dysfunction than controls.

•

White matter hyperintensities are positively associated with executive dysfunction.

•

White matter hyperintensities are positively associated with apathy.

•

Multivariate regression supports white matter hyperintensity associations.

•

Survivors appear to drive white matter hyperintensities associations.

White matter hyperintensities (WMHs) have been related to executive dysfunction, apathy and disinhibition in a wide range of neurological populations. However, this relationship has not been examined in survivors of pediatric brain tumor. The goal of this study was to investigate how executive dysfunction, apathy, and disinhibition relate to WMHs in 31 long-term survivors of pediatric cerebellar brain tumor and 58 controls, using informant-report data from the Frontal Systems Behavior Scale. Total WMH volume was quantified using the Lesion Growth Algorithm. Further, periventricular, and subcortical volumes were identified based on proximity to custom ventricle masks generated in FSL. A ratio of WMH volume to whole brain volume was used to obtain normalized WMH volumes. Additionally, a multivariate regression analysis was performed. On average, informant-report scores were within normal limits and only executive dysfunction was significantly higher in survivors compared to controls (t(47.9) = -2.4, p=.023). Informants reported clinically significant levels of apathy in 32.3% of survivors. Informants also reported clinically significant executive dysfunction in 19.4 % of survivors and clinically significant disinhibition in, again, 19.4 % of survivors. Increased volume of WMHs was positively correlated with executive dysfunction (r = 0.33, p = 0.02) and apathy (r = 0.23, p = .04). Similarly, multivariate regression demonstrated correlations with executive dysfunction (p=.05, FDR corrected) and apathy (p=.05, FDR corrected). Exploratory analysis demonstrated an interaction wherein the relationship between total WMHs and executive dysfunction and apathy depends on whether the participant was a survivor. The current findings indicate that increased WMH volumes are associated with higher ratings of apathy and executive dysfunction, and that these results are likely unique to cerebellar brain tumor survivors. WMH burden may serve as a useful marker to identify survivors at risk of executive dysfunction or increased apathy.

Validity of the Behavioural Assessment of the Dysexecutive Syndrome for Children (BADS-C) in children and adolescents with pediatric acquired brain injury

The Behavioural Assessment of the Dysexecutive Syndrome for Children (BADS-C) was developed to address the need for a standardized ecologically valid test of executive function (EF) in the pediatric population. Our study aimed to investigate the discriminant, concurrent, and ecological validity of BADS-C in a sample with pediatric acquired brain injury (pABI). Seventy-four participants with pABI aged 10-17 years were included to a pre-registered randomized controlled trial, and baseline assessment was used for the current study. Controls consisted of 60 participants aged 10-17 years. Participants with pABI were assessed with neuropsychological tests and questionnaires of EF, and measurements of general intellectual ability (IQ). Results showed that all BADS-C subtests discriminated between participants with pABI and controls, except for the Playing Cards Test. Concurrent and ecological validity was demonstrated through associations between BADS-C total score, Key Search Test, and Zoo Map Test 1, and neuropsychological tests and teacher questionnaire ratings of EF. Key Search Test and Zoo Map Test 1 predicted teacher ratings of EF, beyond IQ and other neuropsychological test of EF. These findings provide support for BADS-C as a valid clinical assessment tool that can detect everyday executive dysfunction in the pABI population, and guide rehabilitation and treatment decisions.

Epidemiology of brain tumors among adolescents and young adults in Nigeria

Adolescents and Young Adults (AYA), have distinct endocrine and psychosocial peculiarities. Brain tumors occur less among AYAs, compared to other age groups and with better prognosis. There is however a paucity of literature about brain tumors in AYA in sub-Saharan Africa. We aim to describe the clinical characteristics of brain tumors in AYA across five neurosurgical centers in Nigeria and the associated factors. We report results for older children (10-14 years), adolescents (15-19 years) and young adults (20-24 years). This was a retrospective review of AYA with brain tumors over a 10-year period (2010-2019). Data analysis was by descriptive statistics, Chi square test and multinomial regression at α0.05. There were 104 AYAand the male to female ratio was 1.2:1. Headache (79.8%) and visual symptoms (65.4%) were the most common presenting symptoms. Focal limb weakness (44.1%) occurred less frequently. Median duration of symptoms prior to presentation was 9 months. Glioma was the most common tumor (31, 29.8%) while pituitary adenoma and craniopharyngioma constituted 30.8% of the tumors. Patients with symptom duration of ≤one year were more likely to have infratentorial tumors. There was no significant association between the KPS following intervention and the AYA characteristics. Age group was not significantly associated with any of the presenting symptoms except ataxia, which was significantly higher among the 10 to 14 years group.We have described the epidemiology of brain tumors within AYA in Nigeria and highlighted a need to maximize their care and meet their special needs.

Exploring the use of the Cognitive Orientation to daily Occupational Performance approach (CO-OP) with children with executive functions deficits after severe acquired brain injury: A single case experimental design study

Children with acquired brain injury (ABI) often have cognitive and behavioral impairments that affect participation in everyday activities. Among them, executive function (EF) deficits are frequent. Cognitive Orientation to Daily Occupational Performance (CO-OP) is an individualized treatment that teaches cognitive strategies necessary to support successful performance. Few studies have examined the effectiveness of CO-OP in children with EF deficits after ABI.

OBJECTIVES

to assess whether the use of CO-OP could be of interest in children with EF deficits after ABI, to improve their occupational performance, their executive functioning in everyday life and their cognitive processes constituting EF.

METHODS

This was a single case experimental study with multiple baselines across individuals and behaviors. We included 2 children at least 6 months after severe ABI. The children received 14 individual sessions of the CO-OP intervention. Each child set 3 goals by using the Canadian Occupational Performance Measure; 2 goals were trained and the third was a control goal. The achievement of the goals was measured by using repeated measures of Goal Attainment Scales (GASs). Ecological assessments of EF included the Children's Cooking Task and parent and teacher ratings of the Behavior Rating Inventory of Executive Function (BRIEF) questionnaire.

RESULTS

both children improved their performance on both trained goals (and, to a lesser extent, on untrained goals). We found significant improvement on tests of EF and on the BRIEF questionnaire, reflecting executive functioning in everyday life, at home and at school.

CONCLUSIONS

these results are encouraging and suggest the feasibility and effectiveness of CO-OP for children with EF deficits after ABI. They should be replicated in a larger number of cases.

TRIAL REGISTRATION

ClinicalTrials.gov (NCT04718688).

Assessing Children's Executive Function: BADS-C Validity

OBJECTIVES

To investigate the external and ecological validity of a standardized test of children's executive functioning (EF), the Behavioral Assessment of the Dysexecutive Syndrome for Children (BADS-C).

BACKGROUND

There are few standardized measures for assessing executive functions in children, and the evidence for the validity of most measures is currently limited.

METHOD

A normative sample of 256 children and adolescents from age 8-16 years completed the BADS-C, and a parent or teacher completed rating scales of the child's everyday problems related to EF (Children's version of the Dysexecutive Questionnaire; DEX-C) and Strengths and Difficulties Questionnaire (SDQ), a commonly used measure of emotional, social, cognitive, and behavioral problems.

RESULTS

Exploratory factor analyses yielded a two-factor structure to the BADS-C, indicative of monitoring and abstract reasoning processes, and a three-factor structure to the DEX-C, reflecting behavioral, and cognitive components of the dysexecutive syndrome as well as emotional responsiveness. Regression analyses showed significant relationships between BADS-C scores and everyday functioning as reported on the DEX and SDQ. Furthermore, there were significant differences in BADS-C scores between those children in the upper and lower quartiles on the SDQ.

CONCLUSION

Results provide tentative evidence of BADS-C and DEX-C construct, convergent and predictive validity.

Social competence in newly diagnosed pediatric brain tumor patients

Brain tumors (BTs) are a common pediatric malignancy. Improved treatment has resulted in higher survival rates. There is, however, increasing concern about adverse effects of the disease and its treatment, including effects on social competence (i.e. effective social functioning in everyday life). The aim of this study is to examine multiple levels of social competence (i.e. social skills and social adjustment) in newly diagnosed pediatric BT patients. Thirty newly diagnosed BT patients aged 5-12 years were assessed shortly after diagnosis with a neuropsychological test battery focusing on social competence, including tests for IQ, social skills (i.e. social-affective and executive functioning) and social adjustment (rated by parents and teachers). Their performance was compared to 95 healthy controls who completed the same assessment. Patients and healthy controls were largely comparable with regard to demographic and environmental factors and did not differ on measures of IQ, social skills and social adjustment. Furthermore, age was found to have a positive significant effect on social skills independent of group. Shortly after diagnosis, pediatric BT patients did not perform different from healthy controls on IQ and measures of social skills and social adjustment. This is an encouraging finding. However, because of potentially neurotoxic adjuvant therapy and the ongoing development of social skills, longitudinal follow-up studies are needed to investigate long-term outcome regarding social competence in BT survivors.

Social attainment in survivors of pediatric central nervous system tumors: a systematic review and meta-analysis from the Children's Oncology Group

PURPOSE

Improved therapies for pediatric central nervous system (CNS) tumors have increased survival rates; however, many survivors experience significant long-term functional limitations. Survivors of pediatric CNS tumors can experience deficits in social attainment. The aim of this review was to systematically amalgamate findings pertaining to social attainment (i.e., educational attainment, marriage, employment outcomes) in survivors of pediatric CNS tumors.

METHODS

PubMed (web-based), PsycINFO (EBSCO), EMBASE (Ovid), and Web of Science (Thomson Reuters) were used to identify articles published between January 2011 and September 2018. Eligible studies reported outcomes for survivors of pediatric CNS tumors diagnosed before age 21 years and > 5 years from diagnosis and/or > 2 years off therapy. All data were independently abstracted by two reviewers. Random-effects meta-analyses were performed using Review Manager 5.0.

RESULTS

The search yielded 7021 unique publications. Forty-six were included in the current review. Meta-analyses revealed survivors of CNS tumors were significantly more likely to have completed compulsory education only (OR = 1.87, 95% CI = 1.66, 2.12, p < 0.00001), less likely to be married (OR = 4.70, 95% CI = 3.89, 5.68, p < 0.00001), and more likely to be unemployed (OR = 2.84, 95% CI = 2.62, 3.08, p < 0.00001) compared to non-cancer controls. Cranial radiation therapy, neurocognitive deficits, and younger age at diagnosis were associated with poorer outcomes. Hearing loss and bilateral blindness were also related to poorer outcomes. Sex did not impact social attainment outcomes.

CONCLUSIONS

Survivors of pediatric CNS tumors are at elevated risk for poor attainment of key adult social outcomes.

IMPLICATIONS FOR CANCER SURVIVORS

There is a critical need to develop interventions to support survivors in becoming independent and productive adults.

Tools for the assessment of neuropsychomotor profile in the rehabilitation of children with central nervous system tumor: a systematic review

Objective:

This study reviews the scientific literature to identify and describe which assessment tools (ATs) are used in pediatric oncology and neuro-oncology rehabilitation and which development neuropsychomotor (DNPM) ATs were built for children with central nervous system (CNS) tumors.

Methods:

A systematic review was performed searching PubMed, CINAHL, PEDro, Science Direct, and Catalog of National Institute of Tumors databases and specialized journals. The search covered 7 years (2010–2017) and used relevant keywords in different combinations. A further search was carried out on DNPM rehabilitation manuals and academic thesis.

Results:

The review retrieved 35 eligible articles containing 63 ATs. The most common ATs were the Behavioral Rating Inventory of Executive Function (BRIEF) and the Wechsler Intelligence Scale for Children (WISC). Most of the ATs covered a single area of child development among behavioral/psychological, cognitive, and motor areas. A total of 159 ATs were found in manuals and thesis, and only 17 of them were already identified in the journal search. None of the ATs identified in both searches had been specifically developed for children with CNS tumor.

Conclusion:

The results highlight the need to develop and validate a global multidimensional AT for children with CNS tumor, overcoming the fragmentation of the assessment procedures and promoting standardized rehabilitation protocols.

What do you need to learn in paediatric psycho-oncology?

Paediatric psycho-oncology is an evolving speciality and is increasingly being recognised as an essential component in children's cancer care. Modern paediatric oncology services aspire to integrate physical care with psycho-social care and build capacity within clinical teams to address the emotional needs of parents and children side by side with other aspects of medical care. This article discusses the unique challenges of paediatric psycho-oncology and common situations where psychological assessment and management of children and young people with cancer become especially important. The authors propose a tiered structure of training. Providing empathic evidence-based psycho-social care is 'everyone's business' in paediatric oncology and not merely that of mental health professionals. However, there are times when a more specialist intervention by a paediatric liaison psychiatrist and/or a clinical psychologist is needed for optimum outcome. Learning interviewing techniques suitable for children and adolescents should be a core part of the training in paediatric psycho-oncology. Professionals should be encouraged to reflect on their own emotional wellbeing, which in turn will provide a stable foundation of emotionally matured care to children, young people and their families.

Assessment of executive functions in children and adolescents with acquired brain injury (ABI) using a novel complex multi-tasking computerised task: The Jansari assessment of Executive Functions for Children (JEF-C©)

Objectives: The Jansari assessment of Executive Functions for Children (JEF-C^©) is a new non-immersive computerised assessment of executive functions. The objectives of the study were to test the feasibility and validity of JEF-C^© in children and adolescents with acquired brain injury (ABI). Methods: Twenty-nine patients with ABI aged 10-18 years and 30 age-and gender-matched controls were tested. Participants performed JEF-C^©, Wechsler Abbreviated Scale of Intelligence (WASI) and the Behavioural Assessment of the Dysexecutive Syndrome for Children (BADS-C), while parents completed the Behaviour Rating Inventory of Executive Function (BRIEF) questionnaire. Results: The JEF-C^© task proved feasible in patients with ABI. The internal consistency was medium (Cronbach's alpha = 0.62 and significant intercorrelations between individual JEF-C^© constructs). Patients performed significantly worse than controls on most of the JEF-C^© subscales and total score, with 41.4% of participants with ABI classified as having severe executive dysfunction. No significant correlations were found between JEF-C^© total score, the BRIEF indices, and the BADS-C. Significant correlations were found between JEF-C^© and demographic characteristics of the sample and intellectual ability, but not with severity/medical variables. Conclusion: JEF-C^© is a playful complex task that appears to be a sensitive and ecologically valid assessment tool, especially for relatively high-functioning individuals.