How do assessments of activities of daily living address executive functions: A scoping review

The efficiency of activities of daily living (ADLs) skills in late adulthood: A mediational approach

The term "Activities of Daily Living" (ADLs) refers to a set of fundamental tasks (i.e., toileting, bathing, personal care, eating, grooming, and getting dressed) considered necessary for living and being autonomous in everyday life. Although in the clinical setting ADLs efficiency is a marker to diagnose dementia, limited evidence on the mechanism implicating muscular function and cognitive alterations in ADLs skills in late adulthood exists. This study primarily intended to determine the extent to which executive functions mediate between muscular strength, as assessed through handgrip strength (HGS) measurement, and ADLs skills of older community-dwellers. A further goal was to explore the impact of gender and cognitive status on ADLs and HGS scores, using education as a covariate. Three hundred and thirty-four older participants, 199 females and 135 males (Mage = 77.5 years, SD = 5.6 years, age range = 63-93 years) completed a battery of tests assessing ADLs, HGS, and executive functions. The results showed that 34-56% of the variance in the ADLs condition was explained by HGS and executive functioning. Furthermore, cognitively healthy participants exhibited better ADLs skills, whereas cognitively impaired individuals, both males and females, exhibited poorer HGS efficiency. In conclusion, in clinical settings, the concurrent evaluation of ADLs skills, motor, and higher-order cognitive processes should be encouraged to detect individuals needing a person-tailored intervention to boost their quality of life.

From word list learning to successful shopping: The neuropsychological assessment continuum from cognitive tests to cognition in everyday life

Cognitive deficits are common after brain injury and can be measured in various ways. Many neuropsychological tests are designed to measure specific cognitive deficits, and self-report questionnaires capture cognitive complaints. Measuring cognition in daily life is important in rehabilitating the abilities required to undertake daily life activities and participate in society. However, assessment of cognition in daily life is often performed in a non-standardized manner. In this opinion paper we discuss the various types of assessment of cognitive functioning and their associated instruments. Drawing on existing literature and evidence from experts in the field, we propose a framework that includes seven dimensions of cognition measurement, reflecting a continuum ranging from controlled test situations through to measurement of cognition in daily life environments. We recommend multidimensional measurement of cognitive functioning in different categories of the continuum for the purpose of diagnostics, evaluation of cognitive rehabilitation treatment, and assessing capacity after brain injury.

Assessment of executive function impairments in adults with acquired brain injury across single-case experimental design: A scoping review of primary outcomes

The use of single-case experimental design (SCED) to evaluate cognitive remediation is growing. SCEDs require rigorous methodology and appropriate choice of primary outcomes. To review primary outcomes that assess executive function impairments in patients with acquired brain injury (ABI). A scoping review was conducted using the Arksey and O'Malley framework and the PRISMA extension for scoping review (PRISMA-ScR). Five databases were searched resulting in the inclusion of twenty-one studies. Primary outcomes were extracted and classified according to the type of measure, ecological setting and sources of possible bias. A wide variety of primary outcomes were identified; the majority of which evaluated behavioural performance during a real-life activity or in a real-life simulated setting. The most frequent bias observed across outcomes was the coaching effect. The findings of this scoping review highlight the importance of selecting appropriate outcomes for repeated measures in SCED studies. Direct observation of the target behaviour is a potential gold standard for assessing the effectiveness of a cognitive intervention.

Cross-cultural adaptation and validation of the cooking task to the French-Canadian context: assessing the impact of executive function disorders through cooking activities

BACKGROUND

Acquired brain injury (ABI) often leads to deficits in executive functioning (EF) which is responsible for severe and longstanding disabilities in activities of daily living. The "Cooking Task" (CT), an ecological test of EF involving multi-tasking, was developed in France and exhibits excellent psychometric properties but has not yet been adapted and validated for the French-Canadian context.

OBJECTIVES

Conduct a cross-cultural adaptation and validation of the CT for the French-Canadian context.

METHODS

The CT was translated and adapted by a committee of experts and was validated.

RESULTS

Adaptation-changes were made to the language (e.g., cartable vs classeur), the materials (e.g., measuring cup vs scale), and the measuring units (e.g., ml/cups vs grams). Validation-Preliminary analyses were conducted on 24 participants with an ABI and 17 controls. Construct convergent validity: The French-Canadian-CT discriminates between ABI and control total score on the CT and on most error type categories. Construct known-group validity: French-Canadian-CT scores correlated with another measure of EF deficits (Dysexecutive Questionnaire and Six Elements Task). Inter-rater reliability score for the total error was high (ICC= .84) and results were similar to those obtained for the France-CT.

CONTRIBUTIONS

This study will provide a new ecologically valid tool for clinicians in Canada.

Further investigations into performance variance on the Multiple Errands Test

INTRODUCTION

The Multiple Errands Test (MET) is a complex, performance-based assessment that is useful for characterising the impact of impairments of executive function on everyday activities. However, performance variance amongst those without neurological pathology, and the impact of non-cognitive factors on this, requires further investigation.

METHODS

This was a cross-sectional analytic study, conducted with a convenience sample of 40 neurologically intact community-dwelling Australian adults. Participants completed a hospital or shopping centre version of the MET, where their Performance Efficiency, Task Completions and Rule Breaks were recorded. Non-cognitive factors of interest were demographic (age, sex and education), psychological (measured with the Hospital Anxiety and Depression Scale and self-ratings of test anxiety) and assessment-related (assessment site, self-reported site familiarity and observed strategy use). MET performance was analysed using descriptive statistics. A series of standard multiple and binary logistic regression analyses examined the relationships between MET performance and non-cognitive factors.

RESULTS

Most participants (n = 35, 87.5%) completed at least 10 of the 12 prescribed tasks and broke an average of four rules (SD = 2.36). They achieved an average performance efficiency rating of 0.75/1 (SD = 0.15), suggesting variability in the extent to which participants made non-essential location stops and/or failed to complete tasks whilst at an essential location. The assessment site and participant site familiarity had a statistically significant (p < 0.05) impact on Performance Efficiency and Task Completion scores, and psychological factors had a statistically significant (p < 0.05) relationship with Rule Breaks.

CONCLUSION

Findings suggest that the impact of factors other than cognition should be considered when interpreting MET performance. The assessment site and participant site familiarity may contribute to significant variability in Performance Efficiency scores. Clinicians should also be aware of the potential impact of these assessment-related factors on Task Completions and psychological distress on Rule Breaks.

Ecologically valid virtual reality-based technologies for assessment and rehabilitation of acquired brain injury: a systematic review

Purpose

A systematic review was conducted to examine the state of the literature regarding using ecologically valid virtual environments and related technologies to assess and rehabilitate people with Acquired Brain Injury (ABI).

Materials and methods

A literature search was performed following the PRISMA guidelines using PubMed, Web of Science, ACM and IEEE databases. The focus was on assessment and intervention studies using ecologically valid virtual environments (VE). All studies were included if they involved individuals with ABI and simulated environments of the real world or Activities of Daily Living (ADL).

Results

Seventy out of 363 studies were included in this review and grouped and analyzed according to the nature of its simulation, prefacing a total of 12 kitchens, 11 supermarkets, 10 shopping malls, 16 streets, 11 cities, and 10 other everyday life scenarios. These VE were mostly presented on computer screens, HMD's and laptops and patients interacted with them primarily via mouse, keyboard, and joystick. Twenty-five out of 70 studies had a non-experimental design.

Conclusion

Evidence about the clinical impact of ecologically valid VE is still modest, and further research with more extensive samples is needed. It is important to standardize neuropsychological and motor outcome measures to strengthen conclusions between studies.

Systematic review registration

identifier CRD42022301560, https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=301560.

Translation, cross-cultural adaptation and validation of the 10-item Weekly Calendar Planning Activity in Spanish-speaking ABI patients: a multicenter study

We present the process of translation, adaptation, and validation in the Spanish context of the 10-item version of the Weekly Calendar Planning Activity (WCPA-10), a performance-based measure of cognitive instrumental activities of daily living (C-IADL). The study consisted of two phases: I) translation/cultural adaptation of the WCPA, conducted by professional bilingual translators, a panel of experts, and a pilot study, and II) validation in a sample of 42 acquired brain injury patients (ABI) and 42 healthy participants (HC). WCPA primary outcomes showed expected convergent/discriminant validity patterns with socio-demographical and clinical variables and cognitive processes identifying those WCPA outcomes that best predicted executive and memory deficits measured with a battery of traditional neuropsychological tests. In addition, performance on the WCPA was a significant predictor of everyday functioning over variables such as socio-demographics or global cognition when measured with traditional tests. External validity was established by the WCPA's ability to identify everyday cognitive deficits in ABI patients compared to HC, even in those with subtle cognitive impairment based on neuropsychological tests. The Spanish WCPA-10 seems an appropriate and sensitive assessment tool to identify cognitive-functional impairment in ABI-patients, even those with subtle cognitive impairment. The results also highlight the relevance of this kind of test, as they indicate a better prediction of patients' real-world functioning than traditional neuropsychological tests.

Correlating continuously captured home-based digital biomarkers of daily function with postmortem neurodegenerative neuropathology

BACKGROUND

Outcome measures available for use in Alzheimer's disease (AD) clinical trials are limited in ability to detect gradual changes. Measures of everyday function and cognition assessed unobtrusively at home using embedded sensing and computing generated "digital biomarkers" (DBs) have been shown to be ecologically valid and to improve efficiency of clinical trials. However, DBs have not been assessed for their relationship to AD neuropathology.

OBJECTIVES

The goal of the current study is to perform an exploratory examination of possible associations between DBs and AD neuropathology in an initially cognitively intact community-based cohort.

METHODS

Participants included in this study were ≥65 years of age, living independently, of average health for age, and followed until death. Algorithms, run on the continuously-collected passive sensor data, generated daily metrics for each DB: cognitive function, mobility, socialization, and sleep. Fixed postmortem brains were evaluated for neurofibrillary tangles (NFTs) and neuritic plaque (NP) pathology and staged by Braak and CERAD systems in the context of the "ABC" assessment of AD-associated changes.

RESULTS

The analysis included a total of 41 participants (M±SD age at death = 92.2±5.1 years). The four DBs showed consistent patterns relative to both Braak stage and NP score severity. Greater NP severity was correlated with the DB composite and reduced walking speed. Braak stage was associated with reduced computer use time and increased total time in bed.

DISCUSSION

This study provides the first data showing correlations between DBs and neuropathological markers in an aging cohort. The findings suggest continuous, home-based DBs may hold potential to serve as behavioral proxies that index neurodegenerative processes.

Sensitivity and specificity of the INECO frontal screening (IFS) in the detection of patients with traumatic brain injury presenting executive deficits

Executive dysfunction (EF) is a common feature of adult traumatic brain injury (TBI), especially in moderate to severe cases. Assessing EF usually requires the administration of an extensive neuropsychological battery, which is time consuming and expensive. The INECO frontal screening (IFS) is a brief, easy-to-administer screening test which has previously shown to be useful in the detection of executive deficits in different psychiatric and neurological populations. The aim of the present study was to assess the usefulness of the IFS in the detection of executive dysfunction in TBI patients. Twenty-eight TBI patients and thirty-two healthy controls were assessed with a battery that included classical executive tests and the IFS. Our results indicated that with a cutoff score of 26.25 points, the IFS showed good sensitivity and specificity in the detection of executive impairments in TBI patients. It also showed good positive and negative predicted values. Our results suggest that the IFS can be considered a useful tool for identifying executive dysfunction in patients with TBI.

Assessments of Functional Cognition Used with Patients following Traumatic Brain Injury in Acute Care: A Survey of Australian Occupational Therapists

This study aimed to describe how occupational therapists working in acute care settings in Australia assess cognitive function in patients with TBI, the influences on assessment choice, and clinician perceptions of performance-based assessment. An online survey was completed by 81 occupational therapists. The most common method of cognitive assessment was reported as non-standardized observation of functional tasks (94.7%), followed by carer-report / self-report (93%). Despite their being positive perceptions of performance-based assessment there was limited use in practice. Assessment use was impacted by practical and organizational constraints including access to assessment resources, time and the built environment in acute care.

Virtual-Reality Performance-Based Assessment of Cognitive Functions in Adult Patients With Acquired Brain Injury: A Scoping Review

Individuals with acquired brain injury (ABI) commonly present with impairments in cognitive abilities. As these competencies seem to be predictive of patients' abilities to reintegrate into the everyday settings, it is crucial to assess them properly. However, previous research has indicated that patients may perform relatively well on standard tests of cognitive functioning, but may nonetheless encounter significant difficulties in organizing and executing everyday tasks. In order to overcome this issue, virtual reality (VR) methods have been introduced in clinical practice with the aim of creating assessments that simulate real-world activities and thus, provide a clearer picture of patients' functioning in everyday settings. This review offers an overview of VR assessment tools described in the scientific literature between 2010 and 2019. Overall, 38 relevant records describing 31 different tools were found. Among these tools, 16 assessed executive functions and prospective memory, while the other 15 assessed visuo-spatial abilities. Although promising results have been reported, our analysis indicated that about half of the tools deliver tasks that differ from everyday activities, thus limiting the generalizability of patients' performance to the real-world. Moreover, a variety of methodological shortfalls related to study Internal and External Validity have been highlighted, which hamper the possibility of drawing definite recommendations on tool choice. These limitations suggest the importance of putting considerable efforts into the improvement or development of VR tools for patients with ABI for both research and clinical purposes, considering the great potential of this form of assessment.

A Novel Tool to Assess Basic Activities of Daily Living in Spanish Preschoolers

BACKGROUND

Basic activities of daily living (BADLs) are those related to self-care. Their performance depends on the development of sensorimotor and cognitive skills, as well as social and environmental aspects. A good performance in BADLs is required for independence and social participation, so they play an important role in early education and early care. We aim to create a tool for BADLs assessment for Spanish preschoolers.

METHODS

The tool was administered to 303 participants (48.5% boys and 51.5% girls) between three and six years of age. Analyses to find out the factorial structure and internal consistency was carried out.

RESULTS

The instrument was composed of 84 items in four scales (eating, personal hygiene, dressing, and daily functioning) with nine factors (oral sensitivity, good manners, manual dexterity, brushing teeth, toilet management, hygiene and grooming, dressing, higher-order and core executive function). Reliability values were from acceptable to preferred (0.74-0.94).

CONCLUSIONS

The instrument could be useful and shows preliminary good indicators in construct validity and reliability.

Neuropsychological Research in Obsessive-Compulsive Disorder: Current Status and Future Directions

Neuropsychological functions in obsessive-compulsive disorder (OCD) have been extensively investigated. Despite some common findings across studies indicating deficient test performance across cognitive domains with small to medium effect sizes, results remain inconsistent and heterogeneous. However, multiple past attempts to identify moderators that may account for such variability have been unrewarding. Typical moderators including symptom severity, age at onset, medication status, and comorbid conditions failed to provide sufficient explanatory power. It has then been posited that these inconsistencies may be attributed to the inherent heterogeneous nature of the disorder (i.e., symptom dimensions), or to the natural fluctuation in symptom severity. However, recent meta-analyses suggest that these factors may not account for the persistent unexplained variability. Other potential factors-some of which are unique to neuropsychological testing-received scarce research attention, including definition of cognitive impairments, specificity and selection of test and outcome measures, and their limited ecological validity. Other moderators, particularly motivational aspects, and metacognitive factors (e.g., self-efficacy) were not previously addressed despite their potential association to OCD, and their documented impact on cognitive function. The aim of the present mini-review is to provide an updated succinct overview of the current status of the neuropsychological literature in OCD and expanding upon oft-neglected potential moderators and their putative impact on neuropsychological findings in OCD. Our goal is to highlight important avenues for further research and provide a road map for investigators in order to advance our understanding of cognitive functions in OCD that has been stagnant in the past decade.

Structural validity and internal consistency of an ecological observation-based assessment, the Activities of Daily Living Profile

INTRODUCTION

Direct observation of everyday task performance is considered the most accurate measure of independence for individuals with executive function impairments. However, few observation-based measures have been shown to have sound psychometric qualities and be clinically applicable. The objective of this study was to investigate the Activities of Daily Living (ADL) Profile's structural validity using exploratory factor analyses and internal consistency in order to identify the minimum set of tasks required to achieve reliable scores in each of three ADL environments (personal, home and community).

METHODS

Ninety-one persons with a severe traumatic brain injury aged 16-40 years (convenience sample) were recruited from a university affiliated level 1 trauma hospital. The 17 observation-based tasks of the ADL Profile were administered by one of five occupational therapists, either in the hospital or in the subjects' home and community environments. This measure of independence considers goal formulation, planning, carrying out and verifying goal attainment.

RESULTS

Exploratory factor analysis indicated the unidimensionality of the 17 tasks of the ADL Profile. A single factor explained more than 80% of the common variation, which in this case is the concept of independence. Internal consistency of task scores is very high (0.955), suggesting redundancy of the tasks. Approaches used to reduce the number of items, and to optimise the clinical applicability of the tool, showed that a minimum of two tasks per each of three environments (personal, home, community) is required to obtain reliable results that respect the tool's internal structure. Each assessment should contain both simple and familiar and more novel and complex tasks.

CONCLUSIONS

Findings show that the ADL Profile is a valid and clinically applicable observation-based measure of independence that considers four important task-related components: goal formulation, planning, carrying out and verifying goal attainment.

Assessment of Sensory Processing and Executive Functions at the School: Development, Reliability, and Validity of EPYFEI-Escolar

The aim of this study was to determine the psychometric properties of the Assessment of Sensory Processing and Executive Functions at the School (EPYFEI-Escolar), a questionnaire designed to assess the sensory processing and executive functions as underlying processes for school participation. The total sample consisted of 536 children aged between 3 and 11 years old who lived in Spain. A total of 103 teachers completed the questionnaire. An exploratory factor analysis was conducted, which showed five main factors: (1) initiation, organization, execution, and supervision of the action; (2) inhibitory control; (3) sensory processing; (4) emotional self-regulation and play; and (5) self-competence. Some of these factors were similar to those found in the EPYFEI for parents in the home context. The reliability of the analysis was high, both for the whole questionnaire and for the factors it is composed of. The results provide evidence of the potential usefulness of the EPYFEI-Escolar in school contexts for determining academic needs and difficulties of children; moreover, this tool can also be used to plan intervention programs in the school environment according to the needs of each child and school.

Developing and Validating a Big-Store Multiple Errands Test

The Multiple Errands Test (MET) is an ecologically valid assessment that characterizes how executive dysfunction manifests in everyday activities. Due to the naturalistic nature of this assessment, clinicians and researchers have had to develop site-specific versions resulting in numerous published versions and making it difficult to establish standard psychometric properties. The aim of this study was to develop a standardized, community version of the MET designed to be used in large department stores meeting set criteria that would not require site specific modifications. This paper reports on the development, content validity, feasibility, and inter-rater reliability of a Big-Store MET, and the performance of healthy participants on this test. Items were selected to match previously published versions in relation to quantity and complexity. Content validity was established by having experts (n = 4) on the MET review the proposed Big-Store version and evaluate the task consistency with previously published versions. To assess feasibility of administration, and inter-rater reliability, a convenience sample of 14 community dwelling adults, self-reporting as healthy, were assessed by two trained raters. We found the Big-Store MET to be feasible to deliver (completed within 30 min, scores show variability, acceptable to participants in community environment) and inter-rater reliability to be very high (ICCs = 0.92-0.99) with the exception of frequency of strategy use. This study introduces the Big-Store MET to the literature, establishes its preliminary validity and reliability thus laying the foundation for a standardized, community-based version of the MET.

Assessment of cognitive instrumental activities of daily living: a systematic review

PURPOSE

Cognitive instrumental activities of daily living are particularly related to executive functions, such as scheduling appointments, monthly payments, managing the household economy, shopping or taking the bus. The aim of this systematic review was to determine the available tests for the assessment of executive functions with ecological validity to predict individuals' functioning.

MATERIALS AND METHODS

An electronic search was conducted in MEDLINE, Cochrane Central, PsyCInfo and IEEE Xplore until May 2019, in addition to a manual search. The PRISMA criteria and the Covidence platform were used to select articles and extract data.

RESULTS

After applying the search selection criteria, 76 studies were identified. They referred to 110 tools to assess instrumental activities of daily living. Those that have received most attention are related to menu preparation and shopping. Performance-based measures are the most widely used traditional methods. Most tests were aimed at the adult population with acquired brain damage, cognitive impairment or dementia. There was a predominance of tests based on the Multiple Errands Test paradigm.

CONCLUSIONS

In recent years, it has increased the number of tools that assess the instrumental activities of daily living based on technologies such as personal or environmental sensors and serious games.IMPLICATIONS FOR REHABILITATIONAssessment of Instrumental Activities of Daily Living through performance-based measures is especially useful for the early detection of dysfunctions or preclinical disability.Difficulties in performing instrumental activities of daily living are closely associated with deficits in executive functions and prospective memory.Activities of Daily Living can be understood as multitasks.The use of virtual reality-based tests was shown to be sensitive to the detection of cognitive deficits in Activities of Daily Living.An advantage of using virtual reality in assessments is that it can help to predict the level of personal autonomy in patients who are in an institutional environment and could be a first approximation to the real environment.

The weekly calendar planning activity in multiple sclerosis: A top-down assessment of executive functions

Deficits in executive functioning are detrimental to employment, daily functioning and quality of life, however their precise nature in multiple sclerosis (MS) remains underspecified. The aims of this study were to: (1) describe the executive processes affected in MS, using a top-down (Weekly Calendar Planning Activity; WCPA) and bottom-up (Delis-Kaplan Executive Function System; DKEFS) assessment tools; (2) explore relationships between performance on the WCPA and DKEFS with a test of everyday functional performance, Actual Reality^TM (AR). Methods: Sixty two participants with MS with and without cognitive impairments (n = 21 and 41, respectively) and 38 Healthy Controls (HC) completed the WCPA, two selected subtests of the DKEFS, and AR. Results: The MS group with cognitive impairments performed worse compared with the MS with no cognitive impairments and HC on both the WCPA and DKEFS. Better scores on the DKEFS were associated with better performance of the WCPA. WCPA was a significant predictor of three of the four AR variables. The DKEFS was a significant predictor of time to perform the AR. The results support the use of the WCPA as an assessment of executive functions in persons with MS. It embodies processes such as environmental monitoring, planning and problem solving, and self-regulation.