Linking occupational therapy models and assessments to the ICF to enable standardized documentation of functioning

Myalgic Encephalomyelitis-Chronic Fatigue Syndrome Common Data Element item content analysis

INTRODUCTION

Myalgic Encephalomyelitis/Chronic Fatigue Syndrome (ME/CFS) is a multisystem chronic disease estimated to affect 836,000-2.5 million individuals in the United States. Persons with ME/CFS have a substantial reduction in their ability to engage in pre-illness levels of activity. Multiple symptoms include profound fatigue, post-exertional malaise, unrefreshing sleep, cognitive impairment, orthostatic intolerance, pain, and other symptoms persisting for more than 6 months. Diagnosis is challenging due to fluctuating and complex symptoms. ME/CFS Common Data Elements (CDEs) were identified in the National Institutes of Health (NIH) National Institute of Neurological Disorders and Stroke (NINDS) Common Data Element Repository. This study reviewed ME/CFS CDEs item content.

METHODS

Inclusion criteria for CDEs (measures recommended for ME/CFS) analysis: 1) assesses symptoms; 2) developed for adults; 3) appropriate for patient reported outcome measure (PROM); 4) does not use visual or pictographic responses. Team members independently reviewed CDEs item content using the World Health Organization International Classification of Functioning, Disability and Health (ICF) framework to link meaningful concepts.

RESULTS

119 ME/CFS CDEs (measures) were reviewed and 38 met inclusion criteria, yielding 944 items linked to 1503 ICF meaningful concepts. Most concepts linked to ICF Body Functions component (b-codes; n = 1107, 73.65%) as follows: Fatiguability (n = 220, 14.64%), Energy Level (n = 166, 11.04%), Sleep Functions (n = 137, 9.12%), Emotional Functions (n = 131, 8.72%) and Pain (n = 120, 7.98%). Activities and Participation concepts (d codes) accounted for a smaller percentage of codes (n = 385, 25.62%). Most d codes were linked to the Mobility category (n = 69, 4.59%) and few items linked to Environmental Factors (e codes; n = 11, 0.73%).

DISCUSSION

Relatively few items assess the impact of ME/CFS symptoms on Activities and Participation. Findings support development of ME/CFS-specific PROMs, including items that assess activity limitations and participation restrictions. Development of psychometrically-sound, symptom-based item banks administered as computerized adaptive tests can provide robust assessments to assist primary care providers in the diagnosis and care of patients with ME/CFS.

Assessing functioning for individuals with neurodevelopmental conditions: Current clinical practice in Australia

BACKGROUND

In the disability sector globally, and specifically in Australia, assessments of functioning have become key to diagnostic processes, and accessing therapy and funding. Over half of all individuals accessing support through Australia's National Disability Insurance Scheme have a neurodevelopmental condition diagnosis. Little is known about assessments of functioning for this population.

METHODS

A mixed methods online survey was designed to understand the current assessment of functioning practices (including clinical contexts, concepts being assessed, and assessment methods) and barriers and facilitators to clinicians using best practice. Results were analysed descriptively, and differences between professions calculated where possible. Content analysis was used to explore qualitative comments.

RESULTS

Clinicians from various medical and allied health backgrounds completed the survey (n = 93), with varying ranges of age, experience, and education. Clinicians reported that they assessed functioning across age, setting, sector, funding body, and individuals with a wide variety of diagnoses. Missing from current practice is a clear transdisciplinary conceptualisation of functioning. The largest barriers to best practice were limited time, large caseloads, availability of appropriate tools, and lack of clarity from funding bodies.

CONCLUSIONS

Missing from current practice is a clear transdisciplinary conceptualisation of functioning.These results will help inform steps forward to improve assessment of functioning practices to ensure that all individuals receive appropriate and sufficient support.

Functioning Problems Associated with Health Conditions with Greatest Disease Burden in South Africa: A Scoping Review

A notable rise in health-related disability for which evidence-based rehabilitation is beneficial is evident in low-to-middle income countries. This scoping review aimed to systematically identify and map the most common functioning problems associated with health conditions that contribute most to disability in South Africa using the International Classification of Functioning, Disability and Health (ICF) framework. Peer-reviewed evidence published from January 2006 to December 2021 was systematically searched from five databases. Some 268 studies reporting on functioning problems (impairments, activity limitations, and participation restrictions) in South African adults (>18 years) related to 10 health conditions were included. A total of 130 different functioning problems were mapped to the ICF. The most prevalent problems (top 20) were related to mobility, pain, and mental health but spanned across several ICF domains and were mostly in patients at primary care. The high prevalence and wide range of functioning problems may be particularly burdensome on an already strained primary health care (PHC) system. This points towards targeted planning of innovative strategies towards strengthening rehabilitation service delivery at primary care to address these complexities where there is an inadequate rehabilitation workforce.

A roadmap to reduce information inequities in disability with digital health and natural language processing

People with disabilities disproportionately experience negative health outcomes. Purposeful analysis of information on all aspects of the experience of disability across individuals and populations can guide interventions to reduce health inequities in care and outcomes. Such an analysis requires more holistic information on individual function, precursors and predictors, and environmental and personal factors than is systematically collected in current practice. We identify 3 key information barriers to more equitable information: (1) a lack of information on contextual factors that affect a person's experience of function; (2) underemphasis of the patient's voice, perspective, and goals in the electronic health record; and (3) a lack of standardized locations in the electronic health record to record observations of function and context. Through analysis of rehabilitation data, we have identified ways to mitigate these barriers through the development of digital health technologies to better capture and analyze information about the experience of function. We propose 3 directions for future research on using digital health technologies, particularly natural language processing (NLP), to facilitate capturing a more holistic picture of a patient's unique experience: (1) analyzing existing information on function in free text documentation; (2) developing new NLP-driven methods to collect information on contextual factors; and (3) collecting and analyzing patient-reported descriptions of personal perceptions and goals. Multidisciplinary collaboration between rehabilitation experts and data scientists to advance these research directions will yield practical technologies to help reduce inequities and improve care for all populations.

Exploring the Multidimensional Participation of Adults Living in the Community in the Chronic Phase following Acquired Brain Injury

This exploratory study aimed to examine multiple aspects of the participation of adults in the chronic phase following acquired brain injury (ABI), considering different disability levels. Our study included 25 adults ≥6 months after ABI (predominantly stroke), living at home, without severe cognitive decline. Primary measures included the Canadian Occupational Performance Measure (subjective participation) and the Mayo-Portland Adaptability Inventory-4 Participation Index (objective participation). The results indicated subjective participation problems in all of the International Classification of Functioning, Disability and Health participation domains. In addition, objective participation was reported as most limited in the areas of leisure and recreational activities, residence, and employment. Both subjective and objective participation profiles varied according to the disability level except for the social and leisure areas, which were found to be similar across all subgroups. However, only partial compatibility was found between the subjective and objective participation aspects. To conclude, our findings indicated that chronic ABI survivors report a variety of subjective and objective participation concerns that varied according to their disability levels. Moreover, the incongruity between the participation aspects suggests that the level of limitation may not necessarily correspond to the importance of a particular participation area. This highlights the need for comprehensive assessments to determine unique individual participation profiles in order to facilitate client-centered interventions supporting the rehabilitation of community-dwelling ABI survivors.

Elizabeth Casson Memorial Lecture 2022: Optimising performance, clinical and economic outcomes in occupational therapy service delivery

The rise in health and social care costs has prompted a critical look at the way health and social care services are managed and delivered. There has been a significant change in assessing the performance and evaluating the outcomes of services. Where once only performance outcome data related to service efficiency were required, now evidence of clinical effectiveness and cost-effectiveness is demanded. When evaluating the outcomes of service delivery, it is important to measure performance outcomes (related to service efficiency), clinical outcomes (related to service effectiveness) and economic outcomes (related to cost-effectiveness). This lecture examines the interdependent relationship between performance, clinical and economic outcomes in service delivery which is underpinned by strong leadership, the application of various service improvement strategies and collaborative research between managers, clinicians, researchers and health economists, with patient and public involvement. Service improvement strategies based on practice-based and research-based evidence will be suggested to optimise performance, clinical and economic outcomes. My lecture concludes that occupational therapists should adopt these service improvement strategies and conduct clinical researches and economic evaluations to develop an efficient, effective and cost-effective service which can meet the client’s needs by using allocated resources and is value for money from a commissioning perspective.

Content validation of common measures of functioning for young children against the International Classification of Functioning, Disability and Health and Code and Core Sets relevant to neurodevelopmental conditions

LAY ABSTRACT

Young children who have developmental delay, autism, or other neurodevelopmental conditions can have difficulties doing things in different areas of their life. What they can and cannot do is called their level of functioning. There are lots of assessment measures that aim to assess functioning. But, we are not sure if these measures assess all the things we need to know about these children's functioning. Other research has identified lists of items (codes) that need to be assessed to understand functioning for young children with different neurodevelopmental conditions fully. These lists include body functions (the things a child's body or brain can do), activities and participation (the activities and tasks a child does) and environmental factors (parts of the environment that can influence functioning). In this study, we looked at the items from these lists assessed by different functioning measures to see how they compared to what should be assessed. The measures that we looked at covered 21%-57% of all the codes and 19%-63% of the codes for lists specific to different conditions. Most of the measures focused on activity and participation codes, and they rarely assessed environmental factors. Knowing which codes and how much of the lists the measures assess can help researchers, clinicians and policymakers to choose measures that are more appropriate for young children with neurodevelopmental conditions.

Functioning problems associated with conditions with greatest disease burden in South Africa and Zimbabwe: a scoping review protocol

Background: A notable rise in health-related disability for which evidence-based rehabilitation is beneficial is evident in low-to-middle income countries. This scoping review aims to summarize and synthesize the status of peer-reviewed literature regarding the most common functioning problems associated with health conditions that contribute most to disability in South Africa and Zimbabwe. Methods: The scoping review will be conducted according to the framework developed by Arksey and O’Malley and corresponding guidance contained in the Joanna Briggs Institute Reviewers’ Manual. Peer-reviewed studies of all designs published from January 2006 onwards will be systematically searched from five databases. Studies reporting on functioning problems (impairments, activity limitations, and participation restrictions) in South African and Zimbabwean adults (>18 years) related to the top 10 health conditions contributing most to years lived with disability in South Africa and Zimbabwe according to the Global Burden of Disease Study 2019 will be included. Two reviewers will screen titles, abstracts, and full texts and chart data. The International Classification of Functioning, Disability and Health (ICF) framework will be used to map identified functioning problems. A narrative approach will be used to synthesize results. Discussion: This scoping review will provide a comprehensive mapping of functioning problems affecting adults in South Africa and Zimbabwe. Understanding the local rehabilitation needs may be a first step in strengthening primary care rehabilitation in low-resource settings. Registration: This scoping review protocol was registered with the Open Science Framework (doi: 10.17605/OSF.IO/FJM7W) on 31/12/2020.

Construct Validity and Clinical Utility of World Health Organization Disability Assessment Schedule 2.0 in Older Patients Discharged From Emergency Departments

Introduction: The World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) is designed to measure functioning and disability in six domains. It is included in the International Classification of Diseases 11th revision (ICD-11). The objective of the study was to examine the construct validity of WHODAS 2.0 and describe its clinical utility for the assessment of functioning and disability among older patients discharged from emergency departments (EDs). Material and Methods: This cross-sectional study is based on data from 129 older patients. Patients completed the 36-item version of WHODAS 2.0 together with the Barthel-20, the Assessment of Motor and Process Skills (AMPS), Timed Up and Go (TUG), and the 30-Second Chair Stand Test (30 s-CST). Construct validity was examined through hypothesis testing by correlating the WHODAS with the other instruments and specifically the mobility domain in WHODAS 2.0 with the TUG and 30 s-CST tests. The clinical utility of WHODAS 2.0 was explored through floor/ceiling effect and missing item responses. Results: WHODAS 2.0 correlated fair with Barthel-20 (r = -0.49), AMPS process skills (r = -0.26) and TUG (r=0.30) and correlated moderate with AMPS motor skills (r = -0.58) and 30s-CST (r = -0.52). The WHODAS 2.0 mobility domain correlated fair with TUG (r = 0.33) and moderate with 30s-CST (r = -0.60). Four domains demonstrated floor effect: D1 "Cognition," D3 "Self-care," D4 "Getting along," and D5 "Household." Ceiling effect was not identified. The highest proportion of missing item responses were present for Item 3.4 (Staying by yourself for a few days), Item 4.4 (Making new friends), and Item 4.5 (Sexual activities). Conclusion: WHODAS 2.0 had fair-to-moderate correlations with Barthel-20, AMPS, TUG, and 30s-CST and provides additional aspects of disability compared with commonly used instruments. However, the clinical utility of WHODAS 2.0 applied to older patients discharged from EDs poses some challenges due to floor effect and missing item responses. Accordingly, patient and health professional perspectives need further investigation.

Linking the Spinal Function Sort and Functional Capacity Evaluation Tests to the International Classification of Functioning, Disability and Health Core Set of Vocational Rehabilitation

Purpose The International Classification of Functioning, Disability and Health (ICF) Comprehensive Core Set for Vocational Rehabilitation (CSVR) is a shortlist of functioning domains developed for use with people of working age that experience limitation in their work-related functional capacity. Functional capacity can be measured by, for example, Spinal Function Sort pictorial questionnaire and Functional Capacity Evaluation tests such as the: Complete Minnesota Dexterity Test, grip strength test, pushing, pulling, progressive iso-inertial lifting and carrying. However, these tests have not yet been linked to the CSVR. The objective of this study was to evaluate the extent to which the Spinal Function Sort and Functional Capacity Evaluation tests could be mapped to the ICF categories of the CSVR. Methods Two raters independently performed the linking of the Spinal Function Sort and the Functional Capacity Evaluation related tests to the CSVR according to established ICF linking rules. If an item could not accurately be linked to a CSVR category, the item was linked to the most fitting ICF category. Disagreements were resolved in a consensus meeting. Interrater agreement between raters was expressed in percentage agreement. Results The Spinal Function Sort and Functional Capacity Evaluation tests described a total of 39 unique ICF categories, out of which only six (15%) came from the CSVR. Interrater agreement ranged between 17 and 91%. Conclusions The study found six categories including vestibular functions, muscle power functions, writing, lifting and carrying objects, fine hand use and hand and arm use within the CSVR using the Spinal Function Sort and The Complete Minnesota Dexterity Test. With the rest of the items, the CSVR was considered too broad.

Automated Coding of Under-Studied Medical Concept Domains: Linking Physical Activity Reports to the International Classification of Functioning, Disability, and Health

Linking clinical narratives to standardized vocabularies and coding systems is a key component of unlocking the information in medical text for analysis. However, many domains of medical concepts, such as functional outcomes and social determinants of health, lack well-developed terminologies that can support effective coding of medical text. We present a framework for developing natural language processing (NLP) technologies for automated coding of medical information in under-studied domains, and demonstrate its applicability through a case study on physical mobility function. Mobility function is a component of many health measures, from post-acute care and surgical outcomes to chronic frailty and disability, and is represented as one domain of human activity in the International Classification of Functioning, Disability, and Health (ICF). However, mobility and other types of functional activity remain under-studied in the medical informatics literature, and neither the ICF nor commonly-used medical terminologies capture functional status terminology in practice. We investigated two data-driven paradigms, classification and candidate selection, to link narrative observations of mobility status to standardized ICF codes, using a dataset of clinical narratives from physical therapy encounters. Recent advances in language modeling and word embedding were used as features for established machine learning models and a novel deep learning approach, achieving a macro-averaged F-1 score of 84% on linking mobility activity reports to ICF codes. Both classification and candidate selection approaches present distinct strengths for automated coding in under-studied domains, and we highlight that the combination of (i) a small annotated data set; (ii) expert definitions of codes of interest; and (iii) a representative text corpus is sufficient to produce high-performing automated coding systems. This research has implications for continued development of language technologies to analyze functional status information, and the ongoing growth of NLP tools for a variety of specialized applications in clinical care and research.