Achieving meaningful measurements of ICF concepts

Community Participation of School-Age Children: Who is at Risk of Restricted Participation?

AIMS

This study aimed to identify children with restricted community participation and examine the extent to which the child, family, and environmental factors were associated with restricted participation.

METHODS

A school-based sample of 92 children with disabilities and 391 children without disabilities aged 5-12 years was recruited in Hong Kong. Parents completed the Participation and Environment Measure for Children and Youth and a demographic questionnaire. Moreover, children completed the Children's Depression Inventory. Rasch analysis was used to determine the criteria that differentiated between children with and without participation restriction, based on frequency of activities. Logistic regression was used to identify the factors associated with participation restriction.

RESULTS

One hundred seventy-three children (35.8% of the sample), including 42 with disabilities, were identified as having restricted participation. Participation restriction was associated with higher depressive symptoms in children (odds ratio (OR) = 1.05, 95% confidence interval (CI) [1.01, 1.08]), lower environmental resources (OR = 0.97, 95% CI [0.96, 0.99]), and coming from families with three or more children (OR = 2.80, 95% CI [1.44, 5.46]).

CONCLUSIONS

The results suggest that a sizable number of children are at risk for restricted participation in the community. Healthcare services and strategies that address the associated factors are needed to promote children's community participation.

Choosing the most appropriate PROM for clinical studies in sports medicine

Choosing the most appropriate patient-reported outcome measure (PROM) for a clinical study is essential in order to achieve trustworthy results. This choice will depend on (a) the objective of the study and hence the research question; (b) the choice of a theoretical framework, such as the World Health Organization's International Classification of Functioning, Disability, and Health (ICF); (c) whether there currently is a PROM that possesses high content validity and high construct validity for the specific patient group and objective, and if not; (d) the decision on whether to use a suboptimal PROM or develop and validate a new PROM. This paper presents the steps that should be followed in order to assess the relevance of PROMs and suggests ways to enhance the choice depending on the goal of the study.

How to develop a condition-specific PROM

Developing new patient-reported outcome measures (PROMs) for application in clinical studies can be necessary if an adequate PROM does not exist. For adequate measurement, it is essential that the PROM has face validity (ie, is perceived to be relevant by clinicians and researchers) and has high content validity (ie, content relevance and content coverage for the targeted patient group). The steps needed to create PROMs that possess face and content validity for a specific condition are described in this paper. Face validity is achieved by item identification and generation through literature review. Content validity is confirmed through repetitive cognitive interviews of patients from the targeted patient group in order to generate a consensus-based pilot-version of the new PROM. This qualitative process ensures that items are appropriately worded, understandable, and minimizes doubts about how items should be answered. A practical example of this process is presented, which shows the development of the Knee Numeric-Entity Evaluation Score (KNEES-ACL), a condition-specific PROM for patients with deficiency of the anterior cruciate ligament (ACL).

Evaluation of the clinical effectiveness of a work-based mentoring programme to develop clinical reasoning on patient outcome: A stepped wedge cluster randomised controlled trial

BACKGROUND

Despite persistent calls to measure the effectiveness of educational interventions on patient outcomes, few studies have been conducted. Within musculoskeletal physiotherapy, the effects of clinical mentoring on postgraduate physiotherapists have been explored, but its impact on patient outcomes is unknown. The objective of this trial was to assess the effectiveness of a work-based mentoring programme to facilitate physiotherapist clinical reasoning on patient outcomes.

METHODS

In a stepped-wedge cluster RCT in the musculoskeletal physiotherapy outpatient departments of a large NHS organisation, 16 physiotherapists were randomised by cluster to receive the intervention-150 hours of mentored clinical practice-at one of 3 time periods; control was usual training. 441 patients submitted outcome measures: Patient-Specific Functional Scale (PSFS) (primary outcome measure), EQ-5D-5L, patient activation and patient satisfaction (secondary outcome measures). A further secondary outcome measure of physiotherapist performance was collected by an independent assessor observing the physiotherapists practice.

RESULTS

80.0% of intervention patients achieved clinically significant PSFS scores compared with 63.8% of control patients. Binary logistic regression analysis modelling for time, cluster and patient characteristics showed strong statistical evidence for this difference (p = 0.023; odds ratio 4.24, 95%CI 1.22, 14.79). Physiotherapist performance scores improved from a mean of 47.8% (SD 3.60) pre-intervention to a mean of 56.0% (SD 4.24) (p<0.001). There was no statistical evidence for differences between groups on other secondary outcomes.

CONCLUSION

This is the first study that we aware of that provides patient outcomes measurement of an established educational intervention in physiotherapy, providing evidence that this type of intervention positively impacts patient outcomes and physiotherapist performance. This provides a basis for further research in education across other healthcare disciplines and outcome measures.

The ICF has made a difference to functioning and disability measurement and statistics

AIMS

Fifteen years after the publication of the International Classification of Functioning, Disability and Health (ICF), we investigated: How ICF applications align with ICF aims, contents and principles, and how the ICF has been used to improve measurement of functioning and related statistics.

METHODS

In a scoping review, we investigated research published 2001-2015 relating to measurement and statistics for evidence of: a change in thinking; alignment of applications with ICF specifications and philosophy; and the emergence of new knowledge.

RESULTS

The ICF is used in diverse applications, settings and countries, with processes largely aligned with the ICF and intended to improve measurement and statistics: new national surveys, information systems and ICF-based instruments; and international efforts to improve disability data. Knowledge is growing about the components and interactions of the ICF model, the diverse effects of the environment on functioning, and the meaning and measurement of participation.

CONCLUSION

The ICF provides specificity and a common language in the complex world of functioning and disability and is stimulating new thinking, new applications in measurement and statistics, and the assembling of new knowledge. Nevertheless, the field needs to mature. Identified gaps suggest ways to improve measurement and statistics to underpin policies, services and outcomes. Implications for Rehabilitation The ICF offers a conceptualization of functioning and disability that can underpin assessment and documentation in rehabilitation, with a growing body of experience to draw on for guidance. Experience with the ICF reminds practitioners to consider all the domains of participation, the effect of the environment on participation and the importance of involving clients/patients in assessment and service planning. Understanding the variability of functioning within everyday environments and designing interventions for removing barriers in various environments is a vital part of rehabilitation planning.

Validity of a sensor-based table-top platform to measure upper limb function

Objective measurement is an essential part of the assessment process in neurological dysfunction such as stroke. However, current clinical scores are insensitive and based on subjective observation from experts. Technology provides an opportunity for enhanced accuracy and specificity of objective measurement. This study describes the use of an interactive force-sensitive table-top platform for the assessment of reach in post-stroke patients, admitted as part of a three week intensive upper limb training programme. Objective measures from the reachable workspace were extracted and included normalised reach distance, normalised reached speed and reach dragging. The data was compared to standardised Fugl-Meyer (FM) clinical scores, recorded at admission (FMPRE) and discharge (FMPOST). Results indicate strong relationships between the three objective measures and subjective FM scores, with significant Spearman correlations found in all cases (|ρ| > 0.5, p < 0.05). The results highlight the validity for a sensor-based table-top system to provide a simple, flexible, and objective platform for assessment of impaired upper limb motor function.

Interpreting physical and behavioral health scores from new work disability instruments

OBJECTIVE

To develop a system to guide interpretation of scores generated from 2 new instruments measuring work-related physical and behavioral health functioning (Work Disability - Physical Function (WD-PF) and WD - Behavioral Function (WD-BH)).

DESIGN

Cross-sectional, secondary data from 3 independent samples to develop and validate the functional levels for physical and behavioral health functioning.

SUBJECTS

Physical group: 999 general adult subjects, 1,017 disability applicants and 497 work-disabled subjects. Behavioral health group: 1,000 general adult subjects, 1,015 disability applicants and 476 work-disabled subjects.

METHODS

Three-phase analytic approach including item mapping, a modified-Delphi technique, and known-groups validation analysis were used to develop and validate cut-points for functional levels within each of the WD-PF and WD-BH instrument's scales.

RESULTS

Four and 5 functional levels were developed for each of the scales in the WD-PF and WD-BH instruments. Distribution of the comparative samples was in the expected direction: the general adult samples consistently demonstrated scores at higher functional levels compared with the claimant and work-disabled samples.

CONCLUSION

Using an item-response theory-based methodology paired with a qualitative process appears to be a feasible and valid approach for translating the WD-BH and WD-PF scores into meaningful levels useful for interpreting a person's work-related physical and behavioral health functioning.

Do women with breast cancer report treatment after-effects to healthcare professionals, and who provides the intervention?

There is a gap between the need for and referral to rehabilitation in women with breast cancer who have ongoing treatment-related problems. The objectives of this study were to determine whether nonreporting of health issues is a contributing factor towards the referral gap and to map the range of professionals who offer intervention. A postal questionnaire based on the International Classification of Functioning Disability and Health core set for breast cancer was sent to healthcare professionals working in all centres of excellence for the treatment of breast cancer in Ireland. Thirty-one per cent responded (n=96). Changes in 'Body Functions' were reported widely and those in 'Body Structures' were limited, and the 'Activities and Participation' section had the most unreported categories. Reporting of categories in the 'Environmental' section was not widespread. Intervention is provided for most categories of altered function and advice for difficulties with tasks/participation is limited. Psychologists and social workers are clearly identified with environmental factors. This study identified the issues that women report and described the professional response. Lack of reporting of issues may play a role in symptom perseverance. The International Classification of Functioning Disability and Health list of categories could be used to facilitate reporting, enhance communication and encourage self-management.

The effect of work-based mentoring on patient outcome in musculoskeletal physiotherapy: study protocol for a randomised controlled trial

BACKGROUND

Despite persistent calls to measure the effectiveness of educational interventions on patient outcomes, few studies have been conducted. Within musculoskeletal physiotherapy, the effects of postgraduate clinical mentoring on physiotherapist performance have been assessed, but the impact of this mentoring on patient outcomes remains unknown. The objective of this trial is to assess the effectiveness of a work-based mentoring programme to facilitate physiotherapist clinical reasoning on patient outcomes in musculoskeletal physiotherapy.

METHODS/DESIGN

A stepped wedge cluster randomised controlled trial (CRCT) has been designed to recruit a minimum of 12 senior physiotherapists who work in musculoskeletal outpatient departments of a large National Health Service (NHS) organization. Participating physiotherapists will be randomised by cluster to receive the intervention at three time periods. Patients will be blinded to whether their physiotherapist has received the intervention. The primary outcome measure will be the Patient-Specific Functional Scale; secondary outcome measures will include the EQ-5D, patient activation, patient satisfaction and physiotherapist performance. Sample size considerations used published methods describing stepped wedge designs, conventional values of 0.80 for statistical power and 0.05 for statistical significance, and pragmatic groupings of 12 participating physiotherapists in three clusters. Based on an intergroup difference of 1.0 on the PSFS with a standard deviation of 2.0, 10 patients are required to complete outcome measures per physiotherapist, at time period 1 (prior to intervention roll-out) and at each of time periods 2, 3 and 4, giving a sample size of 480 patients. To account for the potential loss to follow-up of 33%, 720 sets of patient outcomes will be collected.All physiotherapist participants will receive 150 hours of mentored clinical practice as the intervention and usual in-service training as control. Consecutive, consenting patients attending treatment by the participating physiotherapists during data collection periods will complete outcome measures at baseline, discharge and 12 months post-baseline. The lead researcher will be blinded to the allocation of the physiotherapist when analyzing outcome data; statistical analysis will involve classical linear models incorporating both an intervention effect and a random intercept term to reflect systematic differences among clusters.

TRIAL REGISTRATION

Assigned 31 July 2012: ISRCTN79599220.

Daily life dialogue assessment in psychiatric care-face validity and inter-rater reliability of a tool based on the International Classification of Functioning, Disability and Health

This article describes the development of an assessment tool based on the International Classification of Functioning Disability and Health (ICF) adapted to a psychiatric nursing context where both the patient and the nurse assess the patient's ability to participate in various spheres of life. The aim was to test psychometric properties, focusing on face validity and inter-rater reliability. Three Swedish expert groups participated. Analysis of inter-rater reliability was conducted through simulated patient cases. The results of an unweighted kappa value of 0.38, a linear weighted kappa value of 0.65 and a quadratic weighted kappa value of 0.73 were considered as acceptable when using simulated patient cases.

Development of Rasch-based item banks for the assessment of work performance in patients with musculoskeletal diseases

PURPOSE

This study aimed to develop a self-description assessment instrument to measure work performance in patients with musculoskeletal diseases. In terms of the International Classification of Functioning, Disability and Health (ICF), work performance is defined as the degree of meeting the work demands (activities) at the actual workplace (environment). To account for the fact that work performance depends on the work demands of the job, we strived to develop item banks that allow a flexible use of item subgroups depending on the specific work demands of the patients' jobs.

METHODS

Item development included the collection of work tasks from literature and content validation through expert surveys and patient interviews. The resulting 122 items were answered by 621 patients with musculoskeletal diseases. Exploratory factor analysis to ascertain dimensionality and Rasch analysis (partial credit model) for each of the resulting dimensions were performed.

RESULTS

Exploratory factor analysis resulted in four dimensions, and subsequent Rasch analysis led to the following item banks: 'impaired productivity' (15 items), 'impaired cognitive performance' (18), 'impaired coping with stress' (13) and 'impaired physical performance' (low physical workload 20 items, high physical workload 10 items). The item banks exhibited person separation indices (reliability) between 0.89 and 0.96.

CONCLUSIONS

The assessment of work performance adds the activities component to the more commonly employed participation component of the ICF-model. The four item banks can be adapted to specific jobs where necessary without losing comparability of person measures, as the item banks are based on Rasch analysis.

Staging of mobility, transfer and walking functions of elderly persons based on the codes of the International Classification of Functioning, Disability and Health

BACKGROUND

The International Classification of Functioning, Disability and Health (ICF) was introduced by the World Health Organization as a common taxonomy to describe the burden of health conditions. This study focuses on the development of a scale for staging basic mobility and walking functions based on the ICF.

METHODS

Thirty-three ICF codes were selected to test their fit to the Rasch model and their location. Of these ICF items, four were used to develop a Guttman- type scale of "basic mobility" and another four to develop a"walking" scale to stage functional performance in the elderly. The content validity and differential item functioning of the scales were assessed. The participants, chosen at random, were Japanese over 65 years old using the services of public long-term care insurance, and whose functional assessments were used for scale development and scale validation.

RESULTS

There were 1164 elderly persons who were eligible for scale development. To stage the functional performance of elderly persons, two Guttman-type scales of "basic mobility" and "walking" were constructed. The order of item difficulty was validated using 3260 elderly persons. There is no differential item functioning about study location, sex and age-group in the newly developed scales. These results suggested the newly developed scales have content validity.

CONCLUSIONS

These scales divided functional performance into five stages according to four ICF codes, making the measurements simple and less time-consuming and enable clear descriptions of elderly functioning level. This was achieved by hierarchically rearranging the ICF items and constructing Guttman-type scales according to item difficulty using the Rasch model. In addition, each functional level might require similar resources and therefore enable standardization of care and rehabilitation. Illustrations facilitate the sharing of patient images among health care providers. By using the ICF as a common taxonomy, these scales could be used internationally as assessment scales in geriatric care settings. However these scales require further validity and reliability studies for international application.

Staging activity limitation and participation restriction in elderly community-dwelling persons according to difficulties in self-care and domestic life functioning

OBJECTIVE

This study aimed to describe the conceptual foundation and development of an activity limitation and participation restriction staging system for community-dwelling people 70 yrs or older according to the severity and types of self-care (activities of daily living [ADLs]) and domestic life (instrumental ADLs (IADLs)) limitations experienced.

DESIGN

Data from the second Longitudinal Study of Aging (N = 9447) were used to develop IADL stages through the analyses of self- and proxy-reported difficulties in performing IADLs. An analysis of activity limitation profiles identified hierarchical thresholds of difficulty that defined each stage. IADL stages are combined with ADL stages to profile status for independent living.

RESULTS

IADL stages define five ordered thresholds of increasing activity limitations and a ``not relevant'' stage for those who normally have someone else do those activities. Approximately 42% of the population experience IADL limitations. To achieve a stage, a person must meet or exceed stage-specific thresholds of retained functioning defined for each activity. Combined ADL and IADL stages define 29 patterns of activity limitations expressing the individual's potential for participating in life situations pertinent to self-care and independent community life.

CONCLUSIONS

ADL and IADL stages can serve to distinguish between groups of people according to both severity and the types of limitations experienced during home or outpatient assessments, in population surveillance, and in research.

Development of an ICF-based eligibility procedure for education in Switzerland

Starting in January 2011, Switzerland will implement a multidimensional, context-sensitive procedure to establish eligibility in education systems. This paper provides a brief overview of the different eligibility-related practices with a special focus on children with disabilities. The paper then outlines the philosophical and conceptual framework of the eligibility procedure based on the International Classification of Functioning, Disability and Health, and the UN Convention on the Rights of Persons with Disability. The different components and methodology applied to organise information in the process towards establishing eligibility are also presented. Finally, some observations are made regarding transparent and just applications of the eligibility procedure, and the implementation of this new eligibility procedure.

Situating primary health care within the international classification of functioning, disability and health: enabling the Canadian Family Health Team Initiative

Primary health care (PHC) mandates the provision of services delivered by a collaborative team of providers, ultimately to improve quality of care and health status. Considering the challenges related to interprofessional collaboration within novel PHC models, we explored how the World Health Organization's (WHO) International Classification of Functioning, Disability and Health (ICF) could facilitate the enactment of PHC teams. The Canadian Family Health Team (FHT) initiative is used as an example. This paper will explore how the ICF could inform the development of a practice model to enable PHC. Three potential barriers to the envisioned enactment of PHC within the espoused Canadian FHT initiative are identified through a critical gaps analysis; lack of (i) philosophical grounding, (ii) developmental and operational directives, and (iii) evaluation methods. An ICF-informed practice model is proposed to overcome these potential barriers. It is argued that the proposed ICF-informed practice model has international implications as a unifying conceptual framework ideally situated to facilitate the provision of comprehensive evidence-based person-centered care by interprofessional collaborative teams within diverse PHC models.

The biopsycho-ecological paradigm: a foundational theory for medicine

The current biomedical and psychosocial frameworks that form the conceptual basis of medicine today are insufficient to address the needs of the medically complex and environmentally challenged populations of patients often cared for by physical medicine and rehabilitation specialists. The expanded biopsycho-ecological model of health, illness, injury, and disability operating through mechanisms of Health Environmental Integration (HEI) encourages a more complete understanding of illness, injury, activity limitation, and participation restriction as arising at the interface between the person and the environment. HEI recognizes complex interacting multilevel functional hierarchies beginning at the cellular level and ending at the individual's experience of the environment. Although the foci of illness and injury are within the body and mind, the physical and social environments contain elements that can cause or exacerbate disease and barriers that interact in ways that lead to injuries and disabilities. Furthermore, these environments hold the elements from which treating agents, facilitators, and social supports must be fashioned. The highly integrative biopsycho-ecological framework provides an expanded basis for understanding the objective causes and subjective meanings of disabilities. Disabilities are reduced through HEI by seeking to maximally integrate the body and mind (the self) with both the surrounding physical environment and other people in society. HEI offers mechanisms for interdisciplinary research, an expanded framework for education and empowerment, and a blueprint for optimizing day-to-day clinical care at both the individual patient and treatment population levels in the ever-changing scientific, political, and policy environments.

Outcome measurement for COPD: reliability and validity of the Dyspnea Management Questionnaire

BACKGROUND

The Dyspnea Management Questionnaire (DMQ) is a measure of the psychosocial and behavioral responses to dyspnea for adults with COPD. The research objectives were to evaluate the reliability and validity of an expanded DMQ item pool, as a preliminary step for developing a computer adaptive test.

METHODS

The original 66 items of the DMQ were used for the analyses. The sample included 63 women and 44 men with COPD (n = 107) recruited from two urban medical centers. We used confirmatory factor analysis to test the factor structure of the DMQ and its underlying cognitive-behavioral theoretical base. The internal consistency and test-retest reliability, and breadth of coverage of the expanded DMQ item bank were also evaluated.

RESULTS

Five distinct dyspnea domains were confirmed using 56 original items of the DMQ: dyspnea intensity, dyspnea anxiety, activity avoidance, activity self-efficacy, and strategy satisfaction. Overall, the breadth of items was excellent with a good match between sample scores and item difficulty. The DMQ-56 showed good internal consistency reliability (α = 0.85-to 0.96) and good preliminary test-retest reliability over a 3-week interval (ICC = 0.69-0.92).

CONCLUSIONS

The DMQ demonstrated acceptable levels of reliability and validity for measuring multidimensional dyspnea outcomes after medical, psychological, and behavioral interventions for adults with COPD.

Creating an interface between the International Classification of Functioning, Disability and Health and physical therapist practice

The American Physical Therapy Association (APTA) has endorsed the International Classification of Functioning, Disability and Health (ICF) as a framework to be integrated into physical therapist practice. The ICF is a universal and inclusive platform for the understanding of health and disability and a comprehensive classification system for describing functioning. The APTA's Guide to Physical Therapist Practice was designed to guide patient management, given the different settings and health conditions that physical therapists encounter in their daily clinical practice. However, physical therapists may be unclear as to how to concretely apply the ICF in their clinical practice and to translate the application in a way that is meaningful to them and to their patients. This perspective article proposes ways to integrate the ICF and the Guide to Physical Therapist Practice to facilitate clinical documentation by physical therapists.

The use of the comprehensive International Classification of Functioning, Disability and Health Core Set for low back pain in clinical practice: a reliability study

BACKGROUND AND PURPOSE

The comprehensive International Classification of Functioning, Disability and Health (ICF) Core Set for low back pain (LBP) can be used to describe functioning and the influence of the environment of patients with LBP with a selection of 78 categories, from the ICF components 'body functions', 'body structures', 'activities and participation' and 'environmental factors'. The reliability of the qualifiers' scale of the ICF Core Set for LBP has not yet been studied.

METHODS

Reliability study was conducted in three study centres in the German-speaking part of Switzerland. In the first step, two physiotherapists independently assessed 31 patients with LBP with the original qualifier scale of the 78 ICF categories from the comprehensive ICF Core Set for LBP. After the first 31 patients, inter-rater reliability was assessed and the response options were reduced based on a Rasch analysis. The second sample (n = 30) was assessed by the physiotherapists with the modified qualifier scale and inter-rater reliability was calculated again.

RESULTS

The percentage agreement for the ICF categories ranged from 19% to 87%, mean 44% (nominal kappa from -0.73 to 0.54, median 0.22; weighted kappa -0.2 to 0.69, median 0.38) in the first round with the original qualifier scale. In the second round with the reduced response options, the percentage agreement ranged from 23% to 90%, mean 49% (nominal kappa from -0.15 to 0.71, median 0.24; weighted kappa -0.16 to 0.81, median 0.25). The overall percentage agreement was 44% in the first round and 49% with the reduced response categories. The overall kappa value in the first round was 0.29 and in the second round 0.32. There was a small but statistically significant improvement in the agreement.

CONCLUSION

The low-to-moderate reliability found in this study requires an improved operationalization (e.g. the definition and description of each response category) and improved instructions for the ICF Core Set for LBP.