Interrater Reliability and Clinical Utility of the Personal Care Participation Assessment and Resource Tool (PC–PART) in an Inpatient Rehabilitation Setting

Testing feasibility of relevant outcome measures in an inpatient setting to demonstrate the value of occupational therapy

INTRODUCTION

Measures of participation restrictions in daily life occupations are not typically used and may aid discharge planning and demonstrate the impact of occupational therapy services in inpatient settings. The overall aim of this mixed-methods study was to test the feasibility of relevant outcome measures by (1) investigating which of the three identified measures-the Home Support Needs Assessment, the Personal Care Participation Assessment and Resource Tool, and the Functional Autonomy Measurement System-best identifies meaningful changes in participation restrictions in daily life occupations required for community life; and (2) investigating the acceptability, usefulness, and feasibility of each measure to support inpatient practice.

METHODS

Occupational therapists (n = 3) completed the three measures with patient participants (n = 12) at admission and discharge. Each occupational therapist participated in a semi-structured interview. Outcome measure responses were summarised statistically. Qualitative data were analysed using reflexive thematic analysis.

FINDINGS

Total scores on all three measures changed significantly between admission and discharge (P < 0.002). Three themes reflected the occupational therapist participants' perceptions of the acceptability, usefulness, and feasibility of the outcome measures: 'Clinically and Professionally Meaningful Tools', 'Becoming Familiar', and 'Fostering My Daily Work'.

CONCLUSION

Each measure demonstrated a meaningful change. Selection and successful implementation of an outcome measure depends on its local acceptability to occupational therapists and organisational practices. All three measures are promising tools to address a measurement gap in occupational therapy practice. Future research could embed one measure into practice using knowledge translation methods, with a large-scale evaluation of the value of occupational therapy.

Personal Care Participation Assessment and Resource Tool: Clinical utility for inpatient rehabilitation

Background.

Evidence supports validity of the Personal Care Participation Assessment and Resource Tool (PC-PART), but clinical utility remains unverified.

Purpose.

This study aimed to investigate occupational therapists’ perceptions about the PC-PART’s clinical utility for inpatient rehabilitation.

Method.

Using mixed methods, occupational therapists who had used the PC-PART as part of a research study in an inpatient rehabilitation setting completed a questionnaire ( n = 9) and participated in a focus group ( n = 6) to explore their perspectives about its clinical utility. Quantitative data were summarized and qualitative data analyzed using inductive thematic analysis.

Findings.

Quantitative data highlighted both positive and negative aspects of the PC-PART’s clinical utility. Five themes emerged from the qualitative data: nature of information gathered; familiarity with the instrument; perceived time and effort; item phrasing, interpretation, and presentation; and external influences on clinical use.

Implications.

The PC-PART was perceived to support gathering of clinically useful information, helpful to intervention and discharge planning. Recommendations for improving some item phrasing, operational definitions, and instructions were identified. Although standardized assessments were valued, use in routine practice was challenging, requiring a knowledge translation strategy.

Measurement of activity limitations and participation restrictions: examination of ICF-linked content and scale properties of the FIM and PC-PART instruments

PURPOSE

To explore the operationalization of activity and participation-related measurement constructs through comparison of item phrasing, item response categories and scoring (scale properties) for two separate instruments targeting activities of daily living.

METHOD

Personal Care Participation Assessment and Resource Tool (PC-PART) item content was linked to ICF categories using established linking rules. Previously reported ICF-linked FIM content categories and ICF-linked PC-PART content categories were compared to identify common ICF categories between the instruments. Scale properties of both instruments were compared using a patient scenario to explore the instruments' separate measurement constructs.

RESULTS

The PC-PART and FIM shared 15 of the 53 level two ICF-linked categories identified across both instruments. Examination of the instruments' scale properties for items with overlapping ICF content, and exploration through a patient scenario, provided supportive evidence that the instruments measure different constructs.

CONCLUSIONS

While the PC-PART and FIM share common ICF-linked content, they measure separate constructs. Measurement construct was influenced by the instruments' scale properties. The FIM was observed to measure activity limitations and the PC-PART measured participation restrictions. Scrutiny of instruments' scale properties in addition to item content is critical in the operationalization of activity and participation-related measurement constructs. Implications for Rehabilitation When selecting outcome measures for use in rehabilitation it is necessary to examine both the content of the instruments' items and item phrasing, response categories and scoring, to clarify the construct being measured. Measurement of activity limitations as well as participation restrictions in activities of daily living required for community life provides a more comprehensive measurement of rehabilitation outcomes than measurement of either construct alone. To measure the effects of interventions used in rehabilitation, it is necessary to select measures with relevant content and scale properties that enable evaluation of change in the constructs that are expected to change, as a result of the rehabilitation intervention.

Responsiveness, construct and criterion validity of the Personal Care-Participation Assessment and Resource Tool (PC-PART)

BACKGROUND

The Personal Care-Participation Assessment and Resource Tool (PC-PART) was designed to measure participation restrictions in activities of daily living required for community life. Rasch analysis has confirmed that the PC-PART contains two unidimensional scales providing interval-level measurement: the Self Care and Domestic Life scales. This study investigated validity and responsiveness of these PC-PART scales using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) approach.

METHODS

Thirteen hypotheses about Self Care and Domestic Life scale scores were established prior to conducting the analyses. Data from a prospective randomized controlled trial of additional (weekend) inpatient rehabilitation in Melbourne, Australia, were used. The 996 participants had a mean (SD) age of 74 (13) years and were admitted with orthopaedic (n = 581), neurological (n = 203) or other disabling impairments (n = 212). Self Care and Domestic Life scores were compared to functional independence (FIM), comorbidity (Charlson Comorbidity Index), whether activities of daily living goals were met, and discharge destination.

RESULTS

Low to moderate correlations between FIM and PC-PART scales' scores supported hypotheses that the PC-PART measures a different construct from functional independence: Self Care r s -0.52(95 % CI -.46 to -.57) and Domestic Life r s -0.32(95 % CI -.25 to -.38). The scales had low to moderate discriminative ability for discharge destination, with the area under the curve for Self Care, 0.70 (95 % CI 0.62-0.78), and Domestic Life, 0.72 (95 % CI 0.64-0.80). The discharge to community living cut-off scores for Self Care: 5.50 (sensitivity .83, specificity .53) and Domestic Life: 7.50 (sensitivity .75, specificity .60), represented patients having no participation restrictions. Change scores from admission to discharge demonstrated larger effect sizes for the Self Care (1.67) and Domestic Life (1.50) scales than for the FIM (1.10), supporting hypotheses about responsiveness. Ten of the 13 hypotheses were supported.

CONCLUSIONS

This study provided evidence supporting construct validity, criterion validity and responsiveness of the PC-PART Self Care and Domestic Life scales for inpatient rehabilitation. Clinicians, managers and researchers who wish to measure the patterns and extent of people's participation restrictions in activities of daily living and the associated burden of care, before and/or after intervention, can be somewhat confident about the PC-PART's validity and responsiveness for this purpose.

TRIAL REGISTRATION

Data used in this research were gathered during a registered randomized controlled trial: Australian and New Zealand Clinical Trials Registry ACTRN12609000973213.

State of the journal, 2014

The outgoing editor-in-chief outlines the advances made during her 6-yr tenure and provides recommendations for AJOT’s future

Evaluation of the internal construct validity of the Personal Care Participation Assessment and Resource Tool (PC-PART) using Rasch analysis

Background

The Personal Care Participation Assessment and Resource Tool (PC-PART) is a 43-item, clinician-administered assessment, designed to identify patients’ unmet needs (participation restrictions) in activities of daily living (ADL) required for community life. This information is important for identifying problems that need addressing to enable, for example, discharge from inpatient settings to community living. The objective of this study was to evaluate internal construct validity of the PC-PART using Rasch methods.

Methods

Fit to the Rasch model was evaluated for 41 PC-PART items, assessing threshold ordering, overall model fit, individual item fit, person fit, internal consistency, Differential Item Functioning (DIF), targeting of items and dimensionality. Data used in this research were taken from admission data from a randomised controlled trial conducted at two publically funded inpatient rehabilitation units in Melbourne, Australia, with 996 participants (63% women; mean age 74 years) and with various impairment types.

Results

PC-PART items assessed as one scale, and original PC-PART domains evaluated as separate scales, demonstrated poor fit to the Rasch model. Adequate fit to the Rasch model was achieved in two newly formed PC-PART scales: Self-Care (16 items) and Domestic Life (14 items). Both scales were unidimensional, had acceptable internal consistency (PSI =0.85, 0.76, respectively) and well-targeted items.

Conclusions

Rasch analysis did not support conventional summation of all PC-PART item scores to create a total score. However, internal construct validity of the newly formed PC-PART scales, Self-Care and Domestic Life, was supported. Their Rasch-derived scores provided interval-level measurement enabling summation of scores to form a total score on each scale. These scales may assist clinicians, managers and researchers in rehabilitation settings to assess and measure changes in ADL participation restrictions relevant to community living.

Trial registration

Data used in this research were gathered during a registered randomised controlled trial: Australian and New Zealand Clinical Trials Registry ACTRN12609000973213. Ethics committee approval was gained for secondary analysis of data for this study.