Reliability of the Australian Therapy Outcome Measures for Occupational Therapy (AusTOMs-OT)

An Evaluation of the Overall Utility of Measures of Functioning Suitable for School-Aged Children on the Autism Spectrum: A Scoping Review

A diagnosis of an autism spectrum condition (autism) provides limited information regarding an individual's level of functioning, information key in determining support and funding needs. Using the framework introduced by Arksey and O'Malley, this scoping review aimed to identify measures of functioning suitable for school-aged children on the autism spectrum and evaluate their overall utility, including content validity against the International Classification of Functioning, Disability and Health (ICF) and the ICF Core Sets for Autism. The overall utility of the 13 included tools was determined using the Outcome Measures Rating Form (OMRF), with the Adaptive Behavior Assessment System (ABAS-3) receiving the highest overall utility rating. Content validity of the tools in relation to the ICF and ICF Core Sets for Autism varied, with few assessment tools including any items linking to Environmental Factors of the ICF. The ABAS-3 had the greatest total number of codes linking to the Comprehensive ICF Core Set for Autism while the Vineland Adaptive Behavior Scales (Vineland-3) had the greatest number of unique codes linking to both the Comprehensive ICF Core Set for Autism and the Brief ICF Core Set for Autism (6-16 years). Measuring functioning of school-aged children on the spectrum can be challenging, however, it is important to accurately capture their abilities to ensure equitable and individualised access to funding and supports.

Use of the AusTOMs-OT to record outcomes in an occupational therapy homeless service

Introduction

Occupational therapists provide services to homeless people internationally, yet relatively little research evidence underpins this practice. This study aimed to describe the process of selecting an outcome measure for use in a homeless occupational therapy service and demonstrate the changes experienced in the occupational performance of individuals participating in this service.

Method

The Glasgow homeless occupational therapy service staff reviewed eight outcome measures against six pre-determined criteria. The selected tool was then used to collect data pre and post an occupational therapy intervention with 58 participants. Data were analysed using descriptive statistics and Wilcoxon Signed Ranks Test to determine statistically significant change from admission to discharge in the different domains of the selected outcome measure.

Results

The AusTOMs-OT was implemented in daily practice and 70% of participants were discharged following achievement of therapy goals. Clients made clinically and statistically significant improvements over their admission as measured on AusTOMs-OT in areas such as Transfers, Self-Care and Domestic Life-Home, across the health domains of activity, participation and wellbeing.

Conclusion

AusTOMs-OT was successfully implemented and demonstrated that participants improved over their time with the service. This evidence can be used to support the effectiveness of occupational therapy services with people experiencing homelessness.

Validity and reliability of the Australian Therapy Outcome Measures - Physiotherapy, for podiatry (AusTOMs-PT for use in podiatry)

Background

Valid and reliable outcome measure enable measurement of health care service impact. There are limited valid and reliable outcome measures for use in podiatry practice to measure the impact of treatment. This research aimed to test the face validity of the AusTOMs for Physiotherapy (AusTOMs-PT), it’s adaptability to podiatry clinical practice and the reliability of its use with podiatrists.

Methods

Stage 1 used a nominal group technique with podiatrists who worked in public and/or private settings. All podiatrists underwent self-directed training in the AusTOMs framework and measures prior to interviews or focus group discussion. Discussion was centred about transferability of the core scales of the AusTOMs-PT and an adjunct measure, AusTOMs for Occupational Therapy (AusTOMs-OT) to podiatry practice.

Stage 2 used 10 case studies representative of people who had foot or ankle concerns. Podiatrists were recruited and trained in the use of the relevant AusTOMs-PT scales. Podiatrists individually scored the cases at two timepoints (1 month apart) using the six scales from the AusTOMs-PT deemed by stage 1 as relevant to podiatry. Intra and inter-rater reliability of scales were determined using intraclass correlation coefficients (ICCs).

Results

Thirteen podiatrists participated in individual or focus group interviews in Stage 1. Consensus was gained on six of the nine core scales adopted from the AusTOMs-PT. These were 1. Balance and Postural Control, 3. Musculoskeletal Movement Related Functions, 4. Neurological Movement Related Functions, 5. Pain, 7. Sensory Functions, 8. Skin Functions. Each core scale rated the functional domains of Impairment, Activity Limitation, Participation Restriction and Wellbeing/Distress relating to that presentation of goals of the person in the case study.

There were 22 podiatrists complete training and scored two rounds of case studies using the six scales in Stage 2. There were 91%(n = 20) participants with an intra-rater ICC > 0.5 (moderate or greater). Each domain had an inter-rater reliability of > 0.9 (excellent) during the first round.

Conclusions

The AusTOMs-PT for use in podiatry may be implemented to record change in impairment, function, participation and wellbeing of people receiving podiatry treatment. Podiatry specific training and mentoring, together with repeated use could be expected to improve intra-reliability.

Overview of reviews of standardised occupation-based instruments for use in occupational therapy practice

INTRODUCTION

Using standardised instruments is one approach to support evidence-based practice. Referring to systematic reviews is an option to identify suitable instruments. However, with an abundance of systematic reviews available, therapists are challenged to identify an appropriate instrument to use. Therefore, this overview of reviews aimed to summarise relevant systematic review findings about standardised occupation-based instruments relevant for occupational therapy practice.

METHODS

An overview of reviews was conducted. A systematic search was performed on four databases up to March 2018. Included systematic reviews were analysed for quality using A MeaSurement Tool to Assess systematic Reviews (AMSTAR).

RESULTS

A total of 2187 articles were identified after removing duplicates. Ultimately, 58 systematic reviews were identified that yielded 641 instruments. From those, 45 instruments were selected for appraisal as they met the inclusion criteria of being developed mainly by occupational therapists and were recommended in the summarised findings from the systematic reviews. The instruments were classified according to the following occupation domains: (i) multidimensional, (ii) activities of daily living, (iii) productivity, (iv) social, (v) sleep/rest, (vi) sexuality and (vii) spirituality. No systematic review was identified that specifically focussed on occupations related to school/education, leisure and play.

DISCUSSION

Certain occupation domains such as activities of daily living, social and sleep/rest received high attention amongst researchers. There is a need for systematic reviews of instruments to measure education/school, play and leisure. Limited numbers of instruments were developed by occupational therapists outside the occupation domain of activities of daily living, and in areas of practice other than children and older people. Nevertheless, this overview can give some guidance for occupational therapists in selecting a suitable occupational therapy instrument for practice.