A Web-Based Training Resource for Therapists to Deliver an Evidence-Based Exercise Program for Rheumatoid Arthritis of the Hand (iSARAH): Design, Development, and Usability Testing

An online training resource for clinicians to optimise exercise prescription for persistent low back pain: Design, development and usability testing

BACKGROUND

Low back pain (LBP) is the leading cause of disability worldwide. A recent realist review identified the behavioural mechanisms of trust, motivation, and confidence as key to optimising exercise prescription for persistent LBP.

OBJECTIVES

Our objectives were to (1) design and develop an online training programme, and (2) gain end-user feedback on the useability, usefulness, informativeness and confidence in using the online training programme using a mixed-methods, pre-post study design.

PARTICIPANTS AND INTERVENTION

The online training programme was designed and developed using the results from a realist review, and input from a multi-disciplinary stakeholder group. A five-module online training programme was piloted by the first 10 respondents who provided feedback on the course. Further modifications were made prior to additional piloting. The satisfaction, usefulness, ease of use, and confidence of clinicians in applying the learned principles were assessed on completion.

RESULTS

The online programme was advertised to clinicians using social media. Forty-four respondents expressed initial interest, of which 22 enrolled and 18 completed the course. Of the participants, most were physiotherapists (n = 16/18, 88.9%), aged between 30 and 49 (n = 11/18, 61.1%). All participants were satisfied with the course content, rated the course platform as easy to use and useful, and reported that they were very confident to apply the learning. Most (n = 10/14, 71.4%) reported that their manner of prescribing exercise had changed after completion of the course.

CONCLUSIONS

An online training programme to optimise exercise prescription for persistent LBP appears to be easy to use, informative and improves confidence to apply the learning.

Brazilian Portuguese version and content validity of the Strengthening and Stretching for Rheumatoid Arthritis of the Hand (SARAH)

INTRODUCTION

The Strengthening and Stretching for Rheumatoid Arthritis of the Hand (SARAH) program is a personalized, progressive 12-week exercise program for people with hand problems due to rheumatoid arthritis (RA). Patients are provided with two guidance documents, the 'Patient Exercise Booklet' and the 'Personal Exercise Guide', to continue the exercises independently at home.

OBJECTIVE

This study aimed to translate and culturally adapt the SARAH protocol into Brazilian Portuguese and validate its content.

METHODS

The guidance documents 'Patient Exercise Booklet' and 'Personal Exercise Guide' of the SARAH program were translated and culturally adapted to Brazilian Portuguese. The content validity was obtained by calculating the content validity index (CVI).

RESULTS

The Brazilian version of the SARAH protocol reached semantic, idiomatic, conceptual, and cultural equivalences. The CVI was greater than 0.8, corresponding to a satisfactory index. The verbal comprehension was 4.9, showing good verbal comprehension of the target population.

CONCLUSION

The Brazilian Portuguese version of the SARAH protocol is available to Brazilian people with compromised hands due to RA with satisfactory content validity.

Adapting the Eliminating Medications Through Patient Ownership of End Results Protocol to Promote Benzodiazepine Cessation Among US Military Veterans: Focus Group Study With US Military Veterans and National Veterans Health Administration Leaders

Background

Long-term dependence on prescribed benzodiazepines is a public health problem. Eliminating Medications Through Patient Ownership of End Results (EMPOWER) is a promising self-management intervention, delivered directly to patients as a printed booklet, that is effective in promoting benzodiazepine reduction and cessation in older adults. EMPOWER has high potential to benefit large health care systems such as the US Veterans Health Administration (VHA), which cares for many veterans who use benzodiazepines for extended periods.

Objective

We aimed to adapt the original EMPOWER booklet materials for electronic delivery and for use among US military veterans receiving VHA care who were long-term benzodiazepine users.

Methods

We used elements of Analysis, Design, Development, Implementation, and Evaluation, a framework commonly used in the field of instructional design, to guide a qualitative approach to iteratively adapting EMPOWER Electronic Delivery (EMPOWER-ED). We conducted 3 waves of focus groups with the same 2 groups of VHA stakeholders. Stakeholders were VHA-enrolled veterans (n=16) with medical chart evidence of long-term benzodiazepine use and national VHA leaders (n=7) with expertise in setting VHA policy for prescription benzodiazepine use and developing electronically delivered educational tools for veterans. Qualitative data collected from each wave of focus groups were analyzed using template analysis.

Results

Themes that emerged from the initial focus groups included veterans’ anxiety about self-tapering from benzodiazepines and prior negative experiences attempting to self-taper without support. Participants also provided feedback on the protocol’s look and feel, educational content, the tapering protocol, and website functionality; for example, feedback from policy leaders included listing, on the cover page, the most commonly prescribed benzodiazepines to ensure that veterans were aware of medications that qualify for self-taper using the EMPOWER-ED protocol. Both groups of stakeholders identified the importance of having access to supportive resources to help veterans manage sleep and anxiety in the absence of taking benzodiazepines. Both groups also emphasized the importance of ensuring that the self-taper could be personalized and that the taper instructions were clear. The policy leaders emphasized the importance of encouraging veterans to notify their provider of their decision to self-taper to help facilitate provider assistance, if needed, with the taper process and to help prevent medication stockpiling.

Conclusions

EMPOWER-ED is the first direct-to-patient electronically delivered protocol designed to help US military veterans self-taper from long-term benzodiazepine use. We used the Analysis, Design, Development, Implementation, and Evaluation framework to guide the successful adaption of the original EMPOWER booklet for use with this population and for electronic delivery. The next step in this line of research is to evaluate EMPOWER-ED in a randomized controlled trial.

The online version of an evidence-based hand exercise program for people with rheumatoid arthritis: A mixed-method, proof-of-concept study

INTRODUCTION

The Strengthening And stretching for Rheumatoid Arthritis of the Hand (SARAH) program is a tailored, 12-week hand and arm exercise program recommended in the National Institute for Health and Care Excellence guidelines. It includes seven mobility exercises and four strength exercises against resistance. An online version of the SARAH program (mySARAH) has been developed to allow direct access for people with rheumatoid arthritis.

PURPOSE

The purpose of this study was to assess the feasibility, acceptability, and clinical impact of mySARAH in people with rheumatoid arthritis.

STUDY DESIGN

This is a mixed-method, proof-of-concept study.

METHODS

mySARAH is a self-guided, online version of the SARAH program with six exercise training and review sessions. Participants were observed as they worked through four of the six online sessions. They were also asked to demonstrate the SARAH exercises. Participants undertook two sessions independently at home. At the baseline and 12 weeks, hand pain, hand function, and grip strength were measured. At 12 weeks, feedback on mySARAH, and perceived recovery were also collected. Approximately one month later, a telephone follow-up was conducted to explore participants' experiences with mySARAH. Pain, hand function, and perceived recovery were also assessed.

RESULTS

Eleven participants (males/females: 3/8) with a median (interquartile range) age of 63 (17) years took part. Six participants completed all mySARAH sessions. About 512 exercise and load-setting demonstrations were observed and 491 (96%) were performed correctly. Improvements in grip strength and hand function were observed with no increase in pain. Most of the participants reported improvement and provided positive feedback. All participants perceived mySARAH as a useful resource. Features to improve the online exercise diary such as recording and tracking exercise dose and face-to-face or remote support by phone or Skype from health professionals were suggested to optimize user engagement.

CONCLUSIONS

Initial evaluation of mySARAH indicates that mySARAH was feasible, acceptable, and beneficial to participants. Further iteration and evaluation are needed before large-scale implementation.

Functional standing frame programme early after severe sub-acute stroke (SPIRES): a randomised controlled feasibility trial

BACKGROUND

Early mobilisation (> 24 h post-stroke) is recommended for people with stroke. However, there is a paucity of evidence about how to implement early mobilisation for people who have had a severe stroke. Prolonged standing and task-specific training (sit-to-stand repetitions) have separately been evaluated in the literature; however, these functionally linked tasks have not been evaluated in combination for people with severe sub-acute stroke.

METHODS

The objective was to determine the feasibility of conducting a randomised controlled trial (RCT) of a functional standing frame programme compared with usual physiotherapy for people with severe sub-acute stroke. An assessor-blinded feasibility RCT with nested qualitative component (interviews and focus group) and process evaluation was adopted. Participants were aged ≥ 18 years with new diagnosis of severe sub-acute stroke (modified Rankin Scale (mRS) 4/5) from four Stroke Rehabilitation Units across South West England. Participants were randomised to receive either: (1) functional standing frame programme (30 min. standing plus sit-to-stand repetitions) plus 15 min of usual physiotherapy daily (intervention); (2) usual physiotherapy (45 min) daily (control). Both programmes were protocolised to be undertaken a minimum of five sessions per week for 3 weeks. Feasibility indicators included process, resource, management, and safety. Adherence, fidelity, and acceptability of the trial and intervention were evaluated using data recorded by therapists, observation of intervention and control sessions, interviews and one focus group. Patient measures of motor impairment, activities/participation, and quality of life were carried out by blinded assessors at baseline, 3, 15, 29, and 55 weeks post-randomisation.

RESULTS

Forty-five participants (51-96 years; 42% male, mRS 4 = 80% 5 = 20%) were randomised (n = 22 to intervention). Twenty-seven (60%) participants were followed-up at all time points. Twelve participants (27%) died during the trial; no deaths were related to the trial. Adherence to the minimum number of sessions was low: none of the participants completed all 21 sessions, and only 8 participants (18%) across both groups completed ≥ 15 sessions, over the 3 weeks; 39% intervention; 51% control sessions were completed; mean session duration 39 min (SD 19) control, 37 min intervention (SD 11). Intervention group: mean standing time 13 min (SD 9); mean sit-to-stand repetitions/session 5 (SD 4). Interviews were conducted with 10 participants, four relatives and six physiotherapists. Five physiotherapists attended a focus group.

CONCLUSIONS

The majority of progression criteria for this feasibility trial were met. However, adherence to the interventions was unacceptably low. This aspect of the trial design needs to be addressed prior to moving to a definitive RCT of this standing frame intervention in people with severe sub-acute stroke. Solutions have been identified to address these concerns.

TRIAL REGISTRATION

International Standard Randomised Controlled Trial Number ISRCTN15412695 . Registration 19 December 2016.

Examining user perspective of an online learning resource for physiotherapists: A mixed methods study of the TRAIN program

BACKGROUND

Implementing task specific training is a commonly reported challenge for less experienced therapists. A potential method to improve the ability of recent graduate and student therapists is to upskill regarding task specific training via an online education resource.

PURPOSE

To evaluate the use and acceptability of the TRAIN program as an online learning resource for physiotherapists.

METHODS

Data from Google Analytics was sourced to determine use of the program and details about the users. Users of the TRAIN program were also invited to complete two surveys; prior to beginning and upon completion of the program. The surveys collected information about the demographics of the users, perceptions of usefulness of the online resource and overall sentiment.

RESULTS

Almost 6000 new users interacted with the TRAIN modules during the 15-months study period. The surveys indicated a high level of usability (mean score 9/10, SD 1.5) and clinical utility (mean score 8.8/10, SD 1.6) of the TRAIN program. Perceived knowledge and user confidence in implementing task-specific training was higher for those users completing the post compared to those completing the pre-module survey (knowledge 1.9 and confidence 1.7 out of 10 points higher). Recurring comments in the open-ended feedback pertained to the usefulness, clarity, and ease of use of the TRAIN program.

DISCUSSION AND CONCLUSION

This study provides preliminary evidence supporting the use and acceptability of the TRAIN program as an online learning resource for physiotherapists. This further contributes to the growing body of literature indicating online learning is generally a well-received teaching tool for physiotherapists.

Advancing the management of upper extremity musculoskeletal conditions: Insights from the field of implementation science

INTRODUCTION

The development of effective interventions in hand and upper extremity rehabilitation is critically important; yet even the most promising interventions may not successfully be implemented in practice. Occupational and physical therapists who provide specialized hand and upper extremity rehabilitation services ("hand therapists") can face extensive, multi-level barriers when attempting to use research findings in real-world settings, widening the long-standing research-to-practice gap. Concepts from the field of implementation science can be leveraged to address this gap and expedite the application of research discoveries that can maximize treatment outcomes of the musculoskeletal upper extremity client. As the intersection of hand and upper extremity rehabilitation and implementation science draws growing attention, there is a great need for researchers and clinicians to infuse implementation science into the hand and upper extremity rehabilitation research and practice contexts.

PURPOSE

The purpose of this article is to define implementation science and synthesize several studies from the hand and upper extremity rehabilitation field that have examined the effect of implementation strategies (eg, chart audit and feedback techniques; implementation teams) on implementation outcomes (eg, acceptability, fidelity). We also present recommendations for how (1) hand and upper extremity rehabilitation researchers can design studies to examine both patient outcomes and implementation outcomes relative to interventions for the musculoskeletal upper extremity and (2) hand and upper extremity rehabilitation specialists and administrators can develop implementation teams to facilitate the use of evidence in practice.

CONCLUSION

Collaboration between researchers and clinicians has great potential to advance the entirety of the hand and upper extremity rehabilitation profession, especially when such collaborations are guided by the implementation science field.

Translating the Strengthening and Stretching for Rheumatoid Arthritis of the Hand Programme from clinical trial to clinical practice: An effectiveness–implementation study

Introduction

The Strengthening and Stretching for Rheumatoid Arthritis of the Hand programme is a hand exercise programme for people with rheumatoid arthritis. It was clinically effective when delivered during a clinical trial but there was a need to evaluate translation into routine care.

Methods

We conducted an effectiveness–implementation study. We adapted the trial training into an online format for National Health Service hand therapists. Educational outcomes included confidence and capability to deliver the programme. Implementation outcomes included training reach and adoption. Therapists were invited to collect clinical outcomes. Patients receiving the programme provided data on function (Michigan Hand Questionnaire function scale), pain and grip strength at baseline, treatment discharge and four-month follow-up.

Results

A total of 790 therapists (188 National Health Service organizations) enrolled in the training; 584/790 (74%) therapists (162 National Health Service organizations) completed the training; 448/790 therapists (145 National Health Service organizations) (57%) evaluated the training and were confident (447/448, 99.8%) and capable (443/448, 99%) to deliver the programme with 85% intending to adopt it (379/448). Follow-up data were provided by 116/448 (26%) therapists. Two-thirds (77/116; 51 National Health Service organizations) reported adopting the programme. One hundred and eighteen patients (15 National Health Service trusts) participated. Patients reported improved function (mean change Michigan Hand Questionnaire scores: 10 (95% CI 6.5–13.6) treatment discharge; 7 (95% CI 3.8–10.2) 4-month follow-up). Grip strength increased 24.5% (left) and 31% (right). Pain was stable.

Discussion

Online training was an effective way to train therapists with good reach. Clinical outcomes were similar to the clinical trial providing preliminary evidence of successful translation into routine care.

Development and Usability Testing of a Web-Based and Therapist-Assisted Coping Skills Program for Managing Psychosocial Problems in Individuals With Hand and Upper Limb Injuries: Mixed Methods Study

Background

Ineffective coping has been linked to prolonged pain, distress, anxiety, and depression after a hand and upper limb injury. Evidence shows that interventions based on cognitive behavioral therapy (CBT) may be effective in improving treatment outcomes, but traditional psychological interventions are resource intensive and unrealistic in busy hand therapy practices. Developing web-based, evidence-based psychological interventions specifically for hand therapy may be feasible in clinical practice and at home with reduced training and travel costs. Hand Therapy Online Coping Skills (HOCOS) is a program developed to supplement traditional hand therapy with therapist-assisted coping skills training based on principles from CBT and the Technology Acceptance Model.

Objective

This study aimed to describe the development and assess the usability of HOCOS to support hand therapists in the management of psychosocial problems.

Methods

The ADDIE model (Analysis, Design, Development, Implementation, and Evaluation) of system design was applied to create HOCOS. The usability testing of HOCOS involved a 2-stage process. In the first step, heuristic testing with information and communications technology (ICT) experts was completed using two sets of heuristics: Monkman heuristics and the Health Literacy Online (HLO) checklist. The second step involved user testing with hand therapists performing a series of online and face-to-face activities, completing 12 tasks on the website using the think-aloud protocol, completing the system usability scale (SUS) questionnaire, and a semistructured feedback interview in 2 iterative cycles. Descriptive statistics and content analyses were used to organize the data.

Results

In total, 4 ICT experts and 12 therapists completed usability testing. The heuristic evaluation revealed 15 of 35 violations on the HLO checklist and 5 of 11 violations on the Monkman heuristics. Initially, hand therapists found 5 tasks to be difficult but were able to complete all 12 tasks after the second cycle of testing. The cognitive interview findings were organized into 6 themes: task performance, navigation, design esthetics, content, functionality and features, and desire for future use. Usability issues identified were addressed in two iterative cycles. There was good agreement on all items of the SUS. Overall, therapists found that HOCOS was a detailed and helpful learning resource for therapists and patients.

Conclusions

We describe the development and usability testing of HOCOS; a new web-based psychosocial intervention for individuals with a hand and upper limb injuries. HOCOS targets psychosocial problems linked to prolonged pain and disability by increasing access to therapist-guided coping skills training. We actively involved target users in the development and usability evaluation of the website. The final website was modified to meet the needs and preferences of the participants.

An Interactive Website for Whiplash Management (My Whiplash Navigator): Process Evaluation of Design and Implementation

Background

Whiplash is a health and economic burden worldwide. Contributing to this burden is poor guideline adherence and variable management by health care professionals (HCPs). Web-based tools that facilitate clinical pathways of care are an innovative solution to improve management.

Objective

The study aimed to develop, implement, and evaluate a Web-based tool to support whiplash management following a robust process.

Methods

This study followed the first 3 processes of a research translation framework (idea generation, feasibility, and efficacy) to inform the development, implementation, and evaluation of a website that supports HCPs in whiplash management. Development followed the idea generation and feasibility processes to inform the content, design, features, and functionality of the website. This involved stakeholder (eg, industry partners, website developers, and HCPs) consultations through face-to-face meetings, surveys, and focus group discussions. Implementation followed the feasibility process to determine the practicality of the website for clinical use and the most effective strategy to promote wider uptake. Implementation strategies included classroom education, educational meetings, educational outreach, reminders, and direct phone contact. The analysis of website use and practicality of implementation involved collection of website metrics. Evaluation followed the feasibility and efficacy processes to investigate the acceptability and extent to which the website assisted HCPs in gaining knowledge about whiplash management. Surveys were conducted among student, primary, and specialist HCPs to explore ease of access, use, and satisfaction with the website, as well as self-rated improvements in knowledge of risk assessment, management, and communication between HCPs. Website logs of specialist management decisions (eg, shared care, specialist care, and referred care) were also obtained to determine actual practice.

Results

The development process delivered an interactive, user-friendly, and acceptable website, My Whiplash Navigator, tailored to the needs of HCPs. A total of 260 registrations were recorded from June 2016 to March 2018, including 175 student, 65 primary, and 20 specialist HCPs. The most effective implementation strategies were classroom education for students (81% uptake, 175/215) and educational meetings for primary HCPs (43% uptake, 47/110). Popular pages visited included advice and exercises and risk assessment. Most HCPs agreed that their knowledge about risk management (79/97, 81%) and exercises (85/97, 88%) improved. The specialists’ most common management decision was shared care, an improvement from a previous cohort. Areas to improve were navigation and access to outcome measures.

Conclusions

A robust process resulted in an innovative, interactive, user-friendly, and acceptable website, the My Whiplash Navigator. Implementation with HCPs was best achieved through classroom education and educational meetings. Evaluation of the website showed improved knowledge and practice to be more consistent with a risk-based clinical care pathway for whiplash. The positive results provide sufficient evidence to scale implementation nationally and involve other target markets such as people with whiplash, insurers, and insurance regulators.

An Online Hand Exercise Intervention for Adults With Rheumatoid Arthritis (mySARAH): Design, Development, and Usability Testing

BACKGROUND

The Strengthening and Stretching for Rheumatoid Arthritis of the Hand (SARAH) program is a tailored, progressive 12-week exercise program for people with hand problems due to rheumatoid arthritis. The program was shown to be clinically and cost-effective in a large clinical trial and is recommended by the UK National Institute for Health and Care Excellence (NICE) guidelines for rheumatoid arthritis in adults.

OBJECTIVE

We have developed an online version of the SARAH program (mySARAH) to make the SARAH program widely accessible to people with rheumatoid arthritis. The purposes of this study were to develop mySARAH and to evaluate and address its usability issues.

METHODS

We developed mySARAH using a three-step process and gaining feedback from patient contributors. After initial development, mySARAH was tested in two iterative usability cycles in nine participants using a simplified think-aloud protocol and self-reported questionnaires. We also evaluated if participants executed the SARAH exercises correctly after watching the exercise videos included on the website.

RESULTS

A preliminary version of mySARAH consisting of six sessions over a 12-week period and delivered via text, exercise videos, images, exercise plan form, exercise calendar, and links to additional information on rheumatoid arthritis was developed. Five participants (1 male; 4 females; median age 64 years) and four participants (four females; median age 64.5 years) took part in the first and second usability testing cycles respectively. Usability issues identified from Cycle 1 such as having a navigation tutorial video and individualised feedback on pain levels were addressed prior to Cycle 2. The need for more instructions to complete the mySARAH patient forms was identified in Cycle 2 and was rectified. Self-reports from both cycles indicated that participants found the program useful and easy to use and were confident in performing the SARAH exercises themselves. Eight of the nine participants correctly demonstrated all the exercises.

CONCLUSIONS

mySARAH is the first online hand exercise intervention for people with rheumatoid arthritis. We actively involved target users in the development and usability evaluation and ensured mySARAH met their needs and preferences.