Defining the effect and mediators of two knowledge translation strategies designed to alter knowledge, intent and clinical utilization of rehabilitation outcome measures: a study protocol [NCT00298727]

The impact of standardized balance measurement on physical therapist decision-making in acquired brain injury: a survey

BACKGROUND

The use of balance outcome measures (OM) is proposed to enhance physical therapy services and patient outcomes.

OBJECTIVE

Explore current practices of balance OM use and OM's role in United States physical therapists' decision-making with patient's acquired brain injury (ABI).

METHODS

Cross-sectional survey utilizing snowball sampling, n = 373. Survey items required ranking agreement with statements on Likert scale. Multinomial logistic regression used to determine the relationship between survey answers and participant characteristics.

RESULTS

Ninety-three percent of therapists reported using outcome measures with patients with ABI. Those who reported not using outcome measures with patients with ABI were significantly different on setting, primary patient population, APTA section membership, and ANPT membership. All respondents who primarily treated neurologic diagnoses used outcome measure with clients with ABI, compared to 87% of respondents who worked primarily with orthopedic clients. Comfort, equipment availability, and psychometric properties were the most frequent reasons for choosing a measure. Therapist decision-making was impacted by outcome measures; this frequency was dependent on practice setting, primary patient population, and specialty certifications.

CONCLUSIONS

Physical therapists use a low diversity of outcome measures to assess balance. Respondents rated psychometric properties as more important than past published research. This is the first study to demonstrate that outcome measures play a role for most United States PTs in decision-making in all stages of the patient management model including identification of problems, diagnosis, prognosis, intervention selection, termination of services, and discharge planning, as well justifying service delivery.

Evaluation of a community of practice for speech-language pathologists in aphasia rehabilitation: a logic analysis

BACKGROUND

Aphasia is a communication disorder affecting participation. Although there are evidence-based practice recommendations about participation and aphasia rehabilitation, it may be challenging for speech-language pathologists to ensure that rehabilitation activities have an impact on the person's participation, in part due to time limitations. Participation remains limited after rehabilitation for persons who have aphasia. Communities of practice (CoPs) are a collaborative knowledge transfer strategy that can be used for evidence-based practice implementation. The aim of this study was to describe the components and evaluate a CoP for speech-language pathologists about participation and aphasia rehabilitation.

METHODS

Logic analysis was used to determine the adequacy between resources, implemented activities, outputs and short-term outcomes of the CoP. Qualitative and quantitative descriptive data were collected through observation and participants' logbooks. Outputs and outcomes of the CoP were revealed through thematic analysis and interpretation of descriptive statistics.

RESULTS

Resources including CoP design and educational aims, human and material resources were combined to create various web-based, online and offline activities. Participants invested more time per week than expected in the CoP, shared and created clinical tools and appreciated the array of suggested activities. Participant engagement allowed them to reflect, interact and collaborate with each other. All 13 participants reported they acquired knowledge about clinical tools and 12 mentioned they reflected on their practice. While the CoP was ongoing, six participants noticed evidence-practice gaps, seven prepared to change their practice, and three changed their practice towards including more participation-based considerations.

CONCLUSIONS

This study showed that speech-language pathologists can include more participation-based approaches in aphasia rehabilitation as a result of participating in a time-bound, web-based CoP.

Promoting Therapists' Use of Motor Learning Strategies within Virtual Reality-Based Stroke Rehabilitation

PURPOSE

Therapists use motor learning strategies (MLSs) to structure practice conditions within stroke rehabilitation. Virtual reality (VR)-based rehabilitation is an MLS-oriented stroke intervention, yet little support exists to assist therapists in integrating MLSs with VR system use.

METHOD

A pre-post design evaluated a knowledge translation (KT) intervention incorporating interactive e-learning and practice, in which 11 therapists learned how to integrate MLSs within VR-based therapy. Self-report and observer-rated outcome measures evaluated therapists' confidence, clinical reasoning and behaviour with respect to MLS use. A focus group captured therapists' perspectives on MLS use during VR-based therapy provision.

RESULTS

The intervention improved self-reported confidence about MLS use as measured by confidence ratings (p <0.001). Chart-Stimulated Recall indicated a moderate level of competency in therapists' clinical reasoning about MLSs following the intervention, with no changes following additional opportunities to use VR (p = .944). On the Motor Learning Strategy Rating Instrument, no behaviour change with respect to MLS use was noted (p = 0.092). Therapists favoured the strategy of transferring skills from VR to real-life tasks over employing a more comprehensive MLS approach.

CONCLUSION

The KT intervention improved therapists' confidence but did not have an effect on clinical reasoning or behaviour with regard to MLS use during VR-based therapy.

Measuring evidence-based practice knowledge and skills in occupational therapy--a brief instrument

BACKGROUND

Valid and reliable instruments are required to measure the effect of educational interventions to improve evidence-based practice (EBP) knowledge and skills in occupational therapy. The aims of this paper are to: 1) describe amendments to the Adapted Fresno Test of Competence in EBP (AFT), and 2) report the psychometric properties of the modified instrument when used with South African occupational therapists.

METHODS

The clinical utility of the AFT was evaluated for use with South African occupational therapists and modifications made. The modified AFT was used in two studies to assess its reliability and validity. In Study 1 a convenience sample of 26 occupational therapists in private practice or government-funded health facilities in a South African province were recruited to complete the modified AFT on two occasions 1 week apart. Completed questionnaires were scored independently by two raters. Inter-rater, test-retest reliability and internal consistency were determined. Study 2 was a pragmatic randomised controlled trial involving occupational therapists in four Western Cape Department of Health district municipalities (n = 58). Therapists were randomised in matched pairs to one of two educational interventions (interactive or didactic), and completed the modified AFT at baseline and 12 weeks after the intervention. An intention-to-treat analysis was performed. Data were not normally distributed, thus non-parametric statistics were used.

RESULTS

In Study 1, 21 of 26 participants completed the questionnaire twice. Test-retest (ICC = 0.95, 95 % CI = 0.88-0.98) and inter-rater reliability (Time 1: ICC = 0.995, 95 % CI = 0.99-0.998; Time 2: ICC = 0.99, 95 % CI = 0.97-0.995) were excellent for total scores. Internal consistency based on time 1 scores was satisfactory (α = 0.70). In Study 2, 28 participants received an interactive educational intervention and completed the modified AFT at baseline and 12 weeks later. Median total SAFT scores increased significantly from baseline to 12-weeks (Z = -4.078, p < 0.001) with a moderate effect size (r = 0.55).

CONCLUSION

The modified AFT has demonstrated validity for detecting differences in EBP knowledge between two groups. It also has excellent test-retest and inter-rater reliability. The instrument is recommended for contexts where EBP is an emerging approach and time is at a premium.

TRIAL REGISTRATION

Pan African Controlled Trials Register PACTR201201000346141 . Registered 31 January 2012. Clinical Trials NCT01512823 . Registered 1 February 2012. South African National Clinical Trial Register DOH2710093067 . Registered 27 October 2009.

Development and feasibility of an automated call monitoring intervention for older wheelchair users: the MOvIT project

Background

Recent advances in wheeled mobility technology are multiplying opportunities for community integration and improved quality of life. The mobility needs of older wheelchair users are particularly complex due to a constellation of chronic conditions and comorbidities that may compromise optimal use of the device. The purpose of the Mobility Outcomes via Information Technologies (MOvIT) project is to examine the feasibility of automated calls for the systematic monitoring for adverse outcomes associated with wheelchair use.

Methods

A two-phase mixed methods approach was used. Phase I involved user-centered development and face validation of a monitoring questionnaire with end-users (seven wheelchair users and five healthcare providers). Phase II tested the feasibility of monitoring outcomes using automated calls to administer the MOvIT questionnaire 1 and 3 months after wheelchair delivery with a prospective cohort of older adults (50–84 years of age). When problems were identified, the computer monitoring system notified a clinical coordinator who followed up with respondents requiring interventions. Feasibility data were extracted from the web database and from individual interviews covering perceived ease of use, usefulness and intention to use the MOvIT questionnaire in the future.

Results

The MOvIT monitoring questionnaire developed in phase I tracks nine potential wheelchair-related adverse outcomes considered important for end-users: 1) non-use of wheelchair, 2) pain, 3) skin condition, 4) positioning, 5) wheelchair incidents, 6) psychosocial issues, 7) restricted wheelchair participation, 8) limited wheelchair skills and knowledge, and 9) technical problems. In phase II, 92 individuals who received a wheelchair were eligible, 71 out of 92 accepted (77 %) and 65 out of 71 (92 %) completed the 3-month follow-up. In the sample of 65 participants, a wheelchair-related adverse outcome was confirmed by a rehabilitation professional for 58.5 %, and at least one recommendation was given to 66.2 % during the 3-month monitoring period. A majority of participants found the intervention useful (82.8 %) and said they intended to use the MOvIT monitoring questionnaire in the future (81.5 %). Participants made suggestions to make the calls more adaptive to various ability profiles.

Conclusions

Automated calls tailored for individuals with mobility limitations and associated comorbidities are a promising approach to reach clients who need post-rehabilitation support.

Comparison of an interactive with a didactic educational intervention for improving the evidence-based practice knowledge of occupational therapists in the public health sector in South Africa: a randomised controlled trial

Background

Despite efforts to identify effective interventions to implement evidence-based practice (EBP), uncertainty remains. Few existing studies involve occupational therapists or resource-constrained contexts. This study aimed to determine whether an interactive educational intervention (IE) was more effective than a didactic educational intervention (DE) in improving EBP knowledge, attitudes and behaviour at 12 weeks.

Methods

A matched pairs design, randomised controlled trial was conducted in the Western Cape of South Africa. Occupational therapists employed by the Department of Health were randomised using matched-pair stratification by type (clinician or manager) and knowledge score. Allocation to an IE or a DE was by coin-tossing. A self-report questionnaire (measuring objective knowledge and subjective attitudes) and audit checklist (measuring objective behaviour) were completed at baseline and 12 weeks. The primary outcome was EBP knowledge at 12 weeks while secondary outcomes were attitudes and behaviour at 12 weeks. Data collection occurred at participants’ places of employment. Audit raters were blinded, but participants and the provider could not be blinded.

Results

Twenty-one of 28 pairs reported outcomes, but due to incomplete data for two participants, 19 pairs were included in the analysis. There was a median increase of 1.0 points (95% CI = -4.0, 1.0) in the IE for the primary outcome (knowledge) compared with the DE, but this difference was not significant (P = 0.098). There were no significant differences on any of the attitude subscale scores. The median 12-week audit score was 8.6 points higher in the IE (95% CI = -7.7, 27.0) but this was not significant (P = 0.196). Within-group analyses showed significant increases in knowledge in both groups (IE: T = 4.0, P <0.001; DE: T = 12.0, P = 0.002) but no significant differences in attitudes or behaviour.

Conclusions

The results suggest that the interventions had similar outcomes at 12 weeks and that the interactive component had little additional effect.

Trial registration

Pan African Controlled Trials Register PACTR201201000346141, registered 31 January 2012. Clinical Trials NCT01512823, registered 1 February 2012. South African National Clinical Trial Register DOH2710093067, registered 27 October 2009. The first participants were randomly assigned on 16 July 2008.

A tailored educational intervention improves doctor's performance in managing depression: a randomized controlled trial

RATIONAL AND OBJECTIVES

To assess the effects of a tailored and activating educational intervention, based on a three-stage modified Prochaska model of readiness-to-change, on the performance of general physicians in primary care (GPs) regarding management of depressive disorders.

METHODS

Parallel group, randomized control trial. Primary hypothesis was that performance would improve by 20 percentage units in the intervention arm. The setting was primary care in southern Tehran. The participants were 192 GPs stratified on stage of readiness-to-change, sex, age and work experience. The intervention was a 2-day interactive workshop for a small group of GPs' at a higher stage of readiness-to-change ('intention') and a 2-day interactive large group meeting for those with lower propensity to change ('attitude') at the pre-assessment. GPs in the control arm participated in a standard educational programme on the same topic. The main outcome measures were validated tools to assess GPs' performance by unannounced standardized patients, regarding diagnosis and treatment of depressive disorders. The assessments were made 2 months before and 2 months after the intervention.

RESULTS

GPs in the intervention arm significantly improved their overall mean scores for performance regarding both diagnosis, with an intervention effect of 14 percentage units (P = 0.007), and treatment and referral, with an intervention effect of 20 percentage units (P < 0.0001). The largest improvement after the intervention appeared in the small group: 30 percentage units for diagnosis (P = 0.027) and 29 percentage units for treatment and referral (P < 0.0001).

CONCLUSIONS

Activating learning methods, tailored according to the participants' readiness to change, improved clinical performance of GPs in continuing medical education and can be recommended for continuing professional development.

"Push" versus "Pull" for mobilizing pain evidence into practice across different health professions: a protocol for a randomized trial

BACKGROUND

Optimizing pain care requires ready access and use of best evidence within and across different disciplines and settings. The purpose of this randomized trial is to determine whether a technology-based "push" of new, high-quality pain research to physicians, nurses, and rehabilitation and psychology professionals results in better knowledge and clinical decision making around pain, when offered in addition to traditional "pull" evidence technology. A secondary objective is to identify disciplinary variations in response to evidence and differences in the patterns of accessing research evidence.

METHODS

Physicians, nurses, occupational/physical therapists, and psychologists (n = 670) will be randomly allocated in a crossover design to receive a pain evidence resource in one of two different ways. Evidence is extracted from medical, nursing, psychology, and rehabilitation journals; appraised for quality/relevance; and sent out (PUSHed) to clinicians by email alerts or available for searches of the accumulated database (PULL). Participants are allocated to either PULL or PUSH + PULL in a randomized crossover design. The PULL intervention has a similar interface but does not send alerts; clinicians can only go to the site and enter search terms to retrieve evidence from the cumulative and continuously updated online database. Upon entry to the trial, there is three months of access to PULL, then random allocation. After six months, crossover takes place. The study ends with a final three months of access to PUSH + PULL. The primary outcomes are uptake and application of evidence. Uptake will be determined by embedded tracking of what research is accessed during use of the intervention. A random subset of 30 participants/ discipline will undergo chart-stimulated recall to assess the nature and depth of evidence utilization in actual case management at baseline and 9 months. A different random subset of 30 participants/ discipline will be tested for their skills in accessing evidence using a standardized simulation test (final 3 months). Secondary outcomes include usage and self-reported evidence-based practice attitudes and behaviors measured at baseline, 3, 9, 15 and 18 months.

DISCUSSION

The trial will inform our understanding of information preferences and behaviors across disciplines/practice settings. If this intervention is effective, sustained support will be sought from professional/health system initiatives with an interest in optimizing pain management.

TRIAL REGISTRATION

Registered as NCT01348802 on clinicaltrials.gov.

Phase 1 pilot study of e-mail support for people with long term conditions using the Internet

BACKGROUND

Use of the Internet for people with Long Term Conditions (LTCs) can have a positive effect on knowledge, social support, behavioural and clinical outcomes, yet there is concern that a 'digital divide' prevents some patients from benefitting. While some patients do not have access to the Internet, others that do may still lack expertise or the confidence to make full use of it. The aim of this pilot study was to develop an intervention and test methods for a definitive randomised controlled trial (RCT) of anonymous personal online email support for patients in this latter group.

METHODS

Recruitment success was evaluated by the number and appropriateness of participants recruited. A personalised e-health support intervention was developed. The provisional primary outcome was the extent to which the Internet affected the participants' confidence in dealing with their LTC. Primary outcome, seven process measures and two secondary outcomes measures were evaluated for completeness of data and sensitivity to detect changes.

RESULTS

Thirty nine participants were recruited, 29 after personally receiving a leaflet, seven via email advertising, and three via leaflets left in waiting areas. Most participants (61%) were aged over 60. The majority (21/38) rated themselves as experienced Internet users although only 5/38 had used discussion forums for their LTC. Piloting the intervention identified support needed as: (i) technical help with some websites, (ii) advice about issues such as anonymity, (iii) help in judging information quality, (iv) identification of relevant information (via 'Information Prescriptions'), (v) motivational support to try new sites. Attrition was fairly high: 20/39 completed follow up questionnaires. Three process measures showed ceiling effects and two had too many missing values to be useable.

CONCLUSION

E-health support is a promising way of addressing the problems faced by older generation e-health seekers. Face-to-face leaflet distribution recruited sufficient numbers but additional locations other than hospital should be tried to recruit Internet novices with LTCs. An RCT is feasible and necessary to evaluate the potential benefits of anonymous email support. Our methods could be used by other researchers studying Internet use by people with LTCs.

Effects on knowledge and attitudes of using stages of change to train general practitioners on management of depression: a randomized controlled study

OBJECTIVE

To assess the impact on knowledge and attitudes of a tailored educational intervention on depression using a modified version of the Prochaska stages of change model, compared with standard continuing medical education, for general practitioners (GPs) in primary care in Iran.

METHOD

Using a randomized controlled trial, a total of 192 GPs were evenly randomized to intervention or control arm. The topic for the educational intervention was depressive disorders. The participants were divided in to small and large groups, depending on their initial stage of change. The GPs' knowledge and skills regarding management of depressive disorders were assessed through a questionnaire with 7 multiple choice questions, 11 Likert statements, 3 case vignettes, and 1 essay question. Attitudes toward management of depressive disorders were also assessed. Both questionnaires were validated.

RESULTS

There was a significant improvement in knowledge mean scores regarding multiple choice and Likert questions (intervention effect 6%; P = 0.002), as well as for the case vignettes and essay question (intervention effect 12%; P = 0.011) in the intervention arm, in comparison with the control arm. There were significant changes in mean attitude scores in both study arms, but no difference between them.

CONCLUSIONS

A theoretical model of medical learning and behavioural change can be used to devise educational formats that suit different stages of learning. Such tailored educational formats can improve GPs' knowledge and skills regarding management of depressive disorders.

Personal digital assistants: a review of current and potential utilization among medical residents

BACKGROUND

Increases in the daily work load of medical residents, coupled with constraints on their work hours have made personal digital assistants (PDAs) an increasingly popular management resource. No comprehensive review of PDA utilization among medical residents has been published.

PURPOSE

The purpose is to review and analyze current literature addressing PDA use by medical residents and to asses the future impact handheld computers may have on the daily practices of residents.

METHOD

A systematic literature search was completed to identify publications that describe the use of PDAs by medical residents. Particular attention and priority was given to articles addressing patient care, information management, and educational outcomes.

RESULTS

The rate of PDA utilization has dramatically increased in the past decade. Today, 70% of residents report using a PDA daily. PDAs are most commonly used for referencing medication-prescribing guides, medical textbooks, patient documentation programs, and medical calculators. No articles have reported the impact of housestaff PDA use on educational or patient care outcomes.

CONCLUSION

PDAs are perceived as a valuable resource by most medical residents. Further studies are necessary to confirm that daily PDA use by housestaff confers an educational, institutional, and patient care benefit.

Using an evidence-based approach to measure outcomes in clinical practice

Evaluation of the outcome of evidence-based practice decisions in individual patients or patient groups is step five in the evidence-based practice approach. Outcome measures are any measures that reflect patient status. Status or outcome measures can be used to detect change over time (eg, treatment effects), to discriminate among clinical groups, or to predict future outcomes (eg, return to work). A variety of reliable and valid physical impairment and disability measures are available to assess treatment outcomes in hand surgery and therapy. Evidence from research studies that includes normative data, standard error of measurement, or comparative scores for important clinical subgroups can be used to set treatment goals, monitor recovery, and compare individual patient outcomes to those reported in the literature. Clinicians tend to rely on impairment measures, such as radiographic measures, grip strength, and range of motion, although self-report measures are known to be equally reliable and more related to global effects, such as return-to-work. The process of selecting and implementing outcome measures is crucial. This process works best when team members are involved and willing to trial new measures. In this way, the team can develop customized outcome assessment procedures that meet their needs for assessing individual patients and providing data for program evaluation.

Evaluation of health-related quality of life in patients with shoulder pain: are we doing the best we can?

This article provides an understanding of patient-based shoulder outcome tools and the conceptual framework of disablement models from which the patient-based outcome tools are based. To allow for the evaluation of function, disability, and health-related quality of life in patients suffering from shoulder pain and in particular those whose shoulders have high physical demands, the use of shoulder self-report patient-oriented outcome tools must become standard of practice. A wide variety of available outcome tools demonstrate acceptable levels of measurement properties and are appropriate for virtually every patient with a shoulder disorder.