Comparison of an interactive with a didactic educational intervention for improving the evidence-based practice knowledge of occupational therapists in the public health sector in South Africa: a randomised controlled trial

Enrollment, adherence and retention rates among musculoskeletal disorders rehabilitation practitioners in knowledge translation studies: a systematic review and meta-regression

BACKGROUND

Practitioners' enrollment, adherence, and retention rates influence estimates of effectiveness in knowledge translation (KT) studies and remain important concerns for implementation researchers. This review aimed to systematically summarize the current evidence on feasibility measures as gauged by enrollment, adherence, and retention rates in KT evaluation studies targeting rehabilitation practitioners treating musculoskeletal disorders (MSDs).

METHODS

We searched five electronic databases from the inception to October 2022. We included KT studies that 1) had designs recommended by the Effective Practice and Organisation of Care, 2) targeted rehabilitation practitioners managing patients with MSDs, 3) delivered KT interventions according to the Expert Recommendations for Implementing Change classification, and 4) reported on the feasibility measures (e.g., enrollment, adherence, and retention). Descriptive statistics were conducted to report on study-, practitioners- and intervention-related factors influencing enrollment, adherence, and retention rates. Meta-regression weighted by the sample size of included studies was used to estimate the effect of factors on overall enrollment, adherence, and retention rates.

RESULTS

Findings from 33 KT studies reported weighted enrolment, adherence, and retention rate of 82% (range: 32%-100%), 74% (range: 44%-100%), and 65% (range: 36%-100%) respectively for both intervention and control groups. Factors positively influencing enrollment, adherence, and retention rates included designing short study period with short duration intervention.

CONCLUSIONS

Intense (e.g., high frequency, short duration) single KT intervention was more appealing for practitioners. Future evaluation studies should clearly report follow-up data, and practitioners' prior training, Results may not apply to non-MSD healthcare providers.

The effect of capacity building evidence-based medicine training on its implementation among healthcare professionals in Southwest Ethiopia: a controlled quasi-experimental outcome evaluation

BACKGROUND

Evidence-based medicine (EBM) bridges research and clinical practice to enhance medical knowledge and improve patient care. However, clinical decisions in many African countries don't base on the best available scientific evidence. Hence, this study aimed to determine the effect of training interventions on background knowledge and awareness of EBM sources, attitude, competence, and practice of EBM among healthcare professionals.

METHOD

We designed a controlled group quasi-experimental pre-post test study to evaluate the effect of capacity-building EBM training. A total of 192 healthcare professionals were recruited in the study (96 from the intervention and 96 from the control group). We used a difference-in-differences (DID) analysis to determine the effect of the training. Along the way, we used a fixed effect panel-data regression model to assess variables that could affect healthcare professionals' practice of EBM. The cut point to determine the significant effect of EBM training on healthcare professionals' background knowledge and awareness of EBM sources, attitude, and competence was at a P-value < 0.05.

RESULT

The DID estimator showed a significant net change of 8.0%, 17.1%, and 11.4% at P < 0.01 on attitude, competence, and practice of EBM, respectively, whereas no significant increment in the background knowledge and awareness of EBM sources. The fixed effect regression model showed that the attitude [OR = 2.288, 95% CI: (1.049, 4.989)], competence [OR = 4.174, 95% CI: 1.984, 8.780)], technical support [OR = 2.222, 95% CI: (1.043, 3.401)], and internet access [OR = 1.984, 95% CI: (1.073, 4.048)] were significantly affected EBM practice.

CONCLUSION

The capacity-building training improved attitude, competence, and EBM practice. Policymakers, government, and other concerned bodies recommended focusing on a well-designed training strategy to enhance the attitude, competence, and practice towards EBM among healthcare professionals. It was also recommended to enhance internet access and set mechanisms to provide technical support at health facilities.

Systematic Review of the Effectiveness of Allied Health Clinical Education Programs

INTRODUCTION

Continuing allied health professional (AHP) clinical education is essential to ensure high-quality patient care; however, the effectiveness of current education programs is unclear. This review aimed to determine whether AHP education programs improve the knowledge of AHPs, change their clinical practice behavior, and/or improve patient-related clinical outcome and to identify important components of these programs.

METHODS

Four electronic databases were searched. Controlled clinical trials investigating the effectiveness of clinical education programs were included. Education programs were diverse, varying in design, delivery mode, and intensity. Only therapy-specific AHPs were included. Effectiveness was determined by differences in group outcomes in the domains of AHP knowledge, AHP clinical practice behavior, and patient-related clinical outcomes.

RESULTS

Forty-four studies were identified, of which 26 included physiotherapists only. Most control groups were waitlist, passive dissemination of information, or usual care, limiting comparisons between programs. Changes in AHP knowledge was investigated in 20 trials, with 13 showing an improvement. Thirty studies investigated changes in AHP clinical practice behavior, with half demonstrating a difference between groups. Seventeen studies investigated a patient-related clinical outcome, with five finding a difference between groups. Where improvements in outcomes were demonstrated, programs tended to incorporate self-selection and cater to the learner's contextual needs.

DISCUSSION

AHP knowledge is effectively improved through targeted education programs. To change AHP behavior and patient outcomes, it seems important to incorporate self-selection for the program and consider the learner's individual needs and contexts through mentoring, outreach visits, reflection, and incorporating patient participation in the learning.

Knowledge translation in rehabilitation settings in low, lower-middle and upper-middle-income countries: a scoping review

PURPOSE

This review aims to identify the barriers and facilitators to knowledge use and Knowledge Translation (KT) strategies in rehabilitation in low, lower-middle, and upper-middle-income countries (LMICs).

MATERIALS AND METHODS

A scoping review of studies of KT in rehabilitation in LMICs contexts using the Arksey and O'Malley Framework was conducted. A comprehensive search of MEDLINE and 10 other databases was undertaken to identify studies conducted primarily in LMICs.

RESULTS

From the initial 15.606 titles identified; 27 articles were included for final analysis. Our analysis identified the following themes: Professional culture and context; KT interventions; and the conceptualization and application of KT and Evidence Based Practice (EBP). Individual-level barriers to KT included lack of skills, knowledge about EBP and English language, lack of motivation, and decision-making power. Facilitators to KT included positive attitudes and motivation. Organization-level barriers included lack of time, lack of financial resources, limited access to scientific journals, and applicability of research to rural settings. Facilitators included adequate financial and physical resources, a supportive management environment, and the existence of training and continuing education programs.

CONCLUSION

This review identified common and unique barriers and facilitators to KT in LMICs when compared to KT studies conducted in high-income settings.IMPLICATIONS FOR REHABILITATIONKnowledge Translation from academic institutions to rehabilitation clinical practice in low and upper-middle-income countries is important to support evidence-based practice and patient outcomes.Barriers at the individual level include professionals' ability to understand English and knowledge of the evidence-based practice.Organization-level barriers included lack of time to access and implement new practices, lack of financial and personal resources, limited access to scientific journals, and applicability of research to rural settings.Training and continuing education programs are needed to support rehabilitation professionals' efforts to achieve the application of evidence-based practice in clinical practice.

Continuing education meetings and workshops: effects on professional practice and healthcare outcomes

BACKGROUND

Educational meetings are used widely by health personnel to provide continuing medical education and to promote implementation of innovations or translate new knowledge to change practice within healthcare systems. Previous reviews have concluded that educational meetings can result in small changes in behaviour, but that effects vary considerably. Investigations into which characteristics of educational meetings might lead to greater impact have yielded varying results, and factors that might explain heterogeneity in effects remain unclear. This is the second update of this Cochrane Review.

OBJECTIVES

• To assess the effects of educational meetings on professional practice and healthcare outcomes • To investigate factors that might explain the heterogeneity of these effects SEARCH METHODS: We searched CENTRAL, MEDLINE, Embase, ERIC, Science Citation Index Expanded (ISI Web of Knowledge), and Social Sciences Citation Index (last search in November 2016).

SELECTION CRITERIA

We sought randomised trials examining the effects of educational meetings on professional practice and patient outcomes.

DATA COLLECTION AND ANALYSIS

Two review authors independently extracted data and assessed risk of bias. One review author assessed the certainty of evidence (GRADE) and discussed with a second review author. We included studies in the primary analysis that reported baseline data and that we judged to be at low or unclear risk of bias. For each comparison of dichotomous outcomes, we measured treatment effect as risk difference adjusted for baseline compliance. We expressed adjusted risk difference values as percentages, and we noted that values greater than zero favour educational meetings. For continuous outcomes, we measured treatment effect as per cent change relative to the control group mean post test, adjusted for baseline performance; we expressed values as percentages and noted that values greater than zero favour educational meetings. We report means and 95% confidence intervals (CIs) and, when appropriate, medians and interquartile ranges to facilitate comparisons to previous versions of this review. We analysed professional and patient outcomes separately and analysed 22 variables that were hypothesised a priori to explain heterogeneity. We explored heterogeneity by using univariate meta-regression and by inspecting violin plots.

MAIN RESULTS

We included 215 studies involving more than 28,167 health professionals, including 142 new studies for this update. Educational meetings as the single intervention or the main component of a multi-faceted intervention compared with no intervention • Probably slightly improve compliance with desired practice when compared with no intervention (65 comparisons, 7868 health professionals for dichotomous outcomes (adjusted risk difference 6.79%, 95% CI 6.62% to 6.97%; median 4.00%; interquartile range 0.29% to 13.00%); 28 comparisons, 2577 health professionals for continuous outcomes (adjusted relative percentage change 44.36%, 95% CI 41.98% to 46.75%; median 20.00%; interquartile range 6.00% to 65.00%)) • Probably slightly improve patient outcomes compared with no intervention (15 comparisons, 2530 health professionals for dichotomous outcomes (adjusted risk difference 3.30%, 95% CI 3.10% to 3.51%; median 0.10%; interquartile range 0.00% to 4.00%); 28 comparisons, 2294 health professionals for continuous outcomes (adjusted relative percentage change 8.35%, 95% CI 7.46% to 9.24%; median 2.00%; interquartile range -1.00% to 21.00%)) The certainty of evidence for this comparison is moderate. Educational meetings alone compared with other interventions • May improve compliance with desired practice when compared with other interventions (6 studies, 1402 health professionals for dichotomous outcomes (adjusted risk difference 9.99%, 95% CI 9.47% to 10.52%; median 16.5%; interquartile range 0.80% to 16.50%); 2 studies, 72 health professionals for continuous outcomes (adjusted relative percentage change 12.00%, 95% CI 9.16% to 14.84%; median 12.00%; interquartile range 0.00% to 24.00%)) No studies met the inclusion criteria for patient outcome measurements. The certainty of evidence for this comparison is low. Interactive educational meetings compared with didactic (lecture-based) educational meetings • We are uncertain of effects on compliance with desired practice (3 studies, 370 health professionals for dichotomous outcomes; 1 study, 192 health professionals for continuous outcomes) or on patient outcomes (1 study, 54 health professionals for continuous outcomes), as the certainty of evidence is very low Any other comparison of different formats and durations of educational meetings • We are uncertain of effects on compliance with desired practice (1 study, 19 health professionals for dichotomous outcomes; 1 study, 20 health professionals for continuous outcomes) or on patient outcomes (1 study, 113 health professionals for continuous outcomes), as the certainty of evidence is very low. Factors that might explain heterogeneity of effects Meta-regression suggests that larger estimates of effect are associated with studies judged to be at high risk of bias, with studies that had unit of analysis errors, and with studies in which the unit of analysis was the provider rather than the patient. Improved compliance with desired practice may be associated with: shorter meetings; poor baseline compliance; better attendance; shorter follow-up; professionals provided with additional take-home material; explicit building of educational meetings on theory; targeting of low- versus high-complexity behaviours; targeting of outcomes with high versus low importance; goal of increasing rather than decreasing behaviour; teaching by opinion leaders; and use of didactic versus interactive teaching methods. Pre-specified exploratory analyses of behaviour change techniques suggest that improved compliance with desired practice may be associated with use of a greater number of behaviour change techniques; goal-setting; provision of feedback; provision for social comparison; and provision for social support. Compliance may be decreased by the use of follow-up prompts, skills training, and barrier identification techniques.

AUTHORS' CONCLUSIONS

Compared with no intervention, educational meetings as the main component of an intervention probably slightly improve professional practice and, to a lesser extent, patient outcomes. Educational meetings may improve compliance with desired practice to a greater extent than other kinds of behaviour change interventions, such as text messages, fees, or office systems. Our findings suggest that multi-strategy approaches might positively influence the effects of educational meetings. Additional trials of educational meetings compared with no intervention are unlikely to change the review findings; therefore we will not further update this review comparison in the future. However, we note that randomised trials comparing different types of education are needed.

Impact of Contextual Factors on the Effect of Interventions to Improve Health Worker Performance in Sub-Saharan Africa: Review of Randomised Clinical Trials

BACKGROUND

Africa bears 24% of the global burden of disease but has only 3% of the world's health workers. Substantial variation in health worker performance adds to the negative impact of this significant shortfall. We therefore sought to identify interventions implemented in sub-Saharan African aiming to improve health worker performance and the contextual factors likely to influence local effectiveness.

METHODS AND FINDINGS

A systematic search for randomised controlled trials of interventions to improve health worker performance undertaken in sub-Saharan Africa identified 41 eligible trials. Data were extracted to define the interventions' components, calculate the absolute improvement in performance achieved, and document the likelihood of bias. Within-study variability in effect was extracted where reported. Statements about contextual factors likely to have modified effect were subjected to thematic analysis. Interventions to improve health worker performance can be very effective. Two of the three trials assessing mortality impact showed significant reductions in death rates (age<5 case fatality 5% versus 10%, p<0.01; maternal in-hospital mortality 6.8/1000 versus 10.3/1000; p<0.05). Eight of twelve trials focusing on prescribing had a statistically significant positive effect, achieving an absolute improvement varying from 9% to 48%. However, reported range of improvement between centres within trials varied substantially, in many cases exceeding the mean effect. Nine contextual themes were identified as modifiers of intervention effect across studies; most frequently cited were supply-line failures, inadequate supervision or management, and failure to follow-up training interventions with ongoing support, in addition to staff turnover.

CONCLUSIONS

Interventions to improve performance of existing staff and service quality have the potential to improve patient care in underserved settings. But in order to implement interventions effectively, policy makers need to understand and address the contextual factors which can contribute to differences in local effect. Researchers therefore must recognise the importance of reporting how context may modify effect size.

Measuring evidence-based practice knowledge and skills in occupational therapy--a brief instrument

BACKGROUND

Valid and reliable instruments are required to measure the effect of educational interventions to improve evidence-based practice (EBP) knowledge and skills in occupational therapy. The aims of this paper are to: 1) describe amendments to the Adapted Fresno Test of Competence in EBP (AFT), and 2) report the psychometric properties of the modified instrument when used with South African occupational therapists.

METHODS

The clinical utility of the AFT was evaluated for use with South African occupational therapists and modifications made. The modified AFT was used in two studies to assess its reliability and validity. In Study 1 a convenience sample of 26 occupational therapists in private practice or government-funded health facilities in a South African province were recruited to complete the modified AFT on two occasions 1 week apart. Completed questionnaires were scored independently by two raters. Inter-rater, test-retest reliability and internal consistency were determined. Study 2 was a pragmatic randomised controlled trial involving occupational therapists in four Western Cape Department of Health district municipalities (n = 58). Therapists were randomised in matched pairs to one of two educational interventions (interactive or didactic), and completed the modified AFT at baseline and 12 weeks after the intervention. An intention-to-treat analysis was performed. Data were not normally distributed, thus non-parametric statistics were used.

RESULTS

In Study 1, 21 of 26 participants completed the questionnaire twice. Test-retest (ICC = 0.95, 95 % CI = 0.88-0.98) and inter-rater reliability (Time 1: ICC = 0.995, 95 % CI = 0.99-0.998; Time 2: ICC = 0.99, 95 % CI = 0.97-0.995) were excellent for total scores. Internal consistency based on time 1 scores was satisfactory (α = 0.70). In Study 2, 28 participants received an interactive educational intervention and completed the modified AFT at baseline and 12 weeks later. Median total SAFT scores increased significantly from baseline to 12-weeks (Z = -4.078, p < 0.001) with a moderate effect size (r = 0.55).

CONCLUSION

The modified AFT has demonstrated validity for detecting differences in EBP knowledge between two groups. It also has excellent test-retest and inter-rater reliability. The instrument is recommended for contexts where EBP is an emerging approach and time is at a premium.

TRIAL REGISTRATION

Pan African Controlled Trials Register PACTR201201000346141 . Registered 31 January 2012. Clinical Trials NCT01512823 . Registered 1 February 2012. South African National Clinical Trial Register DOH2710093067 . Registered 27 October 2009.