Applying the RE-AIM Framework to Inform the Development of a Multiple Sclerosis Falls-Prevention Intervention

Disseminating education to solid organ transplant recipients to promote engagement in physical activity

Objective

To evaluate the dissemination of education through a workshop to promote engagement in physical activity (PA) among solid organ transplant (SOT) recipients.

Methods

The in-person workshop consisted of expert-led lectures on topics related to physical activity (day 1) and sports and fitness training with volunteer coaches (day 2). There were separate streams for children/adolescents and adults. RE-AIM (Reach, Efficacy, Adoption, Implementation, and Maintenance) framework was used to evaluate the impact of the workshop. Presenters and participants completed evaluations of the workshop using a 5-point Likert scale. A subgroup of adults completed a self-reported PA questionnaire at baseline and 4-weeks after the workshop.

Results

103 individuals (71 SOT recipients, 32 caregivers) attended the workshop (ages 4 to 71+ years). Sessions were highly rated (median = 5) for both quality and content on both days. There was no significant change (p = 0.16) in PA. However, 56% of SOT recipients reported changing their level of PA.

Conclusion

An educational-workshop with hands-on training was an efficient and well-received method for disseminating awareness about the benefits of PA in SOT recipients.

Innovation

Dissemination of evidence-based knowledge through a novel educational-workshop in a real-world setting has the potential to inform the decisions about PA behavior among SOT recipients.

Using the RE-AIM framework to evaluate the implementation of scaling-up the Friendship Bench in Zimbabwe - a quantitative observational study

BACKGROUND

This study aimed to evaluate the real-world implementation of the Friendship Bench (FB) - an evidence-based brief psychological intervention delivered by community health workers (CHWs) - three years after its implementation in three city health departments in Zimbabwe. Implementation sites were evaluated according to their current performance using the RE-AIM framework making this one of the first evaluations of a scaled-up evidence-based psychological intervention in sub-Saharan Africa (SSA).

METHODS

Using the RE-AIM guide ( www.re-aim.org ), the authors designed quantitative indicators based on existing FB implementation data. Thirty-six primary health care clinics (PHC) in Harare (n=28), Chitungwiza (n=4) and Gweru (n=4) were included. Among these clinics 20 were large comprehensive health care centers, 7 medium (mostly maternal and child healthcare) and 9 small clinics (basic medical care and acting as referral clinic). Existing data from these clinics, added to additionally collected data through interviews and field observations were used to investigate and compare the performance of the FB across clinics. The focus was on the RE-AIM domains of Reach, Adoption, and Implementation.

RESULTS

Small clinics achieved 34% reach, compared to large (15%) and medium clinics (9%). Adoption was high in all clinic types, ranging from 59% to 71%. Small clinics led the implementation domain with 53%, followed by medium sized clinics 43% and large clinics 40%. Small clinics performed better in all indicators and differences in performance between small and large clinics were significant. Program activity and data quality depends on ongoing support for delivering agents and buy-in from health authorities.

CONCLUSION

The Friendship Bench program was implemented over three years transitioning from a research-based implementation program to one led locally. The Reach domain showed the largest gap across clinics where larger clinics performed poorly relative to smaller clinics and should be a target for future implementation improvements. Program data needs to be integrated into existing health information systems. Future studies should seek to optimize scale-up and sustainment strategies to maintain effective task-shared psychological interventions in SSA.

A decision-making model to optimize the impact of community-based health programs

Hospitals and clinics are increasingly interested in building partnerships with community-based organizations to address the social determinants of health. Choosing among community-based health programs can be complex given that programs may have different effectiveness levels and implementation costs. This study develops a decision-making model that can be used to evaluate multiple key factors that would be relevant in resource allocation decisions related to a set of community-based health programs. The decision-making model compares community-based health programs by considering funding limitations, program duration, and participant retention until program completion. Specifically, the model allows decision makers to select the optimal mix of community-based health programs based on the profiles of the population given the above constraints. The model can be used to improve resource allocation in communities, ultimately contributing to the long-term goal of strengthening cross-sector partnerships and the integration of services to improve health outcomes.

Implementing Exercise in Healthcare Settings: The Potential of Implementation Science

Exercise is an efficacious therapy for many chronic diseases. Integrating efficacious evidence-based interventions (EBIs), such as exercise, into daily healthcare practice is a slow and complex pursuit. Implementation science seeks to understand and address this phenomenon by conducting studies about the methods used to promote the routine uptake of EBIs. The purpose of this article is to explore implementation science and a common conceptual framework in the discipline, the Consolidated Framework for Implementation Research (CFIR), as it applies to exercise EBI. We conclude by offering recommendations for future research that leverage implementation science priorities to highlight the potential of this research field for advancing the implementation of exercise EBI.

Beyond current research practice: Methodological considerations in MS rehabilitation research (is designing the perfect rehabilitation trial the Holy Grail or a Gordian knot?)

Rehabilitation is an essential aspect of symptomatic and supportive treatment for people with multiple sclerosis (MS). The number of randomised controlled trials (RCTs) for rehabilitation interventions in MS has increased over the last two decades. The design, conduct and reporting quality of some of these trials could be improved. There are, however, some specific challenges that researchers face in conducting RCTs of rehabilitation interventions, which are often 'complex interventions'. This paper explores some of the challenges of undertaking robust clinical trials in rehabilitation. We focus on issues related to (1) participant selection and sample size, (2) interventions - the 'dose', content, active ingredients, targeting, fidelity of delivery and treatment adherence, (3) control groups and (4) outcomes - choosing the right type, number, timing of outcomes, and the importance of defining a primary outcome and clinically important difference between groups. We believe that by following internationally accepted RCT guidelines, by developing a critical mass of MS rehabilitation 'trialists' through international collaboration and by continuing to critique, challenge, and develop RCT designs, we can exploit the potential of RCTs to answer important questions related to the effectiveness of rehabilitation interventions.

Educational and Exercise Intervention to Prevent Falls and Improve Participation in Subjects With Neurological Conditions: The NEUROFALL Randomized Controlled Trial

Background: Falls, mobility impairments and lack of social support lead to participation restrictions in people with neurological conditions. The aim of this multicenter, single blinded randomized controlled trial was to test whether an educational program focusing on fall prevention and safe mobility reduces falls and increases social participation among people with neurological conditions. Methods: Ninety people with Stroke (n = 25), multiple sclerosis (n = 33) and Parkinson disease (n = 32), median age 63 (31-89), were randomized. A permuted block algorithm stratified by field center was used to allocate participants to an education group (EG, n = 42) consisting of an educational program focused on fall prevention and tailored balance exercises and a control group (CG, n = 48) receiving usual treatments. After baseline assessment, each participants was followed for 6 months with telephone contacts by blinded interviewers. Being fallers (>1 fall) and time to become a faller were used as primary outcomes. Community Integration Questionnaire (CIQ) and Instrumental Activities of Daily Living (IADL) scales assessed treatment effects on social integration and daily living activities. Results: Over a median (Interquartile Range) follow-up of 189 (182-205) days, [EG = 188 (182-202), CG = 189 (182-209)] fallers were 10 in the CG and 11 in the EG (hazard ratio 0.95, 95% confidence interval (CI) 0.45 to 2.5; P = 0.94). At follow-up the EG scored significantly better than CG on the CIQ (+1.7 points, CI: 0.1 to 3.3) and IADL (+2.2 points, CI: 0.4 to 4.0). Conclusions: This educational program did not reduce the risk of falls but it improved the ability to carry out activities of daily living and decreased participation restrictions in people with neurological conditions.

Designing a program evaluation for a medical-dental service for adults with autism and intellectual disabilities using the RE-AIM framework

INTRODUCTION

Robust evaluation of service models can improve the quality and efficiency of care while articulating the models for potential replication. Even though it is an essential part of learning health systems, evaluations that benchmark and sustain models serving adults with developmental disabilities are lacking, impeding pilot programs from becoming official care pathways. Here, we describe the development of a program evaluation for a specialized medical-dental community clinic serving adults with autism and intellectual disabilities in Montreal, Canada.

METHOD

Using a Participatory Action-oriented approach, researchers and staff co-designed an evaluation for a primary care service for this population. We performed an evaluability assessment to identify the processes and outcomes that were feasible to capture and elicited perspectives at both clinical and health system levels. The RE-AIM framework was used to categorize and select tools to capture data elements that would inform practice at the clinic.

RESULTS

We detail the process of conceptualizing the evaluation framework and operationalizing the domains using a mixed-methods approach. Our experience demonstrated (1) the utility of a comprehensive framework that captures contextual factors in addition to clinical outcomes, (2) the need for validated measures that are not cumbersome for everyday practice, (3) the importance of understanding the functional needs of the organization and building a sustainable data infrastructure that addresses those needs, and (4) the need to commit to an evolving, "living" evaluation in a dynamic health system.

CONCLUSIONS

Evaluation employing rigorous patient-centered and systems-relevant metrics can help organizations effectively implement and continuously improve service models. Using an established framework and a collaborative approach provides an important blueprint for a program evaluation in a learning health system. This work provides insight into the process of integrating care for vulnerable populations with chronic conditions in health care systems and integrated knowledge generation processes between research and health systems.

Challenges in assessing population reach in a pragmatic trial

Strategies and Opportunities to STOP Colon Cancer in Priority Populations (STOP CRC) was a pragmatic cluster-randomized trial conducted at federally qualified health centers and designed to “Reach” as many unscreened patients as possible by directly mailing them fecal screening tests.

STOP CRC used an electronic health record registry to identify individuals' needing CRC screening and mail interventions to them. The registry was updated daily removing individuals completing CRC screening or those who no longer were clinic patients. Reach, a component RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance), is defined as the absolute number, percent, and representativeness of individuals “willing to participate in” or “exposed to” an initiative. We describe the complexities of measuring Reach in a pragmatic trial.

Overall 21,134 patients were on the registry list for at least one day, with 18,226 remaining after removing patients completing screening before any mailings. Observed Reached (the percent of individuals exposed to the intervention) using each denominator was 30.7% and 35.6% respectively. Reach improved only modestly after accounting for factors that made it impossible for clinics to send mailings. Few differences were observed in demographic and health care utilization factors among individuals Reached versus not Reached, suggesting that health center Implementation was more influential than patients' willingness or ability to participate.

A pragmatic definition of Reach that accounted for dynamic changes the absolute number eligible and the proportion exposed was more useful than traditional definitions of Reach. Actual Reach was dependent on Implementation and not patient level characteristics.

Clinical Trials Registration Number: ClincalTrials.gov (NCT01742065).

Validation of an individualized reduction of falls intervention program among wheelchair and scooter users with multiple sclerosis

INTRODUCTION

Falls are a serious concern for wheelchair and scooter users with multiple sclerosis (MS). Approximately, 75% of the population reports at least one fall in a 6-month period and nearly half report frequent falls. Falls can result in physical injuries and contribute to activity curtailment. Despite the negative consequences, limited evidenced-based fall prevention programs designed specifically for wheelchair and scooter users with MS exist.

PURPOSE

Recognizing the threat falls pose to health and well-being and the dearth of fall prevention programs, the purpose of this study is to perform a structured process evaluation and examine the feasibility and efficacy of a community-based intervention specifically designed to reduce fall incidence among wheelchair and scooter users with MS. Secondary aims of the intervention are to improve functional mobility skills associated with fall risk (e.g., transfer and wheelchair skills, balance), increase knowledge of fall risk factors, decrease fear of falling, and enhance quality of life and community participation.

METHODS

To evaluate our specific aims, a clinical trial will be performed with 160 wheelchair and scooter users with MS. (ClinicalTrials.gov Identifier: NCT03705364). Participants will be recruited to participate in a small group-style community-based program. The content of the program will be based on factors found to be associated with falls among wheelchair and scooter users with MS. These factors include but are not limited to, wheelchair/scooter related characteristics, transfer activities, impaired seated balance, and environmental factors. A physical or occupational therapist, will implement the intervention, which is comprised of 6 sessions that occur once weekly. The incidence of falls, along with an examination of wheelchair/scooter and transfer skills, seated postural control and knowledge of fall related risk factors will be compared between intervention and control participants, with assessment periods occurring prior to the intervention, 1 to 2 weeks after completion of the 6-week intervention session, and 12 weeks after the intervention period is complete.

CONCLUSION

Results from this study will guide the refinement of the intervention program and inform future research among a large and diverse group of wheelchair and scooter users living with MS.

Applying the RE-AIM Framework for the Evaluation of a Clinical Decision Support Tool for Pediatric Head Trauma: A Mixed-Methods Study

BACKGROUND

The overuse of cranial computed tomography (CT) to diagnose potential traumatic brain injuries (TBIs) exposes children with minor blunt head trauma to unnecessary ionizing radiation. The Pediatric Emergency Care Applied Research Network and the Clinical Research on Emergency Services and Treatments Network implemented TBI prediction rules via electronic health record (EHR) clinical decision support (CDS) to decrease use of CTs in children with minor blunt head trauma.

OBJECTIVE

This article aims to facilitate implementation and dissemination of a CDS alert into emergency departments around the country.

METHODS

We evaluated the EHR CT CDS tool through a mixed-methods analysis of 38 audio-recorded interviews with health care stakeholders and quantitative data sources, using the Reach, Efficacy, Adoption, Implementation, and Maintenance framework.

RESULTS

Reach -: The demographics of participants enrolled in the clinical trial were consistent with national estimates of TBI prevalence. Efficacy-There was a variable and modest reduction in CT rates for the 8,067 children with minor head trauma whose clinicians received CDS. Adoption -: The EHR CT CDS tool was well matched with the organizational mission, values, and priorities of the implementation sites. Implementation- The most important predisposing factors for successful implementation were the presence of an approachable clinical champion at each site and belief that the tool was a relevant, reusable knowledge asset. Enabling factors included an effective integration within the clinical workflow, organizational investment in user training, and ease of use. Maintenance -: Reinforcing factors for the EHR CT CDS tool included a close fit with the institutional culture, belief that it was useful for providers and families, and a good educational and informational tool. As such, the EHR CT CDS tool was maintained in clinical practice long after study completion.

CONCLUSION

Data from this mixed-methods study complement findings from the efficacy trial and provide critical components for consideration prior to integration and subsequent dissemination of the EHR CT CDS tool.

TRIAL REGISTRATION

NCT01453621, Registered September 27, 2011.

Pragmatic Applications of RE-AIM for Health Care Initiatives in Community and Clinical Settings

The RE-AIM (Reach Effectiveness Adoption Implementation Maintenance) planning and evaluation framework has been applied broadly, but users often have difficulty in applying the model because of data collection needs across multiple domains and sources. Questions in the more common "who, what, where, how, when, and why" format may be an effective guide to ensure that individual participants, organization staff, and the perspectives of the setting are considered in planning and evaluation. Such a format can also help users in typical community and clinical settings to identify which outcomes are most valued and to focus limited measurement resources. Translations of RE-AIM that are easy to understand and apply are needed for application in real-world community and clinical settings where research and evaluation resources are limited. The purpose of this article is to provide simplified, pragmatic, user-centered and stakeholder-centered recommendations to increase the use of RE-AIM in community and clinical settings and in translational research.

Community Delivery of a Comprehensive Fall-Prevention Program in People with Multiple Sclerosis: A Retrospective Observational Study

BACKGROUND

People with multiple sclerosis (MS) fall frequently. In 2011, the National Multiple Sclerosis Society launched a multifactorial fall-prevention group exercise and education program, Free From Falls (FFF), to prevent falls in MS. The objective of this study was to assess the impact of participation in the FFF program on balance, mobility, and falls in people with MS.

METHODS

This was a retrospective evaluation of assessments from community delivery of FFF. Changes in Activities-specific Balance Confidence scale scores, Berg Balance Scale scores, 8-foot Timed Up and Go performance, and falls were assessed.

RESULTS

A total of 134 participants completed the measures at the first and last FFF sessions, and 109 completed a 6-month follow-up assessment. Group mean scores on the Activities-specific Balance Confidence scale (F1,66 = 17.14, P < .05, η(2) = 0.21), Berg Balance Scale (F1,68 = 23.39, P < .05, η(2) = 0.26), and 8-foot Timed Up and Go (F1,79 = 4.83, P < .05, η(2) = 0.06) all improved significantly from the first to the last session. At the 6-month follow-up, fewer falls were reported (χ(2) [4, N = 239] = 10.56, P < .05, Phi = 0.21).

CONCLUSIONS

These observational data suggest that the FFF group education and exercise program improves balance confidence, balance performance, and functional mobility and reduces falls in people with MS.