The development of an evidence-based toolkit to prevent meningococcal disease in college students

What should a toolkit to aid the delivery of therapeutic exercise for hip and knee osteoarthritis look like? Qualitative analysis of an international survey of 318 researchers, clinicians, and consumers by the OARSI Rehabilitation Discussion Group

BACKGROUND

We aimed to identify important components of, and practical resources relevant for inclusion in, a toolkit to aid exercise delivery for people with hip/knee osteoarthritis.

METHOD

An online international multi-disciplinary survey was conducted across 43 countries (139 clinicians, 44 people with hip/knee osteoarthritis and 135 osteoarthritis researchers). Participants were presented with the seeding statement 'Practical resources to aid the implementation of exercise for people with hip/knee osteoarthritis should…' and asked to provide up to 10 open text responses. Responses underwent refinement and qualitative content analysis to create domains and categories.

RESULTS

Refinement of 551 open text responses yielded 72 unique statements relevant for analysis. Statements were organised into nine broad domains, suggesting that resources to aid exercise delivery should: (1) be easily accessible; (2) be of high quality; (3) be developed by, and for, stakeholders; (4) include different ways of delivering information; (5) include different types of resources to support exercise and non-exercise components of self-management; (6) include resources on recommended exercises and how to perform/progress them; (7) include tools to support motivation and track progress; (8) include resources to enable tailoring of the programme to the individual and; (9) facilitate access to professional and peer support.

CONCLUSION

Our findings identified important components of, and practical resources to include within, a toolkit to aid delivery of exercise for people with hip/knee osteoarthritis. These findings have implications for exercise providers and lay the foundation for the development of a toolkit to help ensure exercise provision aligns with current international recommendations.

Development and use of a toolkit to facilitate implementation of an evidence-based intervention: a descriptive case study

Background

Implementation of evidence-based clinical interventions in real-world settings becomes a futile effort when effective strategies to foster adoption are not used. A toolkit, or a collection of adaptable documents to inform and facilitate implementation, can increase the use of evidence-based interventions. Most available toolkits provide resources about the intervention but lack guidance for adaptation to different contexts or strategies to support implementation. This paper describes the development and use of a toolkit to guide the implementation of an evidence-based intervention to identify and intervene for people with risky substance use.

Methods

A descriptive case study describes the development and use of a toolkit throughout a two-year study. Investigators and site coordinators from 14 acute care hospitals developed tools and engaged external stakeholders as they prepared for implementation, integrated the clinical intervention into practice, and reflected on implementation.

Results

The final toolkit included 54 different tools selected or created to define the intervention, engage and communicate with stakeholders, assess for readiness and plan for implementation, train clinical nurses and other stakeholders, evaluate training and implementation effectiveness, create policies and procedures for different contexts, and identify opportunities for reimbursement. Each tool corresponds to one or more implementation strategies.

Conclusion

The approach used to develop this implementation toolkit may be used to create resources for the implementation of other evidence-based interventions.

Dissemination and implementation of the ICAMP

The current rate of immunizations for older adults does not meet the immunization goals for Healthy People 2020. Using a Social Ecological Model and Social Cognitive Theory, the purpose of this study was to disseminate and implement the Immunization Champions, Advocates and Mentors Program (ICAMP) into a variety of health care settings. This study used a single group pre-/post-test design. Champions were recruited nationally. Five geographically diverse face-to-face meetings were held to train health care providers to be ICAMP immunization champions. Dissemination and implementation of ICAMP was evaluated using the Reach, Efficacy/Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) model. Participants were surveyed at baseline for descriptive information and were asked to gather immunization rates for at least one particular vaccine and provide follow-up data on progress toward goal achievement. A total of 212 champions from 82 settings participated in ICAMP. The majority were nurses (111/212, 52%). With regard to reach, we obtained 212 applications from individuals in a variety of settings interested in becoming champions. With regard to effectiveness, the majority of the champions (n = 178/212, 84%) used ICAMP material, 88% (n = 186/212) made changes related to immunization processes within their setting, and all reported that immunization practices improved. The majority used the toolkit materials up through 60 days following ICAMP. Sustained use of materials after the 60-day follow-up was less evident. ICAMP was implemented as intended and was effective in changing processes around immunizations. Ongoing work is needed to determine whether ICAMP improves immunization rates.

Scoping review of toolkits as a knowledge translation strategy in health

BACKGROUND

Significant resources are invested in the production of research knowledge with the ultimate objective of integrating research evidence into practice. Toolkits are becoming increasingly popular as a knowledge translation (KT) strategy for disseminating health information, to build awareness, inform, and change public and healthcare provider behavior. Toolkits communicate messages aimed at improving health and changing practice to diverse audiences, including healthcare practitioners, patients, community and health organizations, and policy makers. This scoping review explores the use of toolkits in health and healthcare.

METHODS

Using Arksey and O'Malley's scoping review framework, health-based toolkits were identified through a search of electronic databases and grey literature for relevant articles and toolkits published between 2004 and 2011. Two reviewers independently extracted data on toolkit topic, format, target audience, content, evidence underlying toolkit content, and evaluation of the toolkit as a KT strategy.

RESULTS

Among the 253 sources identified, 139 met initial inclusion criteria and 83 toolkits were included in the final sample. Fewer than half of the sources fully described the toolkit content and about 70% made some mention of the evidence underlying the content. Of 83 toolkits, only 31 (37%) had been evaluated at any level (27 toolkits were evaluated overall relative to their purpose or KT goal, and 4 toolkits evaluated the effectiveness of certain elements contained within them).

CONCLUSIONS

Toolkits used to disseminate health knowledge or support practice change often do not specify the evidence base from which they draw, and their effectiveness as a knowledge translation strategy is rarely assessed. To truly inform health and healthcare, toolkits should include comprehensive descriptions of their content, be explicit regarding content that is evidence-based, and include an evaluation of the their effectiveness as a KT strategy, addressing both clinical and implementation outcomes.

Toward a policy ecology of implementation of evidence-based practices in public mental health settings

Background

Mental health policymaking to support the implementation of evidence-based practices (EBPs) largely has been directed toward clinicians. However, implementation is known to be dependent upon a broader ecology of service delivery. Hence, focusing exclusively on individual clinicians as targets of implementation is unlikely to result in sustainable and widespread implementation of EBPs.

Discussion

Policymaking that is informed by the implementation literature requires that policymakers deploy strategies across multiple levels of the ecology of implementation. At the organizational level, policies are needed to resource the added marginal costs of EBPs, and to assist organizational learning by re-engineering continuing education units. At the payor and regulatory levels, policies are needed to creatively utilize contractual mechanisms, develop disease management programs and similar comprehensive care management approaches, carefully utilize provider and organizational profiling, and develop outcomes assessment. At the political level, legislation is required to promote mental health parity, reduce discrimination, and support loan forgiveness programs. Regulations are also needed to enhance consumer and family engagement in an EBP agenda. And at the social level, approaches to combat stigma are needed to ensure that individuals with mental health need access services.

Summary

The implementation literature suggests that a single policy decision, such as mandating a specific EBP, is unlikely to result in sustainable implementation. Policymaking that addresses in an integrated way the ecology of implementation at the levels of provider organizations, governmental regulatory agencies, and their surrounding political and societal milieu is required to successfully and sustainably implement EBPs over the long term.