A scoping review of frameworks in empirical studies and a review of dissemination frameworks

Considerations for effective dissemination of evidence-based early intervention approaches

LAY ABSTRACT

Dissemination, or the widespread sharing of information, is important for moving research evidence into community practice. Early intervention programs for young autistic children have not yet been widely disseminated to the early childhood workforce. This letter describes factors that may support or prevent dissemination to community-based settings, such as packaging and branding early intervention approaches. We argue that an increased focus on dissemination research is needed.

Exploring public health researchers' approaches, barriers, and needs regarding dissemination: A mixed-methods exploration

Background

Although there is growing attention to research translation, dissemination practices remain underdeveloped. This study aimed to gain insights into the dissemination approaches, barriers for dissemination, and needs for dissemination support of public health researchers of the Amsterdam Public Health (APH) research institute.

Methods

A concurrent mixed-methods design was used, collecting quantitative and qualitative data through a survey and qualitative data from interviews. Researchers of the Health Behaviors and Chronic Diseases (HBCD) research line of APH were approached via email with a link to an online survey. For the interviews, we aimed to balance researchers in terms of career phase and position. Data were analyzed through descriptive statistics and thematic content analysis.

Results

HBCD researchers primarily rely on traditional approaches for dissemination, e.g. academic journals (93%), conferences (93%), and reports to funders (71%). Social media (67%) was also frequently mentioned. Dissemination is often prioritized late due to time constraints and competing priorities. Researchers mentioned a lack of time, money, knowledge, and skills but also limited awareness of available support as barriers. A need for more resources, education, and a shift in mindset was expressed, suggesting a comprehensive inspiring platform and stronger in-house connections as solutions.

Conclusion

HBCD researchers emphasized the importance of dedicated time and budget for dissemination, as well as other forms of institutional support. Overall, there is a need for a shift in mindset, more educational initiatives, greater integration of dissemination into researchers' roles, the establishment of a comprehensive inspiring platform, and stronger in-house connections to support dissemination efforts.

Acceptability and feasibility of policy implementation strategies for taxes earmarked for behavioral health services

Background

This study's aims are to: (1) Compare the acceptability and feasibility of five types of implementation strategies that could be deployed to increase the reach of evidence-based practices (EBPs) with revenue from policies that earmark taxes for behavioral health services, and (2) Illustrate how definitions of implementation strategies and measures of acceptability and feasibility can be used in policy-focused implementation science research.

Methods

Web-based surveys of public agency and community organization professionals involved with earmarked tax policy implementation were completed in 2022-2023 (N = 211, response rate = 24.9%). Respondents rated the acceptability and feasibility of five types of implementation strategies (dissemination, implementation process, integration, capacity-building, and scale-up). Aggregate acceptability and feasibility scores were calculated for each type of strategy (scoring range 4-20). Analyses of variance compared scores across strategies and between organizational actor types.

Findings

For acceptability, capacity-building strategies had the highest rating (M = 16.3, SD = 3.0), significantly higher than each of the four other strategies, p ≤ . 004), and scale-up strategies had the lowest rating (M = 15.6). For feasibility, dissemination strategies had the highest rating (M = 15.3, significantly higher than three of the other strategies, p ≤ .002) and scale-up strategies had the lowest rating (M = 14.4).

Conclusions

Capacity-building and dissemination strategies may be well-received and readily deployed by policy implementers to support EBPs implementation with revenue from taxes earmarked for behavioral health services. Adapting definitions of implementation strategies for policy-focused topics, and applying established measures of acceptability and feasibility to these strategies, demonstrates utility as an approach to advance research on policy-focused implementation strategies.

From bench to policy: a critical analysis of models for evidence-informed policymaking in healthcare

Background

The use of research evidence in policy making is a complex and challenging process that has a long history in various fields, especially in healthcare. Different terms and concepts have been used to describe the relationship between research and policy, but they often lack clarity and consensus. To address this gap, several strategies and models have been proposed to facilitate evidence informed policy making and to identify the key factors and mechanisms involved. This study aims to critically review the existing models of evidence informed policy making (EIPM) in healthcare and to assess their strengths and limitations.

Method

A systematic search and review conducted to identify and critically assess EIPM models in healthcare. We searched PubMed, Web of Science and Scopus databases as major electronic databases and applied predefined inclusion criteria to select the models. We also checked the citations of the included models to find other scholars' perspectives. Each model was described and critiqued each model in detail and discussed their features and limitations.

Result

Nine models of EIPM in healthcare were identified. While models had some strengths in comprehension, flexibility and theoretical foundations, analysis also identified limitations including: presupposing rational policymaking; lacking alternatives for time-sensitive situations; not capturing policy complexity; neglecting unintended effects; limited context considerations; inadequate complexity concepts; limited collaboration guidance; and unspecified evidence adaptations.

Conclusion

The reviewed models provide useful frameworks for EIPM but need further improvement to address their limitations. Concepts from sociology of knowledge, change theory and complexity science can enrich the models. Future EIPM models should better account for the complexity of research-policy relationships and provide tailored strategies based on the policy context.

Advancing the implementation of take-home naloxone by community pharmacists: Testing the role of COM-B

INTRODUCTION

Opioid-related overdose fatalities are rising despite the increased accessibility of take-home naloxone (THN). Targeted implementation strategies are needed to improve the distribution of naloxone. This study investigates the effectiveness of a short video targeting pharmacists that addresses implementation barriers.

METHODS

A pre-post, mixed methods design was adopted to examine the effect of a brief behaviour change intervention (an educational video informed by the capability, opportunity, motivation affecting behaviour (COM-B) model), on factors affecting pharmacists' implementation of THN in Western Australia. Paired samples t-tests for were used to investigate intentions, knowledge, skill, confidence, feasibility, appropriateness, acceptability, attitudes, anticipated patient reactions, social support and implementation climate. Structural equation modelling examined the associations between constructs and to test the proposed mediation of motivation on capability and opportunity affecting intentions to discuss and provide THN.

RESULTS

We analysed data from 102 participants. At follow-up and after all participants had viewed the video, participants had significantly improved intentions, skill, confidence, anticipated reactions, social support and perceptions that THN implementation was feasible, appropriate and acceptable. No significant differences were seen for attitudes, knowledge or implementation climate. The proposed mediation effect of motivation on the associations between opportunity and intentions and capability and intentions was not supported.

DISCUSSION AND CONCLUSIONS

A short video directly targeting identified implementation barriers has the ability to improve key influences in the provision of THN. Dissemination of information to community pharmacists is a challenge. Implementation strategies addressing knowledge and targeting other levels of influence on intentions and behaviour are required.

The "D&I Bridge": introducing a teaching tool to define the D, the I, and the why

Interest in learning dissemination and implementation (D&I) science is at an all-time high. As founding faculty and fellows of a new center focused on D&I science, we have found that non-specialist researchers and newcomers to D&I science often express confusion around the difference between the D and the I. Relatedly, they struggle to identify what their specific D&I projects target to impact public health within the amorphous "black box" that is the singular, loosely defined "research-to-practice gap." To improve conceptual clarity and enhance engagement with D&I science, we developed a graphic-the D&I Bridge-and an accompanying glossary of terms to use as a teaching and framing tool. The D&I Bridge depicts D&I science as bridging what we know from public health knowledge to what we do in public health practice with intention and equity, and it spans over four distinct, inter-related gaps: the public health supply gap, the public health demand gap, the methodological/scientific gap, and the expertise capacity gap. The public health supply gap is addressed by implementation strategies, whereas the public health demand gap is addressed by dissemination strategies. The methodological/scientific gap is addressed by producing generalizable knowledge about D&I, and the expertise capacity gap is addressed by developing the multi-disciplinary workforce needed to advance D&I. Initial practice feedback about the D&I Bridge has been positive, and this conceptualization of D&I science has helped inform our center's D&I training, D&I project consultations, and strategic planning. We believe the D&I Bridge provides a useful heuristic for helping non-specialists understand the differential scopes of various D&I science projects as well as specific gaps that may be addressed by D&I methods.

Implicit and explicit: a scoping review exploring the contribution of anthropological practice in implementation science

BACKGROUND

This study's goal is to identify the existing variation in how, why, and by whom anthropological practice is conducted as part of implementation science projects. As doctorally trained anthropologists, we sought to characterize how and why the term "ethnography" was variously applied in the implementation science literature and characterize the practice of anthropology within and across the field.

METHODS

While we follow the PRISMA-ScR checklist, we present the work with a narrative approach to accurately reflect our review process. A health services librarian developed a search strategy using subject headings and keywords for the following databases: PubMed, Embase (Elsevier), Cochrane CENTRAL (Wiley), CIHAHL (EBSCO), PsycINFO (EBSCO), Web of Science Core Collection, and Anthropology Plus (EBSCO). We focused on the practice of anthropology in implementation research conducted in a healthcare setting, in English, with no date restrictions. Studies were included if they applied one or several elements of anthropological methods in terms of study design, data collection, and/or analysis.

RESULTS

The database searches produced 3450 results combined after duplicates were removed, which were added to Rayyan for two rounds of screening by title and abstract. A total of 487 articles were included in the full-text screening. Of these, 227 were included and received data extraction that we recorded and analyzed with descriptive statistics in three main domains: (1) anthropological methods; (2) implementation science methods; and (3) study context. We found the use of characteristic tools of anthropology like ethnography and field notes are usually not systematically described but often mentioned. Further, we found that research design decisions and compromises (e.g., length of time in the field, logistics of stakeholder involvement, reconciling diverse firsthand experiences) that often impact anthropological approaches are not systematically described.

CONCLUSIONS

Anthropological work often supports larger, mixed-methods implementation projects without being thoroughly reported. Context is essential to anthropological practice and implicitly fundamental to implementation research, yet the goals of anthropology and how its practice informs larger research projects are often not explicitly stated.

A scoping review reveals candidate quality indicators of knowledge translation and implementation science practice tools

OBJECTIVES

To identify candidate quality indicators from existing tools that provide guidance on how to practice knowledge translation and implemenation science (KT practice tools) across KT domains (dissemination, implementation, sustainability, and scalability).

STUDY DESIGN AND SETTING

We conducted a scoping review using the Joanna Briggs Institute Manual for Evidence Synthesis. We systematically searched multiple electronic databases and the gray literature. Documents were independently screened, selected, and extracted by pairs of reviewers. Data about the included articles, KT practice tools, and candidate quality indicators were analyzed, categorized, and summarized descriptively.

RESULTS

Of 43,060 titles and abstracts that were screened from electronic databases and gray literature, 850 potentially relevant full-text articles were identified, and 253 articles were included in the scoping review. Of these, we identified 232 unique KT practice tools from which 27 unique candidate quality indicators were generated. The identified candidate quality indicators were categorized according to the development (n = 17), evaluation (n = 5) and adaptation (n = 3) of the tools, and engagement of knowledge users (n = 2). No tools were identified that appraised the quality of KT practice tools.

CONCLUSIONS

The development of a quality appraisal instrument of KT practice tools is needed. The results will be further refined and finalized in order to develop a quality appraisal instrument for KT practice tools.

Designing for dissemination among public health and clinical practitioners in the USA

Introduction

The slow adoption of evidence-based interventions reflects gaps in effective dissemination of research evidence. Existing studies examining designing for dissemination (D4D), a process that ensures interventions and implementation strategies consider adopters' contexts, have focused primarily on researchers, with limited perspectives of practitioners. To address these gaps, this study examined D4D practice among public health and clinical practitioners in the USA.

Methods

We conducted a cross-sectional study among public health and primary care practitioners in April to June 2022 (analyzed in July 2022 to December 2022). Both groups were recruited through national-level rosters. The survey was informed by previous D4D studies and pretested using cognitive interviewing.

Results

Among 577 respondents, 45% were public health and 55% primary care practitioners, with an overall survey response rate of 5.5%. The most commonly ranked sources of research evidence were email announcements for public health practitioners (43.7%) and reading academic journals for clinical practitioners (37.9%). Practitioners used research findings to promote health equity (67%) and evaluate programs/services (66%). A higher proportion of clinical compared to public health practitioners strongly agreed/agreed that within their work setting they had adequate financial resources (36% vs. 23%, p < 0.001) and adequate staffing (36% vs. 24%, p = 0.001) to implement research findings. Only 20% of all practitioners reported having a designated individual or team responsible for finding and disseminating research evidence.

Conclusions

Addressing both individual and modifiable barriers, including organizational capacity to access and use research evidence, may better align the efforts of researchers with priorities and resources of practitioners.

External context in individual placement and support implementation: a scoping review with abductive thematic analysis

BACKGROUND

Context including the external context may considerably affect the adoption, implementation, sustainment, and scale-up of evidence-based practices. We investigated external contextual features by conducting a scoping review of empirical research regarding the implementation of an evidence-based psychiatric or mental health vocational rehabilitation service called Individual Placement and Support (IPS).

METHODS

The protocol for the scoping review was registered with the Open Science Framework. We used the methodology by Joanna Briggs Institute for conducting the scoping review and reported it according to the PRISMA-ScR checklist. We searched 12 databases for research regarding 'Individual Placement and Support' or 'Evidence-Based Supported Employment'. We retained peer-reviewed empirical studies investigating external contextual factors and their impact on IPS implementation outcomes. We extracted data from the eligible articles and conducted descriptive and thematic analyses.

RESULTS

Fifty-nine original research papers met our eligibility requirements and were retained after reviewing 1124 titles and abstracts and 119 full texts. The analysis generated two main themes: (1) external contextual determinants of service delivery and (2) external systems influencing the evidence-to-practice process. The first main theme encompassed policies and laws, financing, and administratively instituted support resources, and organizational arrangements associated with external stakeholders that may facilitate or hinder the local implementation. The second main theme comprised strategies and actions used by different stakeholders to facilitate implementation locally or scale-up efforts at a system level.

DISCUSSION

Our scoping review illustrates the important role that external contextual factors play and how they may facilitate or hinder the implementation and scale-up of the IPS model across mental health services in different countries. Consideration of these factors by decision-makers in mental health and welfare services, planners, providers, and practitioners is likely to facilitate the development of effective strategies for bridging the evidence-practice gap in implementing the EBPs. Finally, the scoping review identified gaps in knowledge and offered suggestions for future research.

TRIAL REGISTRATION

Open Science Framework.

Urologists' Perceptions and Practices Related to Patient Smoking and Cessation: A National Assessment From the 2021 American Urological Association Census

OBJECTIVE

To assess urologists' perceptions and practices related to smoking and smoking cessation.

MATERIALS AND METHODS

Six survey questions were designed to assess beliefs, practices, and determinants related to tobacco use assessment and treatment (TUAT) in outpatient urology clinics. These questions were included in an annual census survey (2021) offered to all practicing urologists. Responses were weighted to represent the practicing US population of nonpediatric urologists (N = 12,852). The primary outcome was affirmative responses to the question, "Do you agree it is important for urologists to screen for and provide smoking cessation treatment to patients in the outpatient clinic?" Practice patterns, perceptions, and opinions of optimal care delivery were assessed.

RESULTS

In total, 98% of urologists agreed (27%) or strongly agreed (71%) that cigarette smoking is a significant contributor to urologic disease. However, only 58% agreed that TUAT is important in urology clinics. Most urologists (61%) advise patients who smoke to quit but do not provide additional cessation counseling or medications or arrange follow-up. The most frequently identified barriers to TUAT were lack of time (70%), perceptions that patients are unwilling to quit (44%), and lack of comfort prescribing cessation medications (42%). Additionally, 72% of respondents stated that urologists should provide a recommendation to quit and refer patients for cessation support.

CONCLUSION

TUAT does not routinely occur in an evidence-based fashion in outpatient urology clinics. Addressing established barriers and facilitating these practices with multilevel implementation strategies can promote tobacco treatment and improve outcomes for patients with urologic disease.

Dissemination of public health research to prevent non-communicable diseases: a scoping review

BACKGROUND

Dissemination is a critical element of the knowledge translation pathway, and a necessary step to ensure research evidence is adopted and implemented by key end users in order to improve health outcomes. However, evidence-based guidance to inform dissemination activities in research is limited. This scoping review aimed to identify and describe the scientific literature examining strategies to disseminate public health evidence related to the prevention of non-communicable diseases.

METHODS

Medline, PsycInfo and EBSCO Search Ultimate were searched in May 2021 for studies published between January 2000 and the search date that reported on the dissemination of evidence to end users of public health evidence, within the context of the prevention of non-communicable diseases. Studies were synthesised according to the four components of Brownson and colleagues' Model for Dissemination of Research (source, message, channel and audience), as well as by study design.

RESULTS

Of the 107 included studies, only 14% (n = 15) directly tested dissemination strategies using experimental designs. The remainder primarily reported on dissemination preferences of different populations, or outcomes such as awareness, knowledge and intentions to adopt following evidence dissemination. Evidence related to diet, physical activity and/or obesity prevention was the most disseminated topic. Researchers were the source of disseminated evidence in over half the studies, and study findings/knowledge summaries were more frequently disseminated as the message compared to guidelines or an evidence-based program/intervention. A broad range of dissemination channels were utilised, although peer-reviewed publications/conferences and presentations/workshops predominated. Practitioners were the most commonly reported target audience.

CONCLUSIONS

There is a significant gap in the peer reviewed literature, with few experimental studies published that analyse and evaluate the effect of different sources, messages and target audiences on the determinants of uptake of public health evidence for prevention. Such studies are important as they can help inform and improve the effectiveness of current and future dissemination practices in public health contexts.

Amplifying consumers as partners in dissemination and implementation science and practice

Background

This Viewpoint argues for consumers (people with lived experience and their families) to be amplified as key partners in dissemination and implementation science and practice.

Method

We contend that consumer opinion and consumer demand can be harnessed to influence practitioners and policymakers.

Results

Amplifying consumers' voices can improve the fit of evidence-based interventions to the intended end user. We offer recommendations of frameworks to engage consumers in the dissemination and implementation of health interventions. We discuss the primary types of evidence consumers may rely upon, including testimonials and lived experience.

Conclusions

Our intention is for this Viewpoint to continue the momentum in dissemination and implementation science and practice of engaging consumers in our work.

Where do psychologists turn to inform clinical decisions? Audience segmentation to guide dissemination strategies

Background

Audience segmentation is an analysis technique that can identify meaningful subgroups within a population to inform the tailoring of dissemination strategies. We have conducted an empirical clustering audience segmentation study of licensed psychologists using survey data about the sources of knowledge they report most often consulting to guide their clinical decision-making. We identify meaningful subgroups within the population and inform the tailoring of dissemination strategies for evidence-based practice (EBP) materials.

Method

Data come from a 2018-2019 web-based survey of licensed psychologists who were members of the American Psychological Association (APA; N = 518, response rate = 29.8%). Ten dichotomous variables assessed sources that psychologists regularly consult to inform clinical decision-making (e.g., colleagues, academic literature, and practice guidelines). We used latent class analysis to identify segments of psychologists who turn to similar sources and named each segment based on the segment's most salient characteristics.

Results

Four audience segments were identified: the No-guidelines (45% of psychologists), Research-driven (16%), Thirsty-for-knowledge (9%), and No-reviews (30%). The four segments differed not only in their preferred sources of knowledge, but also in the types of evidence-based posttraumatic stress disorder (PTSD) treatments they provide, their awareness and usage intention of the APA PTSD clinical practice guideline, and attitudes toward clinical practice guidelines.

Conclusion

The results demonstrate that licensed psychologists are heterogeneous in terms of their knowledge-seeking behaviors and preferences for knowledge sources. The distinctive characteristics of these segments could guide the tailoring of dissemination materials and strategies to subsequently enhance the implementation of EBP among psychologists.

Unintended consequences of disseminating behavioral health evidence to policymakers: Results from a survey-based experiment

Background

Communication research demonstrates that messages often have unintended consequences, but this work has received limited attention in implementation science. This dissemination experiment sought to determine whether state-tailored policy briefs about the behavioral health consequences of adverse childhood experiences (ACEs), compared to national policy briefs on the topic, increased state legislators'/staffers' perceptions of the policy brief relevance and parental blame for the consequences of ACEs, and whether effects differed between Democrats and Republicans.

Method

A preregistered, web-based survey experiment with U.S. state legislators/staffers was conducted in 2021 (n  =  133). Respondents were randomized to view a policy brief about the behavioral health consequences of ACEs that included state-tailored data (intervention condition) or national data (control condition) and then answered survey questions. Dependent variables were perceived policy brief relevance and parental blame for the consequences of ACEs.

Results

The mean policy brief relevance score was 4.1% higher in the intervention than in the control condition (p  =  .24), but the mean parental blame score was 16.5% higher (p  =  .02). When outcomes were dichotomized, 61.2% of respondents in the intervention condition rated parents as "very much to blame" for the consequences of ACEs compared to 37.1% in the control condition (p  =  .01). When the sample was stratified by political affiliation, the effect of the state-tailored policy brief on parental blame was larger in magnitude among Democrats and not significant among Republicans. The intervention policy brief increased the mean parental blame score by 22.8% among Democrats relative to the control policy brief (p  =  .007) and doubled the proportion rating parents as "very much to blame" (52.2% vs. 26.1%, p  =  .03).

Conclusions

Despite limited statistical power, state-tailored policy briefs significantly increased state legislators'/staffers' perceptions of parental blame for the behavioral health consequences of ACEs, relative to a policy brief with national data. Unintended messaging effects warrant greater attention in dissemination research and practice.

Movement guidelines for young children: Engaging stakeholders to design dissemination strategies in the Hong Kong early childhood education context

Background

Early childhood is a critical period during which patterns of movement behaviors are formed. The World Health Organization had endorsed guidelines for physical activity, sedentary behavior and sleep over a 24-h time period, which had been adopted by the Center for Health Protection of Hong Kong. This paper reports on stakeholder engagements that were conducted to inform the design of strategies to disseminate the guidelines in early childhood education (ECE) settings.

Methods

Using a mixed-methods study design, we sought to (a) assess the stakeholders' levels of awareness and knowledge of the Hong Kong movement guidelines for young children and (b) identify the factors that influence the uptake of the said guidelines. We conducted an online survey of early childhood education teachers (N =314), twelve focus groups involving teachers (N = 18) and parents (N = 18), and individual interviews of key informants (N = 7) and domestic workers who provide care for preschool-aged children (N = 7). Descriptive statistics were used for the quantitative data, and thematic analysis was performed on the qualitative data using an inductive and semantic approach following a realist framework.

Findings

Our findings show that teachers were aware of the movement guidelines for young children, but their knowledge of the specific guidelines was deficient; parents and domestic workers had limited awareness and knowledge of the guidelines. Uptake of the movement guidelines is enabled by parent engagement, activities in the ECE centers, home-school cooperation, and community activities for children. The challenges include the time poverty of parents, local curriculum requirements, limited physical spaces, social values, and pandemic-related restrictions.

Conclusion

We recommend that dissemination strategies in the ECE context should deliver knowledge content and support stakeholders in mitigating the challenges associated with time, space, and social conditions.