Exploring public health researchers' approaches, barriers, and needs regarding dissemination: A mixed-methods exploration

Background

Although there is growing attention to research translation, dissemination practices remain underdeveloped. This study aimed to gain insights into the dissemination approaches, barriers for dissemination, and needs for dissemination support of public health researchers of the Amsterdam Public Health (APH) research institute.

Methods

A concurrent mixed-methods design was used, collecting quantitative and qualitative data through a survey and qualitative data from interviews. Researchers of the Health Behaviors and Chronic Diseases (HBCD) research line of APH were approached via email with a link to an online survey. For the interviews, we aimed to balance researchers in terms of career phase and position. Data were analyzed through descriptive statistics and thematic content analysis.

Results

HBCD researchers primarily rely on traditional approaches for dissemination, e.g. academic journals (93%), conferences (93%), and reports to funders (71%). Social media (67%) was also frequently mentioned. Dissemination is often prioritized late due to time constraints and competing priorities. Researchers mentioned a lack of time, money, knowledge, and skills but also limited awareness of available support as barriers. A need for more resources, education, and a shift in mindset was expressed, suggesting a comprehensive inspiring platform and stronger in-house connections as solutions.

Conclusion

HBCD researchers emphasized the importance of dedicated time and budget for dissemination, as well as other forms of institutional support. Overall, there is a need for a shift in mindset, more educational initiatives, greater integration of dissemination into researchers' roles, the establishment of a comprehensive inspiring platform, and stronger in-house connections to support dissemination efforts.

Mixed methods evaluation of the inaugural year of the Cancer Prevention and Control Research Network's (CPCRN) scholars program

PURPOSE

A diverse workforce trained in dissemination & implementation (D&I) science is critical for improving cancer outcomes and reducing cancer-related health disparities. This study aims to describe and evaluate impact of the Cancer Prevention and Control Research Network (CPCRN) Scholars Program in preparing scholars for collaborative careers in cancer control and implementation research and practice, and offers evaluation-driven recommendations for program improvements.

METHODS

The CPCRN Scholars Workgroup conducted a sequential, mixed methods evaluation. We collected baseline and follow-up surveys and invited all 20 scholars and ten mentors to participate in an exit interview. We assessed the experience with the Scholar's program, ratings of D&I competences, progress on their project, feedback about the curriculum, and understanding of implementation science.

RESULTS

Over 86% partially or fully completed their project within 9 months; 78% of scholars engaged with a CPCRN workgroup. Scholars rated the following program components as valuable: the Putting Public Health Evidence in Action (PPHEIA) training (88.9%), D&I training modules (83.3%), and webinars (kickoff webinar-88.9% and selecting theories/models-88.9%). There was an increase in D&I competencies from baseline to posttest, with the greatest in community engagement topics. About 78% reported that they were satisfied with format of the activities and increased confidence in ability to discuss D&I concepts. From the qualitative interviews, the benefit of the program was becoming more knowledgeable about D&I research and networking.

CONCLUSION

The inaugural year of the program yielded positive results, particularly related to increasing knowledge about D&I science and cancer control. This program builds the capacity of students, researchers and practitioners in D&I science.

Process evaluation of an academic dissemination and implementation science capacity building program

The UC San Diego Altman Clinical and Translational Research Institute Dissemination and Implementation Science Center (DISC) launched in 2020 to provide dissemination and implementation science (DIS) training, technical assistance, community engagement, and research advancement. DISC developed a program-wide logic model to inform a process evaluation of member engagement and impact related to DISC services. The DISC Logic Model (DLM) served as the framework for a process evaluation capturing quantitative and qualitative information about scientific activities, outputs, and outcomes. The evaluation involved a multimethod approach with surveys, attendance tracking, feedback forms, documentation of grant outcomes, and promotions metrics (e.g., Twitter engagement). There were 540 DISC Members at the end of year 2 of the DISC. Engagement in the DISC was high with nearly all members endorsing at least one scientific activity. Technical assistance offerings such as DISC Journal Club and consultation were most frequently used. The most common scientific outputs were grant submission (65, 39%), formal mentoring for career award (40, 24%), and paper submission (34, 21%). The DLM facilitated a comprehensive process evaluation of our center. Actionable steps include prioritizing technical assistance, strengthening networking opportunities, identifying streamlined approaches to facilitate DIS grant writing through writing workshops, as well as "office hours" or organized writing leagues.

Beginning to Address an Implementation Gap in Asthma: Clinicians' Views of Prescribing Reliever Budesonide-Formoterol Inhalers and SMART in the United States

BACKGROUND

The Global Initiative for Asthma and National Asthma Education and Prevention Program recently made paradigm-shifting recommendations regarding inhaler management in asthma. The Global Initiative for Asthma now recommends that combination inhaled corticosteroid (ICS)-formoterol inhalers replace short-acting β-agonists as the preferred reliever therapy at all steps of asthma management. Although the most recent guidelines of the National Asthma Education and Prevention Program did not review reliever ICS-formoterol usage in mild asthma, they similarly recommended single maintenance and reliever therapy (SMART) at steps 3 and 4 of asthma management. Despite these recommendations, many clinicians-particularly in the United States-are not prescribing new inhaler paradigms. Clinician-level reasons for this implementation gap remain largely unexplored.

OBJECTIVE

To gain an in-depth understanding of the facilitators and barriers to prescribing reliever ICS-formoterol inhalers and SMART in the United States.

METHODS

Community and academic primary care providers, pulmonologists, and allergists who reported regularly caring for adults with asthma were interviewed. Interviews were recorded, transcribed, qualitatively coded, and analyzed using the Consolidated Framework for Implementation Research. Interviews were continued until theme saturation.

RESULTS

Among 20 interviewed clinicians, only 6 clinicians described regularly prescribing ICS-formoterol inhalers as a reliever inhaler (either alone or within SMART). Significant barriers to new inhaler approaches included concerns surrounding a lack of Food and Drug Administration labeling for ICS-formoterol as a reliever therapy, a lack of awareness regarding a patient's formulary-preferred ICS-long-acting β-agonist choices, the high cost of combination inhalers, and time constraints. Facilitators to using new inhaler approaches included clinicians' beliefs that the latest inhaler recommendations are simpler and more congruent with real-world patients' behavior, and that a potential change in management strategy would offer a valuable opportunity for shared decision making.

CONCLUSIONS

Although new guidelines exist in asthma, many clinicians described significant barriers to using them including medicolegal issues, pharmaceutical formulary confusion, and high drug costs. Nonetheless, most clinicians believed that the latest inhaler approaches would be more intuitive for their patients and would offer an opportunity for patient-centered collaboration and care. Stakeholders may find these results useful in future attempts to increase the real-world adoption of recent asthma recommendations.

A systematic review of dissemination and implementation science capacity building programs around the globe

BACKGROUND

Research centers and programs focused on dissemination and implementation science (DIS) training, mentorship, and capacity building have proliferated in recent years. There has yet to be a comprehensive inventory of DIS capacity building program (CBP) cataloging information about activities, infrastructure, and priorities as well as opportunities for shared resources, collaboration, and growth. The purpose of this systematic review is to provide the first inventory of DIS CBPs and describe their key features and offerings.

METHODS

We defined DIS CBPs as organizations or groups with an explicit focus on building practical knowledge and skills to conduct DIS for health promotion. CBPs were included if they had at least one capacity building activity other than educational coursework or training alone. A multi-method strategy was used to identify DIS CBPs. Data about the characteristics of DIS CBPs were abstracted from each program's website. In addition, a survey instrument was developed and fielded to gather in-depth information about the structure, activities, and resources of each CBP.

RESULTS

In total, 165 DIS CBPs met our inclusion criteria and were included in the final CBP inventory. Of these, 68% are affiliated with a United States (US) institution and 32% are internationally based. There was one CBP identified in a low- and middle-income country (LMIC). Of the US-affiliated CBPs, 55% are embedded within a Clinical and Translational Science Award program. Eighty-seven CBPs (53%) responded to a follow-up survey. Of those who completed a survey, the majority used multiple DIS capacity building activities with the most popular being Training and Education (n=69, 79%) followed by Mentorship (n=58, 67%), provision of DIS Resources and Tools (n=57, 66%), Consultation (n=58, 67%), Professional Networking (n=54, 62%), Technical Assistance (n=46, 52%), and Grant Development Support (n=45, 52%).

CONCLUSIONS

To our knowledge, this is the first study to catalog DIS programs and synthesize learnings into a set of priorities and sustainment strategies to support DIS capacity building efforts. There is a need for formal certification, accessible options for learners in LMICs, opportunities for practitioners, and opportunities for mid/later stage researchers. Similarly, harmonized measures of reporting and evaluation would facilitate targeted cross-program comparison and collaboration.

Enhancing review criteria for dissemination and implementation science grants

BACKGROUND

The existing grant review criteria do not consider unique methods and priorities of Dissemination and Implementation Science (DIS). The ImplemeNtation and Improvement Science Proposals Evaluation CriTeria (INSPECT) scoring system includes 10 criteria based on Proctor et al.'s "ten key ingredients" and was developed to support the assessment of DIS research proposals. We describe how we adapted INSPECT and used it in combination with the NIH scoring system to evaluate pilot DIS study proposals through our DIS Center.

METHODS

We adapted INSPECT to broaden considerations for diverse DIS settings and concepts (e.g., explicitly including dissemination and implementation methods). Five PhD-level researchers with intermediate to advanced DIS knowledge were trained to conduct reviews of seven grant applications using both the INSPECT and NIH criteria. The INSPECT overall scores range from 0 to 30 (higher scores are better), and the NIH overall scores range from 1 to 9 (lower scores are better). Each grant was independently reviewed by two reviewers, then discussed in a group meeting to compare the experiences using both criteria to evaluate the proposal and to finalize scoring decisions. A follow-up survey was sent to grant reviewers to solicit further reflections on each scoring criterion.

RESULTS

Averaged across reviewers, the INSPECT overall scores ranged from 13 to 24, while the NIH overall scores ranged from 2 to 5. Reviewer reflections highlighted the unique value and utility for each scoring criterion. The NIH criteria had a broad scientific purview and were better suited to evaluate more effectiveness-focused and pre-implementation proposals not testing implementation strategies. The INSPECT criteria were easier to rate in terms of the quality of integrating DIS considerations into the proposal and to assess the potential for generalizability, real-world feasibility, and impact. Overall, reviewers noted that INSPECT was a helpful tool to guide DIS research proposal writing.

CONCLUSIONS

We confirmed complementarity in using both scoring criteria in our pilot study grant proposal review and highlighted the utility of INSPECT as a potential DIS resource for training and capacity building. Possible refinements to INSPECT include more explicit reviewer guidance on assessing pre-implementation proposals, providing reviewers with the opportunity to submit written commentary with each numerical rating, and greater clarity on rating criteria with overlapping descriptions.

Methods to improve the translation of evidence-based interventions: A primer on dissemination and implementation science for occupational safety and health researchers and practitioners

Objective

A limited focus on dissemination and implementation (D&I) science has hindered the uptake of evidence-based interventions (EBIs) that reduce workplace morbidity and mortality. D&I science methods can be used in the occupational safety and health (OSH) field to advance the adoption, implementation, and sustainment of EBIs for complex workplaces. These approaches should be responsive to contextual factors, including the needs of partners and beneficiaries (such as employers, employees, and intermediaries).

Methods

By synthesizing seminal literature and texts and leveraging our collective knowledge as D&I science and/or OSH researchers, we developed a D&I science primer for OSH. First, we provide an overview of common D&I terminology and concepts. Second, we describe several key and evolving issues in D&I science: balancing adaptation with intervention fidelity and specifying implementation outcomes and strategies. Next, we review D&I theories, models, and frameworks and offer examples for applying these to OSH research. We also discuss widely used D&I research designs, methods, and measures. Finally, we discuss future directions for D&I science application to OSH and provide resources for further exploration.

Results

We compiled a D&I science primer for OSH appropriate for practitioners and evaluators, especially those newer to the field.

Conclusion

This article fills a gap in the OSH research by providing an overview of D&I science to enhance understanding of key concepts, issues, models, designs, methods and measures for the translation into practice of effective OSH interventions to advance the safety, health and well-being of workers.

Expanding access to medications for opioid use disorder in primary care clinics: an evaluation of common implementation strategies and outcomes

BACKGROUND

To combat the opioid epidemic in the USA, unprecedented federal funding has been directed to states and territories to expand access to prevention, overdose rescue, and medications for opioid use disorder (MOUD). Similar to other states, California rapidly allocated these funds to increase reach and adoption of MOUD in safety-net, primary care settings such as Federally Qualified Health Centers. Typical of current real-world implementation endeavors, a package of four implementation strategies was offered to all clinics. The present study examines (i) the pre-post effect of the package of strategies, (ii) whether/how this effect differed between new (start-up) versus more established (scale-up) MOUD practices, and (iii) the effect of clinic engagement with each of the four implementation strategies.

METHODS

Forty-one primary care clinics were offered access to four implementation strategies: (1) Enhanced Monitoring and Feedback, (2) Learning Collaboratives, (3) External Facilitation, and (4) Didactic Webinars. Using linear mixed effects models, RE-AIM guided outcomes of reach, adoption, and implementation quality were assessed at baseline and at 9 months follow-up.

RESULTS

Of the 41 clinics, 25 (61%) were at MOUD start-up and 16 (39%) were at scale-up phases. Pre-post difference was observed for the primary outcome of percent of patient prescribed MOUD (reach) (β_time = 3.99; 0.73 to 7.26; p = 0.02). The largest magnitude of change occurred in implementation quality (ES = 0.68; 95% CI = 0.66 to 0.70). Baseline MOUD capability moderated the change in reach (start-ups 22.60%, 95% CI = 16.05 to 29.15; scale-ups -4.63%, 95% CI = -7.87 to -1.38). Improvement in adoption and implementation quality were moderately associated with early prescriber engagement in Learning Collaboratives (adoption: ES = 0.61; 95% CI = 0.25 to 0.96; implementation quality: ES = 0.55; 95% CI = 0.41 to 0.69). Improvement in adoption was also associated with early prescriber engagement in Didactic Webinars (adoption: ES = 0.61; 95% CI = 0.20 to 1.05).

CONCLUSIONS

Rather than providing an all-clinics-get-all-components package of implementation strategies, these data suggest that it may be more efficient and effective to tailor the provision of implementation strategies based on the needs of clinic. Future implementation endeavors could benefit from (i) greater precision in the provision of implementation strategies based on contextual determinants, and (ii) the inclusion of strategies targeting engagement.

Adapting systematic scoping study methods to identify cancer-specific physical activity opportunities in Ontario, Canada

BACKGROUND

Identifying cancer-specific physical activity programs and post-secondary courses targeting students in academic settings (i.e., "real world" opportunities) may promote physical activity behaviors among cancer survivors. Using knowledge synthesis methods such as systematic scoping study methods may facilitate knowledge tool development and guide evidence-based practice to improve knowledge transfer. However, identifying these opportunities poses a challenge as systematic scoping study methods have yet to be applied and adapted to this context. Thus, to extend systematic scoping study methods, the purpose of the current investigation is to describe the adaptation of systematic scoping study methods in the context of cancer-specific "real world" opportunities in Ontario, Canada.

METHODS

Systematic scoping study methods were adapted to develop a knowledge tool, which was a credible resource website for researchers, clinicians, and survivors. Three search strategies including Advanced Google Search, targeted website search, and consultations with experts were used to identify eligible (e.g., appropriate for cancer survivors, offered in the community) cancer-specific physical activity programs. Only the targeted website search was used to search post-secondary institutions because they are centralized onto one government website.

RESULTS

Fifty-eight programs and 10 post-secondary courses met the eligibility criteria. Relevant data from these opportunities were extracted, charted, synthesized, and uploaded onto the resource website. The most successful search strategy for cancer-specific physical activity programs was the targeted website search followed by Google Advanced Search and consultations with content experts.

CONCLUSIONS

Challenges were experienced due to lack of standard reporting among opportunities, bias of potentially relevant records, and changing nature of resulting records. The current investigation demonstrated that systematic scoping study methods can be applied to cancer-specific physical activity programs and post-secondary courses in the context of cancer survivorship in Ontario yielding robust results. The method can be further adapted and updated in future knowledge syntheses in health-related contexts.

SYSTEMATIC REVIEW REGISTRATION

The systematic scoping review method protocol has not been registered.

Conducting a Pragmatic Trial in Integrated Primary Care: Key Decision Points and Considerations

Pragmatic trials testing the effectiveness of interventions under “real world” conditions help bridge the research-to-practice gap. Such trial designs are optimal for studying the impact of implementation efforts, such as the effectiveness of integrated behavioral health clinicians in primary care settings. Formal pragmatic trials conducted in integrated primary care settings are uncommon, making it difficult for researchers to anticipate the potential pitfalls associated with balancing scientific rigor with the demands of routine clinical practice. This paper is based on our experience conducting the first phase of a large, multisite, pragmatic clinical trial evaluating the implementation and effectiveness of behavioral health consultants treating patients with chronic pain using a manualized intervention, brief cognitive behavioral therapy for chronic pain (BCBT-CP). The paper highlights key choice points using the PRagmatic-Explanatory Continuum Indicator Summary (PRECIS-2) tool. We discuss the dilemmas of pragmatic research that we faced and offer recommendations for aspiring integrated primary care pragmatic trialists.

Building capacity in dissemination and implementation science: a systematic review of the academic literature on teaching and training initiatives

BACKGROUND

The field of dissemination and implementation (D&I) science has grown significantly over recent years. Alongside this, an increased demand for training in D&I from researchers and implementers has been seen. Research describing and evaluating D&I training opportunities, referred to here as 'capacity building initiatives' (CBIs), can help provide an understanding of different methods of training as well as training successes and challenges. However, to gain a more detailed understanding of the evidence-base and how D&I CBIs are being reported in publications, a field-wide examination of the academic literature is required.

METHODS

Systematic review to identify the type and range of D&I CBIs discussed and/or appraised in the academic literature. EMBASE, Medline and PsycINFO were searched between January 2006 and November 2019. Articles were included if they reported on a D&I CBI that was developed by the authors (of each of the included articles) or the author's host institution. Two reviewers independently screened the articles and extracted data using a standardised form.

RESULTS

Thirty-one articles (from a total of 4181) were included. From these, 41 distinct D&I CBIs were identified which focussed on different contexts and professions, from 8 countries across the world. CBIs ranged from short courses to training institutes to being part of academic programmes. Nearly half were delivered face-face with the remainder delivered remotely or using a blended format. CBIs often stipulated specific eligibility criteria, strict application processes and/or were oversubscribed. Variabilities in the way in which the D&I CBIs were reported and/or evaluated were evident.

CONCLUSIONS

Increasing the number of training opportunities, as well as broadening their reach (to a wider range of learners), would help address the recognised deficit in D&I training. Standardisation in the reporting of D&I CBIs would enable the D&I community to better understand the findings across different contexts and scientific professions so that training gaps can be identified and overcome. More detailed examination of publications on D&I CBIs as well as the wider literature on capacity building would be of significant merit to the field.

An Interrupted Time Series Analysis of the Dissemination of a Sickle Cell Vaso-Occlusive Episode Treatment Algorithm and a Case Management Referral Form for Individuals With Sickle Cell Disease in the Emergency Department

BACKGROUND

Sickle cell disease is associated with frequent vaso-occlusive episode and emergency department visits. Our group developed (1) a vaso-occlusive episode treatment algorithm based on the National Heart, Lung, and Blood Institute recommendations, and (2) a case management referral form to identify social behavioral health needs of patients with sickle cell disease in the emergency department. The aims of this project were to (1) disseminate the vaso-occlusive episode algorithm and case management referral form, and (2) to evaluate the individual provider-reported awareness, use, and preferred method of access to each tool among emergency department providers in North Carolina.

METHODS

An interrupted time series analysis was used to study the impact that an educational effort had on the awareness of a sickle cell vaso-occlusive episode treatment algorithm and a case management referral form. A targeted list was developed to identify the providers working in emergency departments with the largest number of sickle cell disease patient visits. In-service education was provided to targeted emergency departments in North Carolina over a period of 3 years. The vaso-occlusive episode algorithm and case management referral form were put up on the websites of professional organizations. Surveys were provided to emergency department providers at these targeted emergency departments with a baseline and post dissemination at 20 and 32 months for assessing the provider awareness, use, and preferred method of access of the tools. Additional feedback could be given by the participants through telephone interviews. Descriptive statistics were obtained, and content analysis was performed on interviews.

RESULTS

We received survey responses for the following periods: baseline (T1, n = 190), post dissemination at 20 (T2, n = 142), and 32 months (T3, n = 93). Awareness of the tools was between 42% (baseline) and 41% (post dissemination at T2, T3) for the vaso-occlusive episodes algorithm and 25% (baseline) and 29% (post dissemination at T2, T3) for the case management referral form. However, use of these tools was found to be low as only 19% of the emergency department providers used the vaso-occlusive episode algorithm at T1 and 13% T2, while 5% of emergency department providers used the case management referral form at T1 and 6% at T2. With further education about the tools, an increase in the usage of the tools was observed T3, which was 29% for the vaso-occlusive episodes algorithm and 9% for the case management referral form. Lack of incorporation of the decision support tools into emergency department processes was observed to be an overarching barrier to dissemination of the tools identified in interviews (n = 8).

CONCLUSIONS

This study can be used to inform future strategies on dissemination of evidence-based tools to emergency department providers.

An application of the Science Impact Framework to the Cancer Prevention and Control Research Network from 2014-2018

The Cancer Prevention and Control Research Network (CPCRN) is a strategic collaborative effort focused on accelerating the dissemination and implementation of evidence-based cancer prevention and control interventions to communities. In 2014, the CPCRN Coordinating Center began collecting information in alignment with the Centers for Disease Control and Prevention's (CDC) Science Impact Framework. The Science Impact Framework is a CDC-developed approach to trace and link CDC science to events and/or actions recognized as influential to public health, beyond peer-reviewed publications. The purpose of this paper is to highlight the impact of CPCRN activities using key indicators guided by the CDC's Science Impact Framework. We reviewed annual progress reports submitted by CPCRN centers from 2014 to 2019 to identify the impact indicators. The CPCRN activities were linked to four domains from the Science Impact Framework and its key indicators: Disseminating Science (presentations, training, general communication, and other communication reports), Creating Awareness (requests for expertise, and feedback), Catalyzing Action (grant applications, partnerships and collaborations, research & development, advocacy groups, office practice/point of care changes, and technology creating), and Effecting Change (building public health practice, creation of registries/surveillance, legal/policy changes, and change instilled). Overall, CPCRN activities demonstrate impact beyond peer-reviewed publications and thus should continue building scientific impact to ultimately influence health outcomes.

Evaluating the NICHE program in an Academic Medical Center: Uncovering the missing link between training and effective practice change in the care of older adults

PURPOSE

This paper recounts the history and experiences of one academic medical center that sought to improve the care of elderly patients by adopting and adapting the Geriatric Resource Nurse (GRN) model recommended by the Nurses Improving the Care of Healthsystem Elderly (NICHE) program. A formal evaluation examined the perceptions, opinions and attitudes of non-GRN nursing peers, Nurse Managers (NMs) and members of the Inter-Professional Advisory Board (IAB) regarding GRN practices and the institution's NICHE program.

DESIGN

A qualitative research design with purposive sampling was utilized.

METHODS

Semi-structured interviews and focus groups conducted in the fall/winter 2017 were analyzed using standard content analysis methods of isolating and grouping contextual themes without a predefined framework.

FINDINGS

The institution's GRN training program, a hybrid of the national NICHE program and organization-developed components, has strong support among NMs, members of the IAB and other RNs. However, there exist many misconceptions, erroneous information and misunderstandings about the program and the roles and expectations of GRNs that have hindered the likelihood of producing desired outcomes.

CONCLUSIONS

Training GRNs was insufficient in disseminating and implementing evidenced-based geriatric practices in this hospital. Future work in this area would benefit from integrating concepts and methods from dissemination and implementation science when developing, launching, and sustaining NICHE programs.

CLINICAL RELEVANCE

Integrating principles and models of dissemination and implementation science can increase consistent use of evidence based practices and the likelihood of improved geriatric patient outcomes in NICHE hospitals.

The dynamic influence of human resources on evidence-based intervention sustainability and population outcomes: an agent-based modeling approach

Background

Sustaining evidence-based interventions (EBIs) is an ongoing challenge for dissemination and implementation science in public health and social services. Characterizing the relationship among human resource capacity within an agency and subsequent population outcomes is an important step to improving our understanding of how EBIs are sustained. Although human resource capacity and population outcomes are theoretically related, examining them over time within real-world experiments is difficult. Simulation approaches, especially agent-based models, offer advantages that complement existing methods.

Methods

We used an agent-based model to examine the relationships among human resources, EBI delivery, and population outcomes by simulating provision of an EBI through a hypothetical agency and its staff. We used data from existing studies examining a widely implemented HIV prevention intervention to inform simulation design, calibration, and validity. Once we developed a baseline model, we used the model as a simulated laboratory by systematically varying three human resource variables: the number of staff positions, the staff turnover rate, and timing in training. We tracked the subsequent influence on EBI delivery and the level of population risk over time to describe the overall and dynamic relationships among these variables.

Results

Higher overall levels of human resource capacity at an agency (more positions) led to more extensive EBI delivery over time and lowered population risk earlier in time. In simulations representing the typical human resource investments, substantial influences on population risk were visible after approximately 2 years and peaked around 4 years.

Conclusions

Human resources, especially staff positions, have an important impact on EBI sustainability and ultimately population health. A minimum level of human resources based on the context (e.g., size of the initial population and characteristics of the EBI) is likely needed for an EBI to have a meaningful impact on population outcomes. Furthermore, this model demonstrates how ABMs may be leveraged to inform research design and assess the impact of EBI sustainability in practice.

Electronic supplementary material

The online version of this article (10.1186/s13012-018-0767-0) contains supplementary material, which is available to authorized users.

Small business Total Worker Health: A conceptual and methodological approach to facilitating organizational change

Nearly half of Americans are employed by small businesses, and future projections suggest that the number of those employed by small businesses will rise. Despite this, there is relatively little small business intervention research on the integration of health protection and health promotion, known as Total Worker Health® (TWH). We first discuss the importance of studying small businesses in TWH research and practice. Second, we describe an example of a small business TWH intervention, Health Links™ plus TWH owner/senior manager leadership training, that we are evaluating via the Small+Safe+Well (SSWell) study. Key features of the intervention and the SSWell study include attention to multi-level influences on worker health, safety and well-being; organizational change; and dissemination and implementation science strategies via the RE-AIM model. We offer several considerations for future small business TWH research and practice both in terms of the small business context as well as intervention development and evaluation. Our goal is to provide TWH researchers and practitioners with a framework and an example of how to approach small business TWH interventions. Ultimately, through the SSWell study, we aim to provide small businesses with strong evidence to support the use of TWH strategies that are practical, effective and sustainable.

Dissemination and implementation science in program evaluation: A telemental health clinical consultation case example

Increased attention has been placed on evaluating the extent to which clinical programs that support the behavioral health needs of youth have effective processes and result in improved patient outcomes. Several theoretical frameworks from dissemination and implementation (D&I) science have been put forth to guide the evaluation of behavioral health program implemented in the context of real-world settings. Although a strong rationale for the integration of D&I science in program evaluation exists, few examples exist available to guide the evaluator in integrating D&I science in the planning and execution of evaluation activities. This paper seeks to inform program evaluation efforts by outlining two D&I frameworks and describing their integration in program evaluation design. Specifically, this paper seeks to support evaluation efforts by illustrating the use of these frameworks via a case example of a telemental health consultation program in pediatric primary care designed to improve access to behavioral health care for children and adolescents in rural settings. Lessons learned from this effort, as well as recommendations regarding the future evaluation of programs using D&I science to support behavioral health care in community-based settings are discussed.