The future of health behavior change research: what is needed to improve translation of research into health promotion practice?

Process evaluation of a comprehensive approach to reintegration of disability benefit recipients with multiple problems (CARm) into the labour market

PURPOSE

As the effect evaluation of our randomized controlled trial the "Comprehensive Approach of Reintegration for clients with Multiple problems" (CARm) showed no superior effect on re-integration into paid employment of the clients when compared with clients of the care as usual, we conducted this process evaluation to gain insight into whether the intervention was conducted according to protocol.

METHODS

Using questionnaires on recruitment, reach, dose delivered, dose received, fidelity, context, and satisfaction we collected data from 40 labour experts of the Public Employment Service of the Dutch Social Security Institute, and from 166 disability benefit recipients dealing with multiple problems.

RESULTS

Only few of the labour experts provided the key elements of the intervention to their clients. Between the clients of both groups were no significant differences in the dose received. More than half of the labour experts of the intervention group reported organizational changes.

CONCLUSION

The lack of effect of the CARm intervention was almost certainly caused by implementation failure. Once again this study showed the importance of involving all stakeholders in developing and the conduct of the intervention, and of clarifying the consequences for the organization, to ensure that it can be conducted according to protocol.

Demonstration Projects to Test Built Environment Changes: A Systematic Review

CONTEXT

Built environment interventions (pedestrian/bicycle infrastructure and enhanced access) mitigate barriers to physical activity by making the healthy choice the default choice. Demonstration projects (eg, temporary pedestrian lanes or sidewalks marked with tape) are used to test these interventions before making permanent changes. However, it is unknown whether demonstration projects lead to desired built environment changes.

OBJECTIVE

To systematically review the literature to determine outcomes and overall public health impacts of demonstration projects and whether they lead to permanent changes to the built environment.

DESIGN

Systematic review, conducted from March to September 2022 by searching PubMed and EBSCOhost for peer-reviewed literature and Google for gray (non-peer-reviewed) literature. Inclusion criteria were policy, systems, or environmental interventions; temporary implementation; and presence of evaluation data. Exclusion criteria were individual/interpersonal-level interventions, permanent implementation, and absence of evaluation data. Two authors coded for inclusion/exclusion and resolved discrepancies, coded a portion of included sources and resolved discrepancies, refined coding guide definitions, and coded remaining sources.

MAIN OUTCOME MEASURES

Data were extracted based on the expanded RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, which incorporates constructs of the Implementation Outcomes Framework (acceptability, appropriateness, feasibility).

RESULTS

Gray (N = 23) and peer-reviewed (N = 1) sources describing unique demonstration projects (N = 31) met inclusion criteria. Projects tested built environment interventions including traffic calming measures, crosswalks, bike lanes, intersection design, and trails. Sources primarily reported effectiveness (typically improved safety), maintenance, acceptability, and appropriateness. Most sources did not report projects leading to permanent changes to the built environment.

CONCLUSIONS

Based on inconsistent reporting of key outcomes (number of community members reached, changes to physical activity levels), overall impacts are unknown. Most demonstration projects captured community members' feedback, which was typically positive, but it is unknown whether feedback led to long-term changes. We recommend providing improved demonstration project guidance for practitioners to facilitate robust data collection, including suggested evaluation methods and tools.

Evaluating the feasibility and acceptability of an adapted fencing intervention in breast cancer surgery post-operative care: the RIPOSTE pilot randomized trial

Background

Adapted physical activity programs have shown promising results in reducing the physical, social and psychological side effects associated with breast cancer, but the extent to which they can be effectively adopted, implemented and maintained is unclear. The aim of this study is to use the framework to guide the planning and evaluation of programs according to the 5 following keys: Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) framework to evaluate a fencing program under the French acronym RIPOSTE (Reconstruction, Image de soi, Posture, Oncologie, Santé, Thérapie, Escrime) literally in English (Reconstruction, Self-Image, Posture, Oncology, Health, Therapy, Fencing). This program is an innovative intervention focused on improving the quality of life (QoL) of breast cancer surgery patients through fencing.

Methods

A convergent mixed methods pilot study was conducted to preliminary evaluate the different RE-AIM dimension of the pilot program. Twenty-four participants who have just undergone surgery for invasive breast cancer were randomly allocated in two groups: one group started immediately after their inclusion (Early RIPOSTE group) and the other started 3 months following their inclusion (Delayed RIPOSTE group). Participants answered a questionnaire at inclusion and at the end of the program on QoL, shoulder functional capacity, fatigue, anxiety-depression and physical activity.

Results

RIPOSTE program was able to reach mainly young and dynamic participants, attracted by the originality of fencing and keen to improve their physical condition. Regarding effectiveness, our results suggest a trend to the improvement of QoL, shoulder functional capacity, fatigue and anxiety-depression state, even without any significant differences between the Early RIPOSTE group and the Delayed RIPOSTE group.

Discussions

The cooperation, exchanges and cohesion within the group greatly facilitated the adoption of the program, whereas interruptions during school vacations were the main barriers. The intervention was moderately well implemented and adherence to the protocol was suitable.

Conclusion

RIPOSTE is an acceptable and effective program for involving breast cancer survivors in physical activity, that needs to be tested at a larger scale to investigate its effectiveness, but has the potential to be transferred and scaled up worldwide.

Accounting for diversity in the treatment of suicide and self-injury: A systematic review of the past 50 years of randomized controlled trials

PURPOSE

Patients receiving treatment for self-injurious thoughts and behaviors (SITBs) have diverse backgrounds, yet it remains unclear exactly who is represented in the current SITB treatment literature.

METHODS

We conducted a systematic review of the past 50 years of randomized controlled trials (RCTs) testing SITB treatments to evaluate sampling practices and reporting of sample characteristics, as well as inclusion of global populations across the included 525 papers. We also assessed changes over the past five decades in these three domains.

RESULTS

SITB RCTs frequently reported age and sex (98.6%-95.1%), less frequently reported race (83.4%-38.6%), socioeconomic status (48.1%-46.1%) and ethnicity (41.9%-8.1%), and rarely reported LGBTQ+ status (3.7%-1.6%). U.S.-based RCTs featured predominantly White, non-Hispanic, and non-LGBTQ+ samples. Most RCTs were conducted in high-income North American or European countries. Sample reporting practices, sample representativeness, and inclusion of global populations modestly and inconsistently improved over time.

CONCLUSIONS

There has not been substantial improvement in reporting practices, sample representativeness, or inclusion of global populations in SITB RCTs over the past 50 years. Acknowledging who is being studied and representing diverse populations in SITB treatment research is key to connecting research advances with those who may need it most.

Navigating the field of implementation science towards maturity: challenges and opportunities

BACKGROUND

The field of implementation science has significantly expanded in size and scope over the past two decades, although work related to understanding implementation processes have of course long preceded the more systematic efforts to improve integration of evidence-based interventions into practice settings. While this growth has had significant benefits to research, practice, and policy, there are some clear challenges that this period of adolescence has uncovered.

MAIN BODY

This invited commentary reflects on the development of implementation science, its rapid growth, and milestones in its establishment as a viable component of the biomedical research enterprise. The authors reflect on progress in research and training, and then unpack some of the consequences of rapid growth, as the field has grappled with the competing challenges of legitimacy among the research community set against the necessary integration and engagement with practice and policy partners. The article then enumerates a set of principles for the field's next developmental stage and espouses the aspirational goal of a "big tent" to support the next generation of impactful science.

CONCLUSION

For implementation science to expand its relevance and impact to practice and policy, researchers must not lose sight of the original purpose of the field-to support improvements in health and health care at scale, the importance of building a community of research and practice among key partners, and the balance of rigor, relevance, and societal benefit.

Community Engagement in Implementation Science: the Impact of Community Engagement Activities in the DECIPHeR Alliance

Background

The translation of evidence-based interventions into practice settings remains challenging. Implementation science aims to bridge the evidence-to-practice gap by understanding multilevel contexts and tailoring evidence-based interventions accordingly. Engaging community partners who possess timely, local knowledge is crucial for this process to be successful. The Disparities Elimination through Coordinated Interventions to Prevent and Control Heart and Lung Disease Risk (DECIPHeR) Alliance aims to address cardiopulmonary health disparities by engaging diverse community partners to improve the implementation of evidence-based interventions. The goal of the Community Engagement Subcommittee is to strengthen community engagement practice across DECIPHeR. This paper presents the subcommittee's "Why We Engage Communities" statement that outlines why community engagement is critical for implementation science. The paper also provides case examples of DECIPHeR community engagement activities.

Methods

To develop the "Why We Engage Communities" statement, we conducted a literature review, surveyed subcommittee members to assess the importance of community engagement in their work, and integrated community partner feedback. We synthesize the findings into three key themes and present examples of community engagement activities and their impact across DECIPHeR projects.

Results

The statement presents three themes that illustrate why community engagement increases the impact of implementation and health equity research. Community engagement (1) engages local knowledge and expertise, (2) promotes authentic relationships, and (3) builds community and researcher capacity. The statement provides a guiding framework for strengthening DECIPHeR research and enhancing community partnerships.

Conclusion

Community engagement can improve the implementation of evidence-based interventions across diverse settings, improving intervention effectiveness in underserved communities and furthering health equity.

Perceptions of self-monitoring dietary intake according to a plate-based approach: A qualitative study

Dietary self-monitoring is a behaviour change technique used to help elicit and sustain dietary changes over time. Current dietary self-monitoring tools focus primarily on itemizing foods and counting calories, which can be complex, time-intensive, and dependent on health literacy. Further, there are no dietary self-monitoring tools that conform to the plate-based approach of the 2019 Canada Food Guide (CFG), wherein the recommended proportions of three food groups are visually represented on a plate without specifying daily servings or portion sizes. This paper explored the perceptions of end-users (i.e., general public) and Registered Dietitians of iCANPlateTM-a dietary self-monitoring mobile application resembling the CFG. Qualitative data were collected through virtual focus groups. Focus group questions were based on the Capability, Opportunity, Motivation-Behaviour (COM-B) theoretical framework to explore perceptions of using the CFG and currently available dietary self-monitoring tools. The prototype iCANPlateTM (version 0.1) was presented to gain feedback on perceived barriers and facilitators of its use. Focus group discussions were audio recorded and verbatim transcribed. Trained researchers used thematic analysis to code and analyze the transcripts independently. Seven focus groups were conducted with Registered Dietitians (n = 44) and nine focus groups with members from the general public (n = 52). During the focus groups, participants mainly discussed the capabilities and opportunities required to use the current iteration of iCANPlateTM. Participants liked the simplicity of the application and its capacity to foster self-awareness of dietary behaviours rather than weight control or calorie counting. However, concerns were raised regarding iCANPlateTM's potential to improve adherence to dietary self-monitoring due to specific characteristics (i.e., insufficient classifications, difficulty in conceptualizing proportions, and lack of inclusivity). Overall, participants liked the simplicity of iCANPlateTM and its ability to promote self-awareness of dietary intakes, primarily through visual representation of foods on a plate as opposed to reliance on numerical values or serving sizes, were benefits of using the app. Findings from this study will be used to further develop the app with the goal of increasing adherence to plate-based dietary approaches.

RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) Evaluation of the Use of Activity Trackers in the Clinical Care of Adults Diagnosed With a Chronic Disease: Integrative Systematic Review

BACKGROUND

Chronic diseases are a leading cause of adult mortality, accounting for 41 million deaths globally each year. Low levels of physical activity and sedentary behavior are major risk factors for adults to develop a chronic disease. Physical activity interventions can help support patients in clinical care to be more active. Commercial activity trackers that can measure daily steps, physical activity intensity, sedentary behavior, and distance moved are being more frequently used within health-related interventions. The RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework is a planning and evaluation approach to explore the reach, effectiveness, adoption, implementation, and maintenance of interventions.

OBJECTIVE

The objective of this study is to conduct an integrative systematic review and report the 5 main RE-AIM dimensions in interventions that used activity trackers in clinical care to improve physical activity or reduce sedentary behavior in adults diagnosed with chronic diseases.

METHODS

A search strategy and study protocol were developed and registered on the PROSPERO platform. Inclusion criteria included adults (18 years and older) diagnosed with a chronic disease and have used an activity tracker within their clinical care. Searches of 10 databases and gray literature were conducted, and qualitative, quantitative, and mixed methods studies were included. Screening was undertaken by more than 1 researcher to reduce the risk of bias. After screening, the final studies were analyzed using a RE-AIM framework data extraction evaluation tool. This tool assisted in identifying the 28 RE-AIM indicators within the studies and linked them to the 5 main RE-AIM dimensions.

RESULTS

The initial search identified 4585 potential studies. After a title and abstract review followed by full-text screening, 15 studies were identified for data extraction. The analysis of the extracted data found that the RE-AIM dimensions of adoption (n=1, 7% of studies) and maintenance (n=2, 13% of studies) were underreported. The use of qualitative thematic analysis to understand the individual RE-AIM dimensions was also underreported and only used in 3 of the studies. Two studies used qualitative analysis to explore the effectiveness of the project, while 1 study used thematic analysis to understand the implementation of an intervention.

CONCLUSIONS

Further research is required in the use of activity trackers to support patients to lead a more active lifestyle. Such studies should consider using the RE-AIM framework at the planning stage with a greater focus on the dimensions of adoption and maintenance and using qualitative methods to understand the main RE-AIM dimensions within their design. These results should form the basis for establishing long-term interventions in clinical care.

TRIAL REGISTRATION

PROSPERO CRD42022319635; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=319635.

Systematic review of alternative HIV preexposure prophylaxis care delivery models to improve preexposure prophylaxis services

OBJECTIVES

To identify types, evidence, and study gaps of alternative HIV preexposure prophylaxis (PrEP) care delivery models in the published literature.

DESIGN

Systematic review and narrative synthesis.

METHODS

We searched in the US Centers for Disease Control and Prevention (CDC) Prevention Research Synthesis (PRS) database through December 2022 (PROSPERO CRD42022311747). We included studies published in English that reported implementation of alternative PrEP care delivery models. Two reviewers independently reviewed the full text and extracted data by using standard forms. Risk of bias was assessed using the adapted Newcastle-Ottawa Quality Assessment Scale. Those that met our study criteria were evaluated for efficacy against CDC Evidence-Based Intervention (EBI) or Evidence-Informed Intervention (EI) criteria or Health Resources and Services Administration Emergency Strategy (ES) criteria, or for applicability by using an assessment based on the Reach, Effectiveness, Adoption, Implementation, and Maintenance framework.

RESULTS

This review identified 16 studies published between 2018 and 2022 that implemented alternative prescriber ( n  = 8), alternative setting for care ( n  = 4), alternative setting for laboratory screening ( n  = 1), or a combination of the above ( n  = 3) . The majority of studies were US-based ( n  = 12) with low risk of bias ( n  = 11). None of the identified studies met EBI, EI, or ES criteria. Promising applicability was found for pharmacists prescribers, telePrEP, and mail-in testing.

CONCLUSIONS

Delivery of PrEP services outside of the traditional care system by expanding providers of PrEP care (e.g. pharmacist prescribers), as well as the settings of PrEP care (i.e. telePrEP) and laboratory screening (i.e. mail-in testing) may increase PrEP access and care delivery.

Underreporting contextual factors preclude the applicability appraisal in primary care randomized controlled trials

OBJECTIVES

To assess applicability reporting in randomized controlled trials (RCTs) conducted in primary care (PC).

STUDY DESIGN AND SETTING

We used a random sample of PC RCTs published between 2000 and 2020 to assess applicability. We extracted data related to setting, population, intervention (including implementation), comparator, outcomes, and context. Based on data availability, we assessed whether the five predefined applicability questions were adequately addressed by each PC RCT.

RESULTS

Adequately described elements that were reported frequently (>50%) included the responsible organization for intervention provision (97, 93.3%), study population characteristics (94, 90.4%), intervention implementation including monitoring and evaluation (92, 88.5%), intervention components (89, 85.6%), time frame (82, 78.8%), baseline prevalence (58, 55.8%), and the type of setting and location (53, 51%). Elements that were often underreported included contextual factors, that is, evidence of differential effects across sociodemographic or other groupings (2, 1.9%), intervention components tailored for specific settings (7, 6.7%), health system structure (32, 30.8%), factors affecting implementation (40, 38.5%) and organization structure (50, 48.1%). The proportion of trials that adequately addressed each applicability question ranged between 1% and 20.2%, while none RCT could address all of them.

CONCLUSION

Underreporting contextual factors jeopardize the appraisal of applicability in PC RCTs.

Effects of School-Based Health-Promoting Activities on Children's Health: A Pragmatic Real-World Study

More insight into the health effects of scaled-up school-based interventions in real-world settings is vital to sustainably integrate health in all schools. This study investigated the effectiveness of the scaled-up Healthy Primary School of the Future (HPSF) initiative in real-world school contexts on children's health (behaviours). From 2019 to 2022, eleven Dutch primary schools implemented HPSF-related activities. In 315 children from study years four to six (aged 7-11 years) from these schools, anthropometric measurements were performed, and questionnaires assessing the children's dietary behaviours and physical activity were administered. COVID-19 greatly limited the implementation of HPSF-related activities. Therefore, the results were compared between schools categorised as medium implementers and schools categorised as low implementers. After correction for baseline, waist circumference in the medium implementer group was significantly higher at one-year follow-up (B = 1.089, p = 0.003) and two-year follow-up (B = 1.665, p < 0.001) compared with waist circumference in the low implementer group. No significant effects were observed for other outcomes. This study showed hardly any effects of the scaled-up HPSF initiative, mainly due to the limited implementation caused by COVID-19. More research investigating the real-world effectiveness of HPSF and comparable programmes is greatly encouraged to advance the field of school-based health promotion.

Prioritization of Evidence-Based and Evidence-Informed Interventions for Retention in Medical Care for Persons with HIV

Up to 50% of those diagnosed with HIV in the U.S. are not retained in medical care. Care retention provides opportunity to monitor benefits of HIV therapy and enable viral suppression. To increase retention, there is a need to prioritize best practices appropriate for translation and dissemination for real-world implementation. Eighteen interventions from CDC's Compendium of Evidence-Based Interventions were scored using the RE-AIM framework to determine those most suitable for dissemination. A CDC Division of HIV Prevention workgroup developed a RE-AIM scale with emphasis on the Implementation and Maintenance dimensions and less emphasis on the Efficacy dimension since all 18 interventions were already identified as evidence-based or evidence-informed. Raters referenced primary efficacy publications and scores were averaged for a ranked RE-AIM score for interventions. Of 18 interventions, four included care linkage and 7 included viral suppression outcomes. Interventions received between 20.6 and 35.3 points (45 maximum). Scores were converted into a percentage of the total possible with ranges between 45.8 and 78.4%. Top four interventions were ARTAS (78.4%); Routine Screening for HIV (RUSH) (73.2%); Optn4Life (67.4%) and Virology Fast Track (65.9%). All four scored high on Implementation and Maintenance dimensions. Select items within the scale were applicable to health equity, covering topics such as reaching under-served focus populations and acceptability to that population. Navigation-enhanced Case Management (NAV) scored highest on the health equity subscale. RE-AIM prioritization scores will inform dissemination and translation efforts, help clinical staff select feasible interventions for implementation, and support sustainability for those interventions.

Differences between complete and incomplete couples in physical health research: Implications for methods and generalizability

RATIONALE

Couples-based interventions to facilitate health behavior change and improve disease outcomes are gaining attention from researchers. Dyadic research, however, poses unique methodological challenges that have raised questions about research samples and the generalizability of findings.

OBJECTIVE

The current study examined whether couples in which both partners participated (i.e., complete couples) in a couples' health research study systematically differed from those in which only one partner participated (i.e., incomplete couples).

METHODS

Between January 2014 and November 2015, an online survey was advertised on Facebook to people who were both engaged to be married and living in the Denver, Colorado metropolitan area. When the first member of a couple completed the survey (initially recruited participant), they provided their partner's email address, which prompted the research staff to invite the second partner to complete the same online survey. Constructs assessed included demographics, health behaviors, general health status, and relationship quality. Participants answered questions about themself and their partner. Approximately one-third of the partners of initially recruited participants also participated. Data from initial participants in complete couples (N = 265) were compared to data from initial participants in incomplete couples (N = 509).

RESULTS

Chi-square tests and independent samples t-tests indicated participants in incomplete couples had significantly lower relationship quality, worse health behaviors, and poorer health status compared to those in complete couples. Reports on partner health behaviors also differed in the same direction between the two groups. Participants in complete couples were more likely to be White, less likely to have children, and had more education than in incomplete couples.

CONCLUSIONS

Findings suggest that studies requiring both members of a couple may recruit samples that are less diverse with fewer health concerns than research that only requires individual participation if their partner refused participation. Implications and recommendations for future couples-based health research are discussed.

Guidance on selecting a translational framework for intervention development: Optimizing interventions for impact

Intervention development frameworks offer the behavioral sciences a systematic and rigorous empirical process to guide the translation of basic science into practice in pursuit of desirable public health and clinical outcomes. The multiple frameworks that have emerged share a goal of optimization during intervention development and can increase the likelihood of arriving at an effective and disseminable intervention. Yet, the process of optimizing an intervention differs functionally and conceptually across frameworks, creating confusion and conflicting guidance on when and how to optimize. This paper seeks to facilitate the use of translational intervention development frameworks by providing a blueprint for selecting and using a framework by considering the process of optimization as conceptualized by each. First, we operationalize optimization and contextualize its role in intervention development. Next, we provide brief overviews of three translational intervention development frameworks (ORBIT, MRC, and MOST), identifying areas of overlap and divergence thereby aligning core concepts across the frameworks to improve translation. We offer considerations and concrete use cases for investigators seeking to identify and use a framework in their intervention development research. We push forward an agenda of a norm to use and specify frameworks in behavioral science to support a more rapid translational pipeline.

Design and development of the first randomized controlled trial of an intervention (IDEA) for sexual and gender minority older adults living with dementia and care partners

BACKGROUND

Heightened risks of cognitive impairment, disability, and barriers to care among sexual and gender minority (SGM) older adults are well documented. To date, culturally responsive evidence-based dementia interventions for this population do not exist.

OBJECTIVE

This study describes the design of the first randomized controlled trial (RCT) testing a culturally responsive cognitive behavioral and empowerment intervention, Innovations in Dementia Empowerment and Action (IDEA), developed to address the unique needs of SGM older adults living with dementia and care partners.

METHODS

IDEA is a culturally enhanced version of Reducing Disability in Alzheimer's Disease (RDAD), an efficacious, non-pharmaceutical intervention for people with dementia and care partners. We utilized a staggered multiple baseline design with the goal to enroll 150 dyads randomized into two arms of 75 dyads each, enhanced IDEA and standard RDAD.

RESULTS

IDEA was adapted using findings from the longitudinal National Health, Aging, and Sexuality/Gender study, which identified modifiable factors for SGM older adults, including SGM-specific discrimination and stigma, health behaviors, and support networks. The adapted intervention employed the original RDAD strategies and enhanced them with culturally responsive empowerment practices designed to cultivate engagement, efficacy, and support mobilization. Outcomes include adherence to physical activity, reduction in perceived stress and stigma, and increased physical functioning, efficacy, social support, engagement, and resource use.

CONCLUSION

IDEA addresses contemporary issues for underserved populations living with dementia and their care partners. Our findings will have important implications for marginalized communities by integrating and evaluating the importance of cultural responsiveness in dementia and caregiving interventions.

Improving measurement-based care implementation in adult ambulatory psychiatry: a virtual focus group interview with multidisciplinary healthcare professionals

BACKGROUND

Measurement-Based Care (MBC) is an evidence-based practice shown to enhance patient care. Despite being efficacious, MBC is not commonly used in practice. While barriers and facilitators of MBC implementation have been described in the literature, the type of clinicians and populations studied vary widely, even within the same practice setting. The current study aims to improve MBC implementation in adult ambulatory psychiatry by conducting focus group interviews while utilizing a novel virtual brainwriting premortem method.

METHODS

Semi-structured focus group interviews were conducted with clinicians (n = 18) and staff (n = 7) to identify their current attitudes, facilitators, and barriers of MBC implementation in their healthcare setting. Virtual video-conferencing software was used to conduct focus groups, and based on transcribed verbatin, emergent barriers/facilitators and four themes were identified. Mixed methods approach was utilized for this study. Specifically, qualitative data was aggregated and re-coded separately by three doctoral-level coders. Quantitative analyses were conducted from a follow-up questionnaire surveying clinician attitudes and satisfaction with MBC.

RESULTS

The clinician and staff focus groups resulted in 291 and 91 unique codes, respectively. While clinicians identified a similar number of barriers (40.9%) and facilitators (44.3%), staff identified more barriers (67%) than facilitators (24.7%) for MBC. Four themes emerged from the analysis; (1) a description of current status/neutral opinion on MBC; (2) positive themes that include benefits of MBC, facilitators, enablers, or reasons on why they conduct MBC in their practice, (3) negative themes that include barriers or issues that hinder them from incorporating MBC into their practice, and (4) requests and suggestions for future MBC implementation. Both participant groups raised more negative themes highlighting critical challenges to MBC implementation than positive themes. The follow-up questionnaire regarding MBC attitudes showed the areas that clinicians emphasized the most and the least in their clinical practice.

CONCLUSION

The virtual brainwriting premortem focus groups provided critical information on the shortcomings and strengths of MBC in adult ambulatory psychiatry. Our findings underscore implementation challenges in healthcare settings and provide insight for both research and clinical practice in mental health fields. The barriers and facilitators identified in this study can inform future training to increase sustainability and better integrate MBC with positive downstream outcomes in patient care.

Preventing Falls Among Older Adults in Primary Care: A Mixed Methods Process Evaluation Using the RE-AIM Framework

BACKGROUND AND OBJECTIVES

Falls are a leading cause of injuries and injury deaths for older adults. The Centers for Disease Control and Prevention's Stopping Elderly Accidents Deaths and Injuries (STEADI) initiative, a multifactorial approach to fall prevention, was adapted for implementation within the primary care setting of a health system in upstate New York. The purpose of this article is to: (a) report process evaluation results for this implementation using the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework and (b) examine the utility of RE-AIM for assessing barriers and facilitators.

RESEARCH DESIGN AND METHODS

This evaluation used mixed methods. Qualitative evaluation involved semistructured interviews with key stakeholders and intercept interviews with health care providers and clinic staff. Quantitative methods utilized surveys with clinic staff. Process evaluation tools were developed based on the AIM dimensions of the RE-AIM framework. The study was conducted over a 2-month period, approximately 18 months postimplementation, and complements previously published results of the program's reach and effectiveness.

RESULTS

Primary barriers by RE-AIM construct included competing organizational priorities (Adoption), competing patient care demands (Implementation), and staff turnover (Maintenance). Primary facilitators included having a physician champion (Adoption), preparing and training staff (Implementation), and communicating about STEADI and recognizing accomplishments (Maintenance).

DISCUSSION AND IMPLICATIONS

Results revealed a high degree of concordance between qualitative and quantitative analyses. The framework supported assessments of various stakeholders, multiple organizational levels, and the sequence of practice change activities. Mixed methods yielded rich data to inform future implementations of STEADI-based fall prevention.

Feasibility evaluation of the Reaching Out to Kids with Emotional Trauma (ROcKET) intervention in an elementary school: a single-arm, single-centre, feasibility study based on the RE-AIM framework

OBJECTIVE

The study purpose was to describe feasibility of implementation of the Reaching Out to Kids with Emotional Trauma (ROcKET) intervention. We hypothesised that the ROcKET Intervention would be feasible in a poor resource school.

DESIGN

We performed a single-arm, single-centr feasibility study of an intervention pilot, based on the RE-AIM framework.

SETTING

The intervention was delivered in a single K-4th elementary charter school in the Nashville, TN area, in a low-resource community.

PARTICIPANTS

57 elementary school children attending our partner school and reporting exposure to at least one adverse childhood experience (ACE) and their parents.

INTERVENTIONS

The Reaching Out to Kids with Emotional Trauma (ROcKET) intervention is a school-based multilevel intervention (individual child, family and school) that promotes positive health behaviours in children who have been exposed to ACEs.

OUTCOMES

Outcomes were gathered qualitatively via focus groups. The primary outcome was feasibility. The secondary outcomes were implementation outcomes according to the RE-AIM framework, including Reach, Effectiveness, Adoption and Implementation.

RESULTS

Of 105 eligible children, 57 children and their parents participated (54%) with 31 (54%) girls, 47 (82%) Black/African American, 5 (9%) Hispanic and 5 (9%) white. The school staff implemented all planned ROcKET sessions with >90% fidelity in each session, and 52 (91%) of children who completed the final intervention session went on to complete 6 month follow-up assessments. The average attendance at the in-school child sessions was 57 students (87%), and 35 (61%) of parents attended at least one family session, with 25 (44%) of parents attending at least half of the family sessions. 13 (23%) parents participated in the focus groups. Qualitative data suggested high parent participant satisfaction, uptake of positive health behaviours targeted by the intervention and increased quality of life.

CONCLUSIONS

Our study suggests that the ROcKET intervention was feasible and acceptably delivered in a local elementary school with high reach to low-income and minority populations. These data suggest that schools, especially those serving low-income and minority children, can be an appropriate avenue for interventions designed to address health disparities. Data from this study will be used to advise a pilot study of the intervention.

A systematic literature review of breastfeeding interventions among Black populations using the RE-AIM framework

BACKGROUND

Lactation support resources are less likely to be located in close proximity to where Black families live and there is a systemic racist health care belief that Black women prefer bottle feeding (with infant formula) over breastfeeding. Together, these lead to lower reported breastfeeding rates of Black babies compared to other racial / ethnic groups. It is imperative to have a deeper understanding of the cultural aspects as well as the underlying limitations that prevent Black women / persons from being supported to breastfeed. There is a need to know how effective breastfeeding interventions are in reaching the intended population; how well they work in promoting breastfeeding initiation and continuation; and how successful they are when implemented at the setting and staff level. The purpose of this investigation was to establish the level of internal and external validity that was reported by breastfeeding intervention studies among Black communities.

METHODS

Studies on breastfeeding interventions on Black people that were published between the years 1990 and 2019 were carefully examined through PubMed, EBSCOhost, Web of Science, and OneSearch. A total of 31 studies fulfilled the requirements to be included for this evaluation. In order to extract the information from the articles, the reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) framework extraction tool was utilized.

RESULTS

On average, the proportion of studies that reported across reach, effectiveness, adoption, implementation, and maintenance indicators was 54, 35, 19, 48, and 9%, respectively. Across core RE-AIM indicators only sample size (100%) and breastfeeding outcomes (90%) were reported consistently. External validity indicators related to representativeness of participants (16%) and sites (3%) were rarely reported. Similarly, adherence to intervention protocol, and indicator of internal validity, was reported in a small proportion of articles (19%).

CONCLUSION

This body of literature under-reported on aspects associated to both internal and external validity across all RE-AIM domains. The reporting of the individual level of representativeness; the setting level of representativeness; the intervention's adherence to the protocol; the expenses; and the factors of sustainability would benefit from improvement in future research.

Developing criteria for research translation decision-making in community settings: a systematic review and thematic analysis informed by the Knowledge to Action Framework and community input

Background

There is a pressing need to translate empirically supported interventions, products, and policies into practice to prevent and control prevalent chronic diseases. According to the Knowledge to Action (K2A) Framework, only those interventions deemed “ready” for translation are likely to be disseminated, adopted, implemented, and ultimately institutionalized. Yet, this pivotal step has not received adequate study. The purpose of this paper was to create a list of criteria that can be used by researchers, in collaboration with community partners, to help evaluate intervention readiness for translation into community and/or organizational settings.

Methods

The identification and selection of criteria involved reviewing the K2A Framework questions from the “decision to translate” stage, conducting a systematic review to identify characteristics important for research translation in community settings, using thematic analysis to select unique research translation decision criteria, and incorporating researcher and community advisory board feedback.

Results

The review identified 46 published articles that described potential criteria to decide if an intervention appears ready for translation into community settings. In total, 17 unique research translation decision criteria were identified. Of the 8 themes from the K2A Framework that were used to inform the thematic analysis, all 8 were included in the final criteria list after research supported their importance for research translation decision-making. Overall, the criteria identified through our review highlighted the importance of an intervention’s public health, cultural, and community relevance. Not only are intervention characteristics (e.g., evidence base, comparative effectiveness, acceptability, adaptability, sustainability, cost) necessary to consider when contemplating introducing an intervention to the “real world,” it is also important to consider characteristics of the target setting and/or population (e.g., presence of supporting structure, support or buy-in, changing sociopolitical landscape).

Conclusions

Our research translation decision criteria provide a holistic list for identifying important barriers and facilitators for research translation that should be considered before introducing an empirically supported intervention into community settings. These criteria can be used for research translation decision-making on the individual and organizational level to ensure resources are not wasted on interventions that cannot be effectively translated in community settings to yield desired outcomes.

Using the RE-AIM framework to evaluate the implementation of scaling-up the Friendship Bench in Zimbabwe - a quantitative observational study

BACKGROUND

This study aimed to evaluate the real-world implementation of the Friendship Bench (FB) - an evidence-based brief psychological intervention delivered by community health workers (CHWs) - three years after its implementation in three city health departments in Zimbabwe. Implementation sites were evaluated according to their current performance using the RE-AIM framework making this one of the first evaluations of a scaled-up evidence-based psychological intervention in sub-Saharan Africa (SSA).

METHODS

Using the RE-AIM guide ( www.re-aim.org ), the authors designed quantitative indicators based on existing FB implementation data. Thirty-six primary health care clinics (PHC) in Harare (n=28), Chitungwiza (n=4) and Gweru (n=4) were included. Among these clinics 20 were large comprehensive health care centers, 7 medium (mostly maternal and child healthcare) and 9 small clinics (basic medical care and acting as referral clinic). Existing data from these clinics, added to additionally collected data through interviews and field observations were used to investigate and compare the performance of the FB across clinics. The focus was on the RE-AIM domains of Reach, Adoption, and Implementation.

RESULTS

Small clinics achieved 34% reach, compared to large (15%) and medium clinics (9%). Adoption was high in all clinic types, ranging from 59% to 71%. Small clinics led the implementation domain with 53%, followed by medium sized clinics 43% and large clinics 40%. Small clinics performed better in all indicators and differences in performance between small and large clinics were significant. Program activity and data quality depends on ongoing support for delivering agents and buy-in from health authorities.

CONCLUSION

The Friendship Bench program was implemented over three years transitioning from a research-based implementation program to one led locally. The Reach domain showed the largest gap across clinics where larger clinics performed poorly relative to smaller clinics and should be a target for future implementation improvements. Program data needs to be integrated into existing health information systems. Future studies should seek to optimize scale-up and sustainment strategies to maintain effective task-shared psychological interventions in SSA.

Tensions and Paradoxes of Scaling Up: A Critical Reflection on Physical Activity Promotion

BACKGROUND

Achieving system-level, sustainable 'scale-up' of interventions is the epitome of successful translation of evidence-based approaches in population health. In physical activity promotion, few evidence-based interventions reach implementation at scale or become embedded within systems for sustainable health impact. This is despite the vast published literature describing efficacy studies of small-scale physical activity interventions. Research into physical activity scale-up (through case-study analysis; evaluations of scale-up processes in implementation trials; and mapping the processes, strategies, and principles for scale-up) has identified barriers and facilitators to intervention expansion. Many interventions are implemented at scale by governments but have not been evaluated or have unpublished evaluation information. Further, few public health interventions have evaluations that reveal the costs and benefits of scaled-up implementation. This lack of economic information introduces an additional element of risk for decision makers when deciding which physical activity interventions should be supported with scarce funding resources. Decision-makers face many other challenges when scaling interventions which do not relate to formal research trials of scale-up; Methods: To explore these issues, a multidisciplinary two-day workshop involving experts in physical activity scale-up was convened by the University of Newcastle, Australia, and the University of Ottawa, Canada (February 2019); Results: In this paper we discuss some of the scale-up tensions (challenges and conflicts) and paradoxes (things that are contrary to expectations) that emerged from this workshop in the context of the current literature and our own experiences in this field. We frame scale-up tensions according to epistemology, methodology, time, and partnerships; and paradoxes as 'reach without scale', 'planned serendipity' and 'simple complexity'. We reflect on the implications of these scale-up tensions and paradoxes, providing considerations for future scale-up research and practice moving forward; Conclusions: In this paper, we delve deeper into stakeholders' assumptions, processes and expectations of scaling up, and challenge in what ways as stakeholders, we all contribute to desired or undesired outcomes. Through a lens of 'tensions' and 'paradoxes', we make an original contribution to the scale-up literature that might influence current perspectives of scaling-up, provide future approaches for physical activity promotion, and contribute to understanding of dynamic of research-practice partnerships.

Proactive automatised lifestyle intervention (PAL) in general hospital patients: study protocol of a single-group trial

INTRODUCTION

The co-occurrence of health risk behaviours (HRBs, ie, tobacco smoking, at-risk alcohol use, insufficient physical activity and unhealthy diet) increases the risks of cancer, other chronic diseases and mortality more than additively; and applies to more than half of adult general populations. However, preventive measures that target all four HRBs and that reach the majority of the target populations, particularly those persons most in need and hard to reach are scarce. Electronic interventions may help to efficiently address multiple HRBs in healthcare patients. The aim is to investigate the acceptance of a proactive and brief electronic multiple behaviour change intervention among general hospital patients with regard to reach, retention, equity in reach and retention, satisfaction and changes in behaviour change motivation, HRBs and health.

METHODS AND ANALYSIS

A pre-post intervention study with four time points is conducted at a general hospital in Germany. All patients, aged 18-64 years, admitted to participating wards of five medical departments (internal medicine A and B, general surgery, trauma surgery, ear, nose and throat medicine) are systematically approached and invited to participate. Based on behaviour change theory and individual HRB profile, 175 participants receive individualised and motivation-enhancing computer-generated feedback at months 0, 1 and 3. Intervention reach and retention are determined by the proportion of participants among eligible patients and of participants who continue participation, respectively. Equity in reach and retention are measured with regard to school education and other sociodemographics. To investigate satisfaction with the intervention and subsequent changes, a 6-month follow-up is conducted. Descriptive statistics, multivariate regressions and latent growth modelling are applied.

ETHICS AND DISSEMINATION

The local ethics commission and data safety appointee approved the study procedures. Results will be disseminated via publication in international scientific journals and presentations on scientific conferences.

TRIAL REGISTRATION NUMBER

NCT05365269.

Neuroinflammation in HIV-associated depression: evidence and future perspectives

People living with HIV face a high risk of mental illness, especially depression. We do not yet know the precise neurobiological mechanisms underlying HIV-associated depression. Depression severity in the general population has been linked to acute and chronic markers of systemic inflammation. Given the associations between depression and peripheral inflammation, and since HIV infection in the brain elicits a neuroinflammatory response, it is possible that neuroinflammation contributes to the high prevalence of depression amongst people living with HIV. The purpose of this review was to synthesise existing evidence for associations between inflammation, depression, and HIV. While there is strong evidence for independent associations between these three conditions, few preclinical or clinical studies have attempted to characterise their interrelationship, representing a major gap in the literature. This review identifies key areas of debate in the field and offers perspectives for future investigations of the pathophysiology of HIV-associated depression. Reproducing findings across diverse populations will be crucial in obtaining robust and generalisable results to elucidate the precise role of neuroinflammation in this pathophysiology.

'I Was Present but I Was Absent': Perceptions and Experiences of the Non-Medical Use of Prescription or over the Counter Medication among Employed South African Women

BACKGROUND

The need for workplace substance use prevention programmes globally and in South Africa is driven by the growing problem of substance use and the associated burden on the health and welfare of employees, their families and organizations. Substance use, which include the non-medical use of medications (both prescription and over-the counter), remains widespread and is a major cause of mortality and a risk factor for non-communicable diseases (NCDs).

METHOD

Twenty in-depth semi-structured qualitative interviews were conducted with employed women in treatment or shortly out of treatment for the non-medically indicated use of over the counter or/and prescription medications (NMIU). These interviews were conducted face-to face with women residing in the Western and Eastern Cape provinces of South Africa. Thematic analysis using NVIVO was used to analyse data collected.

RESULTS

The findings from this study suggest that previous use of legal or illegal substances and challenging life experiences underpin pathways to the non-medical use of over-the-counter and prescription medications among employed women. Factors found to contribute to misuse relate to a lack of understanding on risks, and health professional prescribing practices, while mitigators to harmful use were related to increased awareness and understanding harmful practices, the need for improved access and referral to specialist treatment as well as prevention programmes for women.

CONCLUSION

With the improved understanding of the issues surrounding the NMIU of over-the-counter and prescription medications among employed women, the need for interventions to prevent misuse and inadvertently dependency is highlighted.

Application of community - engaged dissemination and implementation science to improve health equity

Community engagement is critical to accelerate and improve implementation of evidence-based interventions to reduce health inequities. Community-engaged dissemination and implementation research (CEDI) emphasizes engaging stakeholders (e.g., community members, practitioners, community organizations, etc.) with diverse perspectives, experience, and expertise to provide tacit community knowledge regarding the local context, priorities, needs, and assets. Importantly, CEDI can help improve health inequities through incorporating unique perspectives from communities experiencing health inequities that have historically been left out of the research process. The community-engagement process that exists in practice can be highly variable, and characteristics of the process are often underreported, making it difficult to discern how engagement of community partners was used to improve implementation. This paper describes the community-engagement process for a multilevel, pragmatic randomized trial to increase the reach and impact of evidence-based tobacco cessation treatment among Community Health Center patients; describes how engagement activities and the resulting partnership informed the development of implementation strategies and improved the research process; and presents lessons learned to inform future CEDI research.

A systematic review of randomized control trials of HPV self-collection studies among women in sub-Saharan Africa using the RE-AIM framework

Introduction

Self-collection of samples for HPV testing may increase women’s access to cervical cancer screening in low- and middle-income settings. However, implementation remains poor in many regions. The purpose of this systematic review was to examine implementation data from randomized controlled trials evaluating human papillomavirus (HPV) self-collection testing among women in sub-Saharan Africa using the RE-AIM (Reach, Efficacy/Effectiveness, Adoption, Implementation, and Maintenance) framework.

Methods

We searched four electronic databases (PubMed, CINAHL, Web of Science, and Global Health) for pragmatic randomized controlled trials that promote HPV self-collection among women in sub-Saharan Africa. Study selection and data extraction were conducted according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) checklist. Two researchers independently extracted information from each article using a RE-AIM data extraction tool. The reporting of RE-AIM dimensions was summarized and synthesized across included interventions.

Results

We identified 2008 citations, and eight studies were included. These reported on five unique interventions. The five interventions were conducted in five countries: Cameroon, Ethiopia, Kenya, Nigeria, and Uganda. Intervention reach (80%) was the most commonly reported RE-AIM dimension, followed by adoption (56%), efficacy/effectiveness (52%), implementation (47%), and maintenance (0%). All the interventions described increased uptake of HPV testing among study participants (effectiveness). However, the majority of the studies focused on reporting internal validity indicators such as inclusion criteria (100%) and exclusion criteria (100%), and few reported on external validity indicators such as participation rate (40%), intervention cost (40%), staff selection (20%), and cost of maintenance (0%).

Conclusions

Our review highlights the under-reporting of external validity indicators such as participation rate, intervention, and maintenance costs in studies of self-collection for HPV testing among women in SSA. Future research should focus on including factors that highlight internal validity factors and external validity factors to develop a greater understanding of ways to increase not only reach but also implementation and long-term maintenance of these interventions. Such data may advance the translation of HPV interventions into practice and reduce health disparities in SSA. Findings highlight the need for innovative tools such as participatory learning approaches or open challenges to expand knowledge and assessment of external validity indicators to ultimately increase the uptake of HPV testing among women in SSA.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00243-5.

Study protocol for iSIPsmarter: A randomized-controlled trial to evaluate the efficacy, reach, and engagement of a technology-based behavioral intervention to reduce sugary beverages among rural Appalachian adults

Sugar-sweetened beverage (SSB) consumption is disproportionately high among rural Appalachian adults, with intakes double the national average and nearly four times the recommended amount. This trial targets this major dietary risk factor and addresses notable gaps in the rural digital health intervention literature. iSIPsmarter is a technology-based behavior and health literacy intervention aimed at improving SSB behaviors. It is comprised of six Internet-delivered, interactive Cores delivered weekly, an integrated short message service (SMS) strategy to engage users in tracking and reporting SSB behaviors, and a cellular-enabled scale for in-home weighing. iSIPsmarter is adapted from an evidence-based intervention and is grounded by the Theory of Planned Behavior and health literacy, numeracy, and media literacy concepts. The RCT is guided by the RE-AIM framework and targets 244 rural Appalachian adults. The goal is to examine the efficacy of iSIPsmarter to reduce SSB in a two-group design [iSIPsmarter vs. static Participant Education website] with four assessment points. Changes in secondary outcomes (e.g., diet quality, weight, quality of life) and maintenance of outcomes will also be evaluated. Additional secondary aims are to examine reach and representativeness, patterns of user engagement, and cost. Two tertiary aims are exploratory mediation analyses and a systems-level, participatory evaluation to understand context for future organizational-level adoption of iSIPsmarter. The long-term goal is to sustain an effective, scalable, and high reach behavioral intervention to reduce SSB-related health inequities and related chronic conditions (i.e., obesity, diabetes, some obesity-related cancers, heart disease, hypertension, dental decay) in rural Appalachia and beyond. ClinicalTrial registry: NCT05030753.

Evaluation of the Healthy Living after Cancer text message-delivered, extended contact intervention using the RE-AIM framework

Background

Text message-delivered interventions have potential to prevent weight regain and maintain diet and physical activity behaviours through extending contact with participants following initial weight loss, lifestyle interventions. Using the RE-AIM Framework, this study evaluated the adoption, reach, implementation, effectiveness, and maintenance of an extended contact text-message intervention following the Healthy Living after Cancer (HLaC) program. HLaC was a 6-month, telephone-delivered intervention targeting healthy diet, physical activity and weight loss for adult cancer survivors, offered by Cancer Councils (CCs) in Australia.

Methods

HLaC completers (n = 182) were offered extended contact via text messages for 6-months (HLaC+Txt). Text message content/frequency was individually tailored to participant’s preferences, ascertained through two telephone-tailoring interviews with CC staff. Adoption (HLaC+Txt uptake among eligible CCs), reach (uptake by HLaC completers) and implementation (intervention cost/length; text dose) were assessed. The effectiveness of extended contact relative to historic controls was quantified by pre-to-post HLaC+Txt changes in self-reported: weight, moderate-vigorous physical activity (MVPA), fruit and vegetable intake, fat and fibre behaviour. Maintenance, following 6-months of noncontact for the intervention cohort, was assessed for these same variables. Semi-structured interviews with CC staff and participants contextualised outcomes.

Results

HLaC+Txt was adopted by all four CCs who had delivered HLaC. In total, 115 participants commenced HLaC+Txt, with reach ranging across CCs from 47 to 80% of eligible participants. The mean number of weeks participants received the text message intervention ranged across CCs from 18.5–22.2 weeks. Participants received (median, 25th,75th percentile) 83 (48, 119) texts, ranging across CCs from 40 to 112. The total cost of HLaC+Txt delivery was on average $AUD85.00/participant. No meaningful (p < 0.05) differences in self-reported outcomes were seen between HLaC+Txt and control cohorts. After 6-months no contact the intervention cohort had maintained weight, fruit intake, fat and fibre index scores relative to end of HLaC+Txt outcomes. Participants/CC staff perceived an important intervention component was maintaining accountability.

Conclusions

While feasible to implement, HLaC+Txt was not effective in the short term. However, intervention effects during the non-contact period suggest the program supports longer term maintenance of weight and diet behaviour. Intervention delivery in this real-world context highlighted key considerations for future implementation.

Trial registration

Australian and New Zealand Clinical Trials Registry (ANZCTR) - ACTRN12615000882527 (registered on 24/08/2015).

Supplementary Information

The online version contains supplementary material available at 10.1186/s12885-021-08806-4.

Small studies, big decisions: the role of pilot/feasibility studies in incremental science and premature scale-up of behavioral interventions

Background

Careful consideration and planning are required to establish “sufficient” evidence to ensure an investment in a larger, more well-powered behavioral intervention trial is worthwhile. In the behavioral sciences, this process typically occurs where smaller-scale studies inform larger-scale trials. Believing that one can do the same things and expect the same outcomes in a larger-scale trial that were done in a smaller-scale preliminary study (i.e., pilot/feasibility) is wishful thinking, yet common practice. Starting small makes sense, but small studies come with big decisions that can influence the usefulness of the evidence designed to inform decisions about moving forward with a larger-scale trial. The purpose of this commentary is to discuss what may constitute sufficient evidence for moving forward to a definitive trial. The discussion focuses on challenges often encountered when conducting pilot/feasibility studies, referred to as common (mis)steps, that can lead to inflated estimates of both feasibility and efficacy, and how the intentional design and execution of one or more, often small, pilot/feasibility studies can play a central role in developing an intervention that scales beyond a highly localized context.

Main body

Establishing sufficient evidence to support larger-scale, definitive trials, from smaller studies, is complicated. For any given behavioral intervention, the type and amount of evidence necessary to be deemed sufficient is inherently variable and can range anywhere from qualitative interviews of individuals representative of the target population to a small-scale randomized trial that mimics the anticipated larger-scale trial. Major challenges and common (mis)steps in the execution of pilot/feasibility studies discussed are those focused on selecting the right sample size, issues with scaling, adaptations and their influence on the preliminary feasibility and efficacy estimates observed, as well as the growing pains of progressing from small to large samples. Finally, funding and resource constraints for conducting informative pilot/feasibility study(ies) are discussed.

Conclusion

Sufficient evidence to scale will always remain in the eye of the beholder. An understanding of how to design informative small pilot/feasibility studies can assist in speeding up incremental science (where everything needs to be piloted) while slowing down premature scale-up (where any evidence is sufficient for scaling).

Evaluating the reach, effectiveness, adoption, implementation and maintenance of the Resistance Training for Teens program

BACKGROUND

Physical activity guidelines recommend young people engage in regular muscle-strengthening activities (e.g., resistance training [RT]). However, few school-based physical activity interventions have been delivered at-scale or promoted RT. The aim of this study was to evaluate the reach, effectiveness, adoption, implementation and maintenance of the Resistance Training for Teens (RT for Teens) program.

METHODS

Data were collected between August 2015 and October 2020. RE-AIM was operationalized as: (i) Reach: number and characteristics of students estimated to be exposed to the program; (ii) Effectiveness: impact of the program on student-level outcomes measured in a subsample of 750 students from 17 schools; (iii) Adoption: number and representativeness of schools with one or more teachers trained to deliver the program; (iv) Implementation: extent to which the program was delivered as intended; and (v) Maintenance: extent to which the program was sustained in schools.

RESULTS

The estimated program reach was ~ 10,000 students, out of a total student population of ~ 200,000 (~ 5%). Students were from diverse socioeconomic and ethnic backgrounds. Improvements in muscular fitness, RT self-efficacy, perceived cardiorespiratory fitness and flexibility, and participation in muscle-strengthening physical activities were documented. A total of 30 workshops were delivered, involving 468 teachers from 249 schools from diverse geographical regions. Implementation varied considerably, with teachers adapting the program to suit the context of their school and student cohorts. However, RT skill development and the promotion of muscular fitness were the session components delivered most during sessions. Teachers' adherence to the SAAFE (Supportive, Active, Autonomous, Fair and Enjoyable) teaching principles was high. Approximately 30% of teachers (144/476) registered to use the RT for Teens app. At the school-level, 37% (93/249) of schools had at least one registered user (teacher and/or student). A total of 2,336 workouts and 3,116 fitness tests were completed by registered users. Of the 249 schools represented, 51 (20.5%) sent an additional (previously untrained) teacher to a second workshop.

CONCLUSIONS

The RT for Teens program had broad reach and adoption. However, intervention delivery varied considerably across schools and additional support strategies are required to optimize intervention implementation and maintain program delivery over time. Future studies will benefit from the utilization of accepted frameworks, recommendations and guidelines for implementation research.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry (ACTRN12621000352808), retrospectively registered 1^st February 2021.

"Replanning" a Statewide Walking Program Through the Iterative Use of the Reach, Effectiveness, Adoption, Implementation, and Maintenance Framework

BACKGROUND

Interventions undergo adaptations when moving from efficacy to effectiveness trials. What happens beyond these initial steps-that is, when the "research" is over-is often unknown. The degree to which implementation quality remains high and impacts remain robust is underreported as these data are often less valued by community entities. Comprehensive and iterative evaluation is recommended to ensure robust outcomes over time.

METHODS

The reach, effectiveness, adoption, implementation, and maintenance framework was used within an assess, plan, do, evaluate, report process to determine the degree to which a statewide physical activity promotion program aligned with evidence-based core components, assess who was reached and impacts on physical activity behaviors, and make decisions for future iterations.

RESULTS

Walk Across Arkansas was adopted by a majority of delivery agents and was effective at increasing physical activity levels postprogram, but those effects were not maintained after 6 months. Future decisions included recruitment strategies to reach a more diverse population and a blueprint document to reduce program drift.

CONCLUSIONS

This article details the process of "replanning" a community-based physical activity intervention to understand public health impact and make decisions for future iterations. Pragmatic reach, effectiveness, adoption, implementation, and maintenance questions were useful throughout the assess, plan, do, evaluate, report process.

Increasing treatment enrollment among smokers who are not motivated to quit: a randomized clinical trial

There is a significant research-to-practice gap with respect to reaching underserved populations with evidence-based tobacco cessation treatments. Increasing enrollment in evidence-based treatments is necessary to reduce tobacco use and tobacco-related health inequities. The purpose of the current study was to evaluate whether Motivation And Problem Solving (MAPS), a flexible, holistic counseling/navigation approach delivered via phone, and proactive provision of Nicotine Replacement Therapy (NRT) would improve Quitline enrollment among a sample of low SES smokers who were not motivated to quit. In a 3×2 factorial design, cigarette smokers (N = 603) were randomized to one of six treatment conditions (Standard Treatment, MAPS-6, or MAPS-12 by NRT or no NRT). Results indicated that both MAPS-6 and MAPS-12 increased Quitline enrollment compared to Standard Treatment (ps < .03). There were no differences between MAPS conditions. NRT did not increase Quitline enrollment. MAPS is an effective intervention with the potential to be disseminated and implemented in healthcare and community settings to increase the reach of evidence-based interventions for tobacco cessation.

Self-Regulations for Educators Questionnaire (SREQ) for implementation programming

The adoption and dissemination of evidence-based programs is predicated on multiple factors, including the degree to which key stakeholders are motivated to implement program best practices. The present study focuses on the development of indicators that capture motivations of teachers to adopt school wellness programming since personal motivations are central to achieving sustainable impacts in these settings. The study specifically describes the measurement development and validation of the Self-Regulations for Educators Questionnaire (SREQ), designed to measure educators’ autonomous and controlled motivation for adopting evidence-based programming in their schools. A naturalistic design to study motivation to adopt aspects of NFL PLAY60 programming through the NFL PLAY60 FitnessGram Partnership Project was used. A total of 1,106 teachers completed the SREQ online. Internal validity was assessed through exploratory and confirmatory factor analysis, and predictive validity using structural equation modeling (SEM). The results supported the two-factor solution with separate items capturing aspects of autonomous and controlled motivation. Both factors had good internal reliability and the item-total correlation coefficients were above 0.40 for both factors. The results also supported the predictive validity as autonomous motivation positively predicted the level of overall engagement, teaching effectiveness, fitness testing reports sent home, and completion of fitness testing with students (p < .05). Controlled motivation positively predicted whether the teachers conducted fitness testing and the engagement of Play 60 Challenge (p < .05). Findings suggest that the SREQ displays a number of psychometric characteristics that make the instrument useful for examining motivation of providers to implement evidence-based best practices.

Implementation at-scale of school-based physical activity interventions: A systematic review utilizing the RE-AIM framework

School-based interventions can increase young people's physical activity levels, but few are implemented at-scale (i.e., the expanded delivery of efficacious interventions under real-world conditions into new/broader populations). The Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework can be used to describe the extent to which interventions have been implemented at-scale. The aim of our review was to determine the extent to which studies of school-based physical activity interventions implemented at-scale reported information across the RE-AIM dimensions. We conducted a systematic search of seven electronic databases to identify studies published up to June 2019. A total of 26 articles (representing 14 individual studies) met the inclusion criteria and were analyzed. Eleven studies reported actual or estimated number of students exposed to the intervention; however, the representativeness of these students was rarely reported. Nine studies reported the intervention effect on the primary outcome during scale-up. Ten studies reported the rate of participating schools/teachers; however, none reported on the characteristics of adopters/nonadopters. Eight studies reported intervention fidelity. Eleven studies described the extent to which the intervention was sustained in schools. There was considerable variability in the reporting of RE-AIM outcomes across studies. There is a need for greater consistency in the evaluation, and reporting of, school-based physical activity interventions implemented at-scale.

Red, Yellow, and Green Light Changes: Adaptations to Extension Health Promotion Programs

Extension professionals have high autonomy to adapt the programs they deliver. However, fidelity is typically not reported, so it is unknown what adaptations are made. It is also unknown whether agents have the necessary training to adapt programs while maintaining fidelity to the core components. The purpose of this study was to determine (1) adaptations that Extension agents and specialists are making to programs they deliver, (2) the reasons for making these adaptations, (3) timing of adaptations, and (4) Extension agents' and specialists' understanding of the adaptation process. Extension agents and specialists nationwide were invited to complete a survey which queried about adaptations based on the traffic light model, adaptome, and adaptation taxonomy. Specifically, the traffic light model assigns a color for adaptations: tailoring language or pictures (green), adding/substituting activities or session sequence (yellow), or deleting lessons and decreasing timeline or session length (red). Responses were received from 98 agents and 24 specialists. Most agents and specialists reported making green (85% and 79%, respectively), yellow (89% and 75%), and red light changes (81% and 58%). Agents were significantly more likely than specialists to change the age appropriateness of lessons or activities, respond to individual client needs, substitute activities, delete lessons or activities, decrease the length and/or number of sessions, and shorten the program timeline. Within green light changes, each of those that could increase cultural appropriateness (tailoring language, scenarios, and pictures) were reported by less than 50% of agents and specialists. Of the most common adaptations reported, the primary reasons for these decisions were difficulty retaining or engaging participants and lack of time/competing demands on time. Most adaptations were made before the program was delivered. Agents rated their confidence level in the program adaptation process as somewhat confident to confident. Dissemination and implementation strategies to improve program adaptation within Extension are needed, including participatory approaches, training on the adaptation process, bi-directional evidence-based program repositories, and organizational-level changes.

Using the RE-AIM framework to evaluate internal and external validity of mobile phone-based interventions in diabetes self-management education and support

OBJECTIVE

We evaluated the extent to which studies that tested short message service (SMS)- and application (app)-based interventions for diabetes self-management education and support (DSMES) report on factors that inform both internal and external validity as measured by the RE-AIM (Reach, Efficacy/Effectiveness, Adoption, Implementation, and Maintenance) framework.

MATERIALS AND METHODS

We systematically searched PubMed, Embase, Web of Science, CINAHL (Cumulative Index of Nursing and Allied Health Literature), and IEEE Xplore Digital Library for articles from January 1, 2009, to February 28, 2019. We carried out a multistage screening process followed by email communications with study authors for missing or discrepant information. Two independent coders coded eligible articles using a 23-item validated data extraction tool based on the RE-AIM framework.

RESULTS

Twenty studies (21 articles) were included in the analysis. The comprehensiveness of reporting on the RE-AIM criteria across the SMS- and app-based DSMES studies was low. With respect to internal validity, most interventions were well described and primary clinical or behavioral outcomes were measured and reported. However, gaps exist in areas of attrition, measures of potential negative outcomes, the extent to which the protocol was delivered as intended, and description on delivery agents. Likewise, we found limited information on external validity indicators across adoption, implementation, and maintenance domains.

CONCLUSIONS

Reporting gaps were found in internal validity but more so in external validity in the current SMS- and app-based DSMES literature. Because most studies in this review were efficacy studies, the generalizability of these interventions cannot be determined. Future research should adopt the RE-AIM dimensions to improve the quality of reporting and enhance the likelihood of translating research to practice.

Internal and External Validity of Social Media and Mobile Technology-Driven HPV Vaccination Interventions: Systematic Review Using the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) Framework

Social media human papillomavirus (HPV) vaccination interventions show promise for increasing HPV vaccination rates. An important consideration for the implementation of effective interventions into real-world practice is the translation potential, or external validity, of the intervention. To this end, we conducted a systematic literature review to describe the current body of evidence regarding the external validity of social media HPV vaccination-related interventions. Constructs related to external validity were based on the reach, effectiveness, adoption, implementation, maintenance (RE-AIM) framework. Seventeen articles published between 2006 and 2020 met the inclusion criteria. Three researchers independently coded each article using a validated RE-AIM framework. Discrepant codes were discussed with a fourth reviewer to gain consensus. Of these 17 studies, 3 were pilot efficacy studies, 10 were randomized controlled trials (RCTs) to evaluate effectiveness, 1 was a population-based study, and 3 did not explicitly state which type of study was conducted. Reflecting this distribution of study types, across all studies the mean level of reporting RE-AIM dimensions varied with reach recording 90.8%, effectiveness (72.1%), adoption (40.3%), implementation (45.6%), and maintenance (26.5%). This review suggests that while the current HPV vaccination social media-driven interventions provide sufficient information on internal validity (reach and effectiveness), few have aimed to gather data on external validity needed to translate the interventions into real world implementation. Our data suggest that implementation research is needed to move HPV vaccination-related interventions into practice. Included in this review are recommendations for enhancing the design and reporting of these HPV vaccination social media-related interventions.

A Group Intervention for Individuals With Obesity and Comorbid Binge Eating Disorder: Results From a Feasibility Study

PURPOSE

A common challenge among a subgroup of individuals with obesity is binge eating, that exists on a continuum from mild binge eating episodes to severe binge eating disorder (BED). BED is common among bariatric patients and the prevalence of disordered eating and ED in bariatric surgery populations is well known. Conventional treatments and assessment of obesity seldom address the underlying psychological mechanisms of binge eating and subsequent obesity. This study, titled PnP (People need People) is a psychoeducational group pilot intervention for individuals with BED and obesity including patients with previous bariatric surgery. Design, feasibility, and a broad description of the study population is reported.

MATERIAL AND METHODS

A total of 42 patients were from an obesity clinic referred to assessment and treatment with PnP in a psychoeducational group setting (3-hour weekly meetings for 10 weeks). Of these, 6 (14.3%) patients had a previous history of bariatric surgery. Feasibility was assessed by tracking attendance, potentially adverse effects and outcome measures including body mass index (BMI), eating disorder pathology, overvaluation of shape and weight, impairment, self-reported childhood difficulties, alexithymia, internalized shame as well as health related quality of life (HRQoL).

RESULTS

All 42 patients completed the intervention, with no adverse effects and a high attendance rate with a median attendance of 10 sessions, 95% CI (8.9,9.6) and 0% attrition. Extent of psychosocial impairment due to eating disorder pathology, body dissatisfaction and severity of ED symptoms were high among the patients at baseline. Additionally, self-reported childhood difficulties, alexithymia, and internalized shame were high among the patients and indicate a need to address underlying psychological mechanisms in individuals with BED and comorbid obesity. Improvement of HRQoL and reduction of binge eating between baseline and the end of the intervention was observed with a medium effect.

CONCLUSION

This feasibility study supports PnP as a potential group psychoeducational intervention for patients living with BED and comorbid obesity. Assessments of BED and delivery of this intervention may optimize selection of candidates and bariatric outcomes. These preliminary results warrant further investigation via a randomized control trial (RCT) to examine the efficacy and effectiveness of PnP.

Evaluation of Green Procurement Practices Among Mining Companies' Hospitals in Ghana: A Qualitative Analysis

This study focuses on the evaluation of the green procurement practices among 7 mining hospitals in Ghana via qualitative analysis techniques. Thus, in this study, based on a 5-year case study, the practices of procurement officers in 7 hospitals belonging to mining companies in Ghana are explored. Within this period, interviews were conducted with key persons with recognizable responsibilities within the supply chain and procurement setup of the facilities. Details of their procurement practices, procedures, and policies were analyzed. A qualitative approach to organizational learning and practice is used to appreciate the existence of these differences observed and also to give a meaning to new perspectives on the challenges in establishing green procurement in the 7 mining companies' hospitals. The results of the analysis demonstrated that adjustments in the buyers' practices are not as much dependent on whether they understand, for instance, policies, tools, and procedures, but rather a matter of whether the buyers actually put their knowledge into practice.

The Lower-Risk Cannabis Use Guidelines' (LRCUG) recommendations: How are Canadian cannabis users complying?

Canada, alongside other jurisdictions, implemented non-medical cannabis legalization in 2018, partly towards improving public health. Evidence-based 'Lower-Risk Cannabis Use Guidelines' (LRCUG), including recommendations for cannabis users on how to decrease risk-behaviors for harms, have been developed and widely disseminated in Canada since 2017. However, knowledge on users' compliance with the LRCUG is limited. We identified four major Canadian (three national, one provincial) population surveys presenting key data on cannabis-related behaviors: the National Cannabis Survey, Canadian Cannabis Survey, Canadian Tobacco, Alcohol & Drugs Survey, and CAMH Monitor. We scanned each survey for indicator data mapping onto either of the LRCUG's recommendations for the years 2017 to 2019. Relevant indicator data, albeit with varying operationalizations, were found for six of the ten LRCUG's recommendation clusters in at least some of the surveys, and were extracted and summarized. For results, substantial -- but declining -- majorities of users consumed cannabis by smoking, yet with shifts towards other use modes. Between one- to two-in-five users engaged in the risk-behaviors of using high-potency cannabis products, frequent cannabis use and cannabis-impaired driving, respectively. A small proportion of pregnant or breastfeeding women continued cannabis use during the study period. The data identified found suggested a heterogeneous picture regarding cannabis users' compliance with the LRCUG's recommendations. Non-compliance is highest for recommendations regarding modes-of-use, and applies to minorities of users for other risks factors. These sub-groups are at elevated risk for acute (e.g., accidents) or long-term (e.g., dependence) cannabis-related harms contributing to the public health burden. Appropriate targeted interventions in these areas require improvement.

Assessing the Organizational Climate for Translational Research with a New Survey Tool

Promoting translational research as a means to overcoming chasms in the translation of knowledge through successive fields of research from basic science to public health impacts and back is a central challenge for research managers and policymakers. Organizational leaders need to assess baseline conditions, identify areas needing improvement, and to judge the impact of specific initiatives to sustain or improve translational research practices at their institutions. Currently, there is a lack of such an assessment tool addressing the specific context of translational biomedical research. To close this gap, we have developed a new survey for assessing the organizational climate for translational research. This self-assessment tool measures employees' perceptions of translational research climate and underlying research practices in organizational environments and builds on the established Survey of Organizational Research Climate, assessing research integrity. Using this tool, we show that scientists at a large university hospital (Charité Berlin) perceive translation as a central and important component of their work. Importantly, local resources and direct support are main contributing factors for the practical implementation of translation into their own research practice. We identify and discuss potential leverage points for an improvement of research climate to foster successful translational research.

A RE-AIM evaluation of Healthy Together: a family-centred program to support children's healthy weights

BACKGROUND

Healthy Together (HT) is family-centered program to support healthy eating and physical activity designed for implementation in community organizations serving families who may be experiencing vulnerabilities (e.g., related to low income, isolation, ethnicity, immigrant/refugee status, and/or Indigenous background). The purpose of this study was to conduct an evaluation of HT in a real-world, scale-up phase using the RE-AIM framework.

METHODS

Using a cross-sectional, non-comparative design, a community-based program evaluation was conducted in 29 organizations implementing HT as part of their core service programs. Data were collected using questionnaires with program participants and facilitators, and interviews with directors of participating organizations. Quantitative data were analyzed using descriptive statistics and qualitative data were content analyzed.

RESULTS

With regards to Reach, over 3400 caregivers, children and youth attended community programming that offered HT. Among those attending on the scheduled day for the evaluation, 663 completed the questionnaires. The majority of caregiver respondents (n = 431) were female (92%) and attended with children 0-6 years. Respondents also included children 4-6 years (n = 142) and 7-12 years (n = 65), and youth 13-18 years (n = 25). Effectiveness was demonstrated in reported improvements in physical activity, healthy eating, and strengthened social connections. HT was also widely supported by participants and facilitators. Adoption was influenced by the desire to enrich core service programs for families, HT's fit within existing programs, organizational commitment, and funding support. Implementation experiences indicated that fidelity to the HT program was generally maintained, with some setting specific adaptations. Maintenance of HT was influenced by financial and non-financial resources within community organizations. Most organizations also introduced new initiatives to extend support for healthy eating and physical activity.

CONCLUSION

Our findings indicate improvements in healthy eating and physical activity, and social connections among program participants, as well as efforts by community organizations to create environments to support healthy weights. HT was successfully delivered in "real-world" community settings across multiple contexts and with families with diverse backgrounds. This along with strategies to support program implementation and sustainability indicate that HT provides a model for other public health interventions to promote family health and wellbeing.

TRIAL REGISTRATION

ClincialTrials.gov NCT03550248. Registered May 25, 2018.

Orofacial pain education in dentistry: A path to improving patient care and reducing the population burden of chronic pain

Dentists stand in an optimal position to prevent and manage patients suffering from chronic orofacial pain (OFP) disorders, such as temporomandibular disorders, burning mouth syndrome, trigeminal neuralgia, persistent idiopathic dentoalveolar pain, among others. However, there are consistent reports highlighting a lack of knowledge and confidence in diagnosing and treating OFP among dental students, recent graduates, and trained dentists, which leads to misdiagnosis, unnecessary costs, delay in appropriate care and possible harm to patients. Education in OFP is necessary to improve the quality of general dental care and reduce individual and societal burden of chronic pain through prevention and improved quality of life for OFP patients. Our aims are to emphasize the goals of OFP education, to identify barriers for its implementation, and to suggest possible avenues to improve OFP education in general, postgraduate, and continuing dental education levels, including proposed minimum OFP competencies for all dentists. Moreover, patient perspectives are also incorporated, including a testimony from a person with OFP. General dentists, OFP experts, educators, researchers, patients, and policy makers need to combine efforts in order to successfully address the urgent need for quality OFP education.

Systems Science Approaches for Global Environmental Health Research: Enhancing Intervention Design and Implementation for Household Air Pollution (HAP) and Water, Sanitation, and Hygiene (WASH) Programs

BACKGROUND

Two of the most important causes of global disease fall in the realm of environmental health: household air pollution (HAP) and poor water, sanitation, and hygiene (WASH) conditions. Interventions, such as clean cookstoves, household water treatment, and improved sanitation facilities, have great potential to yield reductions in disease burden. However, in recent trials and implementation efforts, interventions to improve HAP and WASH conditions have shown few of the desired health gains, raising fundamental questions about current approaches.

OBJECTIVES

We describe how the failure to consider the complex systems that characterize diverse real-world conditions may doom promising new approaches prematurely. We provide examples of the application of systems approaches, including system dynamics, network analysis, and agent-based modeling, to the global environmental health priorities of HAP and WASH research and programs. Finally, we offer suggestions on how to approach systems science.

METHODS

Systems science applied to environmental health can address major challenges by a) enhancing understanding of existing system structures and behaviors that accelerate or impede aims; b) developing understanding and agreement on a problem among stakeholders; and c) guiding intervention and policy formulation. When employed in participatory processes that engage study populations, policy makers, and implementers, systems science helps ensure that research is responsive to local priorities and reflect real-world conditions. Systems approaches also help interpret unexpected outcomes by revealing emergent properties of the system due to interactions among variables, yielding complex behaviors and sometimes counterintuitive results.

DISCUSSION

Systems science offers powerful and underused tools to accelerate our ability to identify barriers and facilitators to success in environmental health interventions. This approach is especially useful in the context of implementation research because it explicitly accounts for the interaction of processes occurring at multiple scales, across social and environmental dimensions, with a particular emphasis on linkages and feedback among these processes. https://doi.org/10.1289/EHP7010.

Mind the gap: an intervention to support caregivers with a new autism spectrum disorder diagnosis is feasible and acceptable

Introduction

Children with autism spectrum disorder (ASD) benefit when their caregivers can effectively advocate for appropriate services. Barriers to caregiver engagement such as provider mistrust, cultural differences, stigma, and lack of knowledge can interfere with timely service access. We describe Mind the Gap (MTG), an intervention that provides education about ASD, service navigation, and other topics relevant to families whose children have a new ASD diagnosis. MTG was developed via community partnerships and is explicitly structured to reduce engagement barriers (e.g., through peer matching, meeting flexibility, culturally-informed practices). We also present on the results of a pilot of MTG, conducted in preparation for a randomized controlled trial.

Methods

MTG was evaluated using mixed methods that included qualitative analysis and pre/post-test without concurrent comparison group. Participants (n=9) were primary caregivers of children (ages 2-7 years) with a recent ASD diagnosis and whose annual income was at or below 185% of the federal poverty level. In order to facilitate trust and relationship building, peer coaches delivered MTG. The coaches were parents of children with ASD who we trained to deliver the intervention. MTG consisted of up to 12 meetings between coaches and caregivers over the course of 18 weeks. Coaches delivered the intervention in homes and other community locations. Coaches shared information about various “modules,” which were topics identified as important for families with a new ASD diagnosis. Coaches worked with families to answer questions, set weekly goals, assess progress, and offer guidance. For the pilot, we focused on three primary outcomes: feasibility, engagement, and satisfaction. Feasibility was measured via enrollment and retention data, as well as coach fidelity (i.e., implementation of MTG procedures). Engagement was measured via number of sessions attended and percentage completion of the selected outcome measures. For completers (n=7), satisfaction was measured via a questionnaire (completed by caregivers) and open-ended interviews (completed by caregivers and coaches).

Results

We enrolled 56% of referred caregivers and 100% of eligible families. Retention was high (78%). Coaches could deliver the intervention with fidelity, completing, on average, 83% of program components. Engagement also was high; caregivers attended an average of 85% of total possible sessions and completed 100% of their measures. Caregivers indicated moderately high satisfaction with MTG. Qualitative data indicated that caregivers and coaches were positive about intervention content, and the coach-caregiver relationship was important. They also had suggestions for changes.

Conclusion

Mind the Gap demonstrates evidence of feasibility, and data from the pilot suggest that it addresses intervention engagement barriers for a population that is under-represented in research. The results and suggestions from participants were used to inform a large-scale RCT, which is currently underway. Overall, MTG shows promise as an intervention that can be feasibly implemented with under-resourced and ethnic minority families of children with ASD

Trial registration

This study is registered with ClinicalTrials.gov: NCT03711799.

Implementation evaluation of a professional development program for comprehensive school physical activity leaders

The purpose of this study was to conduct an implementation monitoring evaluation of a yearlong comprehensive school physical activity program (CSPAP) professional development program across eight multi-state physical education (PE) teacher cohorts. Mixed-method data were collected during a three-year implementation period via workshop attendance sheets and evaluations, post-workshop implementation plans and artifacts, and follow-up phone interviews to enumerate and evaluate the program's process of recruitment, reach, dose delivered, dose received, fidelity, and context. Recruitment strategies reached a total of 234 PE teacher attendees across eight workshops, with 77 PE teachers (primarily female, elementary, public school teachers) completing all program requirements. Facilitators among full program completers were participation incentives and network opportunities, while common inhibitors were difficulty with online technology and perceptions of added workload. Completers submitted implementation plans with at least three action steps, ranging from 4 to 7 months to accomplish, that predominately commenced with securing administration approval as the first step (81%), focused on implementing student physical activity initiatives beyond PE (76%), and evidenced with mostly picture artifacts (78%). Implementation was facilitated by the presence of multilevel support at school and an elevated image of PE and PE teachers at school, and was inhibited by scheduling constraints, unrealistic planning, and conflicting perceptions of physical activity and PE. Overall, this evaluation reveals unique perspectives of PE teachers regarding schoolwide PA promotion and informs future efforts to target and effectively support CSPAP leaders.