A process for developing an implementation intervention: QUERI Series

Preparing community pharmacy teams for health information exchange (HIE)

BACKGROUND

Health information exchanges (HIEs) facilitate health care professionals' electronic sharing of patient information across different organizations. When community pharmacists have access to HIE, they can further contribute to improved patient outcomes. However, several implementation challenges are noted, which impede sustained pharmacist access to HIE. To our knowledge, no bidirectional HIE interface design and pharmacy team-informed implementation process has been documented. In response, our research team designed and developed an HIE interface prototype for use specifically by community pharmacy teams to access local HIE data through their pharmacy dispensing software.

OBJECTIVES

To 1) identify barriers, facilitators, and recommendations for using HIE data in community pharmacies and 2) create a curated list of resources addressing identified implementation needs to aid future implementation of a fully functional, bidirectional HIE interface by community pharmacy teams.

METHODS

Pharmacists, pharmacy technicians, and patients from three pharmacy sites within the Community Pharmacy Enhanced Services Network of Indiana participated in individual semi-structured interviews. Interview questions were mapped to select constructs across all domains of the Consolidated Framework for Implementation Research. Interview transcripts were deductively coded. A subset of participants participated in Evidence-Based Quality Improvement sessions to iteratively update planned resource items needed to support future HIE implementation.

RESULTS

We interviewed 23 total participants: 8 pharmacists, 8 pharmacy technicians, and 7 patients. Five facilitators, four barriers, and two recommendations were identified. These were further characterized into four key implementation needs: instruction on how to use HIE; guidance on workflow and team roles; resources that are patient-facing; and resources that are provider-facing, resulting in 16 planned implementation resources.

CONCLUSION

Our study provides the first-of-its-kind list of pharmacy team-informed resources to facilitate sustainability and scalability of HIE implementation in community pharmacies.

Specifying cross-system collaboration strategies for implementation: a multi-site qualitative study with child welfare and behavioral health organizations

BACKGROUND

Cross-system interventions that integrate health, behavioral health, and social services can improve client outcomes and expand community impact. Successful implementation of these interventions depends on the extent to which service partners can align frontline services and organizational operations. However, collaboration strategies linking multiple implementation contexts have received limited empirical attention. This study identifies, describes, and specifies multi-level collaboration strategies used during the implementation of Ohio Sobriety Treatment and Reducing Trauma (Ohio START), a cross-system intervention that integrates services across two systems (child welfare and evidence-based behavioral health services) for families that are affected by co-occurring child maltreatment and parental substance use disorders.

METHODS

In phase 1, we used a multi-site qualitative design with 17 counties that implemented Ohio START. Qualitative data were gathered from 104 staff from child welfare agencies, behavioral health treatment organizations, and regional behavioral health boards involved in implementation via 48 small group interviews about collaborative approaches to implementation. To examine cross-system collaboration strategies, qualitative data were analyzed using an iterative template approach and content analysis. In phase 2, a 16-member expert panel met to validate and specify the cross-system collaboration strategies identified in the interviews. The panel was comprised of key child welfare and behavioral health partners and scholars.

RESULTS

In phase 1, we identified seven cross-system collaboration strategies used for implementation. Three strategies were used to staff the program: (1) contract for expertise, (2) provide joint supervision, and (3) co-locate staff. Two strategies were used to promote service access: (4) referral protocols and (5) expedited access agreements. Two strategies were used to align case plans: (6) shared decision-making meetings, and (7) sharing data. In phase 2, expert panelists specified operational details of the cross-system collaboration strategies, and explained the processes by which strategies were perceived to improve implementation and service system outcomes.

CONCLUSIONS

We identified a range of cross-system collaboration strategies that show promise for improving staffing, service access, and case planning. Leaders, supervisors, and frontline staff used these strategies during all phases of implementation. These findings lay the foundation for future experimental and quasi-experimental studies that test the effectiveness of cross-system collaboration strategies.

Addressing COVID-19 vaccine hesitancy in rural community pharmacies: a protocol for a stepped wedge randomized clinical trial

BACKGROUND

Uptake of COVID-19 vaccines remains problematically low in the USA, especially in rural areas. COVID-19 vaccine hesitancy is associated with lower uptake, which translates to higher susceptibility to SARS-CoV-2 variants in communities where vaccination coverage is low. Because community pharmacists are among the most accessible and trusted health professionals in rural areas, this randomized clinical trial will examine implementation strategies to support rural pharmacists in delivering an adapted evidence-based intervention to reduce COVID-19 vaccine hesitancy.

METHODS

We will use an incomplete stepped wedge trial design in which we will randomize 30 rural pharmacies (unit of analysis) to determine the effectiveness and incremental cost-effectiveness of a standard implementation approach (consisting of online training that describes the vaccine hesitancy intervention, live webinar, and resource website) compared to adding on a virtual facilitation approach (provided by a trained facilitator in support of the delivery of the vaccine hesitancy counseling intervention by pharmacists). The intervention (ASORT) has been adapted from an evidence-based vaccine communication intervention for HPV vaccines through a partnership with rural pharmacies in a practice-based research network in seven southern US states. ASORT teaches pharmacists how to identify persons eligible for COVID-19 vaccination (including a booster), solicit and address vaccine concerns in a non-confrontational way, recommend the vaccine, and repeat the steps later if needed. The primary trial outcome is fidelity to the ASORT intervention, which will be determined through ratings of recordings of pharmacists delivering the intervention. The secondary outcome is the effectiveness of the intervention, determined by rates of patients who agree to be vaccinated after receiving the intervention. Other secondary outcomes include feasibility, acceptability, adoption, reach, and cost. Cost-effectiveness and budget impact analyses will be conducted to maximize the potential for future dissemination and sustainability. Mixed methods will provide triangulation, expansion, and explanation of quantitative findings.

DISCUSSION

This trial contributes to a growing evidence base on vaccine hesitancy interventions and virtual-only facilitation of evidenced-based practices in community health settings. The trial will provide the first estimate of the relative value of different implementation strategies in pharmacy settings.

TRIAL REGISTRATION

NCT05926544 (clinicaltrials.gov); 07/03/2023.

Using multiple qualitative methods to inform intervention development: Improving functional status measurement for older veterans in primary care settings

Functional status, or the ability to perform activities of daily living, is central to older adults' health and quality of life. However, health systems have been slow to incorporate routine measurement of function into patient care. We used multiple qualitative methods to develop a patient-centered, interprofessional intervention to improve measurement of functional status for older veterans in primary care settings. We conducted semi-structured interviews with patients, clinicians, and operations staff (n = 123) from 7 Veterans Health Administration (VHA) Medical Centers. Interviews focused on barriers and facilitators to measuring function. We used concepts from the Consolidated Framework for Implementation Science and sociotechnical analysis to inform rapid qualitative analyses and a hybrid deductive/inductive approach to thematic analysis. We mapped qualitative findings to intervention components. Barriers to measurement included time pressures, cumbersome electronic tools, and the perception that measurement would not be used to improve patient care. Facilitators included a strong interprofessional environment and flexible workflows. Findings informed the development of five intervention components, including (1) an interprofessional educational session; (2) routine, standardized functional status measurement among older patients; (3) annual screening by nurses using a standardized instrument and follow-up assessment by primary care providers; (4) electronic tools and templates to facilitate increased identification and improved management of functional impairment; and (5) tailored reports on functional status for clinicians and operations leaders. These findings show how qualitative methods can be used to develop interventions that are more responsive to real-world contexts, increasing the chances of successful implementation. Using a conceptually-grounded approach to intervention development has the potential to improve patient and clinician experience with measuring function in primary care.

Usability Evaluation of a Community Pharmacy Health Information Exchange Interface Prototype

OBJECTIVE

Few community pharmacies have access to health information exchange (HIE) data. We conducted a first-of-its-kind usability evaluation of an HIE interface prototype (referred to throughout as the "HIE-Pioneer mock-up") developed with pharmacists and pharmacy technicians to aid future implementation in community pharmacies.

METHODS

Community pharmacists and pharmacy technicians were recruited to complete usability evaluations with the HIE-Pioneer mock-up. Each usability evaluation lasted up to 60 minutes. System usability scale (SUS) scores were collected from each participant following each usability evaluation session and summarized with descriptive statistics. Usability evaluation videos were reviewed for common usability attributes, such as the impact of identified usability problems, learnability, and efficiency. Time on task, task success rates, and prototype utilization were also recorded.

RESULTS

Sixteen total participants completed usability testing across three community pharmacies. The average SUS score was 69.7 (scale 0-100, where 100 is the best), with pharmacists on average reporting higher satisfaction than technicians (74.1 vs. 65.3, respectively). Altogether, we identified 23 distinct usability problems. Key problems identified included needed clarification in tool label names and accessibility of HIE links within the existing workflow. Overall, the usability of the HIE-Pioneer mock-up generally fostered pharmacy professionals' ease of learning and efficiency.

CONCLUSION

Our study identified key areas, and potential solutions, to improve the usability of the HIE-Pioneer mock-up. Overall, pharmacy professionals viewed the HIE-Pioneer mock-up positively, with good satisfaction ratings. The HIE-Pioneer mock-up provides a blueprint for future HIE implementation in community pharmacy settings, which would increase community pharmacy teams' access to HIE data nationwide. Community pharmacy access to bi-directional HIE is expected to improve communication among more health care professionals involved in patient care and equip pharmacy professionals with needed information for improved clinical decision-making.

Positive attitudes toward adoption of a multi-component intervention strategy aimed at improving HIV outcomes among adolescents and young people in Nampula, Mozambique: perspectives of HIV care providers

BACKGROUND

Service providers' attitudes toward interventions are essential for adopting and implementing novel interventions into healthcare settings, but evidence of evaluations in the HIV context is still limited. This study is part of the CombinADO cluster randomized trial (ClinicalTrials.gov NCT04930367), which is investigating the effectiveness of a multi-component intervention package (CombinADO strategy) aimed at improving HIV outcomes among adolescents and young adults living with HIV (AYAHIV) in Mozambique. In this paper we present findings on key stakeholder attitudes toward adopting study interventions into local health services.

METHODS

Between September and December 2021, we conducted a cross-sectional survey with a purposive sample of 59 key stakeholders providing and overseeing HIV care among AYAHIV in 12 health facilities participating in the CombinADO trial, who completed a 9-item scale on attitudes towards adopting the trial intervention packages in health facilities. Data were collected in the pre-implementation phase of the study and included individual stakeholder and facility-level characteristics. We used generalized linear regression to examine the associations of stakeholder attitude scores with stakeholder and facility-level characteristics.

RESULTS

Overall, service-providing stakeholders within this setting reported positive attitudes regarding adopting intervention packages across study clinic sites; the overall mean total attitude score was 35.0 ([SD] = 2.59, Range = [30-41]). The study package assessed (control or intervention condition) and the number of healthcare workers delivering ART care in participating clinics were the only significant explanatory variables to predict higher attitude scores among stakeholders (β = 1.57, 95% CI = 0.34-2.80, p = 0.01 and β = 1.57, 95% CI = 0.06-3.08, p = 0.04 respectively).

CONCLUSIONS

This study found positive attitudes toward adopting the multi-component CombinADO study interventions among HIV care providers for AYAHIV in Nampula, Mozambique. Our findings suggest that adequate training and human resource availability may be important in promoting the adoption of novel multi-component interventions in healthcare services by influencing healthcare provider attitudes.

Developing and Testing Implementation Strategies to support the Centers for Disease Control and Prevention's Initiative for Falls Risk Management in Outpatient Physical Therapy: A Protocol

Objectives

To develop and test implementation strategies to support implementing the Centers for Disease Control and Preventions' Stopping Elderly Accidents, Deaths, and Injuries (STEADI) initiative for falls prevention and falls risk management in a novel setting, outpatient physical therapy.

Design

A feasibility implementation study engaging key partners involved in or affected by the implementation throughout the study.

Setting

Five outpatient physical therapy clinics embedded in a health system.

Participants

Key partners (physical therapists, physical therapist assistants, referring physicians, administrative clinic staff, older adults, and caregivers) involved in or affected by the implementation (N=48) will participate in surveys and interviews to identify barriers and facilitators prior to implementation and post implementation. Twelve key partners representing at least 1 of each group will participate in evidence-based quality improvement panels to identify which barriers and facilitators are most important and feasible to address and to assist in choosing and designing implementation strategies to support the uptake of STEADI in outpatient rehabilitation. STEADI will be implemented in 5 outpatient physical therapy clinics as a standard of care for the ∼1200 older adults attending those clinics annually.

Outcomes

Primary outcomes include clinic- and provider-level (physical therapists and physical therapist assistant) adoption and fidelity to STEADI screening, multifactorial assessment, and falls risk interventions for older adults (65 years or older) attending outpatient physical therapy. Key partners' perceived feasibility, acceptability, and appropriateness of STEADI in outpatient physical therapy will also be measured using validated implementation science questionnaires. Exploratory clinical outcomes of older adults' falls risk pre- and post rehabilitation will be investigated.

Evidence-Based Quality Improvement (EBQI) in the pre-implementation phase: key steps and activities

Background

Evidence-Based Quality Improvement (EBQI) involves researchers and local partners working collaboratively to support the uptake of an evidence-based intervention (EBI). To date, EBQI has not been consistently included in community-engaged dissemination and implementation literature. The purpose of this paper is to illustrate the steps, activities, and outputs of EBQI in the pre-implementation phase.

Methods

The research team applied comparative case study methods to describe key steps, activities, and outputs of EBQI across seven projects. Our approach included: (1) specification of research questions, (2) selection of cases, (3) construction of a case codebook, (4) coding of cases using the codebook, and (5) comparison of cases.

Results

The cases selected included five distinct settings (e.g., correction facilities, community pharmacies), seven EBIs (e.g., nutrition promotion curriculum, cognitive processing therapy) and five unique lead authors. Case examples include both community-embedded and clinically-oriented projects. Key steps in the EBQI process included: (1) forming a local team of partners and experts, (2) prioritizing implementation determinants based on existing literature/data, (3) selecting strategies and/or adaptations in the context of key determinants, (4) specifying selected strategies/adaptations, and (5) refining strategies/adaptations. Examples of activities are included to illustrate how each step was achieved. Outputs included prioritized determinants, EBI adaptations, and implementation strategies.

Conclusions

A primary contribution of our comparative case study is the delineation of various steps and activities of EBQI, which may contribute to the replicability of the EBQI process across other implementation research projects.

Facilitators and barriers to providing affirming care for transgender patients in primary care practices in Arkansas

PURPOSE

This study assessed factors affecting the provision of affirming-care best practices (ACBPs) for transgender individuals by primary care providers (PCPs) in a rural, southern state METHODS: We conducted a sequential explanatory mixed-methods study in 2020, including a statewide survey (phase 1) and interviews (phase 2). Surveyed PCPs (phase 1) included Medical Doctors/Doctors of Osteopathy (MDs/DOs), nurse practitioners, and 1 physician assistant. Interview participants (phase 2) included providers and staff in 6 practices throughout the state. We used an exploratory approach to data collection and performed content analysis to classify interview data into categories representing overarching themes RESULTS: Among surveyed PCPs who reported they had provided care to transgender patients (n = 35), the most common reason for providing gender-affirming medical services was "because of my ethical obligation to treat patients equally" (n = 27, 77%). The most common reason for not providing such services was because the PCPs "have not been trained/don't feel competent to provide these services" (n = 12, 34%). Interviews revealed the following themes: (1) willingness to provide "culturally competent care"; (2) continuum of accepting to affirming attitudes toward transgender individuals; (3) basic understanding of stigma and an awareness of its impact; (4) changes needed to provide "culturally competent care"; and (5) preferred clinical support strategies.

CONCLUSION

Training and education to provide ACBPs are warranted and would meet the needs of patients and providers. Facilitating telemedicine visits for transgender patients with gender-affirming care experts was a favorable implementation strategy for clinical support and is recommended to address access to affirming care.

Barriers to reducing preoperative testing for low-risk surgical procedures: A qualitative assessment guided by the Theoretical Domains Framework

INTRODUCTION

While numerous guidelines do not recommend preoperative tests for low risk patients undergoing low risk surgeries, they are often routinely performed. Canadian data suggests preoperative tests (e.g. ECGs and chest x-rays) preceded 17.9%-35.5% of low-risk procedures. Translating guidelines into clinical practice can be challenging and it is important to understand what is driving behaviour when developing interventions to change it.

AIM

Thus, we completed a theory-based investigation of the perceived barriers and enablers to reducing unnecessary preoperative tests for low-risk surgical procedures in Newfoundland, Canada.

METHOD

We used snowball sampling to recruit surgeons, anaesthesiologists, or preoperative clinic nurses. Interviews were conducted by two researchers using an interview guide with 31 questions based on the theoretical domains framework. Data was transcribed and coded into the 14 theoretical domains and then themes were identified for each domain.

RESULTS

We interviewed 17 surgeons, anaesthesiologists, or preoperative clinic nurses with 1 to 34 years' experience. Overall, while respondents agreed with the guidelines they described several factors, across seven relevant theoretical domains, that influence whether tests are ordered. The most common included uncertainty about who is responsible for test ordering, inability to access patient records or to consult/communicate with colleagues about ordering decisions and worry about surgery delays/cancellation if tests are not ordered. Other factors included workplace norms that conflicted with guidelines and concerns about missing something serious or litigation. In terms of enablers, respondents believed that clear institutional guidelines including who is responsible for test ordering and information about the risk of missing something serious, supported by improved communication between those involved in the ordering process and periodic evaluation will reduce any unnecessary preoperative testing.

CONCLUSION

These findings suggest that both health system and health provider factors need to be addressed in an intervention to reduce pre-operative testing.

Applying the principles of Evidence-Based Public Health in addressing the diabetes mellitus epidemic among African-American communities living in the district of Colombia: A literature review

Diabetes is an epidemic in the United States and is ranked as the sixth leading cause of death in the District of Columbia. According to the US Census population in 2010, >52,000 out of 610,000 residents have been diagnosed with diabetes. The highest prevalence was noted in wards 4, 5, 7, and 8, with the worst impact recorded in ward 8. The diabetes death rate among African Americans is five times that for Caucasians living in Colombia district, according to the DC department of health. There is an 11% disparity in the prevalence of diabetes when comparing black- and white people in the district (14% and 3%, respectively). This amounts to more than double the 6% disparity in the national population. This is also evident at both district and nationwide levels (prevalence of diabetes among people with no high school diploma, 21%; that in college graduates, 5%). The incidence of end-stage renal disease (ESRD), a life-threatening condition and diabetes-related complication is increasing in Colombia district and is rated as the number one cause of death from diabetes. In 2010, the newly diagnosed ESRD cases (420) and total number of ESRD cases due to diabetes (642) in the district were twice that of neighboring states (Maryland, Virginia, and West Virginia) and the entire US. In this review, the importance of implementing an evidence-based public health program in solving the epidemic of diabetes among the black community living in Ward 8 is emphasized. This study applies to every poor or minority ethnic group worldwide and in the US.

Barriers to following imaging guidelines for the treatment and management of patients with low-back pain in primary care: a qualitative assessment guided by the Theoretical Domains Framework

Background

Low back pain (LBP) is a leading cause of disability and is among the top five reasons that patients visit their family doctors. Over-imaging for non-specific low back pain remains a problem in primary care. To inform a larger study to develop and evaluate a theory-based intervention to reduce inappropriate imaging, we completed an assessment of the barriers and facilitators to reducing unnecessary imaging for NSLBP among family doctors in Newfoundland and Labrador (NL).

Methods

This was an exploratory, qualitative study describing family doctors’ experiences and practices related to diagnostic imaging for non-specific LBP in NL, guided by the Theoretical Domains Framework (TDF). Data were collected using in-depth, semi-structured interviews. Transcripts were analyzed deductively (assigning text to one or more domains) and inductively (generating themes at each of the domains) before the results were examined to determine which domains should be targeted to reduce imaging.

Results

Nine family doctors (four males; five females) working in community (n = 4) and academic (n = 5) clinics in both rural (n = 6) and urban (n = 3) settings participated in this study. We found five barriers to reducing imaging for patients with NSLBP: 1) negative consequences, 2) patient demand 3) health system organization, 4) time, and 5) access to resources. These were related to the following domains: 1) beliefs about consequences, 2) beliefs about capabilities, 3) emotion, 4) reinforcement, 5) environmental context and resources, 6) social influences, and 7) behavioural regulation.

Conclusions

Family physicians a) fear that if they do not image they may miss something serious, b) face significant patient demand for imaging, c) are working in a system that encourages unnecessary imaging, d) don’t have enough time to counsel patients about why they don’t need imaging, and e) lack access to appropriate practitioners, community programs, and treatment modalities to prescribe to their patients. These barriers were related to seven TDF domains. Successfully reducing inappropriate imaging requires a comprehensive intervention that addresses these barriers using established behaviour change techniques. These techniques should be matched directly to relevant TDF domains. The results of our study represent the important first step of this process – identifying the contextual barriers and the domains to which they are related.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12875-022-01751-6.

Identification of core components and implementation strategies for a Conservative Kidney Management Pathway across a complex, multisector healthcare system in Canada using World Cafés and the Theoretical Domains Framework

OBJECTIVE

Develop a Conservative Kidney Management (CKM) Pathway for patients unlikely to benefit from dialysis. We sought to determine (1) core components of care and (2) implementation strategies across a multisector healthcare system.

DESIGN

We used the Knowledge to Action Cycle and the Theoretical Domains Framework to identify barriers and facilitators to CKM. Activities included a current state assessment, World Cafés, interviews, focus groups and readiness for change assessments.

SETTING

A provincial initiative in Alberta, Canada.

PARTICIPANTS

282 participants were purposively selected to reflect those involved in the care of patients receiving CKM. This included policy-makers, multidisciplinary healthcare professionals, patients and their family.

MAIN OUTCOME MEASURES

Theoretical domains linked to pathway content and implementation strategies.

RESULTS

Environmental context and resources, social/professional role and identity, knowledge and social influences were the most influential behaviour change domains identified. The most effective strategies for facilitating behaviour change were identified to be education, training, environmental restructuring and modelling. Core components of care were determined to be guidelines for treating symptoms and disease complications consistent with the philosophy of CKM, timely communication of the choice for CKM, coordination with community services, crisis planning, advance care planning and tools to enhance patients' capacity for self-management and shared decision-making. This resulted in development of Alberta's CKM Pathway, an interactive, digital, decision-support tool consisting of: (1) a patient decision aid; (2) a patient/family portal; and (3) a healthcare professional portal, where all resources can be freely accessed.

CONCLUSIONS

The pathway was codesigned by patients and healthcare professionals and involves tailor-made combinations of tools to address unique patient needs and system-community circumstances. Most of the strategies are adaptable to local context and are likely translatable to the implementation of sustainable CKM in other national and international jurisdictions.

Development and Preliminary Evaluation of an Implementation Facilitation Training Program

Background: Implementation scientists are identifying evidence-based implementation strategies that support the uptake of evidence-based practices and other clinical innovations. However, there is limited information regarding the development of training methods to educate implementation practitioners on the use of implementation strategies and help them sustain these competencies. Methods: To address this need, we developed, implemented, and evaluated a training program for one strategy, implementation facilitation (IF), that was designed to maximize applicability in diverse clinical settings. Trainees included implementation practitioners, clinical managers, and researchers. From May 2017 to July 2019, we sent trainees an electronic survey via email and asked them to complete the survey at three-time points: approximately 2 weeks before and 2 weeks and 6 months after each training. Participants ranked their knowledge of and confidence in applying IF skills using a 4-point Likert scale. We compared scores at baseline to post-training and at 6 months, as well as post-training to 6 months post-training (nonparametric Wilcoxon signed-rank tests). Results: Of the 102 participants (76 in-person, 26 virtual), there was an increase in perceived knowledge and confidence in applying IF skills across all learning objectives from pre- to post-training (95% response rate) and pre- to 6-month (35% response rate) follow-up. There was no significant difference in results between virtual and in-person trainees. When comparing post-training to 6 months (30% response rate), perceptions of knowledge increase remained unchanged, although participants reported reduced perceived confidence in applying IF skills for half of the learning objectives at 6 months. Conclusions: Findings indicated that we have developed a promising IF training program. Lack of differences in results between virtual and in-person participants indicated the training can be provided to a remote site without loss of knowledge/skills transfer but ongoing support may be needed to help sustain perceived confidence in applying these skills.

Plain Language Summary

While implementation scientists are documenting an increasing number of implementation strategies that support the uptake of evidence-based practices and other clinical innovations, little is known about how to transfer this knowledge to those who conduct implementation efforts in the frontline clinical practice settings. We developed, implemented, and conducted a preliminary evaluation of a training program for one strategy, implementation facilitation (IF). The training program targets facilitation practitioners, clinical managers, and researchers. This paper describes the development of the training program, the program components, and the results from an evaluation of IF knowledge and skills reported by a subset of people who participated in the training. Findings from the evaluation indicate that this training program significantly increased trainees' perceived knowledge of and confidence in applying IF skills. Further research is needed to examine whether ongoing mentoring helps trainees retain confidence in applying some IF skills over the longer term.

Obesity prevention practices in early care and education settings: an adaptive implementation trial

Background

Despite the potential for Early Care and Education (ECE) settings to promote healthy habits, a gap exists between current practices and evidence-based practices (EBPs) for obesity prevention in childhood.

Methods

We will use an enhanced non-responder trial design to determine the effectiveness and incremental cost-effectiveness of an adaptive implementation strategy for Together, We Inspire Smart Eating (WISE), while examining moderators and mediators of the strategy effect. WISE is a curriculum that aims to increase children’s intake of carotenoid-rich fruits and vegetables through four evidence-based practices in the early care and education setting. In this trial, we will randomize sites that do not respond to low-intensity strategies to either (a) continue receiving low-intensity strategies or (b) receive high-intensity strategies. This design will determine the effect of an adaptive implementation strategy that adds high-intensity versus one that continues with low-intensity among non-responder sites. We will also apply explanatory, sequential mixed methods to provide a nuanced understanding of implementation mechanisms, contextual factors, and characteristics of sites that respond to differing intensities of implementation strategies. Finally, we will conduct a cost effectiveness analysis to estimate the incremental effect of augmenting implementation with high-intensity strategies compared to continuing low-intensity strategies on costs, fidelity, and child health outcomes.

Discussion

We expect our study to contribute to an evidence base for structuring implementation support in real-world ECE contexts, ultimately providing a guide for applying the adaptive implementation strategy in ECE for WISE scale-up. Our work will also provide data to guide implementation decisions of other interventions in ECE. Finally, we will provide the first estimate of relative value for different implementation strategies in this setting.

Trial registration

NCT05050539; 9/20/21.

Preparing for the spread of patient-reported outcome (PRO) data collection from primary care to community pharmacy: a mixed-methods study

Background

Medication non-adherence is a significant public health problem. Patient-reported outcomes (PROs) offer a rich data source to facilitate resolution of medication non-adherence. PatientToc™ is an electronic PRO data collection software originally implemented at primary care practices in California, United States (US). Currently, the use of standardized PRO data collection systems in US community pharmacies is limited. Thus, we are conducting a two-phase evaluation of the spread and scale of PatientToc™ to US Midwestern community pharmacies. This report focuses on the first phase of the evaluation. The objective of this phase was to prepare for implementation of PatientToc™ in community pharmacies by conducting a pre-implementation developmental formative evaluation to (1) identify potential barriers, facilitators, and actionable recommendations to PatientToc™ implementation and (2) create a draft implementation toolkit.

Methods

Data collection consisted of demographics, observations, audio-recorded contextual inquiries, and semi-structured interviews with staff (e.g., primary care providers, pharmacists, pharmacy technicians) and patients during 1-day site visits to a purposive sample of (1) primary care practices currently using PatientToc™ and (2) community pharmacies in Indiana, Wisconsin, and Minnesota interested in the future use of PatientToc™. Post-visit site observation debriefs were also audio-recorded. Verbatim transcripts of all recordings were coded using deductive/inductive approaches and intra-/inter-site summaries were produced identifying potential barriers, facilitators, and actionable recommendations mapped to the Consolidated Framework for Implementation Research constructs. A stakeholder advisory panel engaged in an Evidence-Based Quality Improvement (EBQI) implementation process. This included “member checking” and prioritizing findings, and feedback on the adapted PatientToc™ application, implementation strategies, and accompanying toolkit for community pharmacy implementation.

Results

Two primary care practices, nine pharmacies, and 89 individuals participated. Eight major themes (four barriers and four facilitators) and 14 recommendations were identified. Throughout the four EBQI sessions, the panel (1) confirmed findings; (2) designated high priority recommendations: (a) explain PatientToc™ and its benefits clearly and simply to patients, (b) ensure patients can complete questionnaires within 10 min, and (c) provide hands-on training/resources for pharmacy teams; and (3) provided feedback on the adapted PatientToc™ application and finalized toolkit items for initial community pharmacy implementation.

Conclusions

Adoption of electronically captured PROs in community pharmacies is warranted. The implementation strategies systematically developed in this study can serve as a model for implementation of technology-driven health information patient care services, in the understudied context of community pharmacies.

Implementation of a Meaning-Centered Psychotherapy training (MCPT) program for oncology clinicians: a qualitative analysis of facilitators and barriers

The Meaning-Centered Psychotherapy training program (MCPT) is a multimodal, intensive, in-person program that trains cancer care providers in the evidence-based psychosocial treatment Meaning-Centered Psychotherapy (MCP). This analysis aimed to identify barriers and facilitators to clinical implementation (CI) at 1 year post-training. Trainee feedback regarding CI was collected via a mixed-methods questionnaire, including rating the ease of CI and free-text response identifying facilitators and barriers to CI. Descriptive statistics and thematic content analysis of follow-up data from the first five MCPT training cohorts (n = 55) were performed to assess CI and its facilitators and barriers. One third of participants indicated that it was at least somewhat difficult to implement MCP in clinical practice. Trainee-identified facilitators and barriers to CI were characterized within four main categories: program, patient, treatment, and institution. Within each of these factors, clinicians reported a variety of components that contributed to or hindered their ability to implement MCP. MCPT itself was reported as a facilitator. Patient access and interest were simultaneously identified as facilitators for some and barriers for others. Some trainees found the MCP treatment structure helpful in addressing important patient psychosocial needs, while others felt it was too restrictive. Institutional support played an important role in whether trainees felt hindered or helped to implement MCP. These initial results provide important insight into the program's strengths and have fostered improvements to the MCPT program to better facilitate CI. Further study of MCPT CI is warranted, and theme refinement will be possible with a larger sample.

A more practical guide to incorporating health equity domains in implementation determinant frameworks

BACKGROUND

Due to striking disparities in the implementation of healthcare innovations, it is imperative that researchers and practitioners can meaningfully use implementation determinant frameworks to understand why disparities exist in access, receipt, use, quality, or outcomes of healthcare. Our prior work documented and piloted the first published adaptation of an existing implementation determinant framework with health equity domains to create the Health Equity Implementation Framework. We recommended integrating these three health equity domains to existing implementation determinant frameworks: (1) culturally relevant factors of recipients, (2) clinical encounter or patient-provider interaction, and (3) societal context (including but not limited to social determinants of health). This framework was developed for healthcare and clinical practice settings. Some implementation teams have begun using the Health Equity Implementation Framework in their evaluations and asked for more guidance.

METHODS

We completed a consensus process with our authorship team to clarify steps to incorporate a health equity lens into an implementation determinant framework.

RESULTS

We describe steps to integrate health equity domains into implementation determinant frameworks for implementation research and practice. For each step, we compiled examples or practical tools to assist implementation researchers and practitioners in applying those steps. For each domain, we compiled definitions with supporting literature, showcased an illustrative example, and suggested sample quantitative and qualitative measures.

CONCLUSION

Incorporating health equity domains within implementation determinant frameworks may optimize the scientific yield and equity of implementation efforts by assessing and ideally addressing implementation and equity barriers simultaneously. These practical guidance and tools provided can assist implementation researchers and practitioners to concretely capture and understand barriers and facilitators to implementation disparities.

Stakeholder selected strategies for obesity prevention in childcare: results from a small-scale cluster randomized hybrid type III trial

BACKGROUND

Together, We Inspire Smart Eating (WISE) is an intervention for the early care and education setting to support children's exposure to and intake of fruits and vegetables. WISE emphasizes 4 evidence-based practices (EBPs): (1) use of a mascot; (2) educators' role modeling; (3) positive feeding practices; and (4) hands-on exposures. The current study reports on a small-scale implementation trial aimed at improving the use of WISE EBPs by teachers.

METHODS

A Hybrid Type III Cluster Randomized Design compared a Basic and Enhanced implementation strategy. The Basic Strategy included training and reminders only; the Enhanced strategy was a multi-faceted package of stakeholder-selected strategies including a leadership commitment, an implementation blueprint, a local champion, an environmental reminder of the EBPs, facilitation, and tailored educational resources and incentives. All study sites were Head Starts. Sites were randomized using a balancing technique that considered site characteristics; 4 sites (20 classrooms, 39 educators, 305 children) received Enhanced support; 5 sites (18 classrooms, 36 educators, 316 children) received Basic support. RE-AIM guided the evaluation, and implementation fidelity was the primary outcome. Strategies were assessed using examination of data distributions and unadjusted comparisons (t tests) as well as general linear and mixed effects models controlling for covariates.

RESULTS

For the primary outcome of fidelity, the Enhanced group had significantly higher means for 3 of 4 EBPs. Multivariate models explained a significant portion of variance for both mascot use and hands-on exposure with a significant positive effect observed for treatment condition. The Enhanced group also had higher rates of Appropriateness and Organizational Readiness for Implementing Change (as indicators of implementation and adoption, respectively). There was no significant difference between groups for indicators of Reach, Effectiveness or Maintenance. Formative interviews indicated key targets for iteration and potential mechanisms. Key events were catalogued to provide context for interpretation (e.g., 61% of classrooms with turnover).

CONCLUSIONS

Findings were mixed but suggested promise for the Enhanced strategy, especially considering key events of the study. Implementation fidelity improvements occurred mainly in the last 3 months of the school year; additional time may be needed to translate to improvements in child outcomes.

TRIAL REGISTRATION

NCT03075085 Registered 20 February 2017.

Effectiveness of health consumer representative involvement in implementation of interventions to change health professional behaviour

BACKGROUND

The adoption of research evidence to improve client outcomes may be enhanced using the principles of implementation science. This systematic review aimed to understand the effect of involving consumers to change health professional behaviours and practices. The barriers and enablers to consumer engagement will also be examined.

METHODS

We searched Medline, CINAHL, Embase, the Cochrane Central Register of Controlled Trials and PDQ-Evidence from 2004 to February 2019. Implementation studies involving consumers in at least one phase (development, intervention or facilitation) of an intervention that aimed to change health professional behaviour to align with evidence-based practice were included. Studies in the areas of paediatrics and primary care were excluded. Two review authors independently screened studies for inclusion, and one author extracted data and conducted quality assessments with review of a second author. Knowledge translation interventions were categorized using the Effective Practice and Organisation of Care taxonomy. The primary outcome was measures of change in health professional behaviour.

RESULTS

Sixteen articles met the inclusion criteria. Meta-analysis of three studies found support for consumer involvement in changing healthcare professionals' behaviour (Hedges' g = 0.41, 95% CI [0.27, 0.57], P < 0.001). Most knowledge translation studies involved consumers during the development phase only (n = 12). Most studies (n = 9) included one type of knowledge translation intervention. Professional interventions (including education of health professionals, educational outreach, and audit and feedback) were described in 13 studies.

CONCLUSIONS

Consumer involvement rarely moves beyond the design phase of knowledge translation research in healthcare settings. Further research of the barriers to and effect of increased consumer engagement across all stages of knowledge translation interventions is needed.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42019119179.

An evaluation of the spread and scale of PatientToc™ from primary care to community pharmacy practice for the collection of patient-reported outcomes: A study protocol

BACKGROUND

Medication non-adherence is a problem of critical importance, affecting approximately 50% of all persons taking at least one regularly scheduled prescription medication and costing the United States more than $100 billion annually. Traditional data sources for identifying and resolving medication non-adherence in community pharmacies include prescription fill histories. However, medication possession does not necessarily mean patients are taking their medications as prescribed. Patient-reported outcomes (PROs), measuring adherence challenges pertaining to both remembering and intention to take medication, offer a rich data source for pharmacists and prescribers to use to resolve medication non-adherence. PatientToc™ is a PROs collection software developed to facilitate collection of PROs data from low-literacy and non-English speaking patients in Los Angeles.

OBJECTIVES

This study will evaluate the spread and scale of PatientToc™ from primary care to community pharmacies for the collection and use of PROs data pertaining to medication adherence.

METHODS

The following implementation and evaluation steps will be conducted: 1) a pre-implementation developmental formative evaluation to determine community pharmacy workflow and current practices for identifying and resolving medication non-adherence, potential barriers and facilitators to PatientToc™ implementation, and to create a draft implementation toolkit, 2) two plan-do-study-act cycles to refine an implementation toolkit for spreading and scaling implementation of PatientToc™ in community pharmacies, and 3) a comprehensive, theory-driven evaluation of the quality of care, implementation, and patient health outcomes of spreading and scaling PatientToc™ to community pharmacies.

EXPECTED IMPACT

This research will inform long-term collection and use of PROs data pertaining to medication adherence in community pharmacies.

A mixed-methods protocol for identifying successful sustainability strategies for nutrition and physical activity interventions in childcare

BACKGROUND

Despite the importance of sustainability for nutrition and physical activity in public health interventions, limited studies have explored the factors that promote and inhibit evidence-based program sustainment in the childcare setting. This study protocol describes a mixed-methods approach to develop novel sustainability strategies based on real-world settings and stakeholder feedback, with the goal of providing support for future obesity prevention programs and related studies on intervention sustainability. Two interventions, Together, We Inspire Smart Eating (WISE) and The Food Friends' (FF) Fun with New Foods and Get Movin' with Might Moves, are studied to this end.

METHODS

The study will deploy an explanatory, sequential mixed-methods design. First, the research team will collect a quantitative survey to assess rates of sustainment among WISE and Food Friends sites. We expect to collect 150 surveys from WISE and FF sites combined. Data from these surveys will be used to purposively sample sites for 12 to 18 site visits. Specifically, we will purposively sample low, partial, and high sustaining sites where we will conduct key informant interviews and focus groups as well as validate self-reports on sustainability. Survey content, qualitative interviews, and coding will be based on the Dynamic Sustainability Framework. We will draw on findings from the quantitative survey on predictors of sustainment and the qualitative site visits to understand varying levels of program sustainment. Then, we will utilize evidence-based quality improvement sessions to engage stakeholders in developing a multi-component sustainability strategy.

DISCUSSION

This study will provide a stakeholder-informed sustainability strategy ready for testing in a full-scale trial examining effects on sustainment of evidence-based nutrition and physical activity practices in childcare. We expect this strategy to be relevant for educators and consistent with the views of administrators as a guide for future practice for the targeted nutrition and physical activity interventions and beyond.

De-implementation of detrimental feeding practices: a pilot protocol

BACKGROUND

Early childhood educators (ECEs) often use detrimental feeding practices and are slow to implement positive feeding practices. Nevertheless, few studies have aimed to understand and change ECEs' feeding practices. This gap needs to be addressed because implementation (i.e., adding new, evidence-based practices) and de-implementation (i.e., stopping low-value or harmful practices) are distinct processes that require unique strategies.

METHODS

We will develop a de-implementation strategy for detrimental feeding practices using evidence-based quality improvement (EBQI) sessions to engage stakeholders and draw on the Niven process model for de-implementation. Then, we will investigate the effects of the de-implementation strategy in a proof-of-principle study. The de-implementation strategy will be evaluated in 2 partnering childcare agencies using a pre-post, within-site design. For our primary outcome, we will interview educators throughout the school year to assess the feasibility and acceptability of the intervention and survey them with standard measures for assessing feasibility and acceptability. For secondary outcomes, we will investigate its effects on the use of detrimental and evidence-based feeding practices by teachers and impacts on child BMI and diet.

DISCUSSION

The current study will establish the feasibility and acceptability of our de-implementation approach and will provide preliminary data toward 3 predicted secondary outcomes: (1) decreased detrimental feeding practices by ECEs, (2) increased adoption of and fidelity to nutrition promotion practices, and (3) improved child dietary outcomes. These results are expected to contribute to the uptake and sustainability of mealtime interventions to improve the diets of young children. Results will also apply to the field of implementation science by informing processes for developing de-implementation approaches in a community setting.

Adaptation of an exercise intervention for pregnant women to community-based delivery: a study protocol

INTRODUCTION

Despite well-established guidelines and benefits to exercise, the majority of pregnant women in the USA fail to meet recommended activity levels. Studies need to determine feasible ways to translate clinical interventions to community settings by engaging pregnant women in widely accessible locations to ensure benefits to more women. The aim of this study is to adapt and determine feasibility, acceptability and fidelity of the research clinic-based Expecting intervention (NCT02125149) with pregnant women with obesity in community settings.

METHODS AND ANALYSIS

We will use the Replicating Effective Programs (REP) to guide the adaptation and implementation of the research clinic-based intervention into the community. REP provides a four-phase process for implementing evidence-based interventions including collection of feedback from community stakeholders, iterative piloting of the intervention in the community and a process for standardising the intervention across community settings. Following adaptation, the updated intervention will be piloted. The pilot study will include 60 expecting women. We will randomise half to receive the community-adapted Expecting intervention (intervention, N=30) and half to receive standard of care (control, N=30). Feasibility and Acceptability of Intervention Measures are primary outcomes as key indicators of feasibility. Secondary outcomes will include the number of intervention sessions completed, the change in the number of minutes of physical activity as measured by accelerometer, as well as change in health indicators from enrolment to time of delivery and 6 months post-delivery (ie, body mass index, blood pressure and total cholesterol).

ETHICS AND DISSEMINATION

This study has been approved by the Institutional Review Board (#260132). Findings will be shared with study participants and stakeholder advisors through written summaries and in-person presentations; results will also be shared through presentations at scientific conferences and publications in peer-reviewed journals.

TRIAL REGISTRATION NUMBER

NCT04298125; Pre-results.

Establishing cross-systems collaborations for implementation: protocol for a longitudinal mixed methods study

Background

Cross-system interventions can help integrate services across different service delivery systems but require organizations to establish strong collaborative relationships for implementation. Contingency theory suggests that the effectiveness of different collaborative strategies (i.e. specific ways organizations align operations and services) varies by context. This paper describes a study of different strategies for fostering collaboration between child welfare and substance abuse treatment agencies and the conditions under which they are effective for implementation. We also describe the development and piloting of the Collaborating Across Systems for Program Implementation (CASPI) tool—a decision-making guide intended to help researchers and organizational leaders identify and use appropriate collaborative strategies for their context.

Methods/design

This multisite longitudinal, mixed methods study, leverages a naturally occurring implementation initiative -- in up to 17 Ohio counties -- to implement Ohio START (Sobriety Treatment and Reducing Trauma). START is a child welfare model that requires strong collaboration with local substance use treatment organizations to promote integrated services. During the first two years, we will identify collaborative strategies associated with improved START implementation (penetration and fidelity) and service delivery outcomes (timeliness), given system, and organizational features. We will conduct a convergent mixed methods study drawing on worker surveys, agency documents, administrative data, formal partner agreements, and group interviews. Data will be integrated and analyzed using Qualitative Comparative Analysis (QCA). To develop the CASPI, an expert panel comprised of implementation experts, and community stakeholders will convene to synthesize our findings and develop contents (including a decision tree). During the final year of the study, we will assess the acceptability, appropriateness, and feasibility of the CASPI in a randomized vignette experiment, and a pilot-test with 3 child welfare agencies that have not yet implemented START.

Discussion

Our results will lay the groundwork for a larger controlled trial that will test the CASPI’s effectiveness for supporting effective and efficient implementation of cross-system interventions like START. The CASPI is expected to help leaders and researchers select and use collaboration strategies tailored to their context and be applicable in a wide range of settings including rural communities. Our work also advances system-level implementation strategies.

Trial registration

NCT03931005, Registered April 29, 2019.

Developing an evidence-based reading intervention for early brain injury rehabilitation

Introduction:

Providing evidence-based services in areas with emerging or low-level evidence is a challenge for many clinicians. The aim of the current study was to apply a newly designed novel methodology to develop and describe a new intervention for cognitive-communication reading comprehension deficits in early acquired brain injury rehabilitation.

Methods:

An emergent multi-phase mixed methods design allowed phases of different research activity to build an evidence base of quantitative and qualitative data. A pragmatic clinical framework was developed to combine these traditional research findings with principles from knowledge translation and implementation science, evidence-based practice and intervention development models, clinical contextual practice guidelines and the Medical Research Council’s guidelines for developing and evaluating complex interventions, to create an evidence-based contextually driven clinical intervention.

Results:

The resulting reading comprehension intervention and service delivery model is presented and involves a multiple-strategy intervention across increasing level of reading comprehension complexity. In areas where traditional methodologies provide low-level evidence, this method provides an alternate way to conduct evidence-based clinical research.

Development of an intervention to facilitate implementation and uptake of diabetic retinopathy screening

BACKGROUND

'Implementation interventions' refer to methods used to enhance the adoption and implementation of clinical interventions such as diabetic retinopathy screening (DRS). DRS is effective, yet uptake is often suboptimal. Despite most routine management taking place in primary care and the central role of health care professionals (HCP) in referring to DRS, few interventions have been developed for primary care. We aimed to develop a multifaceted intervention targeting both professionals and patients to improve DRS uptake as an example of a systematic development process combining theory, stakeholder involvement, and evidence.

METHODS

First, we identified target behaviours through an audit in primary care of screening attendance. Second, we interviewed patients (n = 47) and HCP (n = 30), to identify determinants of uptake using the Theoretical Domains Framework, mapping these to behaviour change techniques (BCTs) to develop intervention content. Thirdly, we conducted semi-structured consensus groups with stakeholders, specifically users of the intervention, i.e. patients (n = 15) and HCPs (n = 16), regarding the feasibility, acceptability, and local relevance of selected BCTs and potential delivery modes. We consulted representatives from the national DRS programme to check intervention 'fit' with existing processes. We applied the APEASE criteria (affordability, practicability, effectiveness, acceptability, side effects, and equity) to select the final intervention components, drawing on findings from the previous steps, and a rapid evidence review of operationalised BCT effectiveness.

RESULTS

We identified potentially modifiable target behaviours at the patient (consent, attendance) and professional (registration) level. Patient barriers to consent/attendance included confusion between screening and routine eye checks, and fear of a negative result. Enablers included a recommendation from friends/family or professionals and recognising screening importance. Professional barriers to registration included the time to register patients and a lack of readily available information on uptake in their local area/practice. Most operationalised BCTs were acceptable to patients and HCPs while the response to feasibility varied. After considering APEASE, the core intervention, incorporating a range of BCTs, involved audit/feedback, electronic prompts targeting professionals, HCP-endorsed reminders (face-to-face, by phone and letter), and an information leaflet for patients.

CONCLUSIONS

Using the example of an intervention to improve DRS uptake, this study illustrates an approach to integrate theory with user involvement. This process highlighted tensions between theory-informed and stakeholder suggestions, and the need to apply the Theoretical Domains Framework (TDF)/BCT structure flexibly. The final intervention draws on the trusted professional-patient relationship, leveraging existing services to enhance implementation of the DRS programme. Intervention feasibility in primary care will be evaluated in a randomised cluster pilot trial.

Feasibility of an implementation intervention to increase attendance at diabetic retinopathy screening: protocol for a cluster randomised pilot trial

BACKGROUND

Diabetic retinopathy screening (DRS) leads to the earlier detection of retinopathy and treatment that can prevent or delay the development of diabetes-related blindness. However, uptake continues to be sub-optimal in many countries, including Ireland. Routine management of type 2 diabetes largely takes place in primary care. As such, there may be an opportunity in primary care to introduce interventions to improve DRS uptake. However, few studies test the feasibility of interventions to enhance DRS uptake in this context. Our aim is to investigate the feasibility of an implementation intervention (IDEAs (Improving Diabetes Eye screening Attendance)) delivered in general practice to improve the uptake of the national DRS programme, RetinaScreen.

METHODS

The IDEAs study is a cluster randomised pilot trial with an embedded process evaluation and economic evaluation. Following stratification by practice size, eight general practices (clusters) will be randomly allocated to intervention (n = 4) or wait-list control groups (n = 4). The intervention will be delivered for 6 months, after which, it will be administered to wait-list control practices. The intervention is multi-faceted and comprises provider-level components (training, audit and feedback, health care professional prompt, reimbursement) and patient-level components (GP-endorsed reminder with information leaflet delivered opportunistically face-to-face, and systematically by phone and letter). Patient inclusion criteria are type 1 or type 2 diabetes and DRS programme non-attendance. A multi-method approach will be used to determine screening uptake, evaluate the trial and study procedures and examine the acceptability and feasibility of the intervention from staff and patient perspectives. Quantitative and qualitative data will be collected on intervention uptake and delivery, research processes and outcomes. Data will be collected at the practice, health professional and patient level. A partial economic evaluation will be conducted to estimate the cost of delivering the implementation intervention in general practice. Formal continuation criteria will be used to determine whether IDEAs should progress to a definitive trial.

DISCUSSION

Findings will determine whether IDEAsis feasible and acceptable and will be used to refine the intervention and study procedures. A definitive trial will determine whether IDEAs is a cost-effective intervention to improve DRS uptake and reduce diabetes-related blindness.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03901898. Registered 3rd April 2019.

Project ImPACT for Toddlers: Pilot outcomes of a community adaptation of an intervention for autism risk

This study reports child and family outcomes from a community-based, quasi-experimental pilot trial of Project ImPACT for Toddlers that is a parent-mediated, naturalistic, developmental behavioral intervention for children with or at-risk for autism spectrum disorder developed through a research-community partnership. Community early interventionists delivered either Project ImPACT for Toddlers (n = 10) or Usual Care (n = 9) to families based on Part C assigned provider. Twenty-five families participated, with children averaging 22.76 months old (SD = 5.06). Family and child measures were collected at intake, after 3 months of service, and after a 3-month follow-up. Results indicate significantly greater improvements in positive parent-child interactions for Project ImPACT for Toddlers than usual care families, as well as large, but non-significant, effect sizes for Project ImPACT for Toddlers families in children's social and communication skills.

Implementation Science and Nutrition Education and Behavior: Opportunities for Integration

Implementation science (IS) is the study of approaches designed to increase adoption and sustainability of research evidence into routine practice. This article provides an overview of IS and ideas for its integration with nutrition education and behavior practice and research. Implementation science application in nutrition education and behavior practice can inform real-word implementation efforts. Research opportunities include advancing common approaches to implementation measurement. In addition, the article provides suggestions for future studies (eg, comparative effectiveness trials comparing implementation strategies) to advance the knowledge base of both fields. An example from ongoing research is included to illustrate concepts and methods of IS.

Taxonomy of approaches to developing interventions to improve health: a systematic methods overview

Background

Interventions need to be developed prior to the feasibility and piloting phase of a study. There are a variety of published approaches to developing interventions, programmes or innovations to improve health. Identifying different types of approach, and synthesising the range of actions taken within this endeavour, can inform future intervention development.

Methods

This study is a systematic methods overview of approaches to intervention development. Approaches were considered for inclusion if they described how to develop or adapt an intervention in a book, website or journal article published after 2007, or were cited in a primary research study reporting the development of a specific intervention published in 2015 or 2016. Approaches were read, a taxonomy of approaches was developed and the range of actions taken across different approaches were synthesised.

Results

Eight categories of approach to intervention development were identified. (1) Partnership, where people who will use the intervention participate equally with the research team in decision-making about the intervention throughout the development process. (2) Target population-centred, where the intervention is based on the views and actions of the people who will use it. (3) Evidence and theory-based, where the intervention is based on published research evidence and existing theories. (4) Implementation-based, where the intervention is developed with attention to ensuring it will be used in the real world. (5) Efficiency-based, where components of an intervention are tested using experimental designs to select components which will optimise efficiency. (6) Stepped or phased, where interventions are developed with an emphasis on following a systematic set of processes. (7) Intervention-specific, where an approach is constructed for a specific type of intervention. (8) Combination, where existing approaches to intervention development are formally combined. The actions from approaches in all eight categories were synthesised to identify 18 actions to consider when developing interventions.

Conclusions

This overview of approaches to intervention development can help researchers to understand the variety of existing approaches, and to understand the range of possible actions involved in intervention development, prior to assessing feasibility or piloting the intervention. Findings from this overview will contribute to future guidance on intervention development.

Trial registration

PROSPERO CRD42017080553.

Electronic supplementary material

The online version of this article (10.1186/s40814-019-0425-6) contains supplementary material, which is available to authorized users.

Learning from implementation setbacks: Identifying and responding to contextual challenges

Introduction

We address organizational learning about implementation context during setbacks to primary care redesign in an ambulatory system. The redesign expanded care teams and added a medical assistant assigned administrative and coordination tasks. The redesign was expected to improve care efficiency, prevention, and continuity. In response to setbacks, redesign and system leaders used understanding of context to plan system-wide changes, as well as program adjustments. Doing so enhanced the redesign's prospects and contributed to system learning.

Methods

We conducted a 33-month, mixed-methods study. Qualitative data included quarterly calls with the redesign leaders and 63 activity log entries. There were three site visits; 73 interviews with practice leaders, providers, and medical assistants. Data analysis used categories from an implementation research framework; these were refined and then expanded inductively using log reports, debriefings with change leaders, and documents. Quantitative analysis used system operational data on chronic care, prevention, efficiency, productivity, and patient access.

Results

Redesigned teams were not implemented as widely or rapidly as anticipated and did not deliver hoped-for gains in operational metrics. Interviews reported that team redesign was leading to improvements in chronic care and prevention and eased provider burden. Besides making small adjustments to cope with setbacks, redesign and system leaders engaged in more thorough organizational learning. They examined contextual challenges underlying setbacks and posing risks to the delivery system as a whole. Their responses to challenges helped strengthen the redesign's prospects, improved the delivery system's position in its labor market, and helped the system prepare to meet emerging requirements for value-based care and population health.

Conclusions

This case points to benefits for both health care researchers and change practitioners of paying closer attention to how context affects implementation of organizational change, and to opportunities and conditions for learning from setbacks during change.

A web-based self-management programme for people with type 2 diabetes: the HeLP-Diabetes research programme including RCT

Background

In the UK, 6% of the UK population have diabetes mellitus, 90% of whom have type 2 diabetes mellitus (T2DM). Diabetes mellitus accounts for 10% of NHS expenditure (£14B annually). Good self-management may improve health outcomes. NHS policy is to refer all people with T2DM to structured education, on diagnosis, to improve their self-management skills, with annual reinforcement thereafter. However, uptake remains low (5.6% in 2014–15). Almost all structured education is group based, which may not suit people who work, who have family or other caring commitments or who simply do not like group-based formats. Moreover, patient needs vary with time and a single education session at diagnosis is unlikely to meet these evolving needs. A web-based programme may increase uptake.

Objectives

Our aim was to develop, evaluate and implement a web-based self-management programme for people with T2DM at any stage of their illness journey, with the goal of improving access to, and uptake of, self-management support, thereby improving health outcomes in a cost-effective manner. Specific objectives were to (1) develop an evidence-based theoretically informed programme that was acceptable to patients and health-care professionals (HCPs) and that could be readily implemented within routine NHS care, (2) determine the clinical effectiveness and cost-effectiveness of the programme compared with usual care and (3) determine how best to integrate the programme into routine care.

Design

There were five linked work packages (WPs). WP A determined patient requirements and WP B determined HCP requirements for the self-management programme. WP C developed and user-tested the Healthy Living for People with type 2 Diabetes (HeLP-Diabetes) programme. WP D was an individually randomised controlled trial in primary care with a health economic analysis. WP E used a mixed-methods and case-study design to study the potential for implementing the HeLP-Diabetes programme within routine NHS practice.

Setting

English primary care.

Participants

People with T2DM (WPs A, D and E) or HCPs caring for people with T2DM (WPs B, C and E).

Intervention

The HeLP-Diabetes programme; an evidence-based theoretically informed web-based self-management programme for people with T2DM at all stages of their illness journey, developed using participatory design principles.

Main outcome measures

WPs A and B provided data on user ‘wants and needs’, including factors that would improve the uptake and accessibility of the HeLP-Diabetes programme. The outcome for WP C was the HeLP-Diabetes programme itself. The trial (WP D) had two outcomes measures: glycated haemoglobin (HbA1c) level and diabetes mellitus-related distress, as measured with the Problem Areas in Diabetes (PAID) scale. The implementation outcomes (WP E) were the adoption and uptake at clinical commissioning group, general practice and patient levels and the identification of key barriers and facilitators.

Results

Data from WPs A and B supported our holistic approach and addressed all areas of self-management (medical, emotional and role management). HCPs voiced concerns about linkage with the electronic medical records (EMRs) and supporting patients to use the programme. The HeLP-Diabetes programme was developed and user-tested in WP C. The trial (WP D) recruited to target (n = 374), achieved follow-up rates of over 80% and the intention-to-treat analysis showed that there was an additional improvement in HbA1c levels at 12 months in the intervention group [mean difference –0.24%, 95% confidence interval (CI) –0.44% to –0.049%]. There was no difference in overall PAID score levels (mean difference –1.5 points, 95% CI –3.9 to 0.9 points). The within-trial health economic analysis found that incremental costs were lower in the intervention group than in the control group (mean difference –£111, 95% CI –£384 to £136) and the quality-adjusted life-years (QALYs) were higher (mean difference 0.02 QALYs, 95% CI 0.000 to 0.044 QALYs), meaning that the HeLP-Diabetes programme group dominated the control group. In WP E, we found that the HeLP-Diabetes programme could be successfully implemented in primary care. General practices that supported people in registering for the HeLP-Diabetes programme had better uptake and registered patients from a wider demographic than those relying on patient self-registration. Some HCPs were reluctant to do this, as they did not see it as part of their professional role.

Limitations

We were unable to link the HeLP-Diabetes programme with the EMRs or to determine the effects of the HeLP-Diabetes programme on users in the implementation study.

Conclusions

The HeLP-Diabetes programme is an effective self-management support programme that is implementable in primary care.

Future work

The HeLP-Diabetes research team will explore the following in future work: research to determine how to improve patient uptake of self-management support; develop and evaluate a structured digital educational pathway for newly diagnosed people; develop and evaluate a digital T2DM prevention programme; and the national implementation of the HeLP-Diabetes programme.

Trial registration

Research Ethics Committee reference number 10/H0722/86 for WPs A–C; Research Ethics Committee reference number 12/LO/1571 and UK Clinical Research Network/National Institute for Health Research (NIHR) Portfolio 13563 for WP D; and Research Ethics Committee 13/EM/0033 for WP E. In addition, for WP D, the study was registered with the International Standard Randomised Controlled Trial Register as reference number ISRCTN02123133.

Funding details

This project was funded by the NIHR Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 6, No. 5. See the NIHR Journals Library website for further project information.

A Community-Responsive Adaptation to Reach and Engage Latino Families Affected by Maternal Depression

As family researchers and practitioners seek to improve the quality and accessibility of mental health services for immigrant families, they have turned to culturally adapted interventions. Although many advancements have been made in adapting interventions for such families, we have yet to understand how the adaptation can ensure that the intervention is reaching families identified to be in greatest need within a local system of care and community. We argue that reaching, engaging, and understanding the needs of families entails a collaborative approach with multiple community partners to ensure that adaptations to intervention content and delivery are responsive to the sociocultural trajectory of families within a community. We describe a cultural adaptation framework that is responsive to the unique opportunities and challenges of identifying and recruiting vulnerable families through community partnerships, and of addressing the needs of families by incorporating multiple community perspectives. Specifically, we apply these principles to the cultural adaptation of an intervention originally developed for low-income African American and White families facing maternal depression. The new intervention, Fortalezas Familiares (Family Strengths), was targeted to Latino immigrant families whose mothers were in treatment for depression in mental health and primary care clinics. We conclude with key recommendations and directions for how family researchers and practitioners can design the cultural adaptation of interventions to be responsive to the practices, preferences, and needs of underserved communities, including families and service providers.

Development and refinement of a clinician intervention to facilitate primary care patient use of the PTSD Coach app

Posttraumatic stress disorder (PTSD) is common and undertreated among Veterans Affairs (VA) primary care patients. A brief primary care intervention combining clinician support with a self-management mobile app (Clinician-Supported PTSD Coach, CS-PTSD Coach) may improve patient outcomes. This study developed and refined an intervention to provide clinician support to facilitate use of the PTSD Coach app and gathered VA provider and patient qualitative and quantitative feedback on CS-PTSD Coach to investigate preliminary acceptability and implementation barriers/facilitators. VA primary care providers and mental health leadership (N = 9) completed a survey and interview regarding implementation barriers and facilitators structured according to the Consolidated Framework for Implementation Research (CFIR). Clinicians who delivered CS-PTSD Coach (N = 3) and patients (N = 9) who received it provided feedback on the intervention and implementation process. CS-PTSD Coach has high provider and patient acceptability. Important implementation factors included that CS-PTSD Coach be compatible with the clinics' current practices, have low complexity to implement, be perceived to address patient needs, and have strong support from leadership. Diverse factors related to CS-PTSD Coach delivery facilitate implementation, provide an opportunity to problem-solve barriers, and improve integration of the intervention into primary care.

A mixed methods protocol for developing and testing implementation strategies for evidence-based obesity prevention in childcare: a cluster randomized hybrid type III trial

Background

Despite the potential to reach at-risk children in childcare, there is a significant gap between current practices and evidence-based obesity prevention in this setting. There are few investigations of the impact of implementation strategies on the uptake of evidence-based practices (EBPs) for obesity prevention and nutrition promotion. This study protocol describes a three-phase approach to developing and testing implementation strategies to support uptake of EBPs for obesity prevention practices in childcare (i.e., key components of the WISE intervention).

Methods

Informed by the i-PARIHS framework, we will use a stakeholder-driven evidence-based quality improvement (EBQI) process to apply information gathered in qualitative interviews on barriers and facilitators to practice to inform the design of implementation strategies. Then, a Hybrid Type III cluster randomized trial will compare a basic implementation strategy (i.e., intervention as usual) with an enhanced implementation strategy informed by stakeholders. All Head Start centers (N = 12) within one agency in an urban area in a southern state in the USA will be randomized to receive the basic or enhanced implementation with approximately 20 classrooms per group (40 educators, 400 children per group). The educators involved in the study, the data collectors, and the biostastician will be blinded to the study condition.

The basic and enhanced implementation strategies will be compared on outcomes specified by the RE-AIM model (e.g., Reach to families, Effectiveness of impact on child diet and health indicators, Adoption commitment of agency, Implementation fidelity and acceptability, and Maintenance after 6 months). Principles of formative evaluation will be used throughout the hybrid trial.

Discussion

This study will test a stakeholder-driven approach to improve implementation, fidelity, and maintenance of EBPs for obesity prevention in childcare. Further, this study provides an example of a systematic process to develop and test a tailored, enhanced implementation strategy.

Trial registration

ClinicalTrials.gov, NCT03075085

Using implementation facilitation to foster clinical practice quality and adherence to evidence in challenged settings: a qualitative study

Background

We evaluated a facilitation strategy to help clinical sites likely to experience challenges implement evidence-based Primary Care-Mental Health Integration (PC-MHI) care models within the context of a Department of Veterans Affairs (VA) initiative. This article describes our assessment of whether implementation facilitation (IF) can foster development of high quality PC-MHI programs that adhere to evidence, are sustainable and likely to improve clinical practices and outcomes.

Methods

Utilizing a matched pair design, we conducted a qualitative descriptive evaluation of the IF strategy in sixteen VA primary care clinics. To assess program quality and adherence to evidence, we conducted one-hour structured telephone interviews, at two time points, with clinicians and leaders who knew the most about the clinics’ programs. We then created structured summaries of the interviews that VA national PC-MHI experts utilized to rate the programs on four dimensions (overall quality, adherence to evidence, sustainability and level of improvement).

Results

At first assessment, seven of eight IF sites and four of eight comparison sites had implemented a PC-MHI program. Our qualitative assessment suggested that experts rated IF sites’ programs higher than comparison sites’ programs with one exception. At final assessment, all eight IF but only five comparison sites had implemented a PC-MHI program. Again, experts rated IF sites’ programs higher than their matched comparison sites with one exception. Over time, all ratings improved in five of seven IF sites and two of three comparison sites.

Conclusions

Implementing complex evidence-based programs, particularly in settings that lack infrastructure, resources and support for such efforts, is challenging. Findings suggest that a blend of external expert and internal regional facilitation strategies that implementation scientists have developed and tested can improve PC-MHI program uptake, quality and adherence to evidence in primary care clinics with these challenges. However, not all sites showed these improvements. To be successful, facilitators likely need at least a moderate level of leaders’ support, including provision of basic resources. Additionally, we found that IF and strength of leadership structure may have a synergistic effect on ability to implement higher quality and evidence-based programs.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-017-2217-0) contains supplementary material, which is available to authorized users.

Methods for designing interventions to change healthcare professionals' behaviour: a systematic review

BACKGROUND

Systematic reviews consistently indicate that interventions to change healthcare professional (HCP) behaviour are haphazardly designed and poorly specified. Clarity about methods for designing and specifying interventions is needed. The objective of this review was to identify published methods for designing interventions to change HCP behaviour.

METHODS

A search of MEDLINE, Embase, and PsycINFO was conducted from 1996 to April 2015. Using inclusion/exclusion criteria, a broad screen of abstracts by one rater was followed by a strict screen of full text for all potentially relevant papers by three raters. An inductive approach was first applied to the included studies to identify commonalities and differences between the descriptions of methods across the papers. Based on this process and knowledge of related literatures, we developed a data extraction framework that included, e.g. level of change (e.g. individual versus organization); context of development; a brief description of the method; tasks included in the method (e.g. barrier identification, component selection, use of theory).

RESULTS

3966 titles and abstracts and 64 full-text papers were screened to yield 15 papers included in the review, each outlining one design method. All of the papers reported methods developed within a specific context. Thirteen papers included barrier identification and 13 included linking barriers to intervention components; although not the same 13 papers. Thirteen papers targeted individual HCPs with only one paper targeting change across individual, organization, and system levels. The use of theory and user engagement were included in 13/15 and 13/15 papers, respectively.

CONCLUSIONS

There is an agreement across methods of four tasks that need to be completed when designing individual-level interventions: identifying barriers, selecting intervention components, using theory, and engaging end-users. Methods also consist of further additional tasks. Examples of methods for designing the organisation and system-level interventions were limited. Further analysis of design tasks could facilitate the development of detailed guidelines for designing interventions.

A mixed methods study of individual and organizational factors that affect implementation of interventions for children with autism in public schools

Background

The significant lifelong impairments associated with autism spectrum disorder (ASD), combined with the growing number of children diagnosed with ASD, have created urgency in improving school-based quality of care. Although many interventions have shown efficacy in university-based research, few have been effectively implemented and sustained in schools, the primary setting in which children with ASD receive services. Individual- and organizational-level factors have been shown to predict the implementation of evidence-based interventions (EBIs) for the prevention and treatment of other mental disorders in schools, and may be potential targets for implementation strategies in the successful use of autism EBIs in schools. The purpose of this study is to examine the individual- and organizational-level factors associated with the implementation of EBIs for children with ASD in public schools.

Methods

We will apply the Domitrovich and colleagues (2008) framework that examines the influence of contextual factors (i.e., individual- and organizational-level factors) on intervention implementation in schools. We utilize mixed methods to quantitatively test whether the factors identified in the Domitrovich and colleagues (2008) framework are associated with the implementation of autism EBIs, and use qualitative methods to provide a more comprehensive understanding of the factors associated with successful implementation and sustainment of these interventions with the goal of tailoring implementation strategies.

Discussion

The results of this study will provide an in-depth understanding of individual- and organizational-level factors that influence the successful implementation of EBIs for children with ASD in public schools. These data will inform potential implementation targets and tailoring of strategies that will help schools overcome barriers to implementation and ultimately improve the services and outcomes for children with ASD.

Feasibility and challenges of inpatient psychotherapy for psychosis: lessons learned from a veterans health administration pilot randomized controlled trial

Background

In large health care systems, decision regarding broad implementation of psychotherapies for inpatients with psychosis require substantial evidence regarding effectiveness and feasibility for implementation. It is important to recognize challenges in conducting research to inform such decisions, including difficulties in obtaining consent from and engaging inpatients with psychosis in research. We set out to conduct a feasibility and effectiveness Hybrid Type I pilot randomized controlled trial of acceptance and commitment therapy (ACT) and a semi-formative evaluation of barriers and facilitators to implementation.

Findings

We developed a training protocol and refined an ACT treatment manual for inpatient treatment of psychosis for use at the Veterans Health Administration. While our findings on feasibility were mixed, we obtained supportive evidence of the acceptability and safety of ACT. Identified strengths of ACT included a focus on achievement of valued goals rather than symptoms. Weaknesses included that symptoms may limit patient’s understanding of ACT. Facilitators included building trust and multi-stage informed consent processes. Barriers included restrictive eligibility criteria, rigid use of a manualized protocol, and individual therapy format. Conclusions are limited by our randomization of only 18 patient participants (with nine completing all aspects of the study) out of 80 planned.

Conclusions

Future studies should include (1) multi-stage informed consent processes to build trust and alleviate patient fears, (2) relaxation of restrictions associated with obtaining efficacy/effectiveness data, and (3) use of Hybrid Type II and III designs.

Development of training for medicines-oriented policymakers to apply evidence

Background

Health systems globally promote appropriate prescribing by healthcare providers and safe and effective medicine use by consumers. Rx for Change, a publicly available database, provides access to systematic reviews regarding best practices for prescribing and using medicines. Despite the value of the database for improving prescribing and medicine use, its use remains suboptimal. This study aimed to develop a training program for five medicine-focused organisations in Canada and Australia to facilitate the use and understanding of the Rx for Change database.

Methods

Four steps were undertaken: 1) key informant interviews were completed across all organisations to understand the knowledge user perspective; 2) a directed content analysis was completed of the interview transcripts and proposed training was developed; 3) a second round of feedback on the proposed training by knowledge users was gathered; and 4) feedback was integrated to develop the final training.

Results

Sixteen key informant interviews with knowledge users were conducted. Themes for training content included the scope of, navigation and strategies for using Rx for Change (generic content) and practical examples on incorporating evidence within their workplace context (tailored content). The final training consisted of an informational video, a 60-minute face-to-face workshop and two post-training reminders.

Conclusions

A method of engaging knowledge users in the development of a training program to improve the use of an on-line database of systematic reviews was established and used to design training. Next steps include the delivery and evaluation of the training.

Assessing fidelity of cognitive behavioral therapy in rural VA clinics: design of a randomized implementation effectiveness (hybrid type III) trial

BACKGROUND

Broadly disseminating and implementing evidence-based psychotherapies with high fidelity, particularly cognitive behavioral therapy (CBT), has proved challenging for many health-care systems, including the Department of Veterans Affairs, especially in primary care settings such as small or remote clinics. A computer-based tool (based on the coordinated anxiety learning and management (CALM) program) was designed to support primary care-based mental health providers in delivering CBT. The objectives of this study are to modify the CALM tool to meet the needs of mental health clinicians in veterans affairs (VA) community-based outpatient clinics (CBOCs) and rural "veterans", use external facilitation to implement CBT and determine the effect of the CALM tool versus a manualized version of CALM to improve fidelity to the CBT treatment model, and conduct a needs assessment to understand how best to support future implementation of the CALM tool in routine care.

METHODS/DESIGN

Focus groups will inform the redesign of the CALM tool. Mental health providers at regional VA CBOCs; CBT experts; VA experts in implementation of evidence-based mental health practices; and veterans with generalized anxiety disorder, panic disorder, social anxiety disorder, posttraumatic stress disorder, "with or without" depression will be recruited. A hybrid type III design will be used to examine the effect of receiving CBT training plus either the CALM tool or a manual version of CALM on treatment fidelity. External facilitation will be used as the overarching strategy to implement both CBT delivery methods. Data will also be collected on symptoms of the targeted disorders. To help prepare for the future implementation of the CALM tool in VA CBOCs, we will perform an implementation need assessment with mental health providers participating in the clinical trial and their CBOC directors.

DISCUSSION

This project will help inform strategies for delivering CBT with high fidelity in VA CBOCs to veterans with anxiety disorders and PTSD with or without depression. If successful, results of this study could be used to inform a national rollout of the CALM tool in VA CBOCs including providing recommendations for optimizing the adoption and sustained use of the computerized CALM tool among mental health providers in this setting.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT02488551.

A Web-Based Self-Management Program for Recent Combat Veterans With PTSD and Substance Misuse: Program Development and Veteran Feedback

Combat veterans from the wars in Iraq and Afghanistan commonly experience posttraumatic stress disorder (PTSD) and substance use problems. In addition, these veterans often report significant barriers to receiving evidence-based mental health and substance use care, such as individual beliefs that treatment will be unhelpful, inconvenient, or that they should be able to handle their problems on their own. To increase access to treatment for this underserved population, a Web-based patient self-management program that teaches cognitive-behavioral therapy (CBT) skills to manage PTSD symptoms and substance misuse was developed. This paper describes and provides results from an iterative, multistage process for developing the Web-based program and seeks to inform clinicians in the field about the preferences of veterans for using a Web-based CBT program. Systematic feedback was gathered from (a) three expert clinicians in the field, (b) focus groups of combat veterans (n = 18), and (c) individual feedback sessions with combat veterans (n = 34). Clinician feedback led to the incorporation of motivational strategies to increase participant engagement and an optional module that guides written trauma exposure work. Focus group feedback guided the research team to frame the program in a strength-based approach and allows for maximum flexibility, adaptability, interactivity, and privacy for veterans. In individual feedback sessions, veterans generally found the program likable, easy to use, and relevant to their experiences; critiques of the program led to revised content meant to increase clarity and participant interest. Our findings provide specific guidance for clinicians who are interested in developing or providing technology-based treatment, including the need to gather feedback from an intervention's target audience when adapting a psychotherapeutic intervention and that the treatment must be highly interactive and private to engage clients.

Supportive text messages to reduce mood symptoms and problem drinking in patients with primary depression or alcohol use disorder: protocol for an implementation research study

BACKGROUND

Depression and Alcohol Use Disorders (AUDs) are two leading causes of disability worldwide and are associated with significant treatment challenges requiring new, innovative, cost-effective and technologically-based therapies including the use of supportive text messages.

OBJECTIVE

To determine the feasibility and effectiveness of supportive text messages in long-term follow-up to reduce mood symptoms and problem drinking in patients with Depression or AUD respectively and to explore the usefulness of self-reports of health services utilization as an outcomes measure.

METHODS

This will be a longitudinal, prospective, parallel-design, two-arm, placebo-controlled single-rater-blinded randomized clinical trial with a recruitment period of 6 months and an observation period of 12 months for each participant, with two strata based on primary diagnosis of Major Depressive Disorder or AUD. The sample size will be 120, with about 60 patients randomized from each primary diagnostic grouping. Patients in all intervention groups will receive twice-daily supportive SMS text messages for 3 months and then daily supportive text messages for the next three months. Patients will also receive a phone call every two weeks from the research assistant assigning treatment allocation to confirm that they are still receiving the text messages and to thank them for taking part in the study. Patients in the control group will receive no text messages but will also receive a phone call from the same research assistant every two weeks to thank them for taking part in the study.

RESULTS

The study starts in April 2015 and ends in September 2016. It is envisaged that both qualitative and quantitative primary and secondary outcomes, including patient perceptions of the intervention, will shed light on the feasibility of using automated supportive text message interventions in long term for patients with Depression and AUD. This will inform a full-scale clinical trial.

CONCLUSIONS

The paradigm for behavior change using text messages as a patient-direct intervention is consistent with a cognitive behavior therapy approach and addictions counselling principles. Given the automaticity of the messages, we anticipate that if the intervention proves successful, it will represent a low cost strategy that will be readily available and can bring relief to patients in hard-to-reach areas with limited access to psychological therapies.

TRIAL REGISTRATION

ClinicalTrials.gov: NCT02327858; https://clinicaltrials.gov/ct2/show/NCT02327858 (Archived by WebCite at https://clinicaltrials.gov/ct2/show/NCT02327858).

Development of a behaviour change intervention to increase upper limb exercise in stroke rehabilitation

Background

Two thirds of survivors will achieve independent ambulation after a stroke, but less than half will recover upper limb function. There is strong evidence to support intensive repetitive task-oriented training for recovery after stroke. The number of repetitions needed is suggested to be in the order of hundreds, but this is not currently being achieved in clinical practice. In an effort to bridge this evidence-practice gap, we have developed a behaviour change intervention that aims to increase provision of upper limb repetitive task-oriented training in stroke rehabilitation. This paper aims to describe the systematic processes that took place in collaboratively developing the behaviour change intervention.

Methods

The methods used in this study were not defined a priori but were guided by the Behaviour Change Wheel. The process was collaborative and iterative with four stages of development emerging (i) establishing an intervention development group; (ii) structured discussions to understand the problem, prioritise target behaviours and analyse target behaviours; (iii) collaborative design of theoretically underpinned intervention components and (iv) piloting and refining of intervention components.

Results

The intervention development group consisted of the research team and stroke therapy team at a local stroke rehabilitation unit. The group prioritised four target behaviours at the therapist level: (i) identifying suitable patients for exercises, (ii) provision of exercises, (iii) communicating exercises to family/visitors and (iv) monitoring and reviewing exercises. It also provides a method for self-monitoring performance in order to measure fidelity. The developed intervention, PRACTISE (Promoting Recovery of the Arm: Clinical Tools for Intensive Stroke Exercise), consists of team meetings and the PRACTISE Toolkit (screening tool and upper limb exercise plan, PRACTISE exercise pack and an audit tool).

Conclusions

This paper provides an example of how the Behaviour Change Wheel may be applied in the collaborative development of a behaviour change intervention for health professionals. The process involved was resource-intensive, and the iterative process was difficult to capture. The use of a published behaviour change framework and taxonomy will assist replication in future research and clinical use. The feasibility and acceptability of PRACTISE is currently being explored in two other stroke rehabilitation units.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-015-0223-3) contains supplementary material, which is available to authorized users.

Observational measures of implementer fidelity for a school-based preventive intervention: development, reliability, and validity

Current measures of implementer fidelity often fail to adequately measure core constructs of adherence and competence, and their relationship to outcomes can be mixed. To address these limitations, we used observational methods to assess these constructs and their relationships to proximal outcomes in a randomized trial of a school-based preventive intervention (Rochester Resilience Project) designed to strengthen emotion self-regulation skills in first-third graders with elevated aggressive-disruptive behaviors. Within the intervention group (n = 203), a subsample (n = 76) of students was selected to reflect the overall sample. Implementers were 10 paraprofessionals. Videotaped observations of three lessons from year 1 of the intervention (14 lessons) were coded for each implementer-child dyad on adherence (content) and competence (quality). Using multilevel modeling, we examined how much of the variance in the fidelity measures was attributed to implementer and to the child within implementer. Both measures had large and significant variance accounted for by implementer (competence, 68 %; adherence, 41 %); child within implementer did not account for significant variance indicating that ratings reflected stable qualities of the implementer rather than the child. Raw adherence and competence scores shared 46 % of variance (r = .68). Controlling for baseline differences and age, the amount (adherence) and quality (competence) of program delivered predicted children's enhanced response to the intervention on both child and parent reports after 6 months, but not on teacher report of externalizing behavior. Our findings support the use of multiple observations for measuring fidelity and that adherence and competence are important components of fidelity which could be assessed by many programs using these methods.

The personalized reminder information and social management system (PRISM) trial: rationale, methods and baseline characteristics

Technology holds promise in terms of providing support to older adults. To date, there have been limited robust systematic efforts to evaluate the psychosocial benefits of technology for older people and identify factors that influence both the usability and uptake of technology systems. In response to these issues, we developed the Personal Reminder Information and Social Management System (PRISM), a software application designed for older adults to support social connectivity, memory, knowledge about topics, leisure activities and access to resources. This trail is evaluating the impact of access to the PRISM system on outcomes such as social isolation, social support and connectivity. This paper reports on the approach used to design the PRISM system, study design, methodology and baseline data for the trial. The trial is multi-site randomized field trial. PRISM is being compared to a Binder condition where participants received a binder that contained content similar to that found on PRISM. The sample includes 300 older adults, aged 65-98 years, who lived alone and at risk for being isolated. The primary outcome measures for the trial include indices of social isolation and support and well-being. Secondary outcomes measures include indices of computer proficiency, technology uptake and attitudes towards technology. Follow-up assessments occurred at 6 and 12 months post-randomization. The results of this study will yield important information about the potential value of technology for older adults. The study also demonstrates how a user-centered iterative design approach can be incorporated into the design and evaluation of an intervention protocol.