Rapid Assessment Procedure Informed Clinical Ethnography (RAPICE) in Pragmatic Clinical Trials of Mental Health Services Implementation: Methods and Applied Case Study

Implementation of medication for opioid use disorder treatment during a natural disaster: The PROUD-LA study

BACKGROUND

The impacts of climate change-related extreme weather events (EWEs) on Medication for Opioid Use Disorders (MOUD) implementation for Medicaid beneficiaries are relatively unknown. Such information is critical to disaster planning and other implementation strategies. In this study we examined implementation determinants and strategies for MOUD during EWEs.

METHODS

The Louisiana-based Community Resilience Learning Collaborative and Research Network (C-LEARN) utilized Rapid Assessment Procedures-Informed Community Ethnography (RAPICE), involving community leaders in study design, execution, and data analysis. We conducted qualitative semi-structured interviews with 42 individuals, including MOUD Medicaid member patients and their caregivers, healthcare providers and administrators, and public health officials with experience with climate-related disasters. We mapped key themes onto updated Consolidated Framework for Implementation Research domains.

RESULTS

MOUD use is limited during EWEs by pharmacy closures, challenges to medication prescription and access across state lines, hospital and clinic service limits, overcrowded emergency departments, and disrupted communications with providers. MOUD demand simultaneously increases due to the stress associated with displacement, resource loss, the COVID-19 pandemic, and social determinants of health. Effective implementation strategies include healthcare system disaster plans with protocols for clear and regular patient-provider communication, community outreach, additional staffing, and virtual delivery of services. Providers can also increase MOUD access by having remote access to EHRs, laptops and contact information, resource lists, collaborative networks, and contact with patients via call centers and social media. Patients can retain access to MOUD via online patient portals, health apps, call centers, and provider calls and texts. The impact of EWEs on MOUD access and use is also influenced by individual characteristics of both patients and providers.

CONCLUSIONS

The increasing frequency and severity of climate-related EWEs poses a serious threat to MOUD for Medicaid beneficiaries. MOUD-specific disaster planning and use of telehealth for maintaining contact and providing care are effective strategies for MOUD implementation during EWEs. Potential considerations for policies and practices of Medicaid, providers, and others to benefit members during hurricanes or major community stressors, include changes in Medicaid policies to enable access to MOUD by interstate evacuees, improvement of medication refill flexibilities, and incentivization of telehealth services for more systematic use.

The Rapid Implementation Feedback (RIF) report: real-time synthesis of qualitative data for proactive implementation planning and tailoring

BACKGROUND

Qualitative methods are a critical tool for enhancing implementation planning and tailoring, yet rapid turn-around of qualitative insights can be challenging in large implementation trials. The Department of Veterans Affairs-funded EMPOWER 2.0 Quality Enhancement Research Initiative (QUERI) is conducting a hybrid type 3 effectiveness-implementation trial comparing the impact of Replicating Effective Programs (REP) and Evidence-Based Quality Improvement (EBQI) as strategies for implementing three evidence-based practices (EBPs) for women Veterans. We describe the development of the Rapid Implementation Feedback (RIF) report, a pragmatic, team-based approach for the rapid synthesis of qualitative data to aid implementation planning and tailoring, as well as findings from a process evaluation of adopting the RIF report within the EMPOWER 2.0 QUERI.

METHODS

Trained qualitative staff conducted 125 semi-structured pre-implementation interviews with frontline staff, providers, and leadership across 16 VA sites between October 2021 and October 2022. High-priority topic domains informed by the updated Consolidated Framework for Implementation Research were selected in dialogue between EMPOWER 2.0 implementation and evaluation teams, and relevant key points were summarized for each interview to produce a structured RIF report, with emergent findings about each site highlighted in weekly written and verbal communications. Process evaluation was conducted to assess EMPOWER 2.0 team experiences with the RIF report across pre-implementation data collection and synthesis and implementation planning and tailoring.

RESULTS

Weekly RIF updates supported continuous EMPOWER 2.0 team communication around key findings, particularly questions and concerns raised by participating sites related to the three EBPs. Introducing the RIF report into team processes enhanced: team communication; quality and rigor of qualitative data; sensemaking around emergent challenges; understanding of site readiness; and tailoring of REP and EBQI implementation strategies. RIF report findings have facilitated rapid tailoring of implementation planning and rollout, supporting increased responsiveness to sites' needs and concerns.

CONCLUSIONS

The RIF report provides a structured strategy for distillation of time-sensitive findings, continuous team communication amid a complex multi-site implementation effort, and effective tailoring of implementation rollout in real-time. Use of the RIF report may also support trust-building by enhancing responsiveness to sites during pre- and early implementation.

TRIAL REGISTRATION

Enhancing Mental and Physical Health of Women Veterans (NCT05050266); https://clinicaltrials.gov/study/NCT05050266?term=EMPOWER%202.0&rank=1 Date of registration: 09/09/2021.

Bridges and Mechanisms: Integrating Systems Science Thinking into Implementation Research

We present a detailed argument for how to integrate, or bridge, systems science thinking and methods with implementation science. We start by showing how fundamental systems science principles of structure, dynamics, information, and utility are relevant for implementation science. Then we examine the need for implementation science to develop and apply richer theories of complex systems. This can be accomplished by emphasizing a causal mechanisms approach. Identifying causal mechanisms focuses on the "cogs and gears" of public health, clinical, and organizational interventions. A mechanisms approach focuses on how a specific strategy will produce the implementation outcome. We show how connecting systems science to implementation science opens new opportunities for examining and addressing social determinants of health and conducting equitable and ethical implementation research. Finally, we present case studies illustrating successful applications of systems science within implementation science in community health policy, tobacco control, health care access, and breast cancer screening.

Setting Families Up for Success: A Pilot Study of a Toolkit to Enhance the Autism Spectrum Disorder Diagnostic Evaluation Process

Families of children with autism spectrum disorder (ASD) face challenges engaging in services following diagnosis. This study: (1) developed and implemented a toolkit to tailor ASD evaluation feedback to families' needs, and (2) evaluated caregiver and provider perceptions of the toolkit. Focus groups with providers (N = 11) informed toolkit development. Seven providers participated in pilot training and implementation. Provider and caregiver toolkit perceptions were assessed using interviews, surveys, and a fidelity checklist. Toolkit strategies reflect focus group themes. Provider and caregiver ratings suggest the initial feasibility, acceptability, and utility of the toolkit. This toolkit may be feasible to implement in community settings and may increase caregiver satisfaction, though further refinements are needed to support service connection.

Mixed-methods randomised study exploring the feasibility and acceptability of eye-movement desensitisation and reprocessing for improving the mental health of traumatised survivors of intensive care following hospital discharge: protocol

INTRODUCTION

Post-traumatic symptoms are common among patients discharged from intensive care units (ICUs), adversely affecting well-being, increasing healthcare utilisation and delaying return to work. Non-pharmacological approaches (eg, music, therapeutic touch and patient diaries) have been suggested as candidate interventions and trauma-focused psychological interventions have been endorsed by international bodies. Neither category of intervention is supported by definitive evidence of long-term clinical effectiveness in patients who have been critically ill. This study assesses the feasibility and acceptability of using eye-movement desensitisation and reprocessing (EMDR) to improve the mental health of ICU survivors.

METHODS AND ANALYSIS

EMERALD is a multicentre, two-part consent, pilot feasibility study, recruiting discharged ICU survivors from three hospitals in the UK. We are gathering demographics and measuring post-traumatic symptoms, anxiety, depression and quality of life at baseline. Two months after discharge, participants are screened for symptoms of post-traumatic stress disorder (PTSD) using the Impact of Events Scale-Revised (IES-R). Patients with IES-R scores<22 continue in an observation arm for 12 month follow-up. IES-R scores≥22 indicate above-threshold PTSD symptoms and trigger invitation to consent for part B: a randomised controlled trial (RCT) of EMDR versus usual care, with 1:1 randomisation. The study assesses feasibility (recruitment, retention and intervention fidelity) and acceptability (through semistructured interviews), using a theoretical acceptability framework. Clinical outcomes (PTSD, anxiety, depression and quality of life) are collected at baseline, 2 and 12 months, informing power calculations for a definitive RCT, with quantitative and qualitative data convergence guiding RCT refinements.

ETHICS AND DISSEMINATION

This study has undergone external expert peer review and is funded by the National Institute for Health and Care Research (grant number: NIHR302160). Ethical approval has been granted by South Central-Hampshire A Research Ethics Committee (IRAS number: 317291). Results will be disseminated through the lay media, social media, peer-reviewed publication and conference presentation.

TRIAL REGISTRATION NUMBER

NCT05591625.

Health system assessment for access to care after injury in low- or middle-income countries: A mixed methods study from Northern Malawi

BACKGROUND

Injuries represent a vast and relatively neglected burden of disease affecting low- and middle-income countries (LMICs). While many health systems underperform in treating injured patients, most assessments have not considered the whole system. We integrated findings from 9 methods using a 3 delays approach (delays in seeking, reaching, or receiving care) to prioritise important trauma care health system barriers in Karonga, Northern Malawi, and exemplify a holistic health system assessment approach applicable in comparable settings.

METHODS AND FINDINGS

To provide multiple perspectives on each conceptual delay and include data from community-based and facility-based sources, we used 9 methods to examine the injury care health system. The methods were (1) household survey; (2) verbal autopsy analysis; (3) community focus group discussions (FGDs); (4) community photovoice; (5) facility care-pathway process mapping and elucidation of barriers following injury; (6) facility healthcare worker survey; (7) facility assessment survey; (8) clinical vignettes for care process quality assessment of facility-based healthcare workers; and (9) geographic information system (GIS) analysis. Empirical data collection took place in Karonga, Northern Malawi, between July 2019 and February 2020. We used a convergent parallel study design concurrently conducting all data collection before subsequently integrating results for interpretation. For each delay, a matrix was created to juxtapose method-specific data relevant to each barrier identified as driving delays to injury care. Using a consensus approach, we graded the evidence from each method as to whether an identified barrier was important within the health system. We identified 26 barriers to access timely quality injury care evidenced by at least 3 of the 9 study methods. There were 10 barriers at delay 1, 6 at delay 2, and 10 at delay 3. We found that the barriers "cost," "transport," and "physical resources" had the most methods providing strong evidence they were important health system barriers within delays 1 (seeking care), 2 (reaching care), and 3 (receiving care), respectively. Facility process mapping provided evidence for the greatest number of barriers-25 of 26 within the integrated analysis. There were some barriers with notable divergent findings between the community- and facility-based methods, as well as among different community- and facility-based methods, which are discussed. The main limitation of our study is that the framework for grading evidence strength for important health system barriers across the 9 studies was done by author-derived consensus; other researchers might have created a different framework.

CONCLUSIONS

By integrating 9 different methods, including qualitative, quantitative, community-, patient-, and healthcare worker-derived data sources, we gained a rich insight into the functioning of this health system's ability to provide injury care. This approach allowed more holistic appraisal of this health system's issues by establishing convergence of evidence across the diverse methods used that the barriers of cost, transport, and physical resources were the most important health system barriers driving delays to seeking, reaching, and receiving injury care, respectively. This offers direction and confidence, over and above that derived from single methodology studies, for prioritising barriers to address through health service development and policy.

Stepped collaborative care versus American College of Surgeons Committee on Trauma required screening and referral for posttraumatic stress disorder: Clinical trial protocol

BACKGROUND

Each year in the US, approximately 1.5-2.5 million individuals are so severely injured that they require inpatient hospital admissions. The American College of Surgeons Committee on Trauma (College) now requires that trauma centers have in place protocols to identify and refer hospitalized patients at risk injury psychological sequelae. Literature review revealed no investigations that have identified optimal screening, intervention, and referral procedures in the wake of the College requirement.

METHODS

The single-site pragmatic trial investigation will individually randomize 424 patients (212 intervention and 212 control) to a brief stepped care intervention versus College required mental health screening and referral control conditions. Blinded follow-up interviews at 1-, 3-, 6-, and 12-months post-injury will assess the symptoms of PTSD and related comorbidity for all patients. The emergency department information exchange (EDIE) will be used to capture population-level automated emergency department and inpatient utilization data for the intent-to-treat sample. The investigation aims to test the primary hypotheses that intervention patients will demonstrate significant reductions in PTSD symptoms and emergency department/inpatient utilization when compared to control patients. The study incorporates a Rapid Assessment Procedure-Informed Clinical Ethnography (RAPICE) implementation process assessment.

CONCLUSIONS

The overarching goal of the investigation is to advance the sustainable delivery of high-quality trauma center mental health screening, intervention, and referral procedures for diverse injury survivors. An end-of-study policy summit will harness pragmatic trial data to inform the capacity for US trauma centers to implement high-quality acute care mental health screening, intervention and referral services for diverse injured patient populations.

TRIAL REGISTRATION

Clinicaltrials.govNCT05632770.

Tailored implementation of the FICUS multicomponent family support intervention in adult intensive care units: findings from a mixed methods contextual analysis

BACKGROUND

The Family in Intensive Care UnitS (FICUS) trial investigates the clinical effectiveness of a multicomponent, nurse-led interprofessional family support intervention (FSI) and explores its implementation in intensive care units (ICUs). The local context of each ICU strongly influences intervention performance in practice. To promote FSI uptake and to reduce variation in intervention delivery, we aimed to develop tailored implementation strategies.

METHODS

A mixed method contextual analysis guided by the Consolidated Framework for Implementation Research (CFIR) was performed from March to June 2022 on eight ICUs assigned to the intervention group. ICU key clinical partners were asked to complete a questionnaire on CFIR inner setting measures (i.e., organizational culture, resources, learning climate and leadership engagement) and the Organizational Readiness for Implementing Change (ORIC) scale prior to group interviews, which were held to discuss barriers and facilitators to FSI implementation. Descriptive analysis and pragmatic rapid thematic analysis were used. Then, tailored implementation strategies were developed for each ICU.

RESULTS

In total, 33 key clinical partners returned the questionnaire and 40 attended eight group interviews. Results showed a supportive environment, with CFIR inner setting and ORIC measures each rated above 3 (scale: 1 low-5 high value), with leadership engagement scoring highest (median 4.00, IQR 0.38). Interview data showed that the ICU teams were highly motivated and committed to implementing the FSI. They reported limited resources, new interprofessional information exchange, and role adoption of nurses as challenging.

CONCLUSION

We found that important pre-conditions for FSI implementation, such as leadership support, a supportive team culture, and a good learning climate were present. Some aspects, such as available resources, interprofessional collaboration and family nurses' role adoption were of concern and needed attention. An initial set of implementation strategies were relevant to all ICUs, but some additions and adaptation to local needs were required. Multi-component interventions are challenging to implement within complex systems, such as ICUs. This pragmatic, theory-guided, mixed methods contextual analysis demonstrated high readiness and commitment to FSI implementation in the context of a clinical trial and enabled the specification of a tailored, multifaceted implementation strategy.

Reducing length of antibiotics for children with ear infections: protocol for a cluster-randomized trial in the USA

Aim: Preventing unnecessarily long durations of antibiotic therapy is a key opportunity to reduce antibiotic overuse in children 2 years of age and older with acute otitis media (AOM). Pragmatic interventions to reduce durations of therapy that can be effectively scaled and sustained are urgently needed. This study aims to fill this gap by evaluating the effectiveness and implementation outcomes of two low-cost interventions of differing intensities to increase guideline-concordant antibiotic durations in children with AOM. Methods: The higher intensity intervention will consist of clinician education regarding guideline-recommended short durations of antibiotic therapy; electronic health record (EHR) prescription field changes to promote prescribing of recommended short durations; and individualized clinician audit and feedback on adherence to recommended short durations of therapy in comparison to peers, while the lower intensity intervention will consist only of clinician education and EHR changes. We will explore the differences in implementation effectiveness by patient population served, clinician type, clinical setting and organization as well as intervention type. The fidelity, feasibility, acceptability and perceived appropriateness of the interventions among different clinician types, patient populations, clinical settings and intervention type will be compared. We will also conduct formative qualitative interviews with clinicians and administrators and focus groups with parents of patients to further inform the interventions and study. The formative evaluation will take place over 1.5 years, the interventions will be implemented over 2 years and evaluation of the interventions will take place over 1.5 years. Discussion: The results of this study will provide a framework for other healthcare systems to address the widespread problem of excessive durations of therapy for AOM and inform national antibiotic stewardship policy development. Clinical Trial Registration: NCT05608993 (ClinicalTrials.gov).

Implementation of a multicomponent family support intervention in adult intensive care units: study protocol for an embedded mixed-methods multiple case study (FICUS implementation study)

BACKGROUND

The implementation of complex interventions is considered challenging, particularly in multi-site clinical trials and dynamic clinical settings. This study protocol is part of the family intensive care units (FICUS) hybrid effectiveness-implementation study. It aims to understand the integration of a multicomponent family support intervention in the real-world context of adult intensive care units (ICUs). Specifically, the study will assess implementation processes and outcomes of the study intervention, including fidelity, and will enable explanation of the clinical effectiveness outcomes of the trial.

METHODS AND ANALYSIS

This mixed-methods multiple case study is guided by two implementation theories, the Normalisation Process Theory and the Consolidated Framework for Implementation Research. Participants are key clinical partners and healthcare professionals of eight ICUs allocated to the intervention group of the FICUS trial in the German-speaking part of Switzerland. Data will be collected at four timepoints over the 18-month active implementation and delivery phase using qualitative (small group interviews, observation, focus group interviews) and quantitative data collection methods (surveys, logs). Descriptive statistics and parametric and non-parametric tests will be used according to data distribution to analyse within and between cluster differences, similarities and factors associated with fidelity and the level of integration over time. Qualitative data will be analysed using a pragmatic rapid analysis approach and content analysis.

ETHICS AND DISSEMINATION

Ethics approval was obtained from the Cantonal Ethics Committee of Zurich BASEC ID 2021-02300 (8 February 2022). Study findings will provide insights into implementation and its contribution to intervention outcomes, enabling understanding of the usefulness of applied implementation strategies and highlighting main barriers that need to be addressed for scaling the intervention to other healthcare contexts. Findings will be disseminated in peer-reviewed journals and conferences.

PROTOCOL REGISTRATION NUMBER

Open science framework (OSF) https://osf.io/8t2ud Registered on 21 December 2022.

Perspectives From Community-Based HIV Service Organization Leaders on Priorities in Serving Sexual and Gender Minority Populations

Sexual and gender minority (SGM) populations experience discrimination and care-related barriers when seeking appropriate sexual health services. Using rapid assessment procedures we conducted site visits with 11 community-based HIV service agencies to identify priorities, assets, and needs related to serving SGM clients and assessed the alignment of these services with the city's local Ending the HIV Epidemic plan. We identified and mapped themes across agencies into the Consolidated Framework for Implementation Research domains of inner and outer settings: client-facing materials; priorities in serving SGM communities; SGM policies and protocols; collecting sexual orientation and gender identity data; training and education; and funding and scope of programs. Rapid assessment procedures can accelerate the collection and interpretation of data to help public health institutions and community partners make timely adaptations when implementing comprehensive and culturally humble sexual health services for SGM communities.

Team-Based Qualitative Rapid Analysis: Approach and Considerations for Conducting Developmental Formative Evaluation for Intervention Design

Qualitative rapid analysis is one of many rapid research approaches that offer a solution to the problem of time constrained health services evaluations and avoids sacrificing the richness of qualitative data that is needed for intervention design. We describe modifications to an established team-based, rapid analysis approach that we used to rapidly collect and analyze semi-structured interview data for a developmental formative evaluation of a cardiovascular disease prevention intervention. Over 18 weeks, we conducted and analyzed 35 semi-structured interviews that were conducted with patients and health care providers in the Veterans Health Administration to identify targets for adapting the intervention in preparation for a clinical trial. We identified 12 key themes describing actionable targets for intervention modification. We highlight important methodological decisions that allowed us to maintain rigor when using qualitative rapid analysis for intervention adaptation and we provide practical guidance on the resources needed to execute similar qualitative studies. We additionally reflect on the benefits and challenges of the described approach when working within a remote research team environment.ClinicalTrials.gov: NCT04545489.

Effectiveness of spinal manipulation and biopsychosocial self-management compared to medical care for low back pain: a randomized trial study protocol

BACKGROUND

Chronic low back pain (cLBP) is widespread, costly, and burdensome to patients and health systems. Little is known about non-pharmacological treatments for the secondary prevention of cLBP. There is some evidence that treatments addressing psychosocial factors in higher risk patients are more effective than usual care. However, most clinical trials on acute and subacute LBP have evaluated interventions irrespective of prognosis.

METHODS

We have designed a phase 3 randomized trial with a 2 × 2 factorial design. The study is also a Hybrid type 1 trial with focus on intervention effectiveness while simultaneously considering plausible implementation strategies. Adults (n = 1000) with acute/subacute LBP at moderate to high risk of chronicity based on the STarT Back screening tool will be randomized in to 1 of 4 interventions lasting up to 8 weeks: supported self-management (SSM), spinal manipulation therapy (SMT), both SSM and SMT, or medical care. The primary objective is to assess intervention effectiveness; the secondary objective is to assess barriers and facilitators impacting future implementation. Primary effectiveness outcome measures are: (1) average pain intensity over 12 months post-randomization (pain, numerical rating scale); (2) average low back disability over 12 months post-randomization (Roland-Morris Disability Questionnaire); (3) prevention of cLBP that is impactful at 10-12 months follow-up (LBP impact from the PROMIS-29 Profile v2.0). Secondary outcomes include: recovery, PROMIS-29 Profile v2.0 measures to assess pain interference, physical function, anxiety, depression, fatigue, sleep disturbance, and ability to participate in social roles and activities. Other patient-reported measures include LBP frequency, medication use, healthcare utilization, productivity loss, STarT Back screening tool status, patient satisfaction, prevention of chronicity, adverse events, and dissemination measures. Objective measures include the Quebec Task Force Classification, Timed Up & Go Test, the Sit to Stand Test, and the Sock Test assessed by clinicians blinded to the patients' intervention assignment.

DISCUSSION

By targeting those subjects at higher risk this trial aims to fill an important gap in the scientific literature regarding the effectiveness of promising non-pharmacological treatments compared to medical care for the management of patients with an acute episode of LBP and the prevention of progression to a severe chronic back problem.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT03581123.

Effectiveness of Spinal Manipulation and Biopsychosocial Self-Management compared to Medical Care for Low Back Pain: A Randomized Trial Study Protocol

Background Chronic low back pain (cLBP) is widespread, costly, and burdensome to patients and health systems. Little is known about non-pharmacological treatments for the secondary prevention of cLBP. There is some evidence that treatments addressing psychosocial factors in higher risk patients are more effective than usual care. However, most clinical trials on acute and subacute LBP have evaluated interventions irrespective of prognosis. Methods We have designed a phase 3 randomized trial with a 2x2 factorial design. The study is also a Hybrid type 1 trial with focus on intervention effectiveness while simultaneously considering plausible implementation strategies. Adults (n = 1000) with acute/subacute LBP at moderate to high risk of chronicity based on the STarT Back screening tool will be randomized in to 1 of 4 interventions lasting up to 8 weeks: supported self-management (SSM), spinal manipulation therapy (SMT), both SSM and SMT, or medical care. The primary objective is to assess intervention effectiveness; the secondary objective is to assess barriers and facilitators impacting future implementation. Primary effectiveness outcome measures are: (1) average pain intensity over 12 months post-randomization (pain, numerical rating scale); (2) average low back disability over 12 months post-randomization (Roland-Morris Disability Questionnaire); (3) prevention of cLBP that is impactful at 10-12 months follow-up (LBP impact from the PROMIS-29 Profile v2.0). Secondary outcomes include: recovery, PROMIS-29 Profile v2.0 measures to assess pain interference, physical function, anxiety, depression, fatigue, sleep disturbance, and ability to participate in social roles and activities. Other patient-reported measures include LBP frequency, medication use, healthcare utilization, productivity loss, STarT Back screening tool status, patient satisfaction, prevention of chronicity, adverse events, and dissemination measures. Objective measures include the Quebec Task Force Classification, Timed Up & Go Test, the Sit to Stand Test, and the Sock Test assessed by clinicians blinded to the patients' intervention assignment. Discussion By targeting those subjects at higher risk this trial aims to fill an important gap in the scientific literature regarding the effectiveness of promising non-pharmacological treatments compared to medical care for the management of patients with an acute episode of LBP and the prevention of progression to a severe chronic back problem. Trial registration: ClinicalTrials.gov Identifier: NCT03581123.

Integrating pragmatic and implementation science randomized clinical trial approaches: a PRagmatic Explanatory Continuum Indicator Summary-2 (PRECIS-2) analysis

BACKGROUND

Over the past two decades, pragmatic and implementation science clinical trial research methods have advanced substantially. Pragmatic and implementation studies have natural areas of overlap, particularly relating to the goal of using clinical trial data to leverage health care system policy changes. Few investigations have addressed pragmatic and implementation science randomized trial methods development while also considering policy impact.

METHODS

The investigation used the PRagmatic Explanatory Continuum Indicator Summary-2 (PRECIS-2) and PRECIS-2-Provider Strategies (PRECIS-2-PS) tools to evaluate the design of two multisite randomized clinical trials that targeted patient-level effectiveness outcomes, provider-level practice changes and health care system policy. Seven raters received PRECIS-2 training and applied the tools in the coding of the two trials. Descriptive statistics were produced for both trials, and PRECIS-2 wheel diagrams were constructed. Interrater agreement was assessed with the Intraclass Correlation (ICC) and Kappa statistics. The Rapid Assessment Procedure Informed Clinical Ethnography (RAPICE) qualitative approach was applied to understanding integrative themes derived from the PRECIS-2 ratings and an end-of-study policy summit.

RESULTS

The ICCs for the composite ratings across the patient and provider-focused PRECIS-2 domains ranged from 0.77 to 0.87, and the Kappa values ranged from 0.25 to 0.37, reflecting overall fair-to-good interrater agreement for both trials. All four PRECIS-2 wheels were rated more pragmatic than explanatory, with composite mean and median scores ≥ 4. Across trials, the primary intent-to-treat analysis domain was consistently rated most pragmatic (mean = 5.0, SD = 0), while the follow-up/data collection domain was rated most explanatory (mean range = 3.14-3.43, SD range = 0.49-0.69). RAPICE field notes identified themes related to potential PRECIS-2 training improvements, as well as policy themes related to using trial data to inform US trauma care system practice change; the policy themes were not captured by the PRECIS-2 ratings.

CONCLUSIONS

The investigation documents that the PRECIS-2 and PRECIS-2-PS can be simultaneously used to feasibly and reliably characterize clinical trials with patient and provider-level targets. The integration of pragmatic and implementation science clinical trial research methods can be furthered by using common metrics such as the PRECIS-2 and PRECIS-2-PS. Future study could focus on clinical trial policy research methods development.

TRIAL REGISTRATION

DO-SBIS ClinicalTrials.gov NCT00607620. registered on January 29, 2008. TSOS ClinicalTrials.gov NCT02655354, registered on July 27, 2015.

The integration of rapid qualitative research in clinical trials: reflections from the ward-based goal-directed fluid therapy (GDFT) in acute pancreatitis feasibility trial

BACKGROUND

There has been an increase in the integration of qualitative studies in randomised controlled trials. The purpose of this article is to reflect on our experience of carrying out a rapid qualitative study during a feasibility trial of goal-directed fluid therapy (GDFT) in patients with acute pancreatitis, including our sharing of emerging findings and the use of these findings by the trial team.

METHODS

The study was designed as a rapid feedback evaluation and combined interviews with staff and patients who took part in the trial.

FINDINGS

The rapid qualitative study pointed to common problems in trial recruitment among multiple sites, where lack of engagement of clinical teams across sites might impact negatively on patient recruitment. The article describes how the use of rapid feedback loops can be used as the trial is ongoing to inform changes in implementation. It also covers the potential challenges of working rapidly and collaborative with the trial team.

CONCLUSIONS

Rapid feedback evaluations can be used to generate findings across all stages of trial design and delivery. Additional research is required to explore the implementation of this research design in other settings and trial designs.

Intervention delivery for embedded pragmatic clinical trials: Development of a tool to measure complexity

BACKGROUND

Conducting an embedded pragmatic clinical trial in the workflow of a healthcare system is a complex endeavor. The complexity of the intervention delivery can have implications for study planning, ability to maintain fidelity to the intervention during the trial, and/or ability to detect meaningful differences in outcomes.

METHODS

We conducted a literature review, developed a tool, and conducted two rounds of phone calls with NIH Pragmatic Trials Collaboratory Demonstration Project principal investigators to develop the Intervention Delivery Complexity Tool. After refining the tool, we piloted it with Collaboratory demonstration projects and developed an online version of the tool using the R Shiny application (https://duke-som.shinyapps.io/ICT-ePCT/).

RESULTS

The 6-item tool consists of internal and external factors. Internal factors pertain to the intervention itself and include workflow, training, and the number of intervention components. External factors are related to intervention delivery at the system level including differences in healthcare systems, the dependency on setting for implementation, and the number of steps between the intervention and the outcome.

CONCLUSION

The Intervention Delivery Complexity Tool was developed as a standard way to overcome communication challenges of intervention delivery within an embedded pragmatic trial. This version of the tool is most likely to be useful to the trial team and its health system partners during trial planning and conduct. We expect further evolution of the tool as more pragmatic trials are conducted and feedback is received on its performance outside of the NIH Pragmatic Trials Collaboratory.

The Natural Helper approach to culturally responsive disease management: protocol for a type 1 effectiveness-implementation cluster randomised controlled trial of a cultural mentor programme

INTRODUCTION

Chronic disease is a leading cause of death and disability that disproportionately burdens culturally and linguistically diverse (CALD) communities. Self-management is a cornerstone of effective chronic disease management. However, research suggests that patients from CALD communities may be less likely to engage with self-management approaches. The Natural Helper Programme aims to facilitate patient engagement with self-management approaches (ie, 'activation') by embedding cultural mentors with lived experience of chronic disease into chronic disease clinics/programmes. The Natural Helper Trial will explore the effect of cultural mentors on patient activation, health self-efficacy, coping efforts and health-related quality of life (HRQoL) while also evaluating the implementation strategy.

METHODS AND ANALYSIS

A hybrid type-1 effectiveness-implementation cluster-randomised controlled trial (phase one) and a mixed-method controlled before-and-after cohort extension of the trial (phase 2). Hospital clinics in highly multicultural regions in Australia that provide healthcare for patients with chronic and/or complex conditions, will participate. A minimum of 16 chronic disease clinics (clusters) will be randomised to immediate (active arm) or delayed implementation (control arm). In phase 1, the active arm will receive a multifaceted strategy supporting them to embed cultural mentors in their services while the control arm continues with usual care. Each cluster will recruit an average of 15 patients, assessed at baseline and 6 months (n=240). In phase 2, clusters in the control arm will receive the implementation strategy and evaluate the intervention on an additional 15 patients per cluster, while sustainability in active arm clusters will be assessed qualitatively. Change in activation over 6 months, measured using the Patient Activation Measure will be the primary effectiveness outcome, while secondary effectiveness outcomes will explore changes in chronic disease self-efficacy, coping strategies and HRQoL. Secondary implementation outcomes will be collected from patient-participants, mentors and healthcare providers using validated questionnaires, customised surveys and interviews aligning with the Reach, Effectiveness, Adoption, Implementation, Maintenance framework to evaluate acceptability, reach, dose delivered, sustainability, cost-utility and healthcare provider determinants.

ETHICS AND DISSEMINATION

This trial has full ethical approval (2021/ETH12279). The results from this hybrid trial will be presented at scientific meetings and published in peer-reviewed journals.

TRIAL REGISTRATION NUMBER

ACTRN12622000697785.

The feasibility of implementing a cultural mentoring program alongside pain management and physical rehabilitation for chronic musculoskeletal conditions: results of a controlled before-and-after pilot study

BACKGROUND

Culturally diverse communities face barriers managing chronic musculoskeletal pain conditions including navigation challenges, sub-optimal healthcare provider engagement and difficulty adopting self-management behaviours.

OBJECTIVES

To explore the feasibility and trends of effectiveness of implementing a cultural mentoring program alongside clinical service delivery.

METHODS

This quasi-experimental controlled before-and-after multiple case study was conducted in three hospital-based services that provide treatment for patients with musculoskeletal pain. Two prospective cohorts, a pre-implementation and a post-implementation cohort, of adults with chronic musculoskeletal pain who attended during the 6-month recruitment phase, were eligible if they self-identified with one of the cultures prioritised for mentoring by the clinic. The pre-implementation cohort received routine care for up to 3-months, while the post-implementation cohort received up to 3-months of cultural mentoring integrated into routine care (3 to 10 sessions), provided by a consumer (n = 6) with lived experience. Feasibility measures (recruitment and completion rates, attendance, satisfaction), and trends of effectiveness (Patient Activation Measure and Health Literacy Questionnaire items one and six) were collated over 3-months for both cohorts. Outcomes were presented descriptively and analysed using Mann-Whitney U-tests for between-group comparisons. Translation and transcription of post-treatment semi-structured interviews allowed both cohorts' perspectives of treatment to be analysed using a Rapid Assessment Process.

RESULTS

The cultural mentor program was feasible to implement in clinical services with comparable recruitment rates (66% pre-implementation; 61% post-implementation), adequate treatment attendance (75% pre-implementation; 89% post-implementation), high treatment satisfaction (97% pre-implementation; 96% post-implementation), and minimal participant drop-out (< 5%). Compared to routine care (n = 71), patients receiving mentoring (n = 55) achieved significantly higher Patient Activation Measure scores (median change 0 vs 10.3 points, p < 0.01) at 3-months, while Health Literacy Questionnaire items did not change for either cohort over time. Three themes underpinned participant experiences and acceptability of the mentoring intervention: 'expectational priming', 'lived expertise' and 'collectivist orientation' to understand shared participant experiences and explore the potential differential effect of the mentoring intervention.

CONCLUSION

Participant experiences and observations of improved patient activation provide support for the acceptability of the mentoring intervention integrated into routine care. These results support the feasibility of conducting a definitive trial, while also exploring issues of scalability and sustainability.

Exploring Family Planning Perspectives Among Men Receiving Medications for Opioid Use Disorder: Implications for Service Development

OBJECTIVE

Studies have consistently found high rates of unintended pregnancy among women with substance use disorder. While research efforts have begun to focus on understanding needs and providing family planning services for women in treatment, few studies have included men. This has resulted in a gap in the literature regarding men's reproductive health experiences and family planning desires.

METHODOLOGY

Between December 2019 and February 2020, we conducted semistructured qualitative interviews with adult men receiving medications for opioid use disorder at a safety-net healthcare system in Denver, Colorado. Interviews were recorded and analyzed using the Rapid Assessment Process.

RESULTS

Fifteen men participated in an interview. Overall, men described feeling excluded from family planning education and services as well as from decision making with their partners. Participants desired knowledge and resources related to contraceptive methods, partner communication, and parenting. Additional themes included loss of autonomy around pregnancy decisions, the importance of fatherhood, and the importance of addressing family planning during recovery. Participants expressed interest in a family planning intervention but indicated that engaging men on this topic may be challenging.

CONCLUSIONS

Our findings suggest that men in treatment desire education and involvement in family planning. Participants endorsed access to a subject expert within the treatment environment, but engagement strategies that underscore topic relevance to men will be critical. Initiating a conversation involving education and service navigation in the treatment setting may be a promising strategy for engaging men in recovery in family planning and improving men's access to needed services and resources.

Approaches to enabling rapid evaluation of innovations in health and social care: a scoping review of evidence from high-income countries

OBJECTIVE

The COVID-19 pandemic increased the demand for rapid evaluation of innovation in health and social care. Assessment of rapid methodologies is lacking although challenges in ensuring rigour and effective use of resources are known. We mapped reports of rapid evaluations of health and social care innovations, categorised different approaches to rapid evaluation, explored comparative benefits of rapid evaluation, and identified knowledge gaps.

DESIGN

Scoping review.

DATA SOURCES

MEDLINE, EMBASE and Health Management Information Consortium (HMIC) databases were searched through 13 September 2022.

ELIGIBILITY CRITERIA FOR SELECTING STUDIES

We included publications reporting primary research or methods for rapid evaluation of interventions or services in health and social care in high-income countries.

DATA EXTRACTION AND SYNTHESIS

Two reviewers developed and piloted a data extraction form. One reviewer extracted data, a second reviewer checked 10% of the studies; disagreements and uncertainty were resolved through consensus. We used narrative synthesis to map different approaches to conducting rapid evaluation.

RESULTS

We identified 16 759 records and included 162 which met inclusion criteria.We identified four main approaches for rapid evaluation: (1) Using methodology designed specifically for rapid evaluation; (2) Increasing rapidity by doing less or using less time-intensive methodology; (3) Using alternative technologies and/or data to increase speed of existing evaluation method; (4) Adapting part of non-rapid evaluation.The COVID-19 pandemic resulted in an increase in publications and some limited changes in identified methods. We found little research comparing rapid and non-rapid evaluation.

CONCLUSIONS

We found a lack of clarity about what 'rapid evaluation' means but identified some useful preliminary categories. There is a need for clarity and consistency about what constitutes rapid evaluation; consistent terminology in reporting evaluations as rapid; development of specific methodologies for making evaluation more rapid; and assessment of advantages and disadvantages of rapid methodology in terms of rigour, cost and impact.

Direct Observation Methods: a Practical Guide for Health Researchers

OBJECTIVE

To provide health research teams with a practical, methodologically rigorous guide on how to conduct direct observation.

METHODS

Synthesis of authors' observation-based teaching and research experiences in social sciences and health services research.

RESULTS

This article serves as a guide for making key decisions in studies involving direct observation. Study development begins with determining if observation methods are warranted or feasible. Deciding what and how to observe entails reviewing literature and defining what abstract, theoretically informed concepts look like in practice. Data collection tools help systematically record phenomena of interest. Interdisciplinary teams--that include relevant community members-- increase relevance, rigor and reliability, distribute work, and facilitate scheduling. Piloting systematizes data collection across the team and proactively addresses issues.

CONCLUSION

Observation can elucidate phenomena germane to healthcare research questions by adding unique insights. Careful selection and sampling are critical to rigor. Phenomena like taboo behaviors or rare events are difficult to capture. A thoughtful protocol can preempt Institutional Review Board concerns.

INNOVATION

This novel guide provides a practical adaptation of traditional approaches to observation to meet contemporary healthcare research teams' needs.

Peer providers and linkage with buprenorphine care after hospitalization: A retrospective cohort study

Background: People with opioid use disorder (OUD) are increasingly started on buprenorphine in the hospital, yet many patients do not attend outpatient buprenorphine care after discharge. Peer providers, people in recovery themselves, are a growing part of addiction care. We examine whether patients who received a low-intensity, peer-delivered intervention during hospitalization had a greater rate of linking with outpatient buprenorphine care relative to those not seen by a peer. Methods: This was a retrospective cohort study of adults with OUD who were started on buprenorphine during hospitalization. The primary outcome was receipt of a buprenorphine prescription within 30 days of discharge. Secondary outcomes included attendance at a follow-up visit with a buprenorphine provider within 30 days and hospital readmission within 90 days. Modified Poisson regression analyses tested for differences in the rate ratios (RR) of each binary outcome for patients who were versus were not seen by a peer provider. Peer notes in the electronic health record were reviewed to characterize peer activities. Results: 111 patients met the study inclusion criteria, 31.5% of whom saw a peer provider. 55.0% received a buprenorphine prescription within 30 days of hospital discharge. Patients with versus without peer provider encounters did not significantly differ in the rates of receiving a buprenorphine prescription (RR = 1.06, 95% CI: 0.74-1.51), hospital readmission (RR = 1.45, 95% CI: 0.80-2.64), or attendance at a buprenorphine follow-up visit (RR = 1.03, 95% CI: 0.68-1.57). Peers most often listened to or shared experiences with patients (68.6% of encounters) and helped facilitate medical care (60.0% of encounters). Conclusions: There were no differences in multiple measures of buprenorphine follow-up between patients who received this low-intensity peer intervention and those who did not. There is need to investigate what elements of peer provider programs contribute to patient outcomes and what outcomes should be assessed when evaluating peer programs.

Assessing Vietnamese American patient perspectives on population genetic testing in primary care: A community-engaged approach

Achieving health equity in precision medicine remains a critical challenge because of the continued underrepresentation of non-white populations in research and barriers to genetic services. The goal of this study was to explore Vietnamese American (VA) participant views toward incorporating genetics in routine healthcare to better serve the local VA community within an integrated health system offering primary care-based population genetic testing to adults for conditions that could be prevented or mitigated when detected early. We conducted semi-structured interviews from August–September 2021, with 22 individuals receiving primary care who self-identified as Vietnamese or VA, and employed rapid qualitative analysis (RQA) to identify key concepts. Community research team members participated in study design, data collection, RQA, and reporting. Findings from the interviews revealed that several participant perceived challenges to genetic testing, which included lack of information, fear of results impact, cost, and privacy concerns. Participants suggested various ways to overcome some of these barriers, such as decreasing the cost of testing, receiving information from a trusted physician, using preferred education strategies in the community, and having convenient access to testing. Study participants also shared a variety of trusted sources they would seek out for advice on genetic testing. This study with VAs identified barriers, facilitators, and messengers to offering genetic testing in a local healthcare context and demonstrated how community-engaged research coupled with RQA is a promising approach for healthcare institutions as they identify needs and tailor strategies for implementing population genetic screening programs in local ethnic communities.

Unraveling implementation context: the Basel Approach for coNtextual ANAlysis (BANANA) in implementation science and its application in the SMILe project

BACKGROUND

Designing intervention and implementation strategies with careful consideration of context is essential for successful implementation science projects. Although the importance of context has been emphasized and methodology for its analysis is emerging, researchers have little guidance on how to plan, perform, and report contextual analysis. Therefore, our aim was to describe the Basel Approach for coNtextual ANAlysis (BANANA) and to demonstrate its application on an ongoing multi-site, multiphase implementation science project to develop/adapt, implement, and evaluate an integrated care model in allogeneic SteM cell transplantatIon facILitated by eHealth (the SMILe project).

METHODS

BANANA builds on guidance for assessing context by Stange and Glasgow (Contextual factors: the importance of considering and reporting on context in research on the patient-centered medical home, 2013). Based on a literature review, BANANA was developed in ten discussion sessions with implementation science experts and a medical anthropologist to guide the SMILe project's contextual analysis. BANANA's theoretical basis is the Context and Implementation of Complex Interventions (CICI) framework. Working from an ecological perspective, CICI acknowledges contextual dynamics and distinguishes between context and setting (the implementation's physical location).

RESULTS

BANANA entails six components: (1) choose a theory, model, or framework (TMF) to guide the contextual analysis; (2) use empirical evidence derived from primary and/or secondary data to identify relevant contextual factors; (3) involve stakeholders throughout contextual analysis; (4) choose a study design to assess context; (5) determine contextual factors' relevance to implementation strategies/outcomes and intervention co-design; and (6) report findings of contextual analysis following appropriate reporting guidelines. Partly run simultaneously, the first three components form a basis both for the identification of relevant contextual factors and for the next components of the BANANA approach.

DISCUSSION

Understanding of context is indispensable for a successful implementation science project. BANANA provides much-needed methodological guidance for contextual analysis. In subsequent phases, it helps researchers apply the results to intervention development/adaption and choices of contextually tailored implementation strategies. For future implementation science projects, BANANA's principles will guide researchers first to gather relevant information on their target context, then to inform all subsequent phases of their implementation science project to strengthen every part of their work and fulfill their implementation goals.

The measurement-based care to opioid treatment programs project (MBC2OTP): a study protocol using rapid assessment procedure informed clinical ethnography

Background

Psychosocial interventions are needed to enhance patient engagement and retention in medication treatment within opioid treatment programs. Measurement-based care (MBC), an evidence-based intervention structure that involves ongoing monitoring of treatment progress over time to assess the need for treatment modifications, has been recommended as a flexible and low-cost intervention for opioid treatment program use. The MBC2OTP Project is a two-phase pilot hybrid type 1 effectiveness-implementation trial that has three specific aims: (1) to employ Rapid Assessment Procedure Informed Clinical Ethnography (RAPICE) to collect mixed methods data to inform MBC implementation; (2) to use RAPICE data to adapt an MBC protocol; and (3) to conduct a hybrid type 1 trial to evaluate MBC’s preliminary effectiveness and implementation potential in opioid treatment programs.

Methods

This study will be conducted in two phases. Phase 1 will include RAPICE site visits, qualitative interviews (N = 32–48 total), and quantitative surveys (N = 64–80 total) with staff at eight programs to build community partnerships and evaluate contextual factors impacting MBC implementation. Mixed methods data will be analyzed using immersion/crystallization and thematic analysis to inform MBC adaptation and site selection. Four programs selected for Phase 2 will participate in MBC electronic medical record integration, training, and ongoing support. Chart reviews will be completed in the 6 months prior-to and following MBC integration (N = 160 charts, 80 pre and post) to evaluate effectiveness (patient opioid abstinence and treatment engagement) and implementation outcomes (counselor MBC exposure and fidelity).

Discussion

This study is among the first to take forward recommendations to implement and evaluate MBC in opioid treatment programs. It will also employ an innovative RAPICE approach to enhance the quality and rigor of data collection and inform the development of an MBC protocol best matched to opioid treatment programs. Overall, this work seeks to enhance treatment provision and clinical outcomes for patients with opioid use disorder.

Trial registration This study will be registered with Clinicaltrials.gov within 21 days of first participant enrollment in Phase 2. Study Phase 1 (RAPICE) does not qualify as a clinical trial, therefore Phase 2 clinical trial registration has not yet been pursued because all elements of Phase 2 will be dependent on Phase 1 outcomes.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13722-022-00327-0.

Implementation fidelity, attitudes, and influence: a novel approach to classifying implementer behavior

Background

The current study sought to (1) describe a new classification approach for types of implementer behavior and (2) explore the implementer behavior change in response to tailored implementation facilitation based on the classifications.

Methods

A small-scale, cluster-randomized hybrid type III implementation trial was conducted in 38 early care and education classrooms that were part of the Together, We Inspire Smart Eating (WISE) program. WISE focuses on 4 evidence-based practices (EBPs), which are implemented by teachers to promote nutrition. External facilitators (N = 3) used a modified Rapid Assessment Procedure Informed Clinical Ethnography (RAPICE) to complete immersion (i.e., observations) and thematic content analyses of interviews to identify the characteristics of teachers’ behavior at varying levels of implementation fidelity. Three key factors—attitudes toward the innovation, fidelity/adaptations, and influence—were identified that the research team used to classify teachers’ implementation behavior. This process resulted in a novel classification approach. To assess the reliability of applying the classification approach, we assessed the percent agreement between the facilitators. Based on the teachers’ classification, the research team developed a tailored facilitation response. To explore behavior change related to the tailored facilitation, change in fidelity and classification across the school year were evaluated.

Results

The classifications include (1) enthusiastic adopters (positive attitude, meeting fidelity targets, active influence), (2) over-adapting adopters (positive attitude, not meeting fidelity targets, active influence), (3) passive non-adopters (negative attitude, not meeting fidelity targets, passive influence), and (4) active non-adopters (negative attitudes, not meeting fidelity targets, active influence). The average percent agreement among the three facilitators for classification was 75%. Qualitative data support distinct patterns of perceptions across the classifications. A positive shift in classification was observed for 67% of cases between the mid-point and final classification. Finally, we generated an expanded classification approach to consider additional combinations of the three factors beyond those observed in this study.

Conclusions

Data from this study support the ability to apply the classification approach with moderate to high reliability and to use the approach to tailor facilitation toward improved implementation. Findings suggest the potential of our approach for wider application and potential to improve tailoring of implementation strategies such as facilitation.

"Still on the Fence": A Mixed Methods Investigation of COVID-19 Vaccine Confidence Among Health Care Providers

BACKGROUND

There is evidence of disparities in COVID-19 vaccine acceptance among health care providers. The purpose of this study was to examine confidence receiving and recommending COVID-19 vaccines by health care provider type and race/ethnicity.

METHODS

This mixed methods study involved a cross-sectional survey and qualitative, semi-structured interviews from March to May 2021 among a sample of physicians, advanced practice providers, nurses, and pharmacists. These workers were recruited through voluntary response sampling from an integrated health system in Southern California. The primary dependent variables were (a) confidence in vaccine safety, (b) confidence in vaccine effectiveness, and (c) intent to recommend the vaccine to others. The primary independent variables were health care provider type and race/ethnicity.

FINDINGS

A total of 2,948 providers completed the survey. Nurses relative to physicians were 15% less likely to perceive the COVID-19 vaccine to be safe (risk ratio [RR] = 0.85; 95% confidence interval [CI] = 0.83-0.87); 27% less likely to perceive the vaccine to prevent COVID-19 (RR = 0.73; 95% CI = 0.69-0.76); and 11% less likely to recommend the vaccine to others (RR = 0.89; 95% CI = 0.87-0.91). Hispanic/Latinx providers were 10% less likely to perceive the vaccine to prevent COVID-19 (RR = 0.90; 95% CI = 0.83-0.98) relative to White providers. Qualitative themes included: No need for vaccine; distrusting vaccine research and roll-out; caretaking barriers; uncertainty and potential to change one's mind; framing vaccine decisions around personal beliefs.

CONCLUSIONS & APPLICATION TO PRACTICE

Health care workplaces should consider interventions to increase COVID-19 vaccination among their workers, including education and mandatory vaccination policies.

Engagement in Self-Measured Blood Pressure Monitoring among Medically Under-resourced participants: A Digital Framework Qualitative Study from the Reach Out Study (Preprint)

BACKGROUND

Mobile health (mHealth) interventions serve as a scalable opportunity to engage people with hypertension in self-measured blood pressure (SMBP) monitoring, an evidence-based approach to lowering blood pressure (BP) and improving BP control. Reach Out is an SMS text messaging-based SMBP mHealth trial that aims to reduce BP among hypertensive patients recruited from the emergency department of a safety net hospital in a low-income, predominately Black city.

OBJECTIVE

As the benefits of Reach Out are predicated on participants' engagement with the intervention, we sought to understand participants' determinants of engagement via prompted SMBP with personalized feedback (SMBP+feedback).

METHODS

We conducted semistructured telephone interviews based on the digital behavior change interventions framework. Participants were purposively sampled from 3 engagement categories: high engagers (≥80% response to SMBP prompts), low engagers (≤20% response to BP prompts), and early enders (participants who withdrew from the trial).

RESULTS

We conducted interviews with 13 participants, of whom 7 (54%) were Black, with a mean age of 53.6 (SD 13.25) years. Early enders were less likely to be diagnosed with hypertension prior to Reach Out, less likely to have a primary care provider, and less likely to be taking antihypertensive medications than their counterparts. Overall, participants liked the SMS text messaging design of the intervention, including the SMBP+feedback. Several participants across all levels of engagement expressed interest in and identified the benefit of enrolling in the intervention with a partner of their choice. High engagers expressed the greatest understanding of the intervention, the least number of health-related social needs, and the greatest social support to engage in SMBP. Low engagers and early enders shared a mixed understanding of the intervention and less social support compared to high engagers. Participation decreased as social needs increased, with early enders sharing the greatest amount of resource insecurity apart from a notable exception of a high engager with high health-related social needs.

CONCLUSIONS

Prompted SMBP+feedback was perceived favorably by all participants. To enhance SMBP engagement, future studies could consider greater support in the initiation of SMBP, evaluating and addressing participants' unmet health-related social needs, as well as strategies to cultivate social norms.

Qualitative Research Methods in Chronic Disease: Introduction and Opportunities to Promote Health Equity

Public health research that addresses chronic disease has historically underutilized and undervalued qualitative methods. This has limited the field's ability to advance (a) a more in-depth understanding of the factors and processes that shape health behaviors, (b) contextualized explanations of interventions' impacts (e.g., why and how something did or did not work for recipients and systems), and (c) opportunities for building and testing theories. We introduce frameworks and methodological approaches common to qualitative research, discuss how and when to apply them in order to advance health equity, and highlight relevant strengths and challenges. We provide an overview of data collection, sampling, and analysis for qualitative research, and we describe research questions that can be addressed by applying qualitative methods across the continuum of chronic disease research. Finally, we offer recommendations to promote the strategic application of rigorous qualitative methods, with an emphasis on priority areas to enhance health equity across the evidence generation continuum.

Addressing COVID-19 Testing Inequities Among Underserved Populations in Massachusetts: A Rapid Qualitative Exploration of Health Center Staff, Partner, and Resident Perceptions

Introduction

Access to COVID-19 testing has been inequitable and misaligned with community need. However, community health centers have played a critical role in addressing the COVID-19 testing needs of historically disadvantaged communities. The aim of this paper is to explore the perceptions of COVID-19 testing barriers in six Massachusetts communities that are predominantly low income and describe how these findings were used to build tailored clinical-community strategies to addressing testing inequities.

Methods

Between November 2020 and February 2021, we conducted 84 semi-structured qualitative interviews with 107 community health center staff, community partners, and residents. Resident interviews were conducted in English, Spanish, Vietnamese, and Arabic. We used a 2-phase framework analysis to analyze the data, including deductive coding to facilitate rapid analysis for action and an in-depth thematic analysis applying the Social Ecological Model.

Results

Through the rapid needs assessment, we developed cross-site suggestions to improve testing implementation and communications, as well as community-specific recommendations (e.g., locations for mobile testing sites and local communication channels). Upstream barriers identified in the thematic analysis included accessibility of state-run testing sites, weak social safety nets, and lack of testing supplies and staffing that contributed to long wait times. These factors hindered residents' abilities to get tested, which was further exacerbated by individual fears surrounding the testing process and limited knowledge on testing availability.

Discussion

Our rapid, qualitative approach created the foundation for implementing strategies that reached underserved populations at the peak of the COVID-19 pandemic in winter 2021. We explored perceptions of testing barriers and created actionable summaries within 1–2 months of data collection. Partnering community health centers in Massachusetts were able to use these data to respond to the local needs of each community. This study underscores the substantial impact of upstream, structural disparities on the individual experience of COVID-19 and demonstrates the utility of shifting from a typical years' long research translation process to a rapid approach of using data for action.

A Pragmatic Clinical Trial Approach to Assessing and Monitoring Suicidal Ideation: Results from A National US Trauma Care System Study

OBJECTIVE

Few investigations have comprehensively described methods for assessing and monitoring suicidal ideation in pragmatic clinical trials of mental health services interventions. This investigation's goal was to assess a collaborative care intervention's effectiveness in reducing suicidal ideation and describe suicide monitoring implementation in a nationwide protocol.

METHOD

The investigation was a secondary analysis of a stepped wedge cluster randomized trial at 25-Level I trauma centers. Injury survivors (N = 635) were randomized to control (n = 370) and intervention (n = 265) conditions and assessed at baseline hospitalization and follow-up at 3-, 6- and 12-months post-injury. The Patient Health Questionnaire (PHQ-9) item-9 was used to evaluate patients for suicidal ideation. Mixed model regression was used to assess intervention versus control group changes in PHQ-9 item-9 scores over time and associations between baseline characteristics and development of suicidal ideation longitudinally. As part of the study implementation process assessment, suicide outreach call logs were also reviewed.

RESULTS

Over 50% of patients endorsed suicidal ideation at ≥1 assessment. Intervention patients relative to control patients demonstrated reductions in endorsements of suicidal ideation that did not achieve statistical significance (F[3,1461] = 0.74, P = .53). The study team completed outreach phone calls, texts or voice messages to 268 patients with PHQ-9 item-9 scores ≥1 (n = 161 control, n = 107 intervention).

CONCLUSIONS

Suicide assessment and monitoring can be feasibly implemented in large-scale pragmatic clinical trials. Intervention patients demonstrated less suicidal ideation over time; however, these comparisons did not achieve statistical significance. Intensive pragmatic trial monitoring may mask treatment effects by providing control patients a supportive intervention.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02655354.

Application of an antiracism lens in the field of implementation science (IS): Recommendations for reframing implementation research with a focus on justice and racial equity

Background

Despite the promise of implementation science (IS) to reduce health inequities, critical gaps and opportunities remain in the field to promote health equity. Prioritizing racial equity and antiracism approaches is critical in these efforts, so that IS does not inadvertently exacerbate disparities based on the selection of frameworks, methods, interventions, and strategies that do not reflect consideration of structural racism and its impacts.

Methods

Grounded in extant research on structural racism and antiracism, we discuss the importance of advancing understanding of how structural racism as a system shapes racial health inequities and inequitable implementation of evidence-based interventions among racially and ethnically diverse communities. We outline recommendations for explicitly applying an antiracism lens to address structural racism and its manifests through IS. An anti-racism lens provides a framework to guide efforts to confront, address, and eradicate racism and racial privilege by helping people identify racism as a root cause of health inequities and critically examine how it is embedded in policies, structures, and systems that differentially affect racially and ethnically diverse populations.

Results

We provide guidance for the application of an antiracism lens in the field of IS, focusing on select core elements in implementation research, including: (1) stakeholder engagement; (2) conceptual frameworks and models; (3) development, selection, adaptation of EBIs; (4) evaluation approaches; and (5) implementation strategies. We highlight the need for foundational grounding in antiracism frameworks among implementation scientists to facilitate ongoing self-reflection, accountability, and attention to racial equity, and provide questions to guide such reflection and consideration.

Conclusion

We conclude with a reflection on how this is a critical time for IS to prioritize focus on justice, racial equity, and real-world equitable impact. Moving IS towards making consideration of health equity and an antiracism lens foundational is central to strengthening the field and enhancing its impact.

Plain language abstract

There are important gaps and opportunities that exist in promoting health equity through implementation science. Historically, the commonly used frameworks, measures, interventions, strategies, and approaches in the field have not been explicitly focused on equity, nor do they consider the role of structural racism in shaping health and inequitable delivery of evidence-based practices/programs. This work seeks to build off of the long history of research on structural racism and health, and seeks to provide guidance on how to apply an antiracism lens to select core elements of implementation research. We highlight important opportunities for the field to reflect and consider applying an antiracism approach in: 1) stakeholder/community engagement; 2) use of conceptual frameworks; 3) development, selection and adaptation of evidence-based interventions; 4) evaluation approaches; 5) implementation strategies (e.g., how to deliver evidence-based practices, programs, policies); and 6) how researchers conduct their research, with a focus on racial equity. This is an important time for the field of implementation science to prioritize a foundational focus on justice, equity, and real-world impact through the application of an anti-racism lens in their work.

Guidance for Implementing Video Consultations in Danish General Practice: Rapid Cycle Coproduction Study

Background

The COVID-19 pandemic has changed various spheres of health care. General practitioners (GPs) have widely replaced face-to-face consultations with telephone or video consultations (VCs) to reduce the risk of COVID-19 transmission. Using VCs for health service delivery is an entirely new way of practicing for many GPs. However, this transition process has largely been conducted with no formal guidelines, which may have caused implementation barriers. This study presents a rapid cycle coproduction approach for developing a guide to assist VC implementation in general practice.

Objective

The aim of this paper is to describe the developmental phases of the VC guide to assist general practices in implementing VCs and summarize the evaluation made by general practice users.

Methods

The development of a guide for VC in general practice was structured as a stepped process based on the coproduction and prototyping processes. We used an iterative framework based on rapid qualitative analyses and interdisciplinary collaborations. Thus, the guide was developed in small, repeated cycles of development, implementation, evaluation, and adaptation, with a continuous exchange between research and practice. The data collection process was structured in 3 main phases. First, we conducted a literature review, recorded observations, and held informal and semistructured interviews. Second, we facilitated coproduction with stakeholders through 4 workshops with GPs, a group interview with patient representatives, and individual revisions by GPs. Third, nationwide testing was conducted in 5 general practice clinics and was followed by an evaluation of the guide through interviews with GPs.

Results

A rapid cycle coproduction approach was used to explore the needs of general practice in connection with the implementation of VC and to develop useful, relevant, and easily understandable guiding materials. Our findings suggest that a guide for VCs should include advice and recommendations regarding the organization of VCs, the technical setup, the appropriate target groups, patients’ use of VCs, the performance of VCs, and the arrangements for booking a VC.

Conclusions

The combination of coproduction, prototyping, small iterations, and rapid data analysis is a suitable approach when contextually rich, hands-on guide materials are urgently needed. Moreover, this method could provide an efficient way of developing relevant guide materials for general practice to aid the implementation of new technology beyond the pandemic period.

A pilot study of participatory and rapid implementation approaches to increase depression screening in primary care

BACKGROUND

Most individuals with depression go unidentified and untreated. In 2016 the US Preventive Services Task Force released guidelines recommending universal screening in primary care to identify patients with depression and to link them to treatment. Feasible, acceptable, and effective strategies to implement these guidelines are needed.

METHODS

This three-phased study employed rapid participatory methods to design and test strategies to increase depression screening at Penn Medicine, a large health system with 90 primary care practices. First, researchers solicited ideas and barriers from stakeholders to increase screening using an innovation tournament-a crowdsourcing method that invites stakeholders to submit ideas to address a workplace challenge. Second, a panel of stakeholders and scientists deliberated over and ranked the tournament ideas. An instant runoff election was held to select the winning idea. Third, the research team piloted the winning idea in a primary care practice using rapid prototyping, an approach that quickly refines and iterates strategy designs.

RESULTS

The innovation tournament yielded 31 ideas and 32 barriers from diverse stakeholders (12 primary care physicians, 10 medical assistants, 4 nurse practitioners, 2 practice managers, and 4 patient support assistants). A panel of 6 stakeholders and scientists deliberated on the ideas and voted for patient self-report (i.e., through tablet computers, text message, or an online patient portal) as the winning idea. The research team rapid prototyped tablets in one primary care practice with one physician over 5 five-hour shifts to examine the feasibility, acceptability, and effectiveness of the strategy. Most patients, the physician, and medical assistants found the tablets acceptable and feasible. However, patient support assistants struggled to incorporate them in their workflow and expressed concerns about scaling up the process. Depression screening rates were higher using tablets compared to usual care; follow-up was comparable between tablets and usual care.

CONCLUSIONS

Rapid participatory methods engaged and amplified the voices of diverse stakeholders in primary care. These methods helped design an acceptable and feasible implementation strategy that showed promise for increasing depression screening in a primary care setting. The next step is to evaluate the strategy in a randomized controlled trial across primary care practices.

A mixed-methods study to test a tailored coaching program for health researchers to manage stress and achieve work-life balance

Dissemination and implementation (D&I) researchers serve critical scientific, practical, and personal roles in translating science to public health benefit. However, they face multifaceted barriers that may erode their capacity to plan, lead, and evaluate implementation. Individualized coaching focused on human flourishing is an unexplored approach to fully actualize D&I researchers' capacity to bridge the research-practice gap. The purpose of this exploratory pilot study was to investigate a tailored coaching program to support human flourishing among D&I researchers. A pragmatic, mixed-methods approach guided by the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) Framework was used to evaluate an individualized, nine session coaching program called FUEL (Focus, Unplug, Exercise, Love). Reach and Implementation were assessed through descriptive statistics and rapid qualitative analysis of surveys and coaching logs. Effectiveness and Maintenance were assessed through descriptive statistics and iterative content analysis of participant surveys, as well as iterative content analysis of proxy (e.g., colleague) semi-structured interviews. Reach results indicated that demand for coaching exceeded study enrollment capacity (n = 16 participants). Implementation results showed that the coach spent 12.96 ± 2.82 hr per participant over 3 months. Effectiveness and Maintenance results indicated that FUEL was well-received and provided participants with myriad psychological and professional benefits. Preliminary evidence suggests that the FUEL coaching program is a promising and feasible approach to enhance flourishing among D&I researchers. Future research is needed to evaluate Adoption and scalability. This pilot study may inform future D&I capacity-building initiatives that address researchers' holistic situatedness within the implementation process.

A systematic review of socioecological factors, community violence exposure, and disparities for Latinx youth

Community violence exposure poses a public health risk exacerbated by immigration-related stressors and environmental factors, including systemic racism and interpersonal discrimination, socioeconomic disparities, and anti-immigrant laws and policies, that disproportionately impact Latinx-immigrant and systematically minoritized youth. Using the ecological-transactional model of community violence as a conceptual framework, this systematic review was conducted to examine research on exposure to community violence, risk and protective factors, and associated health and mental health sequelae among Latinx youth. The initial search generated 2,152 articles, 291 of which were reviewed for detailed evaluation; ultimately, 59 articles were included. Mexican-origin youth and adolescent samples were the most represented in research studies. Across several studies, Latinx youth reported high rates of violence exposure and poor health or mental health outcomes. The findings revealed important gaps in socioecological factors, with a dearth of evidence establishing macrosystem factors or culturally salient and immigrant-related factors. Notable risk and protective factors at various ecological levels were identified and discussed as key opportunities for future research and points of intervention or prevention efforts for Latinx-immigrant and systematically minoritized youth.

Impact of the COVID-19 Pandemic on Child and Adolescent Mental Health Policy and Practice Implementation

Background: The impact of the 2019 coronavirus pandemic on the mental health of millions worldwide has been well documented, but its impact on prevention and treatment of mental and behavioral health conditions is less clear. The COVID-19 pandemic also created numerous challenges and opportunities to implement health care policies and programs under conditions that are fundamentally different from what has been considered to be usual care. Methods: We conducted a qualitative study to determine the impact of the COVID-19 pandemic on implementation of evidence-based policy and practice by State Mental Health Authorities (SMHA) for prevention and treatment of mental health problems in children and adolescents. Semi-structured interviews were conducted with 29 SMHA representatives of 21 randomly selected states stratified by coronavirus positivity rate and rate of unmet services need. Data analysis with SMHA stakeholders used procedures embedded in the Rapid Assessment Procedure—Informed Community Ethnography methodology. Results: The need for services increased during the pandemic due primarily to family stress and separation from peers. States reporting an increase in demand had high coronavirus positivity and high unmet services need. The greatest impacts were reduced out-of-home services and increased use of telehealth. Barriers to telehealth services included limited access to internet and technology, family preference for face-to-face services, lack of privacy, difficulty using with young children and youth in need of substance use treatment, finding a Health Insurance Portability and Accountability Act (HIPAA)-compliant platform, training providers and clients, and reimbursement challenges. Policy changes to enable reimbursement, internet access, training, and provider licensing resulted in substantially fewer appointment cancellations or no-shows, greater family engagement, reduction in travel time, increased access for people living in remote locations, and increased provider communication and collaboration. States with high rates of coronavirus positivity and high rates of unmet need were most likely to continue use of telehealth post-pandemic. Despite these challenges, states reported successful implementation of policies designed to facilitate virtual services delivery with likely long-term changes in practice. Conclusions: Policy implementation during the pandemic provided important lessons for planning and preparedness for future public health emergencies. Successful policy implementation requires ongoing collaboration among policy makers and with providers.

The NUDGE trial pragmatic trial to enhance cardiovascular medication adherence: study protocol for a randomized controlled trial

Background

Nearly half of patients do not take their cardiovascular medications as prescribed, resulting in increased morbidity, mortality, and healthcare costs. Mobile and digital technologies for health promotion and disease self-management offer an opportunity to adapt behavioral “nudges” using ubiquitous mobile phone technology to facilitate medication adherence. The Nudge pragmatic clinical trial uses population-level pharmacy data to deliver nudges via mobile phone text messaging and an artificial intelligent interactive chat bot with the goal of improving medication adherence and patient outcomes in three integrated healthcare delivery systems.

Methods

The Theory of mHealth, the Expanded RE-AIM/PRISM, and the PRECIS-2 frameworks were used for program planning, implementation, and evaluation, along with a focus on dissemination and cost considerations. During the planning phase, the Nudge study team developed and piloted a technology-based nudge message and chat bot of optimized interactive content libraries for a range of diverse patients. Inclusion criteria are very broad and include patients in one of three diverse health systems who take medications to treat hypertension, atrial fibrillation, coronary artery disease, diabetes, or hyperlipidemia. A target of approximately 10,000 participants will be randomized to one of 4 study arms: usual care (no intervention), generic nudge (text reminder), optimized nudge, and optimized nudge plus interactive AI chat bot. The PRECIS-2 tool indicated that the study protocol is very pragmatic, although there is variability across PRECIS-2 dimensions.

Discussion

The primary effectiveness outcome is medication adherence defined by the proportion of days covered (PDC) using pharmacy refill data. Implementation outcomes are assessed using the RE-AIM framework, with a particular focus on reach, consistency of implementation, adaptations, cost, and maintenance/sustainability. The project has limitations including limited power to detect some subgroup effects, medication complications (bleeding), and longer-term outcomes (myocardial infarction). Strengths of the study include the diverse healthcare systems, a feasible and generalizable intervention, transparent reporting using established pragmatic research and implementation science frameworks, strong stakeholder engagement, and planning for dissemination and sustainment.

Trial registration

ClinicalTrials.govNCT03973931. Registered on 4 June 2019. The study was funded by the NIH; grant number is 4UH3HL144163-02 issued 4/5/19.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-021-05453-9.

Catalyzing the Translation of Patient-Centered Research Into United States Trauma Care Systems: A Case Example

BACKGROUND

The expedient translation of research findings into sustainable intervention procedures is a longstanding health care system priority. The Patient-Centered Outcomes Research Institute (PCORI) has facilitated the development of "research done differently," with a central tenet that key stakeholders can be productively engaged throughout the research process. Literature review revealed few examples of whether, as originally posited, PCORI's innovative stakeholder-driven approach could catalyze the expedient translation of research results into practice.

OBJECTIVES

This narrative review traces the historical development of an American College of Surgeons Committee on Trauma (ACS/COT) policy guidance, facilitated by evidence supplied by the PCORI-funded studies evaluating the delivery of patient-centered care transitions. Key elements catalyzing the guidance are reviewed, including the sustained engagement of ACS/COT policy stakeholders who have the capacity to invoke system-level implementation strategies, such as regulatory mandates linked to verification site visits. Other key elements, including the encouragement of patient stakeholder voice in policy decisions and the incorporation of end-of-study policy summits in pragmatic comparative effectiveness trial design, are discussed.

CONCLUSIONS

Informed by comparative effectiveness trials, ACS/COT policy has expedited introduction of the patient-centered care construct into US trauma care systems. A comparative health care systems conceptual framework for transitional care which incorporates Research Lifecycle, pragmatic clinical trial and implementation science models is articulated. When combined with Rapid Assessment Procedure Informed Clinical Ethnography (RAPICE), employed as a targeted implementation strategy, this approach may accelerate the sustainable delivery of high-quality patient-centered care transitions for US trauma care systems.

A Rapid Ethnographic Assessment of the Impact of the COVID-19 Pandemic on Mental Health Services Delivery in an Acute Care Medical Emergency Department and Trauma Center

A rapid ethnographic assessment of delivery of mental health services to patients at a Level I trauma center in a major metropolitan hospital undergoing a COVID-19 surge was conducted to assess the challenges involved in services delivery and to compare the experience of delivering services across time. Study participants were patients and providers who interacted with or otherwise were observed by three clinicians engaged in the delivery of care within the Emergency Department (ED) and Trauma Center at Harborview Medical Center from the COVID-19-related "surge" in April to the end of July 2020. Data were collected and analyzed in accordance with the Rapid Assessment Procedures-Informed Clinical Ethnography (RAPICE) protocol. Community and institutional efforts to control the spread of the coronavirus created several challenges to providing mental health services in an acute care setting during the April surge. Most of these challenges were successfully addressed by standardization of infection control protocols, but new challenges emerged including an increase in expenses for infection control and reduction in clinical revenues due to fewer patients, furloughs of mental health services providers and peer specialists in the ED, services not provided or delayed, increased stress due to fear of furloughs or increased workload of those not furloughed, and increases in patients seen with injuries due to risky behavior, violence, and substance use. These findings illustrate the rapidly shifting nature of the pandemic, its impacts on mental health services, and the mitigation efforts of communities and healthcare systems.

Rapid versus traditional qualitative analysis using the Consolidated Framework for Implementation Research (CFIR)

Background

Qualitative approaches, alone or in mixed methods, are prominent within implementation science. However, traditional qualitative approaches are resource intensive, which has led to the development of rapid qualitative approaches. Published rapid approaches are often inductive in nature and rely on transcripts of interviews. We describe a deductive rapid analysis approach using the Consolidated Framework for Implementation Research (CFIR) that uses notes and audio recordings. This paper compares our rapid versus traditional deductive CFIR approach.

Methods

Semi-structured interviews were conducted for two cohorts of the Veterans Health Administration (VHA) Diffusion of Excellence (DoE). The CFIR guided data collection and analysis. In cohort A, we used our traditional CFIR-based deductive analysis approach (directed content analysis), where two analysts completed independent in-depth manual coding of interview transcripts using qualitative software. In cohort B, we used our new rapid CFIR-based deductive analysis approach (directed content analysis), where the primary analyst wrote detailed notes during interviews and immediately “coded” notes into a MS Excel CFIR construct by facility matrix; a secondary analyst then listened to audio recordings and edited the matrix. We tracked time for our traditional and rapid deductive CFIR approaches using a spreadsheet and captured transcription costs from invoices. We retrospectively compared our approaches in terms of effectiveness and rigor.

Results

Cohorts A and B were similar in terms of the amount of data collected. However, our rapid deductive CFIR approach required 409.5 analyst hours compared to 683 h during the traditional deductive CFIR approach. The rapid deductive approach eliminated $7250 in transcription costs. The facility-level analysis phase provided the greatest savings: 14 h/facility for the traditional analysis versus 3.92 h/facility for the rapid analysis. Data interpretation required the same number of hours for both approaches.

Conclusion

Our rapid deductive CFIR approach was less time intensive and eliminated transcription costs, yet effective in meeting evaluation objectives and establishing rigor. Researchers should consider the following when employing our approach: (1) team expertise in the CFIR and qualitative methods, (2) level of detail needed to meet project aims, (3) mode of data to analyze, and (4) advantages and disadvantages of using the CFIR.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01111-5.

Pragmatic approaches to analyzing qualitative data for implementation science: an introduction

Qualitative methods are critical for implementation science as they generate opportunities to examine complexity and include a diversity of perspectives. However, it can be a challenge to identify the approach that will provide the best fit for achieving a given set of practice-driven research needs. After all, implementation scientists must find a balance between speed and rigor, reliance on existing frameworks and new discoveries, and inclusion of insider and outsider perspectives. This paper offers guidance on taking a pragmatic approach to analysis, which entails strategically combining and borrowing from established qualitative approaches to meet a study's needs, typically with guidance from an existing framework and with explicit research and practice change goals.Section 1 offers a series of practical questions to guide the development of a pragmatic analytic approach. These include examining the balance of inductive and deductive procedures, the extent to which insider or outsider perspectives are privileged, study requirements related to data and products that support scientific advancement and practice change, and strategic resource allocation. This is followed by an introduction to three approaches commonly considered for implementation science projects: grounded theory, framework analysis, and interpretive phenomenological analysis, highlighting core analytic procedures that may be borrowed for a pragmatic approach. Section 2 addresses opportunities to ensure and communicate rigor of pragmatic analytic approaches. Section 3 provides an illustrative example from the team's work, highlighting how a pragmatic analytic approach was designed and executed and the diversity of research and practice products generated.As qualitative inquiry gains prominence in implementation science, it is critical to take advantage of qualitative methods' diversity and flexibility. This paper furthers the conversation regarding how to strategically mix and match components of established qualitative approaches to meet the analytic needs of implementation science projects, thereby supporting high-impact research and improved opportunities to create practice change.

Forgotten Contributors in the Brick Sector in Nepal

Brick making in Nepal is an informal sector that is still highly labor intensive. It employs transient workers who are extremely marginalized and exposed to poor working and living conditions. This study assesses the working and living conditions of male and female brick workers and their children and looks to address the main issues and challenges to promote decent living and working conditions in the brick factories through action research. A rapid needs assessment was conducted to take stock of the working and living conditions of male and female workers across five provinces in Nepal. Subsequently, selected pilot interventions through stakeholder consultations were initiated to address these issues and challenges. There are a host of challenges faced by these workers in the factories, with the main issues being occupational health and safety and childcare/education for workers’ children. The study suggests that the working and living conditions of the workers can be improved by incentivizing the brick entrepreneurs to invest in them, thus creating a more productive workforce. Moreover, the findings from the pilot interventions can help in the design of effective solutions.

Stepped Collaborative Care Targeting Posttraumatic Stress Disorder Symptoms and Comorbidity for US Trauma Care Systems: A Randomized Clinical Trial

Importance

To date, few multisite investigations have evaluated early interventions for injured patients with posttraumatic stress disorder (PTSD) symptoms.

Objective

To simultaneously assess the effectiveness and implementation of a brief stepped collaborative care intervention targeting PTSD and comorbidity.

Design, Setting, and Participants

A stepped-wedge cluster randomized clinical trial was conducted at 25 US level I trauma centers. Participants included hospitalized survivors of physical injury who underwent a 2-step evaluation for PTSD symptoms. Patients reporting high levels of distress on the PTSD Checklist (PCL-C) were randomized (N = 635) per the stepped-wedge protocol to enhanced usual care control (n = 370) or intervention (n = 265) conditions. The study was conducted from January 4, 2016, through November 2018. Data analysis was performed from November 4, 2019, to December 8, 2020.

Interventions

The Trauma Survivors Outcomes and Support collaborative care intervention included proactive injury case management that assisted patients transitioning from hospital inpatient to outpatient and community settings. The intervention also integrated evidence-based pharmacotherapy and psychotherapeutic elements targeting PTSD symptoms and comorbidity.

Main Outcomes and Measures

The primary study outcome was PTSD symptoms assessed with the PCL-C at baseline in the surgical ward and at 3, 6, and 12 months postinjury. Secondary outcomes included depressive symptoms, alcohol use, and physical function. Subgroup analyses examined the effect of baseline risk factors for enduring PTSD and quality of protocol implementation on study outcomes. Primary statistical analyses were conducted using the intent-to-treat sample.

Results

A total of 327 men (51.5%) were included in analysis; mean (SD) age was 39.0 (14.2) years. The investigation attained follow-up of 75% to 80% of the participants at 3 to 12 months. The intervention lasted a mean (SD) of 122 (132) minutes. Mixed model regression analyses revealed statistically significant changes in PCL-C scores for intervention patients compared with control patients at 6 months (difference, -2.57; 95% CI, -5.12 to -0.03; effect size, 0.18; P < .05) but not 12 months (difference, -1.27; 95% CI, -4.26 to 1.73; effect size, 0.08; P = .35). Subgroup analyses revealed larger PTSD treatment effects for patients with 3 or more baseline risk factors for enduring PTSD and for patients, including firearm injury survivors, treated at trauma centers with good or excellent protocol implementation. Intervention effects for secondary outcomes did not attain statistical significance.

Conclusions and Relevance

A brief stepped collaborative care intervention was associated with significant 6-month but not 12-month PTSD symptom reductions. Greater baseline PTSD risk and good or excellent trauma center protocol implementation were associated with larger PTSD treatment effects. Orchestrated efforts targeting policy and funding should systematically incorporate the study findings into national trauma center requirements and verification criteria.

Trial Registration

ClinicalTrials.gov Identifier: NCT02655354.

Assessing trauma care systems in low-income and middle-income countries: a systematic review and evidence synthesis mapping the Three Delays framework to injury health system assessments

BACKGROUND

The large burden of injuries falls disproportionately on low/middle-income countries (LMICs). Health system interventions improve outcomes in high-income countries. Assessing LMIC trauma systems supports their improvement. Evaluating systems using a Three Delays framework, considering barriers to seeking (Delay 1), reaching (Delay 2) and receiving care (Delay 3), has aided maternal health gains. Rapid assessments allow timely appraisal within resource and logistically constrained settings. We systematically reviewed existing literature on the assessment of LMIC trauma systems, applying the Three Delays framework and rapid assessment principles.

METHODS

We conducted a systematic review and narrative synthesis of articles assessing LMIC trauma systems. We searched seven databases and grey literature for studies and reports published until October 2018. Inclusion criteria were an injury care focus and assessment of at least one defined system aspect. We mapped each study to the Three Delays framework and judged its suitability for rapid assessment.

RESULTS

Of 14 677 articles identified, 111 studies and 8 documents were included. Sub-Saharan Africa was the most commonly included region (44.1%). Delay 3, either alone or in combination, was most commonly assessed (79.3%) followed by Delay 2 (46.8%) and Delay 1 (10.8%). Facility assessment was the most common method of assessment (36.0%). Only 2.7% of studies assessed all Three Delays. We judged 62.6% of study methodologies potentially suitable for rapid assessment.

CONCLUSIONS

Whole health system injury research is needed as facility capacity assessments dominate. Future studies should consider novel or combined methods to study Delays 1 and 2, alongside care processes and outcomes.

Clinical ethnography in severe mental illness: a clinical method to tackle social determinants and structural racism in personalised care

Ethnic inequalities in the experiences and outcomes of severe mental illness are well established. These include a higher incidence of severe mental illnesses (psychoses), adverse pathways into and through care, including crisis care, police and criminal justice systems involvement, and care under the powers of the Mental Health Act. The situation persists despite awareness and is driven by a mixture of the social determinants of poor health, societal disadvantage and structural racism, as well as conflictual interactions with care systems, which themselves are configured in ways that sustain or deepen these inequalities. Although training and education are often proposed, this is not shown to have sustained effects. Clinical processes (interviewing/assessment/formulation/intervention) need to address systemic influences and improve the cultural precision with which care is delivered, organised and commissioned. We discuss clinical ethnography and present evidence of its value in addressing systemic as well as individual care needs for diverse communities.

A scoping review of the use of ethnographic approaches in implementation research and recommendations for reporting

Background:

Researchers have argued for the value of ethnographic approaches to implementation science (IS). The contested meanings of ethnography pose challenges and possibilities to its use in IS. The goal of this study was to identify sources of commonality and variation, and to distill a set of recommendations for reporting ethnographic approaches in IS.

Methods:

We included in our scoping review English-language academic journal articles meeting two criteria: (1) IS articles in the healthcare field and (2) articles that described their approach as ethnographic. In March 2019, we implemented our search criteria in four academic databases and one academic journal. Abstracts were screened for inclusion by at least two authors. We iteratively develop a codebook for full-text analysis and double-coded included articles. We summarized the findings and developed reporting recommendations through discussion.

Results:

Of the 210 articles whose abstracts were screened, 73 were included in full-text analysis. The number of articles increased in recent years. Ethnographic approaches were used within a wide variety of theoretical approaches and research designs. Articles primarily described using interviews and observational methods as part of their ethnographic approaches, though numerous other methods were also employed. The most cited rationales for using ethnographic approaches were to capture context-specific phenomena, understand insiders’ perspective, and study complex interactions. In reporting on ethnographic approaches, we recommend that researchers provide information on researcher training and position, reflect on researchers’ positionality, describe observational methods in detail, and report results from all the methods used.

Conclusion:

The number of IS studies using ethnography has increased in recent years. Ethnography holds great potential for contributing further to IS, particularly to studying implementation strategy mechanisms and understanding complex adaptive systems.

Researchers have proposed that ethnographic methods may be valuable to implementation research and practice. Ethnographic approaches have their roots in the field of anthropology, but they are now used in many fields. These approaches often involve a researcher spending time in “real-world” settings, conducting interviews and observation to understand a group of people. That said, researchers disagree on the meaning of ethnography, which presents a challenge to its use in implementation science (IS). We searched for articles in the field of IS that described their methods as ethnographic. We then reviewed the articles, looking for similarities and differences in how and why ethnographic approaches were used. Many of these articles said they used ethnographic methods because they were interested in issues like context, research participants’ views, and complex interactions. We found a large amount of variation in how ethnographic methods were used. We developed recommendations for describing ethnographic methods in a way that readers can clearly understand. We also made several observations of the value ethnographic approaches can bring to IS. Ethnographic methods may be especially useful to studying unplanned and unexpected changes that take place during implementation. These recommendations and observations could be helpful to implementation researchers wishing to use ethnographic methods.

Perspectives of Trial Staff on the Barriers to Recruitment in a Digital Intervention for Psychosis and How to Work Around Them: Qualitative Study Within a Trial

BACKGROUND

Recruitment processes for clinical trials of digital interventions for psychosis are seldom described in detail in the literature. Although trial staff have expertise in describing barriers to and facilitators of recruitment, a specific focus on understanding recruitment from the point of view of trial staff is rare, and because trial staff are responsible for meeting recruitment targets, a lack of research on their point of view is a key limitation.

OBJECTIVE

The primary aim of this study was to understand recruitment from the point of view of trial staff and discover what they consider important.

METHODS

We applied pluralistic ethnographic methods, including analysis of trial documents, observation, and focus groups, and explored the recruitment processes of the EMPOWER (Early Signs Monitoring to Prevent Relapse in Psychosis and Promote Well-being, Engagement, and Recovery) feasibility trial, which is a digital app-based intervention for people diagnosed with schizophrenia.

RESULTS

Recruitment barriers were categorized into 2 main themes: service characteristics (lack of time available for mental health staff to support recruitment, staff turnover, patient turnover [within Australia only], management styles of community mental health teams, and physical environment) and clinician expectations (filtering effects and resistance to research participation). Trial staff negotiated these barriers through strategies such as emotional labor (trial staff managing feelings and expressions to successfully recruit participants) and trying to build relationships with clinical staff working within community mental health teams.

CONCLUSIONS

Researchers in clinical trials for digital psychosis interventions face numerous recruitment barriers and do their best to work flexibly and to negotiate these barriers and meet recruitment targets. The recruitment process appeared to be enhanced by trial staff supporting each other throughout the recruitment stage of the trial.

Implementation of a Community-Partnered Research Suicide-Risk Management Protocol: Case Study From Community Partners in Care

OBJECTIVE

Suicidality is common among participants in clinical trials and health services research, but approaches to suicide risk assessment and mitigation vary widely. Studies involving vulnerable populations with limited access to care raise additional ethical concerns. The authors applied a community-partnered approach to develop and implement a suicide-risk management protocol (SRMP) in a depression study in an underresourced setting in Los Angeles.

METHODS

Using a community-partnered participatory research framework, the authors designed and adapted the SRMP. Qualitative data regarding SRMP implementation included notes from SRMP development meetings and from study clinicians conducting outreach calls to study participants. Analyses included baseline and 6- and 12-month telephone survey data from 1,018 enrolled adults with moderate to severe depressive symptoms (8-item Patient Health Questionnaire score ≥10), of whom 48% were Black and 40% Latino.

RESULTS

Community stakeholders prioritized a robust SRMP to ensure participant safety. Features included rapid telephone outreach by study clinicians in all cases of reported recent suicidality and expedited treatment access. Using a suicidality timeframe prompt of "in the past 2 weeks," endorsement of suicidality was common (15% at baseline, 32% cumulative). Midway through the study, the SRMP was modified to assess for present suicidality, which reduced the frequency of clinician involvement. Overall, 318 outreach calls were placed, with none requiring an emergency response. Treatment referrals were provided in 157 calls, and outreach was well received.

CONCLUSIONS

SRMP implementation in research involving underresourced and vulnerable communities merits additional considerations. Partnering with community stakeholders can facilitate the development of acceptable and feasible SRMP procedures.