Understanding adaptations in the Veteran Health Administration's Transitions Nurse Program: refining methodology and pragmatic implications for scale-up

Application of the FRAME-IS to a multifaceted implementation strategy

BACKGROUND

Research demonstrates the importance of documenting adaptations to implementation strategies that support integration of evidence-based interventions into practice. While studies have utilized the FRAME-IS [Framework for Reporting Adaptations and Modifications for Implementation Strategies] to collect structured adaptation data, they are limited by a focus on discrete implementation strategies (e.g., training), which do not reflect the complexity of multifaceted strategies like practice facilitation. In this paper, we apply the FRAME-IS to our trial evaluating the effectiveness of PF on implementation fidelity of an evidence-based technology-facilitated team care model for improved hypertension control within a federally qualified health center (FQHC).

METHODS

Three data sources are used to document adaptations: (1) implementation committee meeting minutes, (2) narrative reports completed by practice facilitators, and (3) structured notes captured on root cause analysis and Plan-Do-Study-Act worksheets. Text was extracted from the data sources according to the FRAME-IS modules and inputted into a master matrix for content analysis by two authors; a third author conducted member checking and code validation.

RESULTS

We modified the FRAME-IS to include part 2 of module 2 (what is modified) to add greater detail of the modified strategy, and a numbering system to track adaptations across the modules. This resulted in identification of 27 adaptations, of which 88.9% focused on supporting practices in identifying eligible patients and referring them to the intervention. About half (52.9%) of the adaptations were made to modify the context of the PF strategy to include a group-based format, add community health workers to the strategy, and to shift the implementation target to nurses. The adaptations were often widespread (83.9%), affecting all practices within the FQHC. While most adaptations were reactive (84.6%), they resulted from a systematic process of reviewing data captured by multiple sources. All adaptations included the FQHC in the decision-making process.

CONCLUSION

With modifications, we demonstrate the ability to document our adaptation data across the FRAME-IS modules, attesting to its applicability and value for a range of implementation strategies. Based on our experiences, we recommend refinement of tracking systems to support more nimble and practical documentation of iterative, ongoing, and multifaceted adaptations.

TRIAL REGISTRATION

Clinicaltrials.gov NCT03713515, Registration date: October 19, 2018.

Adapting an Alcohol Care Linkage Intervention to US Military Veterans Presenting to Primary Care with Hazardous Drinking and PTSD and/or Depression Symptoms: A Qualitative Study

There is a critical need to improve linkage to alcohol care for veterans in primary care with hazardous drinking and PTSD and/or depression symptoms (A-MH). We adapted an alcohol care linkage intervention, "Connect to Care" (C2C), for this population. We conducted separate focus groups with veterans with A-MH, providers, and policy leaders. Feedback centered on how psychologists and other providers can optimally inform veterans about their care options and alcohol use, and how to ensure C2C is accessible. Participants reported that veterans with A-MH may not view alcohol use as their primary concern but rather as a symptom of a potential co-occurring mental health condition. Veterans have difficulty identifying and accessing existing alcohol care options within the Veterans Health Administration. C2C was modified to facilitate alcohol care linkage for this population specific to their locality, provide concrete support and education, and offer care options to preserve privacy.

RE-AIM for rural health innovations: perceptions of (mis) alignment between the RE-AIM framework and evaluation reporting in the Department of Veterans Affairs Enterprise-Wide Initiatives program

Background

The Department of Veterans Affairs (VA) Office of Rural Health (ORH) supports national VA program offices' efforts to expand health care to rural Veterans through its Enterprise-Wide Initiatives (EWIs) program. In 2017, ORH selected Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM), an implementation science framework, to structure the EWI evaluation and reporting process. As part of its mandate to improve EWI program evaluation, the Center for the Evaluation of Enterprise-Wide Initiatives conducted a qualitative evaluation to better understand EWI team' perceptions of, and barriers and facilitators to, the EWI evaluation process.

Methods

We conducted 43 semi-structured interviews with 48 team members (e.g., evaluators, program office leads, and field-based leads) representing 21 EWIs from April-December 2020. Questions focused on participants' experiences using strategies targeting each RE-AIM dimension. Interviews were inductively analyzed in MAXQDA. We also systematically reviewed 51 FY19-FY20 EWI annual reports to identify trends in misapplications of RE-AIM.

Results

Participants had differing levels of experience with RE-AIM. While participants understood ORH's rationale for selecting a common framework to structure evaluations, the perceived misalignment between RE-AIM and EWIs' work emerged as an important theme. Concerns centered around 3 sub-themes: (1) (Mis)Alignment with RE-AIM Dimensions, (2) (Mis)Alignment between RE-AIM and the EWI, and (3) (Mis)Alignment with RE-AIM vs. other Theories, Models, or Frameworks. Participants described challenges differentiating between and operationalizing dimensions in unique contexts. Participants also had misconceptions about RE-AIM and its relevance to their work, e.g., that it was meant for established programs and did not capture aspects of initiative planning, adaptations, or sustainability. Less commonly, participants shared alternative models or frameworks to RE-AIM. Despite criticisms, many participants found RE-AIM useful, cited training as important to understanding its application, and identified additional training as a future need.

Discussion

The selection of a shared implementation science framework can be beneficial, but also challenging when applied to diverse initiatives or contexts. Our findings suggest that establishing a common understanding, operationalizing framework dimensions for specific programs, and assessing training needs may better equip partners to integrate a shared framework into their evaluations.

Implementation science for cancer control: One center's experience addressing context, adaptation, equity, and sustainment

Implementation science (IS) has great potential to enhance the frequency, speed, and quality of the translation of evidence-based programs, policies, products, and guidelines into practice. Progress has been made, but with some notable exceptions, this promise has not been achieved for cancer prevention and control. We discuss five interrelated but conceptually distinct, crosscutting issues important to accelerate IS for cancer prevention and control and how our Colorado Implementation Science Center in Cancer Control (COISC3) addressed these issues. These needs and opportunities include more fully addressing changing, multi-level context; guiding rapid, iterative adaptations; evaluating innovative approaches to engagement and health equity; greater attention to costs and economic issues; and sustainability. We summarize conceptual issues; evaluation needs and capacity building activities and then provide examples of how our IS center addressed these five needs for cancer prevention and control. We discuss changes made to address priorities of (i) guiding adaptations of implementation strategies to address changing context and (ii) working on issues identified and prioritized by our primary care partners rather than the research team. We conclude with discussion of lessons learned, limitations, and directions for future research and practice in IS to enhance cancer prevention and control as well as translational behavioral medicine more generally.

Real-time evaluation and adaptation to facilitate rapid recruitment in a large, prospective cohort study

BACKGROUND

Recruiting large cohorts efficiently can speed the translation of findings into care across a range of scientific disciplines and medical specialties. Recruitment can be hampered by factors such as financial barriers, logistical concerns, and lack of resources for patients and clinicians. These and other challenges can lead to underrepresentation in groups such as rural residents and racial and ethnic minorities. Here we discuss the implementation of various recruitment strategies for enrolling participants into a large, prospective cohort study, assessing the need for adaptations and making them in real-time, while maintaining high adherence to the protocol and high participant satisfaction.

METHODS

While conducting a large, prospective trial of a multi-cancer early detection blood test at Geisinger, an integrated health system in central Pennsylvania, we monitored recruitment progress, adherence to the protocol, and participants' satisfaction. Tracking mechanisms such as paper records, electronic health records, research databases, dashboards, and electronic files were utilized to measure each outcome. We then reviewed study procedures and timelines to list the implementation strategies that were used to address barriers to recruitment, protocol adherence and participant satisfaction.

RESULTS

Adaptations to methods that contributed to achieving the enrollment goal included offering multiple recruitment options, adopting group consenting, improving visit convenience, increasing the use of electronic capture and the tracking of data and source documents, staffing optimization via leveraging resources external to the study team when appropriate, and integrating the disclosure of study results into routine clinical care without adding unfunded work for clinicians. We maintained high protocol adherence and positive participant experience as exhibited by a very low rate of protocol deviations and participant complaints.

CONCLUSION

Recruiting rapidly for large studies - and thereby facilitating clinical translation - requires a nimble, creative approach that marshals available resources and changes course according to data. Planning a rigorous assessment of a study's implementation outcomes prior to study recruitment can further ground study adaptations and facilitate translation into practice. This can be accomplished by proactively and continuously assessing and revising implementation strategies.

An implementation strategy postmortem method developed in the VA rural Transitions Nurse Program to inform spread and scale-up

BACKGROUND

High-quality implementation evaluations report on intervention fidelity and adaptations made, but a practical process for evaluating implementation strategies is needed. A retrospective method for evaluating implementation strategies is also required as prospective methods can be resource intensive. This study aimed to establish an implementation strategy postmortem method to identify the implementation strategies used, when, and their perceived importance. We used the rural Transitions Nurse Program (TNP) as a case study, a national care coordination intervention implemented at 11 hospitals over three years.

METHODS

The postmortem used a retrospective, mixed method, phased approach. Implementation team and front-line staff characterized the implementation strategies used, their timing, frequency, ease of use, and their importance to implementation success. The Expert Recommendations for Implementing Change (ERIC) compilation, the Quality Enhancement Research Initiative phases, and Proctor and colleagues' guidance were used to operationalize the strategies. Survey data were analyzed descriptively, and qualitative data were analyzed using matrix content analysis.

RESULTS

The postmortem method identified 45 of 73 ERIC strategies introduced, including 41 during pre-implementation, 37 during implementation, and 27 during sustainment. External facilitation, centralized technical assistance, and clinical supervision were ranked as the most important and frequently used strategies. Implementation strategies were more intensively applied in the beginning of the study and tapered over time.

CONCLUSIONS

The postmortem method identified that more strategies were used in TNP than planned and identified the most important strategies from the perspective of the implementation team and front-line staff. The findings can inform other implementation studies as well as dissemination of the TNP intervention.

Application of the FRAME-IS to a Multifaceted Implementation Strategy

Background

Research demonstrates the importance of documenting adaptations to implementation strategies that support integration of evidence-based interventions into practice. While studies have utilized the FRAME-IS [Framework for Reporting Adaptations and Modifications for Implementation Strategies] to collect structured adaptation data, they are limited by a focus on discrete implementation strategies (e.g., training), which do not reflect the complexity of multifaceted strategies like practice facilitation (PF). In this paper, we apply the FRAME-IS to our trial evaluating the effectiveness of PF on implementation fidelity of an evidence-based technology-facilitated team care model for improved hypertension control within a federally qualified health center (FQHC).

Methods

Three data sources are used to document adaptations: (1) implementation committee meeting minutes, (2) narrative reports completed by practice facilitators, and (3) structured notes captured on root cause analysis and Plan-Do-Study-Act worksheets. Text was extracted from the data sources according to the FRAME-IS modules and inputted into a master matrix for content analysis by two authors; a third author conducted member checking and code validation.

Results

We modified the FRAME-IS to include part 2 of module 2 (what is modified) to add greater detail of the modified strategy, and a numbering system to track adaptations across the modules. This resulted in identification of 27 adaptations, of which 88.9% focused on supporting practices in identifying eligible patients and referring them to the intervention. About half (52.9%) of the adaptations were made to modify the context of the PF strategy to include a group-based format, add community health workers to the strategy, and to shift the implementation target to nurses. The adaptations were often widespread (83.9%), affecting all practices within the FQHC. While most adaptations were reactive (84.6%), they resulted from a systematic process of reviewing data captured by multiple sources. All adaptations included the FQHC in the decision-making process.

Conclusion

With modifications, we demonstrate the ability to document our adaptation data across the FRAME-IS modules, attesting to its applicability and value for a range of implementation strategies. Based on our experiences, we recommend refinement of tracking systems to support more nimble and practical documentation of iterative, ongoing, and multifaceted adaptations.

Trial Registration

clinicaltrials.gov NCT03713515, Registration date: October 19, 2018.

A multi- and mixed-method adaptation study of a patient-centered perioperative mental health intervention bundle

BACKGROUND

Anxiety and depression are common among older adults and can intensify during perioperative periods, but few mental health interventions are designed for older surgical patients' unique needs. As part of the feasibility trial, we developed and adapted a perioperative mental health (PMH) bundle for older patients comprised of behavioral activation (BA) and medication optimization (MO) to ameliorate anxiety and depressive symptoms before, during, and after cardiac, orthopedic, and oncologic surgery.

METHODS

We used mixed-methods including workshop studios with patients, caregivers, clinicians, researchers, and interventionists; intervention refinement and reflection meetings; patient case review meetings; intervention session audio-recordings and documentation forms; and patient and caregiver semi-structured interviews. We used the results to refine our PMH bundle. We used multiple analytical approaches to report the nature of adaptations, including hybrid thematic analysis and content analysis informed by the Framework for Reporting Adaptations and Modifications - Expanded.

RESULTS

Adaptations were categorized by content (intervention components), context (how the intervention is delivered, based on the study, target population, intervention format, intervention delivery mode, study setting, study personnel), training, and evaluation. Of 51 adaptations, 43.1% involved content, 41.2% involved context, and 15.7% involved training and evaluation. Several key adaptations were noted: (1) Intervention content was tailored to patient preferences and needs (e.g., rewording elements to prevent stigmatization of mental health needs; adjusting BA techniques and documentation forms to improve patient buy-in and motivation). (2) Cohort-specific adaptations were recommended based on differing patient needs. (3) Compassion was identified by patients as the most important element.

CONCLUSIONS

We identified evidence-based mental health intervention components from other settings and adapted them to the perioperative setting for older adults. Informed by mixed-methods, we created an innovative and pragmatic patient-centered intervention bundle that is acceptable, feasible, and responsive to the needs of older surgical populations. This approach allowed us to identify implementation strategies to improve the reach, scalability, and sustainability of our bundle, and can guide future patient-centered intervention adaptations.

CLINICAL TRIALS REGISTRATION

NCT05110690 (11/08/2021).

Anticipating adaptation: tracking the impact of planned and unplanned adaptations during the implementation of a complex population-based genomic screening program

In 2021, the Medical University of South Carolina (MUSC) launched In Our DNA SC. This large-scale initiative will screen 100,000 individuals in South Carolina for three preventable hereditary conditions that impact approximately two million people in the USA but often go undetected. In anticipation of inevitable changes to the delivery of this complex initiative, we developed an approach to track and assess the impact of evaluate adaptations made during the pilot phase of program implementation. We used a modified version of the Framework for Reporting Adaptations and Modification-Enhanced (FRAME) and Adaptations to code adaptations made during the 3-month pilot phase of In Our DNA SC. Adaptations were documented in real-time using a REDCap database. We used segmented linear regression models to independently test three hypotheses about the impact of adaptations on program reach (rate of enrollment in the program, rate of messages viewed) and implementation (rate of samples collected) 7 days pre- and post-adaptation. Effectiveness was assessed using qualitative observations. Ten adaptations occurred during the pilot phase of program implementation. Most adaptations (60%) were designed to increase the number and type of patient contacted (reach). Adaptations were primarily made based on knowledge and experience (40%) or from quality improvement data (30%). Of the three adaptations designed to increase reach, shortening the recruitment message potential patients received significantly increased the average rate of invitations viewed by 7.3% (p = 0.0106). There was no effect of adaptations on implementation (number of DNA samples collected). Qualitative findings support improvement in effectiveness of the intervention after shortening the consent form and short-term positive impact on uptake of the intervention as measured by team member's participation. Our approach to tracking adaptations of In Our DNA SC allowed our team to quantify the utility of modifications, make decisions about pursuing the adaptation, and understand consequences of the change. Streamlining tools for tracking and responding to adaptations can help monitor the incremental impact of interventions to support continued learning and problem solving for complex interventions being delivered in health systems based on real-time data.

A Patient-Centered Perioperative Mental Health Intervention Bundle: A Multi- and Mixed-Method Adaptation Study

Background

Anxiety and depression are common among older adults and can intensify during perioperative periods, but few mental health interventions are designed for older surgical patients' unique needs. We developed and adapted a perioperative mental health (PMH) bundle for older patients comprised of behavioral activation (BA) and medication optimization (MO) to ameliorate anxiety and depressive symptoms before, during, and after cardiac, orthopedic, and oncologic surgery.

Methods

We used mixed-methods including workshop studios with patients, caregivers, clinicians, researchers, and interventionists; intervention refinement and reflection meetings; patient case review meetings; intervention session audio-recordings and documentation forms; and patient and caregiver semi-structured interviews. We used the results to refine our PMH bundle. We used multiple analytical approaches to report the nature of adaptations, including hybrid thematic analysis and content analysis informed by the Framework for Reporting Adaptations and Modifications - Expanded.

Results

Adaptations were categorized by content (intervention components), context (how the intervention is delivered, based on the study, target population, intervention format, intervention delivery mode, study setting, study personnel), training, and evaluation. Of 51 adaptations, 43.1% involved content, 41.2% involved context, and 15.7% involved training and evaluation. Several key adaptations were noted: 1) Intervention content was tailored to patient preferences and needs (e.g., rewording elements to prevent stigmatization of mental health needs; adjusting BA techniques and documentation forms to improve patient buy-in and motivation). 2) Cohort-specific adaptations were recommended based on differing patient needs. 3) Compassion was identified by patients as the most important element.

Conclusions

We identified evidence-based mental health intervention components from other settings and adapted them to the perioperative setting for older adults. Informed by mixed-methods, we created an innovative and pragmatic patient-centered intervention bundle that is acceptable, feasible, and responsive to the needs of older surgical populations. This approach allowed us to identify implementation strategies to improve the reach, scalability, and sustainability of our bundle, and can guide future patient-centered intervention adaptations.

Getting to implementation: Adaptation of an implementation playbook

Introduction

Implementation strategies supporting the translation of evidence into practice need to be tailored and adapted for maximum effectiveness, yet the field of adapting implementation strategies remains nascent. We aimed to adapt "Getting To Outcomes"® (GTO), a 10-step implementation playbook designed to help community-based organizations plan and evaluate behavioral health programs, into "Getting To Implementation" (GTI) to support the selection, tailoring, and use of implementation strategies in health care settings.

Methods

Our embedded evaluation team partnered with operations, external facilitators, and site implementers to employ participatory methods to co-design and adapt GTO for Veterans Health Administration (VA) outpatient cirrhosis care improvement. The Framework for Reporting Adaptations and Modifications to Evidenced-based Implementation Strategies (FRAME-IS) guided documentation and analysis of changes made pre- and post-implementation of GTI at 12 VA medical centers. Data from multiple sources (interviews, observation, content analysis, and fidelity tracking) were triangulated and analyzed using rapid techniques over a 3-year period.

Results

Adaptations during pre-implementation were planned, proactive, and focused on context and content to improve acceptability, appropriateness, and feasibility of the GTI playbook. Modifications during and after implementation were unplanned and reactive, concentrating on adoption, fidelity, and sustainability. All changes were collaboratively developed, fidelity consistent at the level of the facilitator and/or implementer.

Conclusion

GTO was initially adapted to GTI to support health care teams' selection and use of implementation strategies for improving guideline-concordant medical care. GTI required ongoing modification, particularly in steps regarding team building, context assessment, strategy selection, and sustainability due to difficulties with step clarity and progression. This work also highlights the challenges in pragmatic approaches to collecting and synthesizing implementation, fidelity, and adaptation data.

Trial registration

This study was registered on ClinicalTrials.gov (Identifier: NCT04178096).

Using a stakeholder-engaged, iterative, and systematic approach to adapting collaborative decision skills training for implementation in VA psychosocial rehabilitation and recovery centers

BACKGROUND

Adaptation of interventions is inevitable during translation to new populations or settings. Systematic approach to adaptation can ensure that fidelity to core functions of the intervention are preserved while optimizing implementation feasibility and effectiveness for the local context. In this study, we used an iterative, mixed methods, and stakeholder-engaged process to systematically adapt Collaborative Decision Skills Training for Veterans with psychosis currently participating in VA Psychosocial Rehabilitation and Recovery Centers.

METHODS

A modified approach to Intervention Mapping (IM-Adapt) guided the adaptation process. An Adaptation Resource Team of five Veterans, two VA clinicians, and four researchers was formed. The Adaptation Resource Team engaged in an iterative process of identifying and completing adaptations including individual qualitative interviews, group meetings, and post-meeting surveys. Qualitative interviews were analyzed using rapid matrix analysis. We used the modified, RE-AIM enriched expanded Framework for Reporting Adaptations and Modifications to Evidence-based interventions (FRAME) to document adaptations. Additional constructs included adaptation size and scope; implementation of planned adaptation (yes-no); rationale for non-implementation; and tailoring of adaptation for a specific population (e.g., Veterans).

RESULTS

Rapid matrix analysis of individual qualitative interviews resulted in 510 qualitative codes. Veterans and clinicians reported that the intervention was a generally good fit for VA Psychosocial Rehabilitation and Recovery Centers and for Veterans. Following group meetings to reach adaptation consensus, 158 adaptations were completed. Most commonly, adaptations added or extended a component; were small in size and scope; intended to improve the effectiveness of the intervention, and based on experience as a patient or working with patients. Few adaptations were targeted towards a specific group, including Veterans. Veteran and clinician stakeholders reported that these adaptations were important and would benefit Veterans, and that they felt heard and understood during the adaptation process.

CONCLUSIONS

A stakeholder-engaged, iterative, and mixed methods approach was successful for adapting Collaborative Decision Skills Training for immediate clinical application to Veterans in a psychosocial rehabilitation center. The ongoing interactions among multiple stakeholders resulted in high quality, tailored adaptations which are likely to be generalizable to other populations or settings. We recommend the use of this stakeholder-engaged, iterative approach to guide adaptations.

The Influence of the Rural Transitions Nurse Program for Veterans on Healthcare Utilization Costs

BACKGROUND

The Veterans Affairs (VA) Healthcare System Rural Transitions Nurse Program (TNP) addresses barriers veterans face when transitioning from urban tertiary VA hospitals to home. Previous clinical evaluations of TNP have shown that enrolled veterans were more likely to follow up with their primary care provider within 14 days of discharge and experience a significant reduction in mortality within 30 days compared to propensity-score matched controls.

OBJECTIVE

Examine changes from pre- to post-hospitalization in total, inpatient, and outpatient 30-day healthcare utilization costs for TNP enrollees compared to controls.

DESIGN

Quantitative analyses modeling the changes in cost via multivariable linear mixed-effects models to determine the association between TNP enrollment and changes in these costs.

PARTICIPANTS

Veterans meeting TNP eligibility criteria who were discharged home following an inpatient hospitalization at one of the 11 implementation sites from April 2017 to September 2019.

INTERVENTION

The four-step TNP transitional care intervention.

MAIN MEASURES

Changes in 30-day total, inpatient, and outpatient healthcare utilization costs were calculated for TNP enrollees and controls.

KEY RESULTS

Among 3001 TNP enrollees and 6002 controls, no statistically significant difference in the change in total costs (p = 0.65, 95% CI: (- $675, $350)) was identified. However, on average, the increase in inpatient costs from pre- to post-hospitalization was approximately $549 less for TNP enrollees (p = 0.02, 95% CI: (- $856, - $246)). The average increase in outpatient costs from pre- to post-hospitalization was approximately $421 more for TNP enrollees compared to controls (p = 0.003, 95% CI: ($109, $671)).

CONCLUSIONS

Although we found no difference in change in total costs between veterans enrolled in TNP and controls, TNP was associated with a smaller increase in direct inpatient medical costs and a larger increase in direct outpatient medical costs. This suggests a shifting of costs from the inpatient to outpatient setting.

Using a longitudinal multi-method approach to document, assess, and understand adaptations in the Veterans Health Administration Advanced Care Coordination program

Background

Understanding adaptations supports iterative refinement of the implementation process and informs scale out of programs. Systematic documentation of adaptations across the life course of programs is not routinely done, and efficient capture of adaptations in real world studies is not well understood.

Methods

We used a multi-method longitudinal approach to systematically document adaptations during pre-implementation, implementation, and sustainment for the Veteran Health Administration (VA) Advanced Care Coordination program. This approach included documenting adaptations through a real-time tracking instrument, process maps, Implementation and Evaluation (I&E) team meeting minutes, and adaptation interviews. Data collection was guided by the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) enhanced framework for reporting adaptations and modifications to evidence-based interventions (FRAME) model. Adaptations were evaluated across 9 categories, and analytic team consensus and member-checking were used to validate the results.

Results

A total of 144 individual adaptations were identified across two implementation sites and the four data sources; analytic team consensus and member-checking processes resulted in 50 unique adaptations. Most adaptations took place during the early implementation and mid-implementation phases and were: 1) planned; 2) made to address changes in program delivery; 3) made to extend a component; 4) related to the core component of the intervention concerning notification of the community emergency department visit; 5) initiated by the entire or most of the I&E team; 6) made on the basis of: pragmatic/practical considerations; 7) made with an intent to improve implementation domain (to make the intervention delivered more consistently; to better fit the local practice, patient flow or Electronic Health Record (EHR) and/or for practical reasons); 8) a result of internal influences; 9) perceived to impact the RE-AIM implementation dimension (consistent delivery of quality care or costs). I&E team meeting minutes and process maps captured the highest numbers of unique adaptations (n = 19 and n = 13, respectively).

Conclusion

Our longitudinal, multi-method approach provided a feasible way to collect adaptations data through engagement of multiple I&E team members, allowing and a broader understanding of adaptations that took place. Recommendations for future research include pragmatic assessment of the impact of adaptations and meaningful data collection without overburdening the implementing teams and front-line staff.

Methods for capturing and analyzing adaptations: implications for implementation research

Background

Interventions are often adapted; some adaptations may provoke more favorable outcomes, whereas some may not. A better understanding of the adaptations and their intended goals may elucidate which adaptations produce better outcomes. Improved methods are needed to better capture and characterize the impact of intervention adaptations.

Methods

We used multiple data collection and analytic methods to characterize adaptations made by practices participating in a hybrid effectiveness-implementation study of a complex, multicomponent diabetes intervention. Data collection methods to identify adaptations included interviews, observations, and facilitator sessions resulting in transcripts, templated notes, and field notes. Adaptations gleaned from these sources were reduced and combined; then, their components were cataloged according to the framework for reporting adaptations and modifications to evidence-based interventions (FRAME). Analytic methods to characterize adaptations included a co-occurrence table, statistically based k-means clustering, and a taxonomic analysis.

Results

We found that (1) different data collection methods elicited more overall adaptations, (2) multiple data collection methods provided understanding of the components of and reasons for adaptation, and (3) analytic methods revealed ways that adaptation components cluster together in unique patterns producing adaptation “types.” These types may be useful for understanding how the “who, what, how, and why” of adaptations may fit together and for analyzing with outcome data to determine if the adaptations produce more favorable outcomes rather than by adaptation components individually.

Conclusion

Adaptations were prevalent and discoverable through different methods. Enhancing methods to describe adaptations may better illuminate what works in providing improved intervention fit within context.

Trial registration

This trial is registered on clinicaltrials.gov under Trial number NCT03590041, posted July 18, 2018.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-022-01218-3.

Adaptations to relational facilitation for two national care coordination programs during COVID-19

Background

Adaptations to implementation strategies are often necessary to support adoption and scale-up of evidence-based practices. Tracking adaptations to implementation strategies is critical for understanding any impacts on outcomes. However, these adaptations are infrequently collected. In this article we present a case study of how we used a new method during COVID-19 to systematically track and report adaptations to relational facilitation, a novel implementation strategy grounded in relational coordination theory. Relational facilitation aims to assess and improve communication and relationships in teams and is being implemented to support adoption of two Quadruple Aim Quality Enhancement Research Initiative (QA QUERI) initiatives: Care Coordination and Integrated Case Management (CC&ICM) and the Transitions Nurse Program for Home Health Care (TNP-HHC) in the Veterans Health Administration (VA).

Methods

During 2021-2022, relational facilitation training, activities and support were designed as in-person and/or virtual sessions. These included a site group coaching session to create a social network map of care coordination roles and assessment of baseline relationships and communication between roles. Following this we administered the Relational Coordination Survey to assess the relational coordination strength within and between roles. COVID-19 caused challenges implementing relational facilitation, warranting adaptations. We tracked relational facilitation adaptations using a logic model, REDCap tracking tool based on the Framework for Reporting Adaptations and Modifications-Enhanced (FRAME) with expanded Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) dimensions, and member checking. Adaptations were analyzed descriptively and for themes using matrix content analysis.

Results

COVID-19's impact within the VA caused barriers for implementing relational facilitation, warranting eight unique adaptations to the implementation strategy. Most adaptations pertained to changing the format of relational facilitation activities (n = 6; 75%), were based on external factors (n = 8; 100%), were planned (n = 8; 100%) and initiated by the QA QUERI implementation team (n = 8; 100%). Most adaptations impacted adoption (n = 6; 75%) and some impacted implementation (n = 2; 25%) of the CC&ICM and TNP-HHC interventions.

Discussion

Systematically tracking and discussing adaptations to relational facilitation during the COVID-19 pandemic enhanced engagement and adoption of two VA care coordination interventions. The impact of these rapid, early course adaptations will be followed in subsequent years of CC&ICM and TNP-HHC implementation.

A pragmatic implementation research study for In Our DNA SC: a protocol to identify multi-level factors that support the implementation of a population-wide genomic screening initiative in diverse populations

BACKGROUND

In 2021, the Medical University of South Carolina (MUSC) partnered with Helix, a population genetic testing company, to offer population-wide genomic screening for Centers for Disease Control and Preventions' Tier 1 conditions of hereditary breast and ovarian cancer, Lynch syndrome, and familial hypercholesterolemia to 100,000 individuals in South Carolina. We developed an implementation science protocol to study the multi-level factors that influence the successful implementation of the In Our DNA SC initiative.

METHODS

We will use a convergent parallel mixed-methods study design to evaluate the implementation of planned strategies and associated outcomes for In Our DNA SC. Aims focus on monitoring participation to ensure engagement of diverse populations, assessing contextual factors that influence implementation in community and clinical settings, describing the implementation team's facilitators and barriers, and tracking program adaptations. We report details about each data collection tool and analyses planned, including surveys, interview guides, and tracking logs to capture and code work group meetings, adaptations, and technical assistance needs.

DISCUSSION

The goal of In Our DNA SC is to provide population-level screening for actionable genetic conditions and to foster ongoing translational research. The use of implementation science can help better understand how to support the success of In Our DNA SC, identify barriers and facilitators to program implementation, and can ensure the sustainability of population-level genetic testing. The model-based components of our implementation science protocol can support the identification of best practices to streamline the expansion of similar population genomics programs at other institutions.