1
|
Brewer SK, Corbin CM, Baumann AA, Stirman SW, Jones JM, Pullmann MD, Lyon AR. Development of a method for Making Optimal Decisions for Intervention Flexibility during Implementation (MODIFI): a modified Delphi study. Implement Sci Commun 2024; 5:64. [PMID: 38886834 PMCID: PMC11181660 DOI: 10.1186/s43058-024-00592-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Accepted: 05/03/2024] [Indexed: 06/20/2024] Open
Abstract
BACKGROUND Intervention adaptation is often necessary to improve the fit between evidence-based practices/programs and implementation contexts. Existing frameworks describe intervention adaptation processes but do not provide detailed steps for prospectively designing adaptations, are designed for researchers, and require substantial time and resources to complete. A pragmatic approach to guide implementers through developing and assessing adaptations in local contexts is needed. The goal of this project was to develop Making Optimal Decisions for Intervention Flexibility during Implementation (MODIFI), a method for intervention adaptation that leverages human centered design methods and is tailored to the needs of intervention implementers working in applied settings with limited time and resources. METHOD MODIFI was iteratively developed via a mixed-methods modified Delphi process. Feedback was collected from 43 implementation research and practice experts. Two rounds of data collection gathered quantitative ratings of acceptability and inclusion (Round 1) and feasibility (Round 2), as well as qualitative feedback regarding MODIFI revisions analyzed using conventional content analysis. RESULTS In Round 1, most participants rated all proposed components as essential but identified important avenues for revision which were incorporated into MODIFI prior to Round 2. Round 2 emphasized feasibility, where ratings were generally high and fewer substantive revisions were recommended. Round 2 changes largely surrounded operationalization of terms/processes and sequencing of content. Results include a detailed presentation of the final version of the three-step MODIFI method (Step 1: Learn about the users, local context, and intervention; Step 2: Adapt the intervention; Step 3: Evaluate the adaptation) along with a case example of its application. DISCUSSION MODIFI is a pragmatic method that was developed to extend the contributions of other research-based adaptation theories, models, and frameworks while integrating methods that are tailored to the needs of intervention implementers. Guiding teams to tailor evidence-based interventions to their local context may extend for whom, where, and under what conditions an intervention can be effective.
Collapse
Affiliation(s)
- Stephanie K Brewer
- Department of Psychiatry and Behavioral Sciences, School of Medicine, University of Washington, 6200 NE 74Th St, Suite 100, Seattle, WA, 98115, USA.
| | - Catherine M Corbin
- School of Special Education, School Psychology, and Early Childhood Studies, College of Education, University of Florida, Norman Hall, Room 1801, Gainesville, FL, 32611, USA
| | - Ana A Baumann
- Department of Surgery, Washington University School of Medicine, 600 S. Taylor Ave, Attn: Ana Bauman, MSC:8100-0094-02, St. Louis, MO, 63110, USA
| | - Shannon Wiltsey Stirman
- Department of Psychiatry and Behavioral Sciences, Stanford University, 795 Willow Rd. (NC-PTSD), Menlo Park, CA, 94025, USA
| | - Janine M Jones
- College of Education, University of Washington, Miller Hall 322 S, Campus, Box 353600, Seattle, WA, 98195, USA
| | - Michael D Pullmann
- Department of Psychiatry and Behavioral Sciences, School of Medicine, University of Washington, 6200 NE 74Th St, Suite 100, Seattle, WA, 98115, USA
| | - Aaron R Lyon
- Department of Psychiatry and Behavioral Sciences, School of Medicine, University of Washington, 6200 NE 74Th St, Suite 100, Seattle, WA, 98115, USA
| |
Collapse
|
2
|
Brewer SK, Corbin CM, Baumann AA, Stirman SW, Jones JM, Pullmann MD, Lyon AR. Development of a method for Making Optimal Decisions for Intervention Flexibility during Implementation (MODIFI): A modified Delphi study. RESEARCH SQUARE 2023:rs.3.rs-3467152. [PMID: 37961432 PMCID: PMC10635387 DOI: 10.21203/rs.3.rs-3467152/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/15/2023]
Abstract
Background Intervention adaptation is often necessary to improve the fit between evidence-based practices/programs and implementation contexts. Existing frameworks describe intervention adaptation processes but do not provide detailed steps for prospectively designing adaptations, are designed for researchers, and require substantial time and resources to complete. A pragmatic approach to guide implementers through developing and assessing adaptations in local contexts is needed. The goal of this project was to develop Making Optimal Decisions for Intervention Flexibility during Implementation (MODIFI), a method for intervention adaptation that leverages human centered design methods and is tailored to the needs of intervention implementers working in applied settings with limited time and resources. Method MODIFI was iteratively developed via a mixed-methods modified Delphi process. Feedback was collected from 43 implementation research and practice experts. Two rounds of data collection gathered quantitative ratings of acceptability (Round 1) and feasibility (Round 2), as well as qualitative feedback regarding MODIFI revisions analyzed using conventional content analysis. Results In Round 1, most participants rated all proposed components as essential but identified important avenues for revision which were incorporated into MODIFI prior to Round 2. Round 2 emphasized feasibility, where ratings were generally high and fewer substantive revisions were recommended. Round 2 changes largely surrounded operationalization of terms/processes and sequencing of content. Results include a detailed presentation of the final version of the three-step MODIFI method (Step 1: Learn about the users, local context, and intervention; Step 2: Adapt the intervention; Step 3: Evaluate the adaptation) along with a case example of its application. Discussion MODIFI is a pragmatic method that was developed to extend the contributions of other research-based adaptation theories, models, and frameworks while integrating methods that are tailored to the needs of intervention implementers. Guiding teams to tailor evidence-based interventions to their local context may extend for whom, where, and under what conditions an intervention can be effective.
Collapse
Affiliation(s)
| | | | - Ana A Baumann
- Washington University School of Medicine in Saint Louis: Washington University in St Louis School of Medicine
| | | | | | | | | |
Collapse
|
3
|
Levinson J, Hickey E, Fuchu P, Chu A, Barnett M, Stadnick NA, Feinberg E, Broder-Fingert S. Recommendations for post-implementation adaptations to optimize family navigation in pediatric primary care: a qualitative study with parents and navigators. BMC PRIMARY CARE 2023; 24:123. [PMID: 37328810 PMCID: PMC10273746 DOI: 10.1186/s12875-023-02072-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Accepted: 05/31/2023] [Indexed: 06/18/2023]
Abstract
BACKGROUND Family Navigation (FN) is an evidence-based care management intervention designed to reduce disparities in access to care by providing families with individually tailored support and care coordination. Early data suggest FN is effective, but effectiveness is significantly influenced by both contextual (e.g. setting) and individual (e.g., ethnicity) variables. To better understand how FN could be tailored to address this variability in effectiveness, we set forth to explore proposed adaptations to FN by both navigators and families who received FN. METHODS This study was a nested qualitative study set within a larger randomized clinical trial of FN to improve access to autism diagnostic services in urban pediatric primary care practices in Massachusetts, Pennsylvania, and Connecticut serving low-income, racial and ethnic minority families. Following FN implementation, key informant interviews were conducted based on the Framework for Reporting Adaptations and Modifications-Expanded (FRAME) with a purposeful sample of parents of children who received FN (n = 21) and navigators (n = 7). Interviews were transcribed verbatim and were coded using framework-guided rapid analysis to categorize proposed adaptations to FN. RESULTS Parents and navigators proposed 38 adaptations in four domains: 1) content of the intervention (n = 18), 2) context of the intervention (n = 10), 3) training and evaluation (n = 6), and 4) implementation and scale-up (n = 4). The most frequently endorsed adaptation recommendations focused on content (e.g., lengthening FN, providing parents with additional education on autism and parenting children with autism) and implementation (e.g., increasing access to navigation). Although probes targeted critical feedback, parents and navigators were overwhelmingly positive about FN. CONCLUSIONS This study builds upon prior FN effectiveness and implementation research by providing concrete areas for adaptation and refinement of the intervention. Recommendations by parents and navigators have the potential to inform improvement of existing navigation programs and development of new programs in similarly underserved populations. These findings are critical as adaptation (cultural and otherwise) is an important principle in the field of health equity. Ultimately, adaptations will need to be tested to determine clinical and implementation effectiveness. TRIAL REGISTRATION ClinicalTrials.gov, registration number NCT02359084, February 9, 2015.
Collapse
Affiliation(s)
| | | | - Plyce Fuchu
- University of Massachusetts Chan Medical School, 55 North Lake Avenue, Worcester, MA, 01605, USA.
| | | | - Miya Barnett
- University of California, Santa Barbara, Santa Barbara, USA
| | | | - Emily Feinberg
- Boston Medical Center, Boston, USA
- Boston University School of Medicine, Boston, USA
| | - Sarabeth Broder-Fingert
- University of Massachusetts Chan Medical School, 55 North Lake Avenue, Worcester, MA, 01605, USA
| |
Collapse
|
4
|
Abstract
PURPOSE OF REVIEW School-based asthma management is an important component of pediatric asthma care that has the potential to provide more universal evidence-based asthma care to children and mitigate asthma-related health inequities. The purpose of this review is to highlight relevant developments in school-based asthma management over the past 2 years. RECENT FINDINGS There have been considerable recent scientific advances in school-based asthma management including robust clinical trials of environmental interventions in the classroom setting, school-nurse led interventions, stock albuterol policy changes, school-based telemedicine approaches and innovative methods to engage community stakeholders in research that have pushed the frontiers of school-based asthma care. SUMMARY Recent scientific work in school-based asthma management demonstrates the potential power of schools in providing access to guideline-based asthma care for all children with asthma and in improving their health outcomes. Future work should focus on the evaluation of methods to promote the adoption of school-based asthma management strategies in real-world practice and support evidence-based policy change and strategic partnerships to improve asthma health outcomes and produce meaningful public health impact for diverse children and families.
Collapse
Affiliation(s)
- Ashley A. Lowe
- Department of Health Promotion Sciences, Mel and Enid Zuckerman College of Public Health, University of Arizona, Tucson, Arizona, USA
- Asthma & Airway Disease Research Center, University of Arizona Health Sciences, University of Arizona, Tucson, Arizona, USA
| | - Ina St Onge
- Department of Pediatrics, Division of Pulmonary Medicine, University of Massachusetts Chan Medical School, UMass Memorial Children’s Medical Center, Worcester, MA, USA
| | - Michelle Trivedi
- Department of Pediatrics, Division of Pulmonary Medicine, University of Massachusetts Chan Medical School, UMass Memorial Children’s Medical Center, Worcester, MA, USA
- Department of Population and Quantitative Health Sciences, University of Massachusetts Medical Center, Worcester, MA, USA
- Child Health Equity Center, Department of Pediatrics, UMass Chan Medical School, UMass Memorial Children’s Medical Center, Worcester, MA, USA
| |
Collapse
|
5
|
O'Donoghue J, Luther J, Hoque S, Mizrahi R, Spano M, Frisard C, Garg A, Crawford S, Byatt N, Lemon SC, Rosal M, Pbert L, Trivedi M. Strategies to improve the recruitment and retention of underserved children and families in clinical trials: A case example of a school-supervised asthma therapy pilot. Contemp Clin Trials 2022; 120:106884. [PMID: 35995130 PMCID: PMC9489677 DOI: 10.1016/j.cct.2022.106884] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Revised: 07/24/2022] [Accepted: 08/12/2022] [Indexed: 11/30/2022]
Abstract
BACKGROUND Due to underrepresentation of racial/ethnic minority and low-income groups in clinical studies, there is a call to improve the recruitment and retention of these populations in research. Pilot studies can test recruitment and retention practices for better inclusion of medically underserved children and families in subsequent clinical trials. We examined this using a school-based asthma intervention, in preparation for a larger clinical trial in which our goal is to include an underserved study population. METHODS We recruited children with poorly controlled asthma in a two-site pilot cluster randomized controlled trial of school-supervised asthma therapy versus enhanced usual care (receipt of an educational asthma workbook). We sought a study population with a high percentage of children and families from racial/ethnic minority and low-income groups. The primary outcome of the pilot trial was recruitment/retention over 12 months. Strategies used to facilitate recruitment/retention of this study population included engaging pre-trial multi-level stakeholders, selecting trial sites with high percentages of underserved children and families, training diverse medical providers to recruit participants, conducting remote trial assessments, and providing multi-lingual study materials. RESULTS Twenty-six children [42.3% female, 11.5% Black, 30.8% Multiracial (Black & other), 76.9% Hispanic, and 92.3% with family income below $40,000] and their caregivers were enrolled in the study, which represents 55.3% of those initially referred by their provider, with 96.2%, 92.3%, and 96.2% retention at 3-, 6-, and 12-month follow-up, respectively. CONCLUSION Targeted strategies facilitated the inclusion of a medically underserved population of children and families in our pilot study, prior to expanding to a larger trial.
Collapse
Affiliation(s)
- Julia O'Donoghue
- Division of Pulmonology, Department of Pediatrics, University of Massachusetts Chan Medical School, Worcester, MA, United States of America.
| | - Janki Luther
- Department of Medicine, Washington University School of Medicine, St. Louis, MO, United States of America
| | - Shushmita Hoque
- Division of Pulmonology, Department of Pediatrics, University of Massachusetts Chan Medical School, Worcester, MA, United States of America
| | - Raphael Mizrahi
- Division of Pulmonology, Department of Pediatrics, University of Massachusetts Chan Medical School, Worcester, MA, United States of America
| | - Michelle Spano
- Division of Pulmonology, Department of Pediatrics, University of Massachusetts Chan Medical School, Worcester, MA, United States of America
| | - Christine Frisard
- Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, Worcester, MA, United States of America
| | - Arvin Garg
- Department of Pediatrics, University of Massachusetts Chan Medical School, Worcester, MA, United States of America
| | - Sybil Crawford
- Department of Medicine, University of Massachusetts Chan Medical School, Worcester, MA, United States of America
| | - Nancy Byatt
- Department of Psychiatry, University of Massachusetts Chan Medical School, Worcester, MA, United States of America
| | - Stephenie C Lemon
- Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, Worcester, MA, United States of America
| | - Milagros Rosal
- Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, Worcester, MA, United States of America
| | - Lori Pbert
- Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, Worcester, MA, United States of America
| | - Michelle Trivedi
- Division of Pulmonology, Department of Pediatrics, University of Massachusetts Chan Medical School, Worcester, MA, United States of America; Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, Worcester, MA, United States of America
| |
Collapse
|