A CBPR-Enhanced Delphi Method: The Measurement Approaches to Partnership Success Case Study

As part of a 5-year study to develop and validate an instrument for measuring success in long-standing community-based participatory research (CBPR) partnerships, we utilized the Delphi method with a panel of 16 community and academic CBPR experts to assess face and content validity of the instrument's broad concepts of success and measurement items. In addition to incorporating quantitative and qualitative feedback from two online surveys, we included a 2-day face-to-face meeting with the Expert Panel to invite open discussion and diversity of opinion in line with the CBPR principles framing and guiding the study. The face-to-face meeting allowed experts to review the survey data (with maintained anonymity), convey their perspectives, and offer interpretations that were untapped in the online surveys. Using a CBPR approach facilitated a synergistic process that moved above and beyond the consensus achieved in the initial Delphi rounds, to enhance the Delphi technique and the development of items in the instrument.

Validation of the Measurement Approaches to Partnership Success (MAPS) Questionnaire

Conceptualizing and testing factors that contribute to the success of community-academic partnerships are critical to understanding their contributions to the health and well-being of communities. Most measures to date focus on factors that contribute to the development of new partnerships, and only a few have been adequately tested and validated. Methods. The Measurement Approaches to Partnership Success (MAPS) study followed a community-based participatory research (CBPR) approach and a multiphase process that included the construction and pilot testing of a questionnaire, and a national survey to validate the psychometric properties of the questionnaire in long-standing CBPR partnerships (existing ≥ six years). All members within partnerships were recruited to complete the survey (55 partnerships with 563 partners). We used confirmatory factor analysis (CFA), Cronbach's alpha statistics, and a pairwise correlations approach to assess discriminant and convergent validity, and assessed internal consistency, and test-retest reliability. Results. All MAPS Questionnaire dimensions demonstrated strong validity and reliability and demonstrated agreement over time. Conclusion. The MAPS Questionnaire includes seven dimensions and 81 items related to the MAPS conceptual model and provides a scientific, in-depth measurement tool that allows long-standing CBPR partnerships to evaluate their work toward achieving health equity.

Using a CBPR Approach to Guide Successful Recruitment for an Online Questionnaire: The Measurement Approaches to Partnership Success (MAPS) Case Study

The Measurement Approaches to Partnership Success (MAPS) study team effectively used a community-based participatory research (CBPR) approach to recruit 55 long-standing CBPR partnerships to participate in an online questionnaire to assess factors associated with partnership success. Our recruitment was guided by interconnected values of collaboration, transparency, and relationship-building to maintain fidelity to CBPR principles throughout the process. We operationalized these values into a series of strategies to recruit partnerships and sustain their involvement, including establishing primary points of contact, offering incentives for completion, personalizing recruitment materials, and practicing flexibility in our approach. We aim to inform public health researchers on the strategies that enabled our team to achieve 100% of our study recruitment goal, with the intent that our recommendations can be applied by others to enhance their recruitment efforts and reach their data collection goals for future public health research.

Erratum: Building the foundation for equitable and inclusive research: Seed grant programs to facilitate development of diverse CBPR community-academic research partnerships - CORRIGENDUM

[This corrects the article DOI: 10.1017/cts.2022.495.].

The Measurement Approaches to Partnership Success (MAPS) Questionnaire and Facilitation Guide: A Validated Measure of CBPR Partnership Success

Partnerships that effectively engage in certain key structural and process functions are more likely to meet their research goals and contribute to longer-term health equity outcomes. Ongoing evaluation of partnerships' level of achievement of these key functions, along with their fidelity to the guiding principles of community-based participatory research (CBPR), is therefore essential to understand how they can achieve desired partnership outcomes. This article describes the validated Measurement Approaches to Partnership Success (MAPS) Questionnaire and the use of an accompanying Facilitation Guide in helping members of CBPR partnerships evaluate their partnership's state of development and interpret findings to improve its structure, processes, and outcomes. We describe the conceptual framework guiding the development of the MAPS Questionnaire and its 81-item across seven key outcome dimensions, along with 28 items measuring precursor characteristics of CBPR partnership outcomes. The Facilitation Guide provides general guidelines for sharing, interpreting, and applying results within partnerships using a participatory process, definitions and items for each dimension, an example of presenting summary means, and dimension-specific reflective questions for discussion. We offer recommendations for practical uses of the MAPS Questionnaire and Facilitation Guide. Whether used as a comprehensive tool or by dimension, the MAPS Questionnaire is conceptually sound and empirically validated for evaluating how CBPR partnerships can achieve long-standing success. CBPR partnerships at any stage of development will find the MAPS Questionnaire and Facilitation Guide useful in measuring and interpreting indicators of partnership success, sharing results, and improving their ability to contribute to achieving health equity goals.

Cultivating an Ecosystem: A Qualitative Exploration of Sustainability in Long-Standing Community-Based Participatory Research Partnerships

Background:

While sustainability is crucial to the success of community-based participatory research (CBPR) partnerships, there is a lack of conceptual clarity on what defines sustainability and what characterizes sustainability-promoting practices in long-standing (in existence ≥ 6 years) CBPR partnerships.

Objectives:

The aim of this article is to explore the definition of sustainability, as well as practices that influence sustainability from the perspectives of academic and community experts in long-standing CBPR partnerships.

Methods:

This qualitative analysis is part of Measurement Approaches to Partnership Success (MAPS), a participatory mixed methods validity study that examined “success” and its contributing factors in long-standing CBPR partnerships. Thematic analysis of 21 semi-structured interviews was conducted, including 10 academic and 11 community experts of long-standing CBPR partnerships.

Results:

The key defining components of sustainability we identified include: distinguishing between sustaining the work of the partnership and ongoing relationships among partners; working towards a common goal over time; and enduring changes that impact the partnership. We further identified strengthening and capacity building practices at multiple levels of the partnership that served to promote the sustainability of the partnership’s work and of ongoing relationships among partners.

Conclusions:

Sustainability can be understood as supporting an ecosystem that surrounds the beneficial relationships between academic and community partners. Ongoing evaluation and application of practices that promote the sustainability of partnership activities and relationships may strengthen the long-term effectiveness of CBPR partnerships in advancing health equity.

Cultivating an ecosystem: A qualitative exploration of sustainability in long-standing community-based participatory research (CBPR) partnerships

Background

While sustainability is crucial to the success of community-based participatory research (CBPR) partnerships, there is a lack of conceptual clarity on what defines sustainability and what characterizes sustainability-promoting practices in long-standing (in existence ≥ 6 years) CBPR partnerships.

Objectives

The aim of this article is to explore the definition of sustainability, as well as practices that influence sustainability from the perspectives of academic and community experts in long-standing CBPR partnerships.

Methods

This qualitative analysis is part of Measurement Approaches to Partnership Success (MAPS), a participatory mixed methods validity study that examined "success" and its contributing factors in long-standing CBPR partnerships. Thematic analysis of 21 semi-structured interviews was conducted, including 10 academic and 11 community experts of long-standing CBPR partnerships.

Results

The key defining components of sustainability we identified include: distinguishing between sustaining the work of the partnership and ongoing relationships among partners; working towards a common goal over time; and enduring changes that impact the partnership. We further identified strengthening and capacity building practices at multiple levels of the partnership that served to promote the sustainability of the partnership's work and of ongoing relationships among partners.

Conclusions

Sustainability can be understood as supporting an ecosystem that surrounds the beneficial relationships between academic and community partners. Ongoing evaluation and application of practices that promote the sustainability of partnership activities and relationships may strengthen the long-term effectiveness of CBPR partnerships in advancing health equity.

Cultivating an Ecosystem: A Qualitative Exploration of Sustainability in Long-Standing Community-Based Participatory Research Partnerships

BACKGROUND

While sustainability is crucial to the success of community-based participatory research (CBPR) partnerships, there is a lack of conceptual clarity on what defines sustainability and what characterizes sustainability-promoting practices in long-standing (in existence 6 years or longer) CBPR partnerships.

OBJECTIVES

The aim of this article is to explore the definition of sustainability, as well as practices that influence sustainability from the perspectives of academic and community experts in long-standing CBPR partnerships.

METHODS

This qualitative analysis is part of Measurement Approaches to Partnership Success, a participatory mixed methods validity study that examined "success" and its contributing factors in long-standing CBPR partnerships. Thematic analysis of 21 semistructured interviews was conducted, including 10 academic and 11 community experts of long-standing CBPR partnerships.

RESULTS

The key defining components of sustainability we identified include: distinguishing between sustaining the work of the partnership and ongoing relationships among partners; working towards a common goal over time; and enduring changes that impact the partnership. We further identified strengthening and capacity building practices at multiple levels of the partnership that served to promote the sustainability of the partnership's work and of ongoing relationships among partners.

CONCLUSIONS

Sustainability can be understood as supporting an ecosystem that surrounds the beneficial relationships between academic and community partners. Ongoing evaluation and application of practices that promote the sustainability of partnership activities and relationships may strengthen the long-term effectiveness of CBPR partnerships in advancing health equity.

Cultivating an Ecosystem: A Qualitative Exploration of Sustainability in Long-Standing Community-Based Participatory Research Partnerships

Background:

While sustainability is crucial to the success of community-based participatory research (CBPR) partnerships, there is a lack of conceptual clarity on what defines sustainability and what characterizes sustainability-promoting practices in long-standing (in existence ≥ 6 years) CBPR partnerships.

Objectives:

The aim of this article is to explore the definition of sustainability, as well as practices that influence sustainability from the perspectives of academic and community experts in long-standing CBPR partnerships.

Methods:

This qualitative analysis is part of Measurement Approaches to Partnership Success (MAPS), a participatory mixed methods validity study that examined “success” and its contributing factors in long-standing CBPR partnerships. Thematic analysis of 21 semi-structured interviews was conducted, including 10 academic and 11 community experts of long-standing CBPR partnerships.

Results:

The key defining components of sustainability we identified include: distinguishing between sustaining the work of the partnership and ongoing relationships among partners; working towards a common goal over time; and enduring changes that impact the partnership. We further identified strengthening and capacity building practices at multiple levels of the partnership that served to promote the sustainability of the partnership’s work and of ongoing relationships among partners.

Conclusions:

Sustainability can be understood as supporting an ecosystem that surrounds the beneficial relationships between academic and community partners. Ongoing evaluation and application of practices that promote the sustainability of partnership activities and relationships may strengthen the long-term effectiveness of CBPR partnerships in advancing health equity.

Building the foundation for equitable and inclusive research: Seed grant programs to facilitate development of diverse CBPR community-academic research partnerships

Introduction

The effectiveness of community-based participatory research (CBPR) partnerships to address health inequities is well documented. CBPR integrates knowledge and perspectives of diverse communities throughout the research process, following principles that emphasize trust, power sharing, co-learning, and mutual benefits. However, institutions and funders seldom provide the time and resources needed for the critical stage of equitable partnership formation and development.

Methods

Since 2011, the Detroit Urban Research Center, collaborating with other entities, has promoted the development of new community-academic research partnerships through two grant programs that combine seed funding with capacity building support from community and academic instructors/mentors experienced in CBPR. Process and outcomes were evaluated using mixed methods.

Results

From 2011 to 2021, 50 partnerships received grants ranging from $2,500 to $30,000, totaling $605,000. Outcomes included equitable partnership infrastructure and processes, innovative pilot research, translation of findings to interventions and policy change, dissemination to multiple audiences, new proposals and projects, and sustained community-academic research partnerships. All partnerships continued beyond the program; over half secured additional funding.

Conclusions

Keys to success included participation as community-academic teams, dedicated time for partnership/relationship development, workshops to develop equity-based skills, relationships, and projects, expert community-academic instructor guidance, and connection to additional resources. Findings demonstrate that small amounts of seed funding for newly forming community-academic partnerships, paired with capacity building support, can provide essential time and resources needed to develop diverse, inclusive, equity-focused CBPR partnerships. Building such support into funding initiatives and through academic institutions can enhance impact and sustainability of translational research toward advancing health equity.

Understanding the Benefit-Cost Relationship in Long-standing Community-based Participatory Research (CBPR) Partnerships: Findings from the Measurement Approaches to Partnership Success (MAPS) Study

As part of the Measurement Approaches to Partnership Success (MAPS) study, we investigated the relationship between benefits and costs of participation in long-standing community-based participatory research (CBPR) partnerships using social exchange theory as a theoretical framework. Three major findings were identified: (1) the concept of benefits and costs operating as a ratio, where individual benefits must outweigh costs for participation, applies to early stages of CBPR partnership formation; (2) as CBPR partnerships develop, the benefits and costs of participation include each other's needs and the needs of the group as a whole; and (3) there is a shift in the relationship of benefits and costs over time in long-standing CBPR partnerships, in which partners no longer think in terms of costs but rather investments that contribute to mutual benefits.

Measurement Approaches to Partnership Success: Theory and Methods for Measuring Success in Long-Standing Community-Based Participatory Research Partnerships

BACKGROUND

Numerous conceptual frameworks have been developed to understand how community-based participatory research (CBPR) partnerships function, and multiple measurement approaches have been designed to evaluate them. However, most measures are not validated, and have focused on new partnerships. To define and assess the meaning of success in long-standing CBPR partnerships, we are conducting a CBPR study, Measurement Approaches to Partnership Success (MAPS). In this article we describe the theoretical underpinnings and methodological approaches used.

OBJECTIVES

The objectives of this study are to 1) develop a questionnaire to evaluate success in long-standing CBPR partnerships, 2) test the psychometric qualities of the questionnaire, 3) assess the relationships between key variables and refine the questionnaire and theoretical model, and 4) develop mechanisms and a feedback tool to apply partnership evaluation findings.

METHODS

Methodological approaches have included: engaged a community-academic national Expert Panel; conducted key informant interviews with Expert Panel; conducted a scoping literature review; conducted a Delphi process with the Expert Panel; and revised the measurement instrument. Additional methods include: conduct cognitive interviews and pilot testing; revise and test final version of the questionnaire with long-standing CBPR partnerships; examine the reliability and validity; analyze the relationship among variables in the framework; revise the framework; and develop a feedback mechanism for sharing partnership evaluation results.

CONCLUSIONS

Through the application of a theoretical model and multiple methodological approaches, the MAPS study will result in a validated measurement instrument and will develop procedures for effectively feeding back evaluation findings in order to strengthen authentic partnerships to achieve health equity.

A Participatory, Mixed Methods Approach to Define and Measure Partnership Synergy in Long-standing Equity-focused CBPR Partnerships

Understanding what contributes to success of community-based participatory research (CBPR) partnerships is essential to ensuring their effectiveness in addressing health disparities and health inequities. Synergy, the concept of accomplishing more together than separately, is central to partnership effectiveness. However, synergy specific to long-standing, equity-focused CBPR partnerships has not been closely examined. To address this, we defined and developed measures of partnership synergy as one dimension of a participatory mixed methods study, Measurement Approaches to Partnership Success (MAPS), to develop a validated instrument to measure success in long-standing CBPR partnerships. Framed by a conceptual model and scoping literature review, we conducted in-depth interviews with a national panel of academic and community experts in CBPR and equity to develop partnership synergy measures. Items were refined through an iterative process, including a three-stage Delphi process, comparison with existing measures, cognitive interviews, and pilot testing. Seven questionnaire items were developed to measure synergy arising from equitable partnerships bringing together diverse partners across power differences to promote equity. Defining and measuring synergy in the context of long-standing partnership success is central to understanding the role of synergy in collaborative approaches to research and action and can strengthen CBPR partnerships to promote healthy communities and advance health equity.

Applying Experiential Action Learning Pedagogy to an Intensive Course to Enhance Capacity to Conduct Community-Based Participatory Research

Community-based participatory research (CBPR) is widely recognized as an effective approach to understand and address health inequities. Opportunities for public health practitioners and researchers to engage jointly with community partners in intensive colearning processes can build capacity for CBPR. Using active learning approaches that engage diverse partners can enhance partnership development, competence, and equity. Examination of such pedagogical approaches can strengthen understanding of their contributions to the effectiveness of CBPR capacity-building programs. This article describes a weeklong intensive course carried out by the Detroit Urban Research Center as the foundation for a yearlong training program to build the capacity of community-academic partnership teams to engage in CBPR in their own communities. The in-person CBPR course was developed and implemented by expert academic and community instructors and used an experiential action learning model that integrated CBPR principles and processes. We describe the course content and application of our collaborative, experiential action learning model to course design; present results from participant evaluation of course effectiveness, CBPR competence, and equitable partnership development; and examine the contributions of the pedagogical approach to outcomes central to successful CBPR. The participatory, formative course evaluation used multiple methods that included closed- and open-ended questionnaires to assess instructional effectiveness, participant competence on 12 core components of CBPR, and course impact on partner relationships. Evaluation findings suggest that an experiential action learning approach with attention to colearning, collaboration among diverse instructors and participants, and an environment that fosters and models equitable and trusting relationships can be effective in building CBPR capacity.

Shifting from "Community-Placed" to "Community-Based" Research to Advance Health Equity: A Case Study of the Heatwaves, Housing, and Health: Increasing Climate Resiliency in Detroit (HHH) Partnership

Extreme summertime heat is a significant public health threat that disproportionately impacts vulnerable urban populations. Research on health impacts of climate change (including increasing intensity, duration, and frequency of hot weather) is sometimes designed and implemented without the involvement of the communities being studied, i.e., "community-placed" not "community-based." We describe how the Heatwaves, Housing, and Health: Increasing Climate Resiliency in Detroit (HHH) partnership engaged relevant communities by integrating a community-based participatory research (CBPR) approach into an existing, academic-designed research project through a steering committee of community and academic partners. Using a case study approach, we analyze program documentation, partnership evaluation questionnaires, and HHH steering committee meeting notes. We describe the CBPR process by which we successfully collected research data in Detroit during summer 2016, engaged in collaborative analysis of data, and shared results with Detroit residents. Evaluations of the partnership over 2 years show community involvement in research; enhanced capacities; success in securing new grant funding; and ways that CBPR strengthened the validity, relevance, and translation of research. Engaging communities as equal partners using CBPR, even after a study is underway, can strengthen research to understand and address the impacts of extreme heat on health and equity in urban communities.

Enhancing Capacity of Community-Academic Partnerships to Achieve Health Equity: Results From the CBPR Partnership Academy

Community-based participatory research (CBPR) is an equitable partnership approach that links academic researchers, community organizations, and public health practitioners to work together to understand and address health inequities. Although numerous educational materials on CBPR exist, few training programs develop the skills and knowledge needed to establish effective, equitable partnerships. Furthermore, there are few professional development opportunities for academic researchers, practitioners, and community members to obtain these competencies in an experiential co-learning process. In response, the Detroit Community-Academic Urban Research Center developed the CBPR Partnership Academy, an innovative, yearlong capacity-building program facilitated by experienced community and academic partners, involving an intensive short course, partnership development, grant proposal preparation and funding, mentoring, online learning forums, and networking. Three diverse cohorts (36 teams) from 18 states and 2 tribal nations have participated. We describe the rationale and components of the training program and present results from the first two cohorts. Evaluation results suggest enhanced competence and efficacy in conducting CBPR. Outcomes include partnerships established, grant proposals submitted and funded, workshops and research conducted, and findings disseminated. A community-academic partner-based, integrated, applied program can be effective for professional development and establishing innovative linkages between academics and practitioners aimed at achieving health equity.

Examining Joint Effects of Air Pollution Exposure and Social Determinants of Health in Defining "At-Risk" Populations Under the Clean Air Act: Susceptibility of Pregnant Women to Hypertensive Disorders of Pregnancy

Pregnant women are uniquely susceptible to adverse effects of air pollution exposure due to vulnerabilities and health consequences during pregnancy (e.g., hypertensive disorders of pregnancy [HDP]) compared to the general population. Because the Clean Air Act (CAA) creates a duty to protect at-risk groups, the regulatory assessment of at-risk populations has both policy and scientific foundations. Previously, pregnant women have not been specially protected in establishing the margin of safety for the ozone and particulate matter (PM) standards. Due to physiological changes, pregnant women can be at greater risk of adverse effects of air pollution and should be considered an at-risk population. Women with preexisting conditions, women experiencing poverty, and groups that suffer systematic discrimination may be particularly susceptible to cardiac effects of air pollutants during pregnancy. We rigorously reviewed 11 studies of over 1.3 million pregnant women in the United States to characterize the relationship between ozone or PM exposure and HDP. Findings were generally mixed, with a few studies reporting a joint association between ozone or PM and social determinants or pre-existing chronic health conditions related to HDP. Adequate evidence associates exposure to PM with an adverse effect of HDP among pregnant women not evident among non-gravid populations.

A community-based participatory planning process and multilevel intervention design: toward eliminating cardiovascular health inequities

The elimination of persistent health inequities requires the engagement of multiple perspectives, resources, and skills. Community-based participatory research (CBPR) is one approach to developing action strategies that promote health equity by addressing contextual as well as individual-level factors, and that can contribute to addressing more fundamental factors linked to health inequity. Yet many questions remain about how to implement participatory processes that engage local insights and expertise, are informed by the existing public health knowledge base, and build support across multiple sectors to implement solutions. This article describes a CBPR approach used to conduct a community assessment and action planning process, culminating in development of a multilevel intervention to address inequalities in cardiovascular disease in Detroit, Michigan. The authors consider implications for future efforts to engage communities in developing strategies toward eliminating health inequities.

Community-based participatory research: a capacity-building approach for policy advocacy aimed at eliminating health disparities

There have been increasing calls for community-academic partnerships to enhance the capacity of partners to engage in policy advocacy aimed at eliminating health disparities. Community-based participatory research (CBPR) is a partnership approach that can facilitate capacity building and policy change through equitable engagement of diverse partners. Toward this end, the Detroit Community-Academic Urban Research Center, a long-standing CBPR partnership, has conducted a policy training project. We describe CBPR and its relevance to health disparities; the interface between CBPR, policy advocacy, and health disparities; the rationale for capacity building to foster policy advocacy; and the process and outcomes of our policy advocacy training. We discuss lessons learned and implications for CBPR and policy advocacy to eliminate health disparities.