Replacement of core team members on embedded implementation research teams: experiences from Latin America and the Caribbean

Objective

To understand how replacement of decision-makers (DMs) serving as principal investigators (PI) or co-PIs on research teams may affect the feasibility and value of embedded implementation research (EIR) used to improve health policies, programs, and services in Latin America and the Caribbean.

Methods

This was a descriptive qualitative study based on 39 semistructured interviews with 13 embedded research teams selected by financing agencies to explore team composition, interaction among members, and research results. Interviews were conducted at three points during the study period from September 2018 to November 2019; data were analyzed from 2020 to 2021.

Results

Research teams were found to be operating in one of three situations: (i) permanent core team (no change) with either active DM or inactive DM participation; (ii) replacement of DM-PI or co-PI that did not affect EIR research; and (iii) replacement of DM-PI that affected EIR.

Conclusions

To ensure EIR continuity and stability, research teams should include high-level DMs together with more technical staff performing essential implementation activities. This structure could improve collaboration among professional researchers and ensure greater embeddedness of EIR to strengthen the health system.

Relevance and quality of implementation research proposals to face the challenges of public health in Latin-America and the Caribbean

OBJECTIVES

To analyse the relevance and quality of the research proposals submitted to the 2016 call for proposals for the initiative Improving Programme Implementation through Embedded Research (iPIER-2016) to address current public health challenges in Latin America and the Caribbean.

METHODS

We performed a cross-sectional study using information from 108 research proposals using quantitative and qualitative methods. We used three frameworks to analyse the relevance of the proposals: The Global Burden of Disease, the WHO Health Systems Conceptual Framework and the Sustainable Development Goals proposed in 2015 by the United Nations. We performed an index to analyse the relevance and quality of the proposals.

RESULTS

Twenty seven percent of the proposals have very good relevance, one third of the proposals have quality flaws. This means their research questions are not related to implementation research or their methods are insufficient or inadequate to respond to the objective.

CONCLUSIONS

The response to this call is proof of health authorities' interest in research as a tool to improve the implementation of health programs in the region. However, proposals show important variations in terms of relevance and quality among countries and training health staff in programme implementation seems a central requirement.

Overcoming the health systems' segmentation to achieve universal health coverage in Mexico

Health is a human right that everyone should be able to exercise. Yet health systems segmentation and fragmentation are a major challenge to advancing universal health coverage (UHC) and achieving health equity. Between 2019 and 2020, Mexico launched a profound restructuration of its health system claiming its aim was to attain UHC, free healthcare services and drugs and to combat corruption. We analyse the implications of the modifications of the Mexican Constitution and the dismantling of the Seguro Popular de Salud (Popular Health Insurance) in relation to segmentation. We argue that, instead of advancing towards UHC and equality, these changes reinforce inequalities and that transforming health systems must respect human rights.

Analysis of implementation outcomes of quality improvement initiatives in Haiti: the fingerprint initiative

Objective

To assess the process and outcomes of the implementation of an electronic fingerprint initiative as part of quality improvement in three health facilities in the Northern Department of Haiti, in terms of its acceptability, adoption, feasibility, fidelity, and sustainability. In Haiti, poor attendance of the healthcare workforce is a nationwide problem, closely related to the quality of care. Three health institutions have tried to implement an electronic fingerprint system to monitor and improve attendance.

Methods

An exploratory and qualitative descriptive study of the implementation outcomes of the fingerprint initiative. It was based on semi-structured interviews and one group discussion using purposeful sampling techniques to recruit participants, and an open coding system and deductive approach to analyze the data using ATLAS.ti 8.

Results

The fingerprint initiative was successfully implemented in a non-governmental organization supported health facility but, despite some planning, it was never implemented in the public health facilities. The acceptability of the implementation was high in the not-for-profit organization and low in the public settings, mostly in relation to the presence of champions and the leadership at each health facility.

Conclusions

We recommend more involvement of the leadership of health facilities in the different phases of the implementation process in order to guarantee acceptability, adoption, fidelity and sustainabiliy. More research is needed to articulate this technology-driven initiative in the Haitian health system.

Embedded implementation research determinants in Latin American health systems

OBJECTIVE:

To assess the determinants of embedded implementation research (EIR) conduct in seven Latin American and Caribbean countries.

METHODS:

This qualitative interpretative study conducted and analyzed 14 semi-structured interviews based on a grounded theory approach using Atlas-ti© 7.5.7. We grouped the conditions appointed by interviewees as determinants of EIR conduct into six domains.

RESULTS:

The participation of high-level engaged decision makers as research co-producers is an important EIR determinant that fosters research use. Nevertheless, EIR faces challenges such as dealing with key personnel changes and fluctuating political contexts.

CONCLUSIONS:

Despite its limitations, EIR is effective in creating a sense of ownership of research results among implementers, which helps bridge the gap between research and decision-making in health systems.

Dataset related to the characteristics of the champion that influence the implementation of quality improvement programs in health facilities

Analyses of the present data are reported in the article "What are the characteristics of the champion that influence the implementation of quality improvement programs?" [5]. Data were collected from April to September 2019 using a qualitative data collection tool, an interview guide (see Appendix 1). A total of 21 staff were interviewed from three different health facilities in the Northern Department of Haiti. They gave their perceptions about the qualities and the characteristics of the champions involved in the planning and implementation of quality improvement initiatives in the health facilities in order to introduce change for a better quality of care. This data article provides an overview of the content of those interviews in terms of the characteristics of the champions. In addition, instructions are included about the output of Atlas ti software. You could reuse those data to get a better understanding of the quality and the characteristics of the champions that play a critical role in the implementation of quality improvement programs. The dataset includes the following: - Raw data: interviews transcripts - The Atlas ti software outputs: codes and quotations - The codebook.

Mapping of research on maternal health interventions in low- and middle-income countries: a review of 2292 publications between 2000 and 2012

Background

Progress in achieving maternal health goals and the rates of reductions in deaths from individual conditions have varied over time and across countries. Assessing whether research priorities in maternal health align with the main causes of mortality, and those factors responsible for inequitable health outcomes, such as health system performance, may help direct future research. The study thus investigated whether the research done in low- and middle-income countries (LMICs) matched the principal causes of maternal deaths in these settings. 

Methods

Systematic mapping was done of maternal health interventional research in LMICs from 2000 to 2012. Articles were included on health systems strengthening, health promotion; and on five tracer conditions (haemorrhage, hypertension, malaria, HIV and other sexually transmitted infections (STIs)). Following review of 35,078 titles and abstracts in duplicate, data were extracted from 2292 full-text publications.

Results

Over time, the number of publications rose several-fold, especially in 2004–2007, and the range of methods used broadened considerably. More than half the studies were done in sub-Saharan Africa (55.4 %), mostly addressing HIV and malaria. This region had low numbers of publications per hypertension and haemorrhage deaths, though South Asia had even fewer. The proportion of studies set in East Asia Pacific dropped steadily over the period, and in Latin America from 2008 to 2012. By 2008–2012, 39.1 % of articles included health systems components and 30.2 % health promotion. Only 5.4 % of studies assessed maternal STI interventions, diminishing with time. More than a third of haemorrhage research included health systems or health promotion components, double that of HIV research.

Conclusion

Several mismatches were noted between research publications, and the burden and causes of maternal deaths. This is especially true for South Asia; haemorrhage and hypertension in sub-Saharan Africa; and for STIs worldwide. The large rise in research outputs and range of methods employed indicates a major expansion in the number of researchers and their skills. This bodes well for maternal health if variations in research priorities across settings and topics are corrected.

Electronic supplementary material

The online version of this article (doi:10.1186/s12992-016-0189-1) contains supplementary material, which is available to authorized users.

Perspectives on the methods of a large systematic mapping of maternal health interventions

Background

Mapping studies describe a broad body of literature, and differ from classical systematic reviews, which assess more narrowly-defined questions and evaluate the quality of the studies included in the review. While the steps involved in mapping studies have been described previously, a detailed qualitative account of the methodology could inform the design of future mapping studies.

Objectives

Describe the perspectives of a large research team on the methods used and collaborative experiences in a study that mapped the literature published on maternal health interventions in low- and middle-income countries (2292 full text articles included, after screening 35,048 titles and abstracts in duplicate).

Methods

Fifteen members of the mapping team, drawn from eight countries, provided their experiences and perspectives of the study in response to a list of questions and probes. The responses were collated and analysed thematically following a grounded theory approach.

Results

The objectives of the mapping evolved over time, posing difficulties in ensuring a uniform understanding of the purpose of the mapping among the team members. Ambiguity of some study variables and modifications in data extraction codes were the main threats to the quality of data extraction. The desire for obtaining detailed information on a few topics needed to be weighed against the benefits of collecting more superficial data on a wider range of topics. Team members acquired skills in systematic review methodology and software, and a broad knowledge of maternal health literature. Participation in analysis and dissemination was lower than during the screening of articles for eligibility and data coding. Though all respondents believed the workload involved was high, study outputs were viewed as novel and important contributions to evidence. Overall, most believed there was a favourable balance between the amount of work done and the project’s outputs.

Conclusions

A large mapping of literature is feasible with a committed team aiming to build their research capacity, and with a limited, simplified set of data extraction codes. In the team’s view, the balance between the time spent on the review, and the outputs and skills acquired was favourable. Assessments of the value of a mapping need, however, to take into account the limitations inherent in such exercises, especially the exclusion of grey literature and of assessments of the quality of the studies identified.

Electronic supplementary material

The online version of this article (doi:10.1186/s12992-016-0191-7) contains supplementary material, which is available to authorized users.

Local and foreign authorship of maternal health interventional research in low- and middle-income countries: systematic mapping of publications 2000-2012

BACKGROUND

Researchers in low- and middle-income countries (LMICs) are under-represented in scientific literature. Mapping of authorship of articles can provide an assessment of data ownership and research capacity in LMICs over time and identify variations between different settings.

METHODS

Systematic mapping of maternal health interventional research in LMICs from 2000 to 2012, comparing country of study and of affiliation of first authors. Studies on health systems or promotion; community-based activities; and haemorrhage, hypertension, HIV/STIs and malaria were included. Following review of 35,078 titles and abstracts, 2292 full-text publications were included. Data ownership was measured by the proportion of articles with an LMIC lead author (author affiliated with an LMIC institution).

RESULTS

The total number of papers led by an LMIC author rose from 45.0/year in 2000-2003 to 98.0/year in 2004-2007, but increased only slightly thereafter to 113.1/year in 2008-2012. In the same periods, the proportion of papers led by a local author was 58.4 %, 60.8 % and 60.1 %, respectively. Data ownership varies markedly between countries. A quarter of countries led more than 75 % of their research; while in 10 countries, under 25 % of publications had a local first author. Researchers at LMIC institutions led 56.6 % (1297) of all papers, but only 26.8 % of systematic reviews (65/243), 29.9 % of modelling studies (44/147), and 33.2 % of articles in journals with an Impact Factor ≥5 (61/184). Sub-Saharan Africa authors led 54.2 % (538/993) of studies in the region, while 73.4 % did in Latin America and the Caribbean (223/304). Authors affiliated with United States (561) and United Kingdom (207) institutions together account for a third of publications. Around two thirds of USAID and European Union funded studies had high-income country leads, twice as many as that of Wellcome Trust and Rockefeller Foundation.

CONCLUSIONS

There are marked gaps in data ownership and these have not diminished over time. Increased locally-led publications, however, does suggest a growing capacity in LMIC institutions to analyse and articulate research findings. Differences in author attribution between funders might signal important variations in funders' expectations of authorship and discrepancies in how funders understand collaboration. More stringent authorship oversight and reconsideration of authorship guidelines could facilitate growth in LMIC leadership. Left unaddressed, deficiencies in research ownership will continue to hinder alignment between the research undertaken and knowledge needs of LMICs.

Using systematized tacit knowledge to prioritize implementation challenges in existing maternal health programs: implications for the post MDG era

Strategic priority setting and implementation of strategies to reduce maternal mortality are key to the post Millennium Development Goal (MDG) 2015 agenda. This article highlights the feasibility and the advantages of using a systematized tacit knowledge approach, using data from maternal health program personnel, to identify local challenges to implementing policies and programs to inform the post MDG era. Communities of practice, conceived as groups of people sharing professional interests, experiences and knowledge, were formed with diverse health personnel implementing maternal health programs in Mexico and Nicaragua. Participants attended several workshops and developed different online activities aiming to strengthen their capacities to acquire, analyze, adapt and apply research results and to systematize their experience and knowledge of the actual implementation of these programs. Concept mapping, a general method designed to organize and depict the ideas of a group on a particular topic, was used to manage, discuss and systematize their tacit knowledge about implementation problems of the programs they work in. Using a special online concept mapping platform, participants prioritized implementation problems by sorting them in conceptual clusters and rating their importance and feasibility of solution. Two hundred and thirty-one participants from three communities of practice in each country registered on the online concept mapping platform and 200 people satisfactorily completed the sorting and rating activities. Participants further discussed these results to prioritize the implementation problems of maternal health programs. Our main finding was a great similarity between the Mexican and the Nicaraguan general results highlighting the importance and the feasibility of solution of implementation problems related to the quality of healthcare. The use of rigorously organized tacit knowledge of health personnel proved to be a feasible and useful tool for prioritization to inform implementation priorities in the post MDG agenda.

Mapping the use of research to support strategies tackling maternal and child health inequities: evidence from six countries in Africa and Latin America

Background

Striving to foster collaboration among countries suffering from maternal and child health (MCH) inequities, the MASCOT project mapped and analyzed the use of research in strategies tackling them in 11 low- and middle-income countries. This article aims to present the way in which research influenced MCH policies and programs in six of these countries – three in Africa and three in Latin America.

Methods

Qualitative research using a thematic synthesis narrative process was used to identify and describe who is producing what kind of research, how research is funded, how inequities are approached by research and policies, the countries’ research capacities, and the type of evidence base that MCH policies and programs use. Four tools were designed for these purposes: an online survey for researchers, a semi-structured interview with decision makers, and two content analysis guides: one for policy and programs documents and one for scientific articles.

Results

Three modalities of research utilization were observed in the strategies tackling MCH inequities in the six included countries – instrumental, conceptual and symbolic. Instrumental utilization directly relates the formulation and contents of the strategies with research results, and is the least used within the analyzed policies and programs. Even though research is considered as an important input to support decision making and most of the analyzed countries count five or six relevant MCH research initiatives, in most cases, the actual impact of research is not clearly identifiable.

Conclusions

While MCH research is increasing in low- and middle-income countries, the impact of its outcomes on policy formulation is low. We did not identify a direct relationship between the nature of the financial support organizations and the kind of evidence utilization within the policy process. There is still a visible gap between researchers and policymakers regarding their different intentions to link evidence and decision making processes.

[The health system of Colombia]

This document briefly describes the health conditions of the Colombian population and, in more detail, the characteristics of the Colombian health system. The description of the system includes its structure and coverage; financing sources; expenditure in health; physical material and human resources available; monitoring and evaluation procedures; and mechanisms through which the population participates in the evaluation of the system. Salient among the most recent innovations implemented in the Colombian health system are the modification of the Compulsory Health Plan and the capitation payment unit, the vertical integration of the health promotion enterprises and the institutions in charge of the provision of services and the mobilization of additional resources to meet the objectives of universal coverage and the homologation of health benefits among health regimes.

[The health system of Venezuela]

This paper describes the Venezuelan health system, including its structure and coverage, financial sources, human and material resources and its stewardship functions. This system comprises a public and a private sector. The public sector includes the Ministry of Popular Power for Health (MS) and several social security institutions, salient among them the Venezuelan Institute for Social Security (IVSS). The MH is financed with federal, state and county contributions. The IVSS is financed with employer, employee and government contributions. These two agencies provide services in their own facilities. The private sector includes providers offering services on an out-of-pocket basis and private insurance companies. The Venezuelan health system is undergoing a process of reform since the adoption of the 1999 Constitution which calls for the establishment of a national public health system. The reform process is now headed by the Barrio Adentro program.