Leadership, action, learning and accountability to deliver quality care for women, newborns and children

How to evaluate a multi-country implementation-focused network: Reflections from the Quality of Care Network (QCN) evaluation

Learning about how to evaluate implementation-focused networks is important as they become more commonly used. This research evaluated the emergence, legitimacy and effectiveness of a multi-country Quality of Care Network (QCN) aiming to improve maternal, newborn and child health (MNCH) outcomes. We examined the QCN global level, national and local level interfaces in four case study countries. This paper presents the evaluation team's reflections on this 3.5 year multi-country, multi-disciplinary project. Specifically, we examine our approach, methodological innovations, lessons learned and recommendations for conducting similar research. We used a reflective methodological approach to draw lessons on our practice while evaluating the QCN. A 'reflections' tool was developed to guide the process, which happened within a period of 2-4 weeks across the different countries. All country research teams held focused 'reflection' meetings to discuss questions in the tool before sharing responses with this paper's lead author. Similarly, the different lead authors of all eight QCN papers convened their writing teams to reflect on the process and share key highlights. These data were thematically analysed and are presented across key themes around the implementation experience including what went well, facilitators and critical methodological adaptations, what can be done better and recommendations for undertaking similar work. Success drivers included the team's global nature, spread across seven countries with members affiliated to nine institutions. It was multi-level in expertise and seniority and highly multidisciplinary including experts in medicine, policy and health systems, implementation research, behavioural sciences and MNCH. Country Advisory Boards provided technical oversight and support. Despite complexities, the team effectively implemented the QCN evaluation. Strong leadership, partnership, communication and coordination were key; as were balancing standardization with in-country adaptation, co-production, flattening hierarchies among study team members and the iterative nature of data collection. Methodological adaptations included leveraging technology which became essential during COVID-19, clear division of roles and responsibilities, and embedding capacity building as both an evaluation process and outcome, and optimizing technology use for team cohesion and quality outputs.

Factors shaping network emergence: A cross-country comparison of quality of care networks in Bangladesh, Ethiopia, Malawi, and Uganda

The Quality-of-Care Network (QCN) was conceptualized by the World Health Organization (WHO) and other global partners to facilitate learning on and improve quality of care for maternal and newborn health within and across low and middle-income countries. However, there was significant variance in the speed and extent to which QCN formed in the involved countries. This paper investigates the factors that shaped QCN's differential emergence in Bangladesh, Ethiopia, Malawi, and Uganda. Drawing on network scholarship, we conducted a replicated case study of the four country cases and triangulated several sources of data, including a document review, observations of national-level and district level meetings, and key informant interviews in each country and at the global level. Thematic coding was performed in NVivo 12. We find that QCN emerged most quickly and robustly in Bangladesh, followed by Ethiopia, then Uganda, and slowest and with least institutionalization in Malawi. Factors connected to the policy environment and network features explained variance in network emergence. With respect to the policy environment, pre-existing resources and initiatives dedicated to maternal and newborn health and quality improvement, strong data and health system capacity, and national commitment to advancing on synergistic goals were crucial drivers to QCN's emergence. With respect to the features of the network itself, the embedding of QCN leadership in powerful agencies with pre-existing coordination structures and trusting relationships with key stakeholders, inclusive network membership, and effective individual national and local leadership were also crucial in explaining QCN's speed and quality of emergence across countries. Studying QCN emergence provides critical insights as to why well-intentioned top-down global health networks may not materialize in some country contexts and have relatively quick uptake in others, and has implications for a network's perceived legitimacy and ultimate effectiveness in producing stated objectives.

Quality improvement in public-private partnerships in low- and middle-income countries: a systematic review

BACKGROUND

Public-private partnerships (PPP) are often how health improvement programs are implemented in low-and-middle-income countries (LMICs). We therefore aimed to systematically review the literature about the aim and impacts of quality improvement (QI) approaches in PPP in LMICs.

METHODS

We searched SCOPUS and grey literature for studies published before March 2022. One reviewer screened abstracts and full-text studies for inclusion. The study characteristics, setting, design, outcomes, and lessons learned were abstracted using a standard tool and reviewed in detail by a second author.

RESULTS

We identified 9,457 citations, of which 144 met the inclusion criteria and underwent full-text abstraction. We identified five key themes for successful QI projects in LMICs: 1) leadership support and alignment with overarching priorities, 2) local ownership and engagement of frontline teams, 3) shared authentic learning across teams, 4) resilience in managing external challenges, and 5) robust data and data visualization to track progress. We found great heterogeneity in QI tools, study designs, participants, and outcome measures. Most studies had diffuse aims and poor descriptions of the intervention components and their follow-up. Few papers formally reported on actual deployment of private-sector capital, and either provided insufficient information or did not follow the formal PPP model, which involves capital investment for a explicit return on investment. Few studies discussed the response to their findings and the organizational willingness to change.

CONCLUSIONS

Many of the same factors that impact the success of QI in healthcare in high-income countries are relevant for PPP in LMICs. Vague descriptions of the structure and financial arrangements of the PPPs, and the roles of public and private entities made it difficult to draw meaningful conclusions about the impacts of the organizational governance on the outcomes of QI programs in LMICs. While we found many articles in the published literature on PPP-funded QI partnerships in LMICs, there is a dire need for research that more clearly describes the intervention details, implementation challenges, contextual factors, leadership and organizational structures. These details are needed to better align incentives to support the kinds of collaboration needed for guiding accountability in advancing global health. More ownership and power needs to be shifted to local leaders and researchers to improve research equity and sustainability.

Strengthening provider accountability: A scoping review of accountability/monitoring frameworks for quality of RMNCH care

Increasing health providers' accountability is an important element in improving quality of care (QoC) for reproductive, maternal, neonatal, and child health (RMNCH), so as to improve health outcomes of the population in many low- and middle-income countries (LMICs). Implemented RMNCH monitoring initiatives vary in their settings, methods of data collection, and indicators selected for monitoring. The purpose of this study is to evaluate the monitoring/accountability frameworks used by key global monitoring initiatives and provide insights for countries to develop context-customized indicators for RMNCH monitoring and accountability in middle-income countries. The authors conducted a scoping review of key global monitoring initiatives on their monitoring/accountability framework and associated indicators. Data was extracted into a spreadsheet template for analysis. Monitoring/accountability frameworks corresponding to the selected global RMNCH initiatives were described, analyzed, and then categorized the monitoring indicators used by the initiatives according to the type of indicators, quality domains, monitoring levels, and type of services. The results showed that all frameworks regarded developing quality indicators and their monitoring as important elements of accountability and emphasized the role of health systems blocks as inputs for QoC. The researchers demonstrated the importance of measuring quality through both condition-specific and general health system indicators. However, given the different purposes of global monitoring initiatives, the indicators they used varied. We found a lack of indicators measuring QoC of reproductive health. In terms of quality domains, the timeliness and efficiency of RMNCH services were neglected, as few of these indicators were selected for monitoring. Global monitoring initiatives provide valuable frameworks for countries to understand which key indicators need to be tracked to achieve global objectives and develop the foundation for their own accountability/monitoring systems. Gaps in quality indicator design and use emphasize countries need to build on what the global initiatives have achieved to systematically examine quality concerns, develop a tailored and effective accountability/monitoring framework, and improve population health.

From Theory to Implementation: Adaptations to a Quality Improvement Initiative According to Implementation Context

As countries continue to invest in quality improvement (QI) initiatives in health facilities, it is important to acknowledge the role of context in implementation. We conducted a qualitative study between February 2019 and January 2020 to explore how a QI initiative was adapted to enable implementation in three facility types: primary health centres, public hospitals and private facilities in Lagos State, Nigeria.Despite a common theory of change, implementation of the initiative needed to be adapted to accommodate the local needs, priorities and organisational culture of each facility type. Across facility types, inadequate human and capital resources constrained implementation and necessitated an extension of the initiative's duration. In public facilities, the local governance structure was adapted to facilitate coordination, but similar adaptations to governance were not possible for private facilities. Our findings highlight the importance of anticipating and planning for the local adaptation of QI initiatives according to implementation environment.

Development of measures for assessing mistreatment of women during facility-based childbirth based on labour observations

INTRODUCTION

Mistreatment of women during childbirth is increasingly recognised as a significant issue globally. Research and programmatic efforts targeting this phenomenon have been limited by a lack of validated measurement tools. This study aimed to develop a set of concise, valid and reliable multidimensional measures for mistreatment using labour observations applicable across multiple settings.

METHODS

Data from continuous labour observations of 1974 women in Nigeria (n=407), Ghana (n=912) and Guinea (n=655) were used from the cross-sectional WHO's multicountry study 'How women are treated during facility-based childbirth' (2016-2018). Exploratory factor analysis was conducted to develop a scale measuring interpersonal abuse. Two indexes were developed through a modified Organisation for Economic Co-operation and Development approach for generating composite indexes. Measures were evaluated for performance, validity and internal reliability.

RESULTS

Three mistreatment measures were developed: a 7-item Interpersonal Abuse Scale, a 3-item Exams & Procedures Index and a 12-item Unsupportive Birth Environment Index. Factor analysis results showed a consistent unidimensional factor structure for the Interpersonal Abuse Scale in all three countries based on factor loadings and interitem correlations, indicating good structural construct validity. The scale had a reliability coefficient of 0.71 in Nigeria and approached 0.60 in Ghana and Guinea. Low correlations (Spearman correlation range: -0.06-0.19; p≥0.05) between mistreatment measures supported our decision to develop three separate measures. Predictive criterion validation yielded mixed results across countries. Both items within measures and measure scores were internally consistent across countries; each item co-occurred with other items in a measure, and scores consistently distinguished between 'high' and 'low' mistreatment levels.

CONCLUSION

The set of concise, comprehensive multidimensional measures of mistreatment can be used in future research and quality improvement initiatives targeting mistreatment to quantify burden, identify risk factors and determine its impact on health and well-being outcomes. Further validation and reliability testing of the measures in other contexts is needed.

Private sector delivery of quality care for maternal, newborn and child health in low-income and middle-income countries: a mixed-methods systematic review protocol

INTRODUCTION

To accelerate progress to reach the sustainable development goals for ending preventable maternal, newborn and child deaths, it is critical that both the public and private health service delivery systems invest in increasing coverage of interventions to sustainably deliver quality care for mothers, newborns and children at scale. Although various approaches have been successful in high-income countries, little is known about how to effectively engage and sustain private sector involvement in delivering quality care in low-income and middle-income countries. Our systematic review will examine private sector implementation of quality care for maternal, newborn and child health (MNCH) and the impact of this care. This protocol details our intended methodological and analytical approaches, based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) reporting guideline for protocols.

METHODS AND ANALYSIS

Following the PRISMA approach, this systematic review will include quantitative, qualitative and mixed-methods studies addressing the provision of quality MNCH care by private sector providers. Eight databases (Cumulative Index to Nursing and Allied Health, EconLit, Excerpta Medica Database, International Bibliography of the Social Sciences, Popline, PubMed, ScienceDirect, Web of Science) and two websites will be searched for relevant studies published between 1 January 1995 and 30 June 2019. For inclusion, studies in low-income and middle-income countries must examine at least one of the following critical outcomes: maternal morbidity or mortality, newborn morbidity or mortality, child morbidity or mortality, quality of care, experience of care and service utilisation. Depending on the data, analyses could include meta-analysis, descriptive quantitative statistics, narrative synthesis and thematic synthesis. Quality will be assessed using tools for qualitative and quantitative studies.

ETHICS AND DISSEMINATION

Formal ethical approval is not required for this research, as the secondary data are not identifiable. Findings from this review will be used to develop models for effective collaboration of the private and public sectors in implementing quality of care for MNCH. In addition to publishing our findings in a peer-reviewed journal, the findings will be shared through the Quality of Care Network, relevant mailing lists, webinars and social media.

PROSPERO REGISTRATION NUMBER

CRD42019143383.

How women are treated during facility-based childbirth in four countries: a cross-sectional study with labour observations and community-based surveys

BACKGROUND

Women across the world are mistreated during childbirth. We aimed to develop and implement evidence-informed, validated tools to measure mistreatment during childbirth, and report results from a cross-sectional study in four low-income and middle-income countries.

METHODS

We prospectively recruited women aged at least 15 years in twelve health facilities (three per country) in Ghana, Guinea, Myanmar, and Nigeria between Sept 19, 2016, and Jan 18, 2018. Continuous observations of labour and childbirth were done from admission up to 2 h post partum. Surveys were administered by interviewers in the community to women up to 8 weeks post partum. Labour observations were not done in Myanmar. Data were collected on sociodemographics, obstetric history, and experiences of mistreatment.

FINDINGS

2016 labour observations and 2672 surveys were done. 838 (41·6%) of 2016 observed women and 945 (35·4%) of 2672 surveyed women experienced physical or verbal abuse, or stigma or discrimination. Physical and verbal abuse peaked 30 min before birth until 15 min after birth (observation). Many women did not consent for episiotomy (observation: 190 [75·1%] of 253; survey: 295 [56·1%] of 526) or caesarean section (observation: 35 [13·4%] of 261; survey: 52 [10·8%] of 483), despite receiving these procedures. 133 (5·0%) of 2672 women or their babies were detained in the facility because they were unable to pay the bill (survey). Younger age (15-19 years) and lack of education were the primary determinants of mistreatment (survey). For example, younger women with no education (odds ratio [OR] 3·6, 95% CI 1·6-8·0) and younger women with some education (OR 1·6, 1·1-2·3) were more likely to experience verbal abuse, compared with older women (≥30 years), adjusting for marital status and parity.

INTERPRETATION

More than a third of women experienced mistreatment and were particularly vulnerable around the time of birth. Women who were younger and less educated were most at risk, suggesting inequalities in how women are treated during childbirth. Understanding drivers and structural dimensions of mistreatment, including gender and social inequalities, is essential to ensure that interventions adequately account for the broader context.

FUNDING

United States Agency for International Development and the UNDP/UNFPA/UNICEF/WHO/World Bank Special Programme of Research, Development and Research Training in Human Reproduction, Department of Reproductive Health and Research, WHO.

Do Quality Improvement Initiatives Improve Outcomes for Patients in Antiretroviral Programs in Low- and Middle-Income Countries? A Systematic Review

BACKGROUND

There have been a range of quality improvement (QI) and quality assurance initiatives in low- and middle-income countries to improve antiretroviral therapy (ART) treatment outcomes for people living with HIV. To date, these initiatives have not been systematically assessed and little is known about how effective, cost-effective, or sustainable these strategies are in improving clinical outcomes.

METHODS

We conducted a systematic review adhering to PRISMA guidelines (PROSPERO ID: CRD42017071848), searching PubMed, MEDLINE, Embase, Web of Science, and the Cochrane database of controlled trials for articles reporting on the effectiveness of QI and quality assurance initiatives in HIV programs in low- and middle-income countries in relation to ART uptake, retention in care, adherence, viral load suppression, mortality, and other outcomes including cost-effectiveness and long-term sustainability.

RESULTS

One thousand eight hundred sixty articles were found, of which 29 were included. QI approaches were categorized as follows: (1) health system approaches using QI methods; (2) QI learning networks including collaboratives; (3) standard-based methods that use QI tools to improve performance gaps; and (4) campaigns using QI methods. The greatest improvements were seen in ART uptake [median increase of 14.0%; interquartile range (IQR) -9.0 to 29.3], adherence [median increase of 22.0% (IQR -7.0 to 25.0)], and viral load suppression [median increase 26.0% (IQR -8.0 to 26.0)].

CONCLUSIONS

QI interventions can be effective in improving clinical outcomes; however, there was significant variability, making it challenging to identify which aspects of interventions lead to clinical improvements. Standardizing reporting and assessment of QI initiatives is needed, supported by national quality policies and directorates, and robust research.

When the patient is the expert: measuring patient experience and satisfaction with care

In 2018, three independent reports were published, emphasizing the need for attention to, and improvements in, quality of care to achieve effective universal health coverage. A key aspect of high quality health care and health systems is that they are person-centred, a characteristic that is at the same time intrinsically important (all individuals have the right to be treated with dignity and respect) and instrumentally important (person-centred care is associated with improved health-care utilization and health outcomes). Following calls to make 2019 a year of action, we provide guidance to policy-makers, researchers and implementers on how they can take on the task of measuring person-centred care. Theoretically, measures of person-centred care allow quality improvement efforts to be evaluated and ensure that health systems are accountable to those they aim to serve. However, in practice, the utility of these measures is limited by lack of clarity and precision in designing and by using measures for different aspects of person-centeredness. We discuss the distinction between two broad categories of measures of patient-centred care: patient experience and patient satisfaction. We frame our discussion of these measures around three key questions: (i) how will the results of this measure be used?; (ii) how will patient subjectivity be accounted for?; and (iii) is this measure validated or tested? By addressing these issues during the design phase, researchers will increase the usability of their measures.

Maternal, newborn, child and adolescent health: challenges for the next decade

The Millennium Development Goals era achieved substantial improvements in the health of women and children. Yet progress was uneven and many women and children still suffer from preventable mortality and morbidity. The United Nations Secretary General’s Global Strategy for Women’s, Children’s and Adolescents’ Health (2016–2030) set out an ambitious ‘survive, thrive and transform’ agenda for countries as they accelerate progress towards the health-related Sustainable Development Goals. This review highlights aspects of ‘survive, thrive and transform’ that have had strong traction globally, namely quality of care and humanitarian settings for ‘survive’, early childhood development and adolescent health for ‘thrive’ and community engagement and a sustainable environment for ‘transform’.