Measures matter: A scoping review of maternal and newborn indicators

A case study analysis of a successful birth center in northern Uganda

BACKGROUND

Mothers and infants continue to die at alarming rates throughout the Global South. Evidence suggests that high-quality midwifery care significantly reduces preventable maternal and neonatal morbidity and mortality. This paper uses a case study approach to describe the social and institutional model at one birth center in Northern Uganda where, in over 20,000 births, there have been no maternal deaths and the neonatal mortality rate is 11/1000-a rate that is lower than many high-resource countries.

METHODS

This case study combined institutional ethnographic and narrative methods to explore key maternal and neonatal outcomes. The sample included birthing people who intended to or had given birth at the center, as well as the midwives, staff, stakeholders, and community health workers affiliated with the center. Data were collected through individual and small group interviews, participant observation, field notes, data and document reviews. Iterative and systematic analytical steps were followed, and all data were organized and managed with Atlas.ti software.

RESULTS

Findings describe the setting, an overview of the birth center's history, how it is situated within the community, its staffing, administration, clinical outcomes, and model of care. A synthesis of contextual variables and key outcomes as they relate to the components of the evidence-informed Quality Maternal and Newborn Care (QMNC) framework are presented. Three overarching themes were identified: (a) community knowledge and understanding, (b) community integrated care, and (c) quality care that is respectful, accessible, and available.

CONCLUSIONS

This birth center is an example of care that embodies the findings and anticipated outcomes described in the QMNC framework. Replication of this model in other childbearing settings may help alleviate unnecessary perinatal morbidity and mortality.

Clinical indicators to monitor health care in low back pain: a scoping review

Clinical care indicators for low back pain can be used to monitor healthcare practices and consequently be used to evaluate success of strategies to improve care quality. The aim of this study was to identify the clinical care indicators that have been used to measure appropriateness of health care for patients with low back pain. We conducted a systematic search of five electronic databases and Google to identify clinical care indicators that have been used to measure any aspect of care for people with low back pain. Care indicators were narratively described according to their type (i.e. structure, process, or outcomes) and categorized by their purpose (e.g. to measure aspects related to assessment, imaging requests, treatment/prevention, and outcomes). A total of 3562 and 2180 records were retrieved from electronic databases and Google searches, respectively. We identified 280 indicators related to low back pain care from 40 documents and publications. Most quality indicators were process indicators (n = 213, 76%), followed by structure (n = 41, 15%) and outcome indicators (n = 26, 9%). The most common indicators were related to imaging requests (n = 41, 15%), referral to healthcare providers (n = 30, 11%), and shared decision-making (n = 21, 7%). Our review identified a range of clinical care indicators that have been used to measure the quality of health care for people with low back pain. Our findings will support a Delphi study to reach international consensus on what would be the most important and feasible indicators for a minimum dataset to be collected globally.

Travelling numbers and broken loops: A qualitative systematic review on collecting and reporting maternal and neonatal health data in low-and lower-middle income countries

Data and indicator estimates are considered vital to document persisting challenges in maternal and newborn health and track progress towards global goals. However, prioritization of standardised, comparable quantitative data can preclude the collection of locally relevant information and pose overwhelming burdens in low-resource settings, with negative effects on the provision of quality of care. A growing body of qualitative studies aims to provide a place-based understanding of the complex processes and human experiences behind the generation and use of maternal and neonatal health data. We conducted a qualitative systematic review exploring how national or international requirements to collect and report data on maternal and neonatal health indicators are perceived and experienced at the sub-national and country level in low-income and lower-middle income countries. We systematically searched six electronic databases for qualitative and mixed-methods studies published between January 2000 and March 2023. Following screening of 4084 records by four reviewers, 47 publications were included in the review. Data were analysed thematically and synthesised from a Complex Adaptive Systems (CAS) theoretical perspective. Our findings show maternal and neonatal health data and indicators are not fixed, neutral entities, but rather outcomes of complex processes. Their collection and uptake is influenced by a multitude of system hardware elements (human resources, relevancy and adequacy of tools, infrastructure, and interoperability) and software elements (incentive systems, supervision and feedback, power and social relations, and accountability). When these components are aligned and sufficiently supportive, data and indicators can be used for positive system adaptivity through performance evaluation, prioritization, learning, and advocacy. Yet shortcomings and broken loops between system components can lead to unforeseen emergent behaviors such as blame, fear, and data manipulation. This review highlights the importance of measurement approaches that prioritize local relevance and feasibility, necessitating participatory approaches to define context-specific measurement objectives and strategies.

Intrapartum care measures and indicators for monitoring the implementation of WHO recommendations for a positive childbirth experience: a scoping review

OBJECTIVE

We aimed to identify all available studies describing measures or indicators used to monitor 41 intrapartum care practices described in the 2018 WHO intrapartum care recommendations, with a view to informing development of standardised measurement of implementing these recommendations.

DESIGN

Systematic scoping review.

METHODS

We conducted a scoping review to identify studies reporting measures of intrapartum care published between 1 January 2000 and 28 June 2021. Primary and secondary outcome measures included study characteristics (publication year, journal, country and World Bank classification) and intrapartum care measure characteristics (definition, numerator, denominator, measurement level and measurement approach). We searched MEDLINE, EMBASE, CINAHL, Cochrane Library, the Maternity and Infant Care Database, Global Index Medicus and grey literature using structured search terms related to included recommendations, focusing on respectful and supportive care, and clinical practices performed throughout labour and birth. The measures identified were classified by the WHO recommendation and their characteristics reported.

RESULTS

We identified 150 studies which described 1331 intrapartum care measures. These measures corresponded to 35 of the 41 included WHO recommendations, and represented all domains of the WHO recommendations (care throughout labour and birth, first stage of labour, second stage of labour, third stage of labour). A total of 40.1% (534 of 1331 measures) of measures were related to respectful maternity care. Most studies used a questionnaire or survey measurement approach (522 of 1331 measures, 39.2%).

CONCLUSION

This scoping review presents a database of existing intrapartum care measures used to monitor the quality of intrapartum care globally. There is no clear consensus on a core set of measures for evaluating the practice of the WHO's intrapartum care recommendations. This review provides a foundation to support the development of a core set of internationally standardised intrapartum care measures for the WHO intrapartum care recommendations, highlighting key areas requiring consensus and validation, and measure development.

Strengthening provider accountability: A scoping review of accountability/monitoring frameworks for quality of RMNCH care

Increasing health providers' accountability is an important element in improving quality of care (QoC) for reproductive, maternal, neonatal, and child health (RMNCH), so as to improve health outcomes of the population in many low- and middle-income countries (LMICs). Implemented RMNCH monitoring initiatives vary in their settings, methods of data collection, and indicators selected for monitoring. The purpose of this study is to evaluate the monitoring/accountability frameworks used by key global monitoring initiatives and provide insights for countries to develop context-customized indicators for RMNCH monitoring and accountability in middle-income countries. The authors conducted a scoping review of key global monitoring initiatives on their monitoring/accountability framework and associated indicators. Data was extracted into a spreadsheet template for analysis. Monitoring/accountability frameworks corresponding to the selected global RMNCH initiatives were described, analyzed, and then categorized the monitoring indicators used by the initiatives according to the type of indicators, quality domains, monitoring levels, and type of services. The results showed that all frameworks regarded developing quality indicators and their monitoring as important elements of accountability and emphasized the role of health systems blocks as inputs for QoC. The researchers demonstrated the importance of measuring quality through both condition-specific and general health system indicators. However, given the different purposes of global monitoring initiatives, the indicators they used varied. We found a lack of indicators measuring QoC of reproductive health. In terms of quality domains, the timeliness and efficiency of RMNCH services were neglected, as few of these indicators were selected for monitoring. Global monitoring initiatives provide valuable frameworks for countries to understand which key indicators need to be tracked to achieve global objectives and develop the foundation for their own accountability/monitoring systems. Gaps in quality indicator design and use emphasize countries need to build on what the global initiatives have achieved to systematically examine quality concerns, develop a tailored and effective accountability/monitoring framework, and improve population health.

A scoping review, mapping, and prioritisation process for emergency obstetric and neonatal quality of care indicators: Focus on provision and experience of care

Background

Globally, approximately 800 women and 6400 newborns die around the time of childbirth each day. Many of these deaths could be prevented with high-quality emergency obstetric and newborn care (EmONC). The Monitoring Emergency Obstetric Care: A handbook guides strengthening EmONC services. However, the handbook contains limited quality of care measures. Our study identified and prioritised quality of care indicators for potential inclusion in the handbook, which is undergoing revision.

Methods

We conducted a consultative scoping review, mapping, and prioritisation exercise to select a short list of indicators on facility-based maternal and newborn quality of care. Indicators were identified from literature searches and expert suggestions and organised by the categories of structure, process, and outcomes as defined in the World Health Organization's Standards for Improving Quality of Maternal and Newborn Care in Health Facilities. We focused on process indicators, encompassing the provision of care and experience of care during the intrapartum period, and developed a priority list of indicators using the selection criteria of relevance and feasibility. Experience of care indicators were also mapped against the Person-Centered Maternity Care (PCMC) scale.

Results

We extracted a total of 3023 quality of care indicators. After removing out-of-scope and duplicate indicators and applying our selection criteria, we identified 20 provision of care indicators for possible inclusion in the revised EmONC handbook. We recommend including a score for experience of care that could be measured with the 30-item or the 13-item PCMC scale. We also identified 29 experience of care items not covered by the PCMC scale that could be used. Provider experience, patient safety, and quality of abortion care were identified as areas for which no or few indicators were found through our scoping review.

Conclusions

Through a rigorous, consultative, and multi-step process, we selected a short list of process-related, facility-based quality of care indicators for emergency obstetric and newborn care. This list could be included in the EmONC handbook or used for other monitoring purposes. Country consultations to assess the utility and feasibility of the proposed indicators and their adaptation to local contexts will support their refinement and uptake.

Registration

https://osf.io/msxbd (Open Science Framework).

A critical review: developing a birth integrity framework for epidemiological studies through meta-ethnography

Over the past decade, there has been growing evidence that women worldwide experience sub-standard care during facility-based childbirth. With this critical review, we synthesize concepts and measurement approaches used to assess maternity care conditions and provision, birth experiences and perceptions in epidemiological, quantitative research studies (e.g., obstetric violence, maternal satisfaction, disrespect or mistreatment during childbirth, person-centered care), aiming to propose an umbrella concept and framework under which the existing and future research strands can be situated. On the 82 studies included, we conduct a meta-ethnography (ME) using reciprocal translation, in-line argumentation, and higher-level synthesis to propose the birth integrity multilevel framework. We perform ME steps for the conceptual level and the measurement level. At the conceptual level, we organize the studies according to the similarity of approaches into clusters and derive key concepts (definitions). Then, we 'translate' the clusters into one another by elaborating each approach's specific angle and pointing out the affinities and differences between the clusters. Finally, we present an in-line argumentation that prepares ground for the synthesis. At the measurement level, we identify themes from items through content analysis, then organize themes into 14 categories and subthemes. Finally, we synthesize our result to the six-field, macro-to-micro level birth integrity framework that helps to analytically distinguish between the interwoven contributing factors that influence the birth situation as such and the integrity of those giving birth. The framework can guide survey development, interviews, or interventional studies.

Validating indicators for monitoring availability and geographic distribution of emergency obstetric and newborn care (EmoNC) facilities: A study triangulating health system, facility, and geospatial data

Availability of emergency obstetric and newborn care (EmONC) is a strong supply side measure of essential health system capacity that is closely and causally linked to maternal mortality reduction and fundamentally to achieving universal health coverage. The World Health Organization's indicator "Availability of EmONC facilities" was prioritized as a core indicator to prevent maternal death. The indicator focuses on whether there are sufficient emergency care facilities to meet the population need, but not all facilities designated as providing EmONC function as such. This study seeks to validate "Availability of EmONC" by comparing the value of the indicator after accounting for key aspects of facility functionality and an alternative measure of geographic distribution. This study takes place in four subnational geographic areas in Argentina, Ghana, and India using a census of all birthing facilities. Performance of EmONC in the 90 days prior to data collection was assessed by examining facility records. Data were collected on facility operating hours, staffing, and availability of essential medications. Population estimates were generated using ArcGIS software using WorldPop to estimate the total population, and the number of women of reproductive age (WRA), pregnancies and births in the study areas. In addition, we estimated the population within two-hours travel time of an EmONC facility by incorporating data on terrain from Open Street Map. Using these data sources, we calculated and compared the value of the indicator after incorporating data on facility performance and functionality while varying the reference population used. Further, we compared its value to the proportion of the population within two-hours travel time of an EmONC facility. Included in our study were 34 birthing facilities in Argentina, 51 in Ghana, and 282 in India. Facility performance of basic EmONC (BEmONC) and comprehensive EmONC (CEmONC) signal functions varied considerably. One facility (4.8%) in Ghana and no facility in India designated as BEmONC had performed all seven BEmONC signal functions. In Argentina, three (8.8%) CEmONC-designated facilities performed all nine CEmONC signal functions, all located in Buenos Aires Region V. Four CEmONC-designated facilities in Ghana (57.1%) and the three CEmONC-designated facilities in India (23.1%) evidenced full CEmONC performance. No sub-national study area in Argentina or India reached the target of 5 BEmONC-level facilities per 20,000 births after incorporating facility functionality yet 100% did in Argentina and 50% did in India when considering only facility designation. Demographic differences also accounted for important variation in the indicator's value. In Ghana, the total population in Tolon within 2 hours travel time of a designated EmONC facility was estimated at 99.6%; however, only 91.1% of women of reproductive age were within 2 hours travel time. Comparing the value of the indicator when calculated using different definitions reveals important inconsistencies, resulting in conflicting information about whether the threshold for sufficient coverage is met. This raises important questions related to the indicator's validity. To provide a valid measure of effective coverage of EmONC, the construct for measurement should extend beyond the most narrow definition of availability and account for functionality and geographic accessibility.

Developing and testing a protocol using a common data model for federated collection and analysis of national perinatal health indicators in Europe

Context: International comparisons of the health of mothers and babies provide essential benchmarks for guiding health practice and policy, but statistics are not routinely compiled in a comparable way. These data are especially critical during health emergencies, such as the coronavirus disease (COVID-19) pandemic. The Population Health Information Research Infrastructure (PHIRI) project aimed to promote the exchange of population data in Europe and included a Use Case on perinatal health. Objective: To develop and test a protocol for federated analysis of population birth data in Europe. Methods: The Euro-Peristat network with participants from 31 countries developed a Common Data Model (CDM) and R scripts to exchange and analyse aggregated data on perinatal indicators. Building on recommended Euro-Peristat indicators, complemented by a three-round consensus process, the network specified variables for a CDM and common outputs. The protocol was tested using routine birth data for 2015 to 2020; a survey was conducted assessing data provider experiences and opinions. Results: The CDM included 17 core data items for the testing phase and 18 for a future expanded phase. 28 countries and the four UK nations created individual person-level databases and ran R scripts to produce anonymous aggregate tables. Seven had all core items, 17 had 13-16, while eight had ≤12. Limitations were not having all items in the same database, required for this protocol. Infant death and mode of birth were most frequently missing. Countries took from under a day to several weeks to set up the CDM, after which the protocol was easy and quick to use. Conclusion: This open-source protocol enables rapid production and analysis of perinatal indicators and constitutes a roadmap for a sustainable European information system. It also provides minimum standards for improving national data systems and can be used in other countries to facilitate comparison of perinatal indicators.

Assessing the neonatal health policy landscape in low- and middle-income countries: Findings from the 2018 WHO SRMNCAH policy survey

Background

We aimed to describe the availability of newborn health policies across the continuum of care in low- and middle-income countries (LMICs) and to assess the relationship between the availability of newborn health policies and their achievement of global Sustainable Development Goal and Every Newborn Action Plan (ENAP) neonatal mortality and stillbirth rate targets in 2019.

Methods

We used data from World Health Organization's 2018-2019 sexual, reproductive, maternal, newborn, child and adolescent health (SRMNCAH) Policy Survey and extracted key newborn health service delivery and cross-cutting health systems policies that align with the WHO health system building blocks. We constructed composite measures to represent packages of newborn health policies for five components along the continuum of care: antenatal care (ANC), childbirth, postnatal care (PNC), essential newborn care (ENC), and management of small and sick newborns (SSNB). We used descriptive analyses to present the differences in the availability of newborn health service delivery policies by World Bank income group in 113 LMICs. We employed logistic regression analysis to assess the relationship between the availability of each composite newborn health policy package and achievement of global neonatal mortality and stillbirth rate targets by 2019.

Results

In 2018, most LMICs had existing policies regarding newborn health across the continuum of care. However, policy specifications varied widely. While the availability of the ANC, childbirth, PNC, and ENC policy packages was not associated with having achieved global NMR targets by 2019, LMICs with existing policy packages on the management of SSNB were 4.4 times more likely to have reached the global NMR target (adjusted odds ratio (aOR) = 4.40; 95% confidence interval (CI) = 1.09-17.79) after controlling for income group and supporting health systems policies.

Conclusions

Given the current trajectory of neonatal mortality in LMICs, there is a dire need for supportive health systems and policy environments for newborn health across the continuum of care. Adoption and implementation of evidence-informed newborn health policies will be a crucial step in putting LMICs on track to meet global newborn and stillbirth targets by 2030.

Measures to assess quality of postnatal care: A scoping review

High quality postnatal care is key for the health and wellbeing of women after childbirth and their newborns. In 2022, the World Health Organization (WHO) published global recommendations on maternal and newborn care for a positive postnatal care experience in a new WHO PNC guideline. Evidence regarding appropriate measures to monitor implementation of postnatal care (PNC) according to the WHO PNC guideline is lacking. This scoping review aims to document the measures used to assess the quality of postnatal care and their validity. The review was conducted according to the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR). Five electronic bibliographic databases were searched together with a grey literature search. Two reviewers independently screened and appraised identified articles. All data on PNC measures were extracted and mapped to the 2022 WHO PNC recommendations according to three categories: i) maternal care, ii) newborn care, iii) health system and health promotion interventions. We identified 62 studies providing measures aligning with the WHO PNC recommendations. For most PNC recommendations there were measures available and the highest number of recommendations were found for breastfeeding and the assessment of the newborn. No measures were found for recommendations related to sedentary behavior, criteria to be assessed before discharge, retention of staff in rural areas and use of digital communication. Measure validity assessment was described in 24 studies (39%), but methods were not standardized. Our review highlights a gap in existing PNC measures for several recommendations in the WHO PNC guideline. Assessment of the validity of PNC measures was limited. Consensus on how the quality of PNC should be measured is needed, involving a selection of priority measures and the development of new measures as appropriate.

Continuum of maternal and newborn health in Sierra Leone: a 2019 national survey

Introduction

Globally, Sierra Leone has some of the worst maternal and child health indicators. The situation is worsened by a dearth of evidence about the level of continuum of care, an evidence-based intervention aimed at reducing maternal and perinatal morbidity and mortality. Hence this study aimed to assess the level of and factors associated with continuum of maternal and newborn care in Sierra Leone.

Method

This study analyzed secondary data from the 2019 Sierra Leone Demographic Health Survey. Analysis was restricted to women who had a live birth in the 5 years preceding the survey (n = 7326). Complete continuum of care was considered when a woman reported having had at least eight antenatal care contacts, skilled birth attendance and mother and baby had at least one postnatal check-up. Bi-variable and multivariable logistic regression were performed using the statistical package for the social sciences software version 25.

Results

Only 17.9% (95% CI: 17.4–19.1) of the women utilized complete continuum of care for maternal and newborn health services in Sierra Leone. About 22% (95% CI: 21.3–23.1) utilized 8 or more antenatal care contacts, 88% (95% CI: 87.9–89.4) had skilled birth attendance while 90.7% (95% CI: 90.2–91.5) and 90.4% (95% CI: 89.9–91.2) of mothers and neonates utilized postnatal care respectively. Having started antenatal care within the first trimester (aOR 1.71, 95% CI: 1.46–2.00), being resident in the Southern region (aOR 1.85, 95% CI: 1.23–2.80), belonging to richer wealth quintile (aOR 1.76, 95% CI: 1.27–2.44), using internet (aOR 1.49, 95% CI: 1.12–1.98) and having no big problems seeking permission to access healthcare (aOR 1.34, 95% CI: 1.06–1.69) were significantly associated with utilization of continuum of care.

Conclusion

The overall completion of continuum of maternal care is low, with ANC being the lowest utilized component of continuum of care. These findings call for urgent attention for maternal health stakeholders to develop and implement tailored interventions prioritizing women empowerment, access to affordable internet services, timely initiation of ANC contacts, women in developed regions such as the Western and those from poor households.

Measuring and monitoring child health and wellbeing: recommendations for tracking progress with a core set of indicators in the Sustainable Development Goals era

Although great improvements in child survival were achieved in the past two decades, progress has been uneven within and across countries, and the COVID-19 pandemic threatens to reverse previous advances. Demographic and epidemiological transitions around the world have resulted in shifts in the causes and distribution of child death and diseases, and many children are living with short-term and long-term chronic illnesses and disabilities. These changes, plus global threats such as pandemics, transnational and national security issues, and climate change, mean that regular monitoring of child health and wellbeing is essential if we are to achieve the Sustainable Development Goals. This Health Policy describes the three-phased process undertaken by the Child Health Accountability Tracking technical advisory group (CHAT) to develop a core set of indicators on child health and wellbeing for global monitoring purposes, and presents CHAT's research recommendations to address data gaps. CHAT reached consensus on 20 core indicators specific to the health sector, which include 11 impact-level indicators and nine outcome-level indicators that cover the topics of: acute conditions and prevention; health promotion and child development; and chronic conditions, disabilities, injuries, and violence against children. An additional six indicators (three impact and three outcome) that capture information on child health issues such as malaria and HIV are recommended; however, these indicators are only relevant to high-burden regions. CHAT's four research priorities will require investments in health information systems and measurement activities. These investments will help to increase data on children aged 5-9 years; develop standard metadata and data collection processes to enable cross-country comparisons and progress assessments over time; reach a global consensus on essential interventions and associated indicators for monitoring emerging priority areas such as child development, chronic conditions, disabilities, and injuries; and implement strategies to increase the uptake of data on child health to improve evidence-based planning, programming, and advocacy efforts.

Multisite, mixed methods study to validate 10 maternal health system and policy indicators in Argentina, Ghana and India: a research protocol

INTRODUCTION

Most efforts to assess maternal health indicator validity focus on measures of service coverage. Fewer measures focus on the upstream enabling environment, and such measures are typically not research validated. Thus, methods for validating system and policy-level indicators are not well described. This protocol describes original multicountry research to be conducted in Argentina, Ghana and India, to validate 10 indicators from the monitoring framework for the 'Strategies toward Ending Preventable Maternal Mortality' (EPMM). The overall aim is to improve capacity to drive and track progress towards achieving the priority recommendations in the EPMM strategies. This work is expected to contribute new knowledge on validation methodology and reveal important information about the indicators under study and the phenomena they target for monitoring. Validating the indicators in three diverse settings will explore the external validity of results.

METHODS AND ANALYSIS

This observational study explores the validity of 10 indicators from the EPMM monitoring framework via seven discrete validation exercises that will use mixed methods: (1) cross-sectional review of policy data, (2) retrospective review of facility-level patient and administrative data and (3) collection of primary quantitative and qualitative cross-sectional data from health service providers and clients. There is a specific methodological approach and analytic plan for each indicator, directed by unique, relevant validation research questions.

ETHICS AND DISSEMINATION

The protocol was approved by the Office of Human Research Administration at Harvard University in November 2019. Individual study sites received approval via local institutional review boards by January 2020 except La Pampa, Argentina, approved June 2020. Our dissemination plan enables unrestricted access and reuse of all published research, including data sets. We expect to publish at least one peer-reviewed publication per validation exercise. We will disseminate results at conferences and engage local stakeholders in dissemination activities in each study country.

A rapid systematic review and evidence synthesis of effective coverage measures and cascades for childbirth, newborn and child health in low- and middle-income countries

BACKGROUND

Effective coverage measures aim to estimate the proportion of a population in need of a service that received a positive health outcome. In 2020, the Effective Coverage Think Tank Group recommended using a 'coverage cascade' for maternal, newborn, child and adolescent health and nutrition (MNCAHN), which organises components of effective coverage in a stepwise fashion, with each step accounting for different aspects of quality of care (QoC), applied at the population level. The cascade outlines six steps that increase the likelihood that the population in need experience the intended health benefit: 1) the population in need (target population) who contact a health service; 2) that has the inputs available to deliver the service; 3) who receive the health service; 4) according to quality standards; 5) and adhere to prescribed medication(s) or health workers instructions; and 6) experience the expected health outcome. We examined how effective coverage of life-saving interventions from childbirth to children aged nine has been defined and assessed which steps of the cascade are captured by existing measures.

METHODS

We undertook a rapid systematic review. Seven scientific literature databases were searched covering the period from May 1, 2017 to July, 8 2021. Reference lists from reviews published in 2018 and 2019 were examined to identify studies published prior to May 2017. Eligible studies reported population-level contact coverage measures adjusted for at least one dimension of QoC.

RESULTS

Based on these two search approaches this review includes literature published from 2010 to 2021. From 16 662 records reviewed, 33 studies were included, reporting 64 effective coverage measures. The most frequently examined measures were for childbirth and immediate newborn care (n = 24). No studies examined measures among children aged five to nine years. Definitions of effective coverage varied across studies. Key sources of variability included (i) whether a single effective coverage measure was reported for a package of interventions or separate measures were calculated for each intervention; (ii) the number and type of coverage cascade steps applied to adjust for QoC; and (iii) the individual items included in the effective coverage definition and the methods used to generate a composite quality measure.

CONCLUSION

In the MNCAHN literature there is substantial heterogeneity in both definitions and construction of effective coverage, limiting the comparability of measures over time and place. Current measurement approaches are not closely aligned with the proposed cascade. For widespread adoption, there is a need for greater standardisation of indicator definitions and transparency in reporting, so governments can use these measures to improve investments in MNACHN and implement life-saving health policies and programs.

Prevalence and factors associated with utilisation of postnatal care in Sierra Leone: a 2019 national survey

Background

Within Sub-Saharan Africa, some countries still report unacceptably high rates of maternal and perinatal morbidity and mortality, despite improvements in the utilisation of maternity care services. Postnatal care (PNC) is one of the recommended packages in the continuum of maternity care aimed at reducing maternal and neonatal mortality. This study aimed to determine the prevalence and factors associated with PNC utilisation in Sierra Leone.

Methods

We used Sierra Leone Demographic and Health Survey (UDHS) 2019 data of 7326 women aged 15 to 49 years. We conducted multivariable logistic regression to determine the factors associated with PNC utilisation, using SPSS version 25.

Results

Out of 7326 women, 6625 (90.4, 95% CI: 89.9–91.2) had at least one PNC contact for their newborn, 6646 (90.7, 95% CI: 90.2–91.5) had a postnatal check after childbirth and 6274 (85.6, 95% CI: 85.0–86.6) had PNC for both their babies and themselves. Delivery by caesarean section (aOR 8.01, 95% CI: 3.37–19.07), having a visit by a health field worker (aOR 1.80, 95% CI: 1.46–2.20), having had eight or more ANC contacts (aOR 1.37, 95% CI: 1.08–1.73), having tertiary education (aOR 2.71, 95% CI: 1.32–5.56) and having no big problems seeking permission to access healthcare (aOR 1.51, 95% CI: 1.19–1.90) were associated with higher odds of PNC utilisation. On the other hand, being resident in the Northern (aOR 0.48, 95% CI: 0.29–0.78) and Northwestern regions (aOR 0.54, 95% CI: 0.36–0.80), belonging to a female headed household (aOR 0.69, 95% CI: 0.56–0.85) and being a working woman (aOR 0.66, 95% CI: 0.52–0.84) were associated with lower odds of utilizing PNC.

Conclusion

Factors associated with utilisation of PNC services operate at individual, household, community and health system/policy levels. Some of them can be ameliorated by targeted government interventions to improve utilisation of PNC services.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-12494-5.

Measurement tools and indicators for assessing nurturing care for early childhood development: A scoping review

Nurturing care encompasses five components that are crucial for supporting early childhood development: good health, adequate nutrition, opportunities for early learning, responsive caregiving, and safety and security. While there has been increasing attention in global public health towards designing and delivering programs, services, and policies to promote nurturing care, measurement has focused more on the components of health and nutrition, with less attention to early learning, responsive caregiving, and safety and security. We conducted a scoping review to identify articles that measured at least one nurturing care outcome in a sample of caregivers and/or children under-5 years of age in low- and middle-income countries (LMICs). We systematically searched five electronic bibliographic databases for peer-reviewed articles published from database inception until November 30, 2020. We first classified outcomes to their respective nurturing care component, and then applied an inductive approach to organize key constructs within each nurturing care component and the specific measures and indicators used across studies. We identified 239 total articles representing more than 50 LMICs for inclusion in the review. The majority of included studies reported a measure of nutrition (N = 166), early learning (N = 140), and health (N = 102), followed by responsive caregiving (N = 78) and lastly safety and security (N = 45). For each nurturing care component, we uncovered multiple constructs relevant to children under-5: nutrition (e.g., anthropometry, complementary feeding), early learning (e.g., stimulation practices, early childhood education), health (e.g., birth outcomes, morbidity), responsive caregiving (e.g., parental responsivity, parent-child interactions), and safety and security (e.g., discipline, inadequate supervision). Particularly for outcomes of early learning and responsive caregiving, there was greater variability with regards to the measures used, reported indicators, and analytic construction of variables than the other three nurturing care components. This study provides a comprehensive review of the current state of measurement of nurturing care. Additional research is needed in order to establish the most optimal measures and indicators for assessing nurturing care, especially for early learning and responsive caregiving.

Monitoring the Dutch Solid Start Program: Developing an Indicator Set for Municipalities to Monitor their First Thousand Days-Approach

INTRODUCTION

The Dutch Solid Start program aims to improve the collaboration between the medical and social sector to offer every child the best start in life. Municipalities form local coalitions of partners within the medical and social sector to support parents and children during the first thousand days. The aim of this study was to develop an indicator set for coalitions to monitor their local Solid Start program.

METHODS

A modified Delphi study with three rounds was carried out among Dutch experts in Solid Start practice, policy and research (n = 39) to reach consensus.

RESULTS

The indicator set included 19 indicators covering the three phases of the Solid Start program: preconception, pregnancy and after birth (up to two years). Prioritized indicators included both social and medical topics, among which poverty, psychological/psychiatric problems, stress, smoking, cumulation of risk factors, preconception care, low literacy, premature birth, and intellectual disability. Additionally, a development agenda was established with topics and indicators that lacked data or clear operationalization (e.g. stress, unintended pregnancy, loneliness).

DISCUSSION AND CONCLUSION

The developed indicator set enhances the conversation between policymakers, managers, professionals and other stakeholders about the local situation and developments in order to prioritize interventions and policies. Next, the indicator set needs evaluation to assess its usefulness.

Towards a harmonised framework for developing quality of care indicators for global health: a scoping review of existing conceptual and methodological practices

OBJECTIVES

Despite significant advances in the science of quality of care measurement over the last decade, approaches to developing quality of care indicators for global health priorities are not clearly defined. We conducted a scoping review of concepts and methods used to develop quality of healthcare indicators to better inform ongoing efforts towards a more harmonised approach to quality of care indicator development in global health.

METHODS

We conducted a systematic search of electronic databases, grey literature and references for articles on developing quality of care indicators for routine monitoring in all healthcare settings and populations, published in English between 2010 and 2020. We used well-established methods for article screening and selection, data extraction and management. Results were summarised using a descriptive analysis and a narrative synthesis.

RESULTS

The 221 selected articles were largely from high-income settings (89%), particularly the USA (46%), Canada (9%), UK (9%) and Europe (17%). Quality of care indicators were developed mainly for healthcare providers (56%), for benchmarking or quality assurance (37%) and quality improvement (29%), in hospitals (32%) and primary care (26%), across many diseases. The terms 'quality indicator' and 'quality measure' were the most frequently encountered terms (50% and 21%, respectively). Systematic approaches for quality of care indicator development emerged within national quality of care systems or through cross-country collaborations in high-income settings. Maternal, neonatal and child health (33%), mental health (26%) and primary care (57%) studies applied most components of systematic approaches, but not consistently or rigorously.

DISCUSSION

The current evidence shows variations in concepts and approaches to developing quality of care indicators, with development and application mainly in high-income countries.

CONCLUSION

Additional efforts are needed to propose 'best-practice' conceptual frameworks and methods for developing quality of care indicators to improve their utility in global health measurement.

Operationalising effective coverage measurement of facility based childbirth in Gombe State; a comparison of data sources

Estimating effective coverage of childbirth care requires linking population based data sources to health facility data. For effective coverage to gain widespread adoption there is a need to focus on the feasibility of constructing these measures using data typically available to decision makers in low resource settings. We estimated effective coverage of childbirth care in Gombe State, northeast Nigeria, using two different combinations of facility data sources and examined their strengths and limitations for decision makers. Effective coverage captures information on four steps: access, facility inputs, receipt of interventions and process quality. We linked data from the 2018 Nigerian Demographic and Health Survey (NDHS) to two sources of health facility data: (1) comprehensive health facility survey data generated by a research project; and (2) District Health Information Software 2 (DHIS2). For each combination of data sources, we examined which steps were feasible to calculate, the size of the drop in coverage between steps and the resulting estimate of effective coverage. Analysis included 822 women with a recent live birth, 30% of whom attended a facility for childbirth. Effective coverage was low: 2% based on the project data and less than 1% using the DHIS2. Linking project data with NDHS, it was feasible to measure all four steps; using DHIS2 it was possible to estimate three steps: no data was available to measure process quality. The provision of high quality care is suboptimal in this high mortality setting where access and facility readiness to provide care, crucial foundations to the provision of high quality of care, have not yet been met. This study demonstrates that partial effective coverage measures can be constructed from routine data combined with nationally representative surveys. Advocacy to include process of care indicators in facility summary reports could optimise this data source for decision making.

The prioritization and development of key social and structural indicators to address gaps in a framework for monitoring the Strategies toward Ending Preventable Maternal Mortality (EPMM): Results of an iterative expert technical consultation

Background

Since 2014, iterative technical work has captured stakeholder demand and channeled it toward improving maternal health measurement, to support SDG 3.1. Strategies toward Ending Preventable Maternal Mortality (EPMM) (2015) turned a broad lens on upstream systemic determinants of maternal health and survival highlighted in 11 Key Themes. A monitoring framework was developed to help countries track progress across these domains. This process yielded requests for additional indicators where stakeholders identified gaps for tracking EPMM Key Themes. In response, two technical consultations aimed at affirming the measurement gaps, specifying the constructs for measurement, and fully elaborating the metadata to allow them to be monitored.

Methods

Measures for development were prioritized based on multi-stakeholder dialogues in five countries, and data collected from government officials and UN partners in twenty countries on perceived need for proposed additional indicators. Sixty-one participants representing expertise in measure development and the topical areas covered took part across both consultations. Measures were developed through two simultaneous participatory online consultations stratified by focus area, comprising videos, discussion forums, polls, and live Zoom meetings.

Results

Eight candidate indicators relevant to priority recommendations in the EPMM Strategies are presented. Each includes a definition, numerator and denominator (if applicable), method of estimation, disaggregation factors, preferred data source(s), and expected periodicity. Four address gaps in measures of fundamental rights-related determinants of maternal health at national and subnational level, including women's reproductive autonomy; participative accountability for maternal health outcomes; and Respectful Maternity Care. Four strengthen the ability to count, track, and link births and maternal deaths and causes of death.

Conclusions

The proposed indicators correspond to specific EPMM Key Themes, filling gaps identified by multiple stakeholders, and respond to calls for a broadened approach to measurement and for indicators that track the social and health-systems determinants of maternal health. They reflect inputs and aspirations of numerous stakeholders, gathered over time and across various platforms. The iterative, discursive exploration of the concepts for measurement and the need for metrics to track them responds to recent calls for measure development to be carried out in more inclusive ways, and to be primarily concept- and user-driven.

A Scoping Review of Adolescent Health Indicators

PURPOSE

A host of recent initiatives relating to adolescent health have been accompanied by varying indicator recommendations, with little stakeholder coordination. We assessed currently included adolescent health-related indicators for their measurement focus, identified overlap across initiatives, and determined measurement gaps.

METHODS

We conducted a scoping review to map the existing indicator landscape as depicted by major measurement initiatives. We classified indicators as per 33 previously identified core adolescent health measurement areas across five domains and by age groups. We also identified indicators common across measurement initiatives even if differing in details.

RESULTS

We identified 413 indicators across 16 measurement initiatives, with most measuring health outcomes and conditions (162 [39%]) and health behaviors and risks (136 [33%]); followed by policies, programs, and laws (49 [12%]); health determinants (44 [11%]); and system performance and interventions (22 [5%]). Age specification was available for 221 (54%) indicators, with 51 (23%) focusing on the full adolescent age range (10-19 years), 1 (<1%) on 10-14 years, 27 (12%) on 15-19 years, and 142 (64%) on a broader age range including adolescents. No definitional information, such as numerator and denominator, was available for 138 indicators. We identified 236 distinct indicators after accounting for overlap.

CONCLUSION

The adolescent health measurement landscape is vast and includes substantial variation among indicators purportedly assessing the same concept. Gaps persist in measuring systems performance and interventions; policies, programs, and laws; and younger adolescents' health. Addressing these gaps and harmonizing measurement is fundamental to improve program implementation and accountability for adolescent health globally.

Barriers and enablers to routine register data collection for newborns and mothers: EN-BIRTH multi-country validation study

BACKGROUND

Policymakers need regular high-quality coverage data on care around the time of birth to accelerate progress for ending preventable maternal and newborn deaths and stillbirths. With increasing facility births, routine Health Management Information System (HMIS) data have potential to track coverage. Identifying barriers and enablers faced by frontline health workers recording HMIS source data in registers is important to improve data for use.

METHODS

The EN-BIRTH study was a mixed-methods observational study in five hospitals in Bangladesh, Nepal and Tanzania to assess measurement validity for selected Every Newborn coverage indicators. We described data elements required in labour ward registers to track these indicators. To evaluate barriers and enablers for correct recording of data in registers, we designed three interview tools: a) semi-structured in-depth interview (IDI) guide b) semi-structured focus group discussion (FGD) guide, and c) checklist assessing care-to-documentation. We interviewed two groups of respondents (January 2018-March 2019): hospital nurse-midwives and doctors who fill ward registers after birth (n = 40 IDI and n = 5 FGD); and data collectors (n = 65). Qualitative data were analysed thematically by categorising pre-identified codes. Common emerging themes of barriers or enablers across all five hospitals were identified relating to three conceptual framework categories.

RESULTS

Similar themes emerged as both barriers and enablers. First, register design was recognised as crucial, yet perceived as complex, and not always standardised for necessary data elements. Second, register filling was performed by over-stretched nurse-midwives with variable training, limited supervision, and availability of logistical resources. Documentation complexity across parallel documents was time-consuming and delayed because of low staff numbers. Complete data were valued more than correct data. Third, use of register data included clinical handover and monthly reporting, but little feedback was given from data users.

CONCLUSION

Health workers invest major time recording register data for maternal and newborn core health indicators. Improving data quality requires standardised register designs streamlined to capture only necessary data elements. Consistent implementation processes are also needed. Two-way feedback between HMIS levels is critical to improve performance and accurately track progress towards agreed health goals.

Uterotonics for prevention of postpartum haemorrhage: EN-BIRTH multi-country validation study

BACKGROUND

Postpartum haemorrhage (PPH) is a leading cause of preventable maternal mortality worldwide. The World Health Organization (WHO) recommends uterotonic administration for every woman after birth to prevent PPH. There are no standardised data collected in large-scale measurement platforms. The Every Newborn Birth Indicators Research Tracking in Hospitals (EN-BIRTH) is an observational study to assess the validity of measurement of maternal and newborn indicators, and this paper reports findings regarding measurement of coverage and quality for uterotonics.

METHODS

The EN-BIRTH study took place in five hospitals in Bangladesh, Nepal and Tanzania, from July 2017 to July 2018. Clinical observers collected tablet-based, time-stamped data. We compared observation data for uterotonics to routine hospital register-records and women's report at exit-interview survey. We analysed the coverage and quality gap for timing and dose of administration. The register design was evaluated against gap analyses and qualitative interview data assessing the barriers and enablers to data recording and use.

RESULTS

Observed uterotonic coverage was high in all five hospitals (> 99%, 95% CI 98.7-99.8%). Survey-report underestimated coverage (79.5 to 91.7%). "Don't know" replies varied (2.1 to 14.4%) and were higher after caesarean (3.7 to 59.3%). Overall, there was low accuracy in survey data for details of uterotonic administration (type and timing). Register-recorded coverage varied in four hospitals capturing uterotonics in a specific column (21.6, 64.5, 97.6, 99.4%). The average coverage measurement gap was 18.1% for register-recorded and 6.0% for survey-reported coverage. Uterotonics were given to 15.9% of women within the "right time" (1 min) and 69.8% within 3 min. Women's report of knowing the purpose of uterotonics after birth ranged from 0.4 to 64.9% between hospitals. Enabling register design and adequate staffing were reported to improve routine recording.

CONCLUSIONS

Routine registers have potential to track uterotonic coverage - register data were highly accurate in two EN-BIRTH hospitals, compared to consistently underestimated coverage by survey-report. Although uterotonic coverage was high, there were gaps in observed quality for timing and dose. Standardisation of register design and implementation could improve data quality and data flow from registers into health management information reporting systems, and requires further assessment.

Translating international guidelines for use in routine maternal and neonatal healthcare quality measurement

BACKGROUND

Improving facility-based quality for maternal and neonatal care is the key to reducing morbidity and mortality rates in low- and middle-income countries. Recent guidance from WHO and others has produced a large number of indicators to choose from to track quality.

OBJECTIVE

To explore how to translate complex global maternal and neonatal health standards into actionable application at the facility level.

METHODS

We applied a two-step process as an example of how the 352 indicators in WHO's 2016 Standards for Improving Quality of Maternal and Newborn Care in Health Facilities might be reduced to only those with the strongest evidence base, associated with outcomes, and actionable by facility managers. We applied Hill criteria and assessed whether indicators were within the control of facility managers. We next conducted a rapid review of supporting literature and applied GRADE analysis, retaining those with scores of 'moderate' or 'high'. To understand the utility and barriers to measuring this limited set of indicators in practice, we undertook a case study of hypothetical measurement application in two districts in Bangladesh, interviewing 25 clinicians, managers, and other stakeholders.

RESULTS

From the initial 352 indicators, 56 were retained. The 56 indicators were used as a base for interviews. Respondents emphasized the practical challenges to the use of complex guides and the need for parsimonious and actionable sets of quality indicators.

CONCLUSIONS

This work offers one way to move towards a reduced quality indicator set, beginning from current WHO guidance. Despite study limitations, this work provides evidence of the need for reduced and evidence-based sets of quality indicators if guides are to be used to improve quality in practice. We hope that future research will build on and refine our efforts. Measuring quality effectively so that evidence guides and improves practice is the first step to assuring safe maternal and neonatal care.

Defining, conceptualizing, and measuring perceived maternal care quality in low- to high-income countries: a scoping review protocol

BACKGROUND

Health practitioners and researchers must be able to measure and assess maternal care quality in facilities to monitor, intervene, and reduce global maternal mortality rates. On the global scale, there is a general lack of consensus on how maternal care quality is defined, conceptualized, and measured. Much of the literature addressing this problem has focused primarily on defining, conceptualizing, and measuring clinical indicators of maternal care quality. Less attention has been given in this regard to perceived maternal care quality among women which is known to influence care utilization and adherence. Therefore, there is a need to map the literature focused on defining, conceptualizing, and measuring perceived maternal care quality across low-, middle-, and high-income country contexts.

METHODS

This scoping review protocol will follow the Arksey and O'Malley methodological framework. A comprehensive search strategy will be used to search for articles published from inception to 2020 in Ovid MEDLINE, Embase, AMED, and WHO Global Index Medicus. Gray literature will be included. Two independent reviewers will screen articles by title and abstract, then by full-text based on pre-determined inclusion/exclusion criteria. A third reviewer will arbitrate any discrepancies. This protocol outlines a four-step analytic approach that includes numerical, graphical, tabular, and narrative summaries to provide a comprehensive description of the body of literature.

DISCUSSION

The findings from this scoping review will provide a comprehensive overview of the existing evidence on perceived maternal care quality. The findings are expected to inform future work on building consensus around the definition and conceptualization of perceived maternal care quality, and lay the groundwork for future research aimed at developing measures of perceived maternal care quality that can be applied across country contexts. Consequently, this review may aid in facilitating coordinated efforts to measure and improve maternal care quality across diverse country contexts (i.e., low-, middle-, and high-income country contexts).

REVIEW REGISTRATION

This scoping review has been registered in the Open Science Framework (osf.io/k8nqh).

Provision of essential evidence-based interventions during facility-based childbirth: cross-sectional observations of births in northeast Nigeria

OBJECTIVES

To measure the provision of evidence-based preventive and promotive interventions to women, and subsequently their newborns, during childbirth in a high-mortality setting.

DESIGN AND PARTICIPANTS

Cross-sectional observations of care provided to women, and their newborns during the intrapartum and immediate postpartum period using a standardised checklist capturing healthcare worker behaviours regarding lifesaving and respectful care.

SETTING

Ten primary healthcare facilities in Gombe state, northeast Nigeria. The northeast region of Nigeria has some of the highest maternal and newborn death rates globally.

MAIN OUTCOME MEASURES

Data on 50 measures of internationally recommended evidence-based interventions and good practice.

RESULTS

1875 women were admitted to a health facility during the observation period; of these, 1804 gave birth in the facility and did not experience an adverse event or death. Many clinical interventions around the time of birth were routinely implemented, including provision of uterotonic (96% (95% CI 93% to 98%)), whereas risk-assessment measures, such as history-taking or checking vital signs were rarely completed: just 2% (95% CI 2% to 7%) of women had their temperature taken and 12% (95% CI 9% to 16%) were asked about complications during the pregnancy.

CONCLUSIONS

The majority of women did not receive the recommended routine processes of childbirth care they and their newborns needed to benefit from their choice to deliver in a health facility. In particular, few benefited from even basic risk assessments, leading to missed opportunities to identify risks. To continue with the recommendation of childbirth care in primary healthcare facilities in high mortality settings like Gombe, it is crucial that birth attendant capacity, capability and prioritisation processes are addressed.

Can conditional cash transfers improve maternal health care? Evidence from El Salvador's Comunidades Solidarias Rurales program

There is growing evidence on positive human capital impacts of large, poverty-focused cash transfer programs. However, evidence is inconclusive on whether cash transfer programs affect maternal health outcomes, and if so, through which pathways. We use a regression discontinuity design with an implicit threshold to evaluate the impact of Comunidades Solidarias Rurales in El Salvador on four maternal health service utilization outcomes: (a) prenatal care; (b) skilled attendance at birth; (c) birth in health facilities; and (d) postnatal care. We find robust impacts on outcomes at the time of birth but not on prenatal and postnatal care. In addition to income effects, supply-side health service improvements and gains in women's agency may have played a role in realizing these gains. With growing inequalities in maternal health outcomes globally, results contribute to an understanding of how financial incentives can address health systems and financial barriers that prevent poor women from seeking and receiving care at critical periods for both maternal and infant health.

What is meant by validity in maternal and newborn health measurement? A conceptual framework for understanding indicator validation

BACKGROUND

Rigorous monitoring supports progress in achieving maternal and newborn mortality and morbidity reductions. Recent work to strengthen measurement for maternal and newborn health highlights the existence of a large number of indicators being used for this purpose. The definitions and data sources used to produce indicator estimates vary and challenges exist with completeness, accuracy, transparency, and timeliness of data. The objective of this study is to create a conceptual overview of how indicator validity is defined and understood by those who develop and use maternal and newborn health indicators.

METHODS

A conceptual framework of validity was developed using mixed methods. We were guided by principles for conceptual frameworks and by a review of the literature and key maternal and newborn health indicator guidance documents. We also conducted qualitative semi-structured interviews with 32 key informants chosen through purposive sampling.

RESULTS

We categorised indicator validity into three main types: criterion, convergent, and construct. Criterion or diagnostic validity, comparing a measure with a gold standard, has predominantly been used to assess indicators of care coverage and content. Studies assessing convergent validity quantify the extent to which two or more indicator measurement approaches, none of which is a gold-standard, relate. Key informants considered construct validity, or the accuracy of the operationalisation of a concept or phenomenon, a critical part of the overall assessment of indicator validity.

CONCLUSION

Given concerns about the large number of maternal and newborn health indicators currently in use, a more consistent understanding of validity can help guide prioritization of key indicators and inform development of new indicators. All three types of validity are relevant for evaluating the performance of maternal and newborn health indicators. We highlight the need to establish a common language and understanding of indicator validity among the various global and local stakeholders working within maternal and newborn health.

Validating women’s reports of antenatal and postnatal care received in Bangladesh, Cambodia and Kenya

Background

Global indicators for monitoring progress in maternal and newborn health have tended to rely on contact coverage indicators rather than the content of services received. As part of the effort to improve measurement of progress in maternal and newborn health, this study examines how accurately women can report on information and health interventions received during an antenatal or postnatal health consultation at health facilities in Bangladesh, Cambodia and Kenya.

Methods

We conducted secondary analysis of matched observation and client interview data to compare women’s reports of care received at exit interview with observation by a trained third-party observer. We assessed indicator accuracy by calculating sensitivity, specificity, area under the receiver operating characteristic curve (AUC) and inflation factor (IF). Indicators considered to have both high individual accuracy (an AUC value of 0.70 or greater) and low population-level bias (0.75<IF<1.25) were considered to have acceptable validity. In addition, we considered the number of countries where both validation criteria were met.

Results

For indicators of antenatal care, we found 16 of 18 indicators in Bangladesh, 3 of 6 in Cambodia and 3 of 8 in Kenya met both validation criteria. For postnatal care, we found evidence of acceptable validity for 6 of 8 indicators in Bangladesh, 5 of 14 in Cambodia and 3 of 16 in Kenya. In general, we documented higher validity for indicators related to concrete, observable actions, as opposed to information or advice given. Women were more likely to recall care received for themselves, rather than for their newborn.

Conclusions

Women reported accurately on multiple aspects of antenatal and postnatal care. While we describe broad patterns in the types of indicators likely to be recalled with accuracy, differences by setting warrant further investigation. Findings inform efforts to better monitor the coverage and quality of maternal and newborn health interventions.

What the percentage of births in facilities does not measure: readiness for emergency obstetric care and referral in Senegal

Introduction

Increases in facility deliveries in sub-Saharan Africa have not yielded expected declines in maternal mortality, raising concerns about the quality of care provided in facilities. The readiness of facilities at different health system levels to provide both emergency obstetric and newborn care (EmONC) as well as referral is unknown. We describe this combined readiness by facility level and region in Senegal.

Methods

For this cross-sectional study, we used data from nine Demographic and Health Surveys between 1992 and 2017 in Senegal to describe trends in location of births over time. We used data from the 2017 Service Provision Assessment to describe EmONC and emergency referral readiness across facility levels in the public system, where 94% of facility births occur. A national global positioning system facility census was used to map access from lower-level facilities to the nearest facility performing caesareans.

Results

Births in facilities increased from 47% in 1992 to 80% in 2016, driven by births in lower-level health posts, where half of facility births now occur. Caesarean rates in rural areas more than doubled but only to 3.7%, indicating minor improvements in EmONC access. Only 9% of health posts had full readiness for basic EmONC, and 62% had adequate referral readiness (vehicle on-site or telephone and vehicle access elsewhere). Although public facilities accounted for three-quarters of all births in 2016, only 16% of such births occurred in facilities able to provide adequate combined readiness for EmONC and referral.

Conclusions

Our findings imply that many lower-level public facilities—the most common place of birth in Senegal—are unable to treat or refer women with obstetric complications, especially in rural areas. In light of rising lower-level facility births in Senegal and elsewhere, improvements in EmONC and referral readiness are urgently needed to accelerate reductions in maternal and perinatal mortality.

Assessing coverage of interventions for reproductive, maternal, newborn, child, and adolescent health and nutrition

Progress has been made in priority interventions, but we need new measurement systems that include the whole life course and give better assessment of equity of coverage, argue Jennifer Requejo and colleagues

Monitoring childbirth care in primary health facilities: a validity study in Gombe State, northeastern Nigeria

BACKGROUND

Improving the quality of facility-based births is a critical strategy for reducing the high burden of maternal and neonatal mortality and morbidity across all settings. Accurate data on childbirth care is essential for monitoring progress. In northeastern Nigeria, we assessed the validity of childbirth care indicators in a rural primary health care context, as documented by health workers and reported by women at different recall periods.

METHODS

We compared birth observations (gold standard) to: (i) facility exit interviews with observed women; (ii) household follow-up interviews 9-22 months after childbirth; and (iii) health worker documentation in the maternity register. We calculated sensitivity, specificity, and area under the receiver operating curve (AUC) to determine individual-level reporting accuracy. We calculated the inflation factor (IF) to determine population-level validity.

RESULTS

Twenty-five childbirth care indicators were assessed to validate health worker documentation and women's self-reports. During exit interviews, women's recall had high validity (AUC≥0.70 and 0.75

CONCLUSIONS

In addition to standard household surveys, monitoring of facility-based childbirth care should consider drawing from and linking multiple data sources, including routine health facility data and exit interviews with recently delivered women.

Collapse

Key Words Collapse

MESH Headings

• Adolescent
• Adult
• Delivery, Obstetric/standards
• Documentation/methods
• Female
• Humans
• Infant, Newborn
• Medical Records
• Middle Aged
• Nigeria
• Pregnancy
• Primary Health Care
• Reproducibility of Results
• Rural Health Services
• Self Report
• Young Adult

Collapse

Grants Collapse

Affiliation(s)

Antoinette Alas Bhattacharya Department of Disease Control, London School of Hygiene & Tropical Medicine, London, UK
Elizabeth Allen Department of Medical Statistics, London School of Hygiene & Tropical Medicine, London, UK
Nasir Umar Department of Disease Control, London School of Hygiene & Tropical Medicine, London, UK
Adamu Umar Usman Data Research and Mapping Consult, Abuja, Nigeria
Habila Felix State Primary Health Care Development Agency, Gombe, Nigeria
Ahmed Audu State Primary Health Care Development Agency, Gombe, Nigeria
Joanna Rm Schellenberg Department of Disease Control, London School of Hygiene & Tropical Medicine, London, UK
Tanya Marchant Department of Disease Control, London School of Hygiene & Tropical Medicine, London, UK

Collapse

Monitoring maternal and newborn health outcomes globally: a brief history of key events and initiatives

OBJECTIVE

Over time, we have seen a major evolution of measurement initiatives, indicators and methods, such that today a wide range of maternal and perinatal indicators are monitored and new indicators are under development. Monitoring global progress in maternal and newborn health outcomes and development has been dominated in recent decades by efforts to set, measure and achieve global goals and targets: the Millennium Development Goals followed by the Sustainable Development Goals. This paper aims to review, reflect and learn on accelerated progress towards global goals and events, including universal health coverage, and better tracking of maternal and newborn health outcomes.

METHODS

We searched for literature of key events and global initiatives over recent decades related to maternal and newborn health. The searches were conducted using PubMed/MEDLINE and the World Health Organization Global Index Medicus.

RESULTS

This paper describes global key events and initiatives over recent decades showing how maternal and neonatal mortality and morbidity, and stillbirths, have been viewed, when they have achieved higher priority on the global agenda, and how they have been measured, monitored and reported. Despite substantial improvements, the enormous maternal and newborn health disparities that persist within and between countries indicate the urgent need to renew the focus on reducing inequities.

CONCLUSION

The review has featured the long story of the progress in monitoring improving maternal and newborn health outcomes, but has also underlined current gaps and significant inequities. The many global initiatives described in this paper have highlighted the magnitude of the problems and have built the political momentum over the years for effectively addressing maternal and newborn health and well-being, with particular focus on improved measurement and monitoring.

"What gets measured better gets done better": The landscape of validation of global maternal and newborn health indicators through key informant interviews

Background

A large number of indicators are currently used to monitor the state of maternal and newborn health, including those capturing dimensions of health system and input, care access and availability, care quality and safety, coverage and outcomes, and impact. Validity of these indicators is a key issue in the process of assessing indicator performance and suitability. This paper aims to understand the meaning of indicator validity in the field of maternal and newborn health, and to identify key recommendations for future research.

Methods

This qualitative study used purposive sampling to identify key informants until thematic saturation was achieved. We interviewed 32 respondents from a variety of backgrounds using semi-structured interviews covering five themes: the meaning of indicator validity, methodological approaches to assessing validity, acceptable levels of indicator validity, gaps in validation research, and recommendations for addressing these gaps. Interview transcripts were analysed data using thematic content approach.

Results

Three conceptually different definitions of indicator validity were described by respondents. They considered indicator validity to encompass meaning and potential to spur action, going beyond diagnostic validity. Indicator validation was seen as an ongoing process of building and synthesising a wide range of evidence rather than a one-size-fits-all cut-off in diagnostic validity tests. Gaps identified included assessing validity of indicators of quality of care and indicators based on facility-level data, as well as expanding studies to a broader range of global settings. The key recommendation was to develop a coordinated approach to summarising and evaluating research on indicator validity, including capacity building in appraising and communicating the available evidence for country-specific needs.

Conclusion

The findings will inform future recommendations around indicator testing and validation.

'Who assisted with the delivery of (NAME)?' Issues in estimating skilled birth attendant coverage through population-based surveys and implications for improving global tracking

The percentage of live births attended by a skilled birth attendant (SBA) is a key global indicator and proxy for monitoring progress in maternal and newborn health. Yet, the discrepancy between rising SBA coverage and non-commensurate declines in maternal and neonatal mortality in many low-income and middle-income countries has brought increasing attention to the challenge of what the indicator of SBA coverage actually measures, and whether the indicator can be improved. In response to the 2018 revised definition of SBA and the push for improved measurement of progress in maternal and newborn health, this paper examines the evidence on what women can tell us about who assisted them during childbirth and methodological issues in estimating SBA coverage via population-based surveys. We present analyses based on Demographic and Health Surveys and Multiple Indicator Cluster Surveys conducted since 2015 for 23 countries. Our findings show SBA coverage can be reasonably estimated from population-based surveys in settings of high coverage, though women have difficulty reporting specific cadres. We propose improvements in how skilled cadres are classified and documented, how linkages can be made to facility-based data to examine the enabling environment and further ways data can be disaggregated to understand the complexity of delivery care. We also reflect on the limitations of what SBA coverage reveals about the quality and circumstances of childbirth care. While improvements to the indicator are possible, we call for the use of multiple indicators to inform local efforts to improve the health of women and newborns.

Indicators for monitoring maternal and neonatal quality care: a systematic review

BACKGROUND

Research and different organizations have proposed indicators to monitor the quality of maternal and child healthcare, such indicators are used for different purposes.

OBJECTIVE

To perform a systematic review of indicators for the central phases of the maternal and child healthcare continuum of care (pregnancy, childbirth, newborn care and postpartum).

METHOD

A search conducted using international repositories, national and international indicator sets, scientific articles published between 2012 and 2016, and grey literature. The eligibility criteria was documents in Spanish or English with indicators to monitor aspects of the continuum of care phases of interest. The identified indicators were characterized as follows: formula, justification, evidence level, pilot study, indicator type, phase of the continuum, intended organizational level of application, level of care, and income level of the countries. Selection was based on the characteristics associated with scientific soundness (formula, evidence level, and reliability).

RESULTS

We identified 1791 indicators. Three hundred forty-six were duplicated, which resulted in 1445 indicators for analysis. Only 6.7% indicators exhibited all requirements for scientific soundness. The distribution by the classifying variables is clearly uneven, with a predominance of indicators for childbirth, hospital care and facility level.

CONCLUSIONS

There is a broad choice of indicators for maternal and child healthcare. However, most indicators lack demonstrated scientific soundness and refer to particular continuum phases and levels within the healthcare system. Additional efforts are needed to identify good indicators for a comprehensive maternal and child healthcare monitoring system.