A literature review of quantitative indicators to measure the quality of labor and delivery care

Intrapartum care measures and indicators for monitoring the implementation of WHO recommendations for a positive childbirth experience: a scoping review

OBJECTIVE

We aimed to identify all available studies describing measures or indicators used to monitor 41 intrapartum care practices described in the 2018 WHO intrapartum care recommendations, with a view to informing development of standardised measurement of implementing these recommendations.

DESIGN

Systematic scoping review.

METHODS

We conducted a scoping review to identify studies reporting measures of intrapartum care published between 1 January 2000 and 28 June 2021. Primary and secondary outcome measures included study characteristics (publication year, journal, country and World Bank classification) and intrapartum care measure characteristics (definition, numerator, denominator, measurement level and measurement approach). We searched MEDLINE, EMBASE, CINAHL, Cochrane Library, the Maternity and Infant Care Database, Global Index Medicus and grey literature using structured search terms related to included recommendations, focusing on respectful and supportive care, and clinical practices performed throughout labour and birth. The measures identified were classified by the WHO recommendation and their characteristics reported.

RESULTS

We identified 150 studies which described 1331 intrapartum care measures. These measures corresponded to 35 of the 41 included WHO recommendations, and represented all domains of the WHO recommendations (care throughout labour and birth, first stage of labour, second stage of labour, third stage of labour). A total of 40.1% (534 of 1331 measures) of measures were related to respectful maternity care. Most studies used a questionnaire or survey measurement approach (522 of 1331 measures, 39.2%).

CONCLUSION

This scoping review presents a database of existing intrapartum care measures used to monitor the quality of intrapartum care globally. There is no clear consensus on a core set of measures for evaluating the practice of the WHO's intrapartum care recommendations. This review provides a foundation to support the development of a core set of internationally standardised intrapartum care measures for the WHO intrapartum care recommendations, highlighting key areas requiring consensus and validation, and measure development.

Neonatal near miss and associated factors among neonates admitted to neonatal intensive care unit of hospitals in East Wollega, Western Ethiopia, 2019

Background:

Neonatal near miss is an infant who nearly died but survived from birth to 28 days. Neonatal period is the most vulnerable time for child’s healthiness and continued existence. Globally, about 2.5 million children died in their first month of life and 7000 die/day.

Objective:

To assess neonatal near miss and associated factors among neonates admitted to intensive care unit at hospitals in East Wollega, West Ethiopia, 2019.

Methods:

Quantitative, facility-based cross-sectional study was conducted from 15 July to 30 August 2019 on 403 neonates admitted to neonatal intensive care unit of hospitals. After ethical clearance, five recruited and trained nurses collected the data with pretested structured questionnaire. Neonates sampled were selected using systematic random sampling. Data entered into Epi-info version 7.1 and exported to SPSS Version 24. Binary logistic regression was performed, and adjusted odds ratio with P-value ⩽ 0.05 at 95% confidence interval was used as statistically significant.

Results:

All, 403, study participants were included in this study, yielding 100% response rate. From these, 196 (48.60%) neonates were near miss. In multivariable logistic regression, mother who lived in rural area (adjusted odds ratio = 3.84, 95% confidence interval = (1.78, 8.31)), cesarean section (adjusted odds ratio = 10.68, 95% confidence interval = (2.95, 38.71)), and neonates referred to hospitals (adjusted odds ratio = 3.32, 95% confidence interval = (3.27, 12.01)). Also, female neonates (adjusted odds ratio = 2.99, 95% confidence interval = (1.45, 6.14)) and multiple birth (adjusted odds ratio = 3.07, 95% confidence interval = (1.32, 7.16)) were significantly associated with neonatal near miss.

Conclusion:

Neonatal near miss found to be high compared to previously existing research in Brazil. Health institutions, health professionals, and concerned bodies on plan and implementation of neonatal care need to consider these factors during pregnancy, delivery, and for neonates immediate after birth and in neonatal intensive care unit.

Quality of perinatal care for women with high-risk pregnancies during the COVID-19 pandemic in Iran

Background

COVID-19 has had a catastrophic effect on the healthcare system. Healthcare quality assessment measures the difference between expected and actual performances to identify gaps in the healthcare system. This study aimed to evaluate the quality of perinatal care for women with high-risk pregnancies (HPR) during the COVID-19 pandemic.

Materials and Methods

This cross-sectional study enrolled 450 women with HPR from health centers in Ahvaz, Iran, from December 2020 to May 2021, using a multi-stage sampling method. Quality of care was assessed using an observational checklist adapted from Ministry of Health guidelines. Data were analyzed using descriptive and statistical methods.

Results

The quality of the assessed aspect in comprehensive health centers and in peripartum, perinatal, and postpartum wards was moderate. The overall score for peripartum care was significantly positively correlated with the length of the retraining period, and the quality of perinatal care was significantly related to the proportion of elective cesarean sections and preterm delivery.

Conclusion

The development of care practices in health centers in Iran should focus on education and counseling. Practices in peripartum wards should emphasize the use of partographs, physical/mental support, and privacy for mothers, while perinatal wards should focus on timely counseling.

Determinants of childbirth care quality along the care continuum in limited resource settings: A structural equation modeling analysis of cross-sectional data from Burkina Faso and Côte d'Ivoire

Introduction

Despite the important increase in in-facility births, perinatal mortality rates have remained high and slow to decrease in many developing countries. This situation is attributed to poor childbirth care quality. The reason why women delivering in health facilities do not always receive care of an adequate standard is unclear. We assessed the determinants of childbirth care quality along the care continuum by means of different approaches.

Methods

A health facility-based cross-sectional study with a direct observation of health care workers’ practices while caring for mother–newborn pairs was carried out in Burkina Faso and Côte d’Ivoire. The performance of a set of essential best practices (EBPs) was assessed in each birth event at the admission, prepushing and immediate postpartum stages. A quality score, in the form of the additive sum of EBPs effectively delivered, was computed for each stage. We used negative binomial regression models and a structural equation modeling analysis to assess the determinants of care quality at each stage and the relationships of the quality delivered at the different stages, respectively.

Results

A total of 532 and 627 mother–newborn pairs were evaluated in Burkina Faso and Côte d’Ivoire, respectively. In both countries, delivery care quality varied significantly at all stages between health districts. Predelivery care quality was consistently higher in referral hospitals than in primary health care facilities (incident rate ratio (IRR) = 1.02, p < 0.05, and IRR = 1.10, p < 0.05, respectively, for Burkina Faso and Côte d’Ivoire). Quality at admission was poorer among nurses than among midwives in Burkina Faso (IRR = 0.81, p < 0.001). Quality at the admission and predelivery stages was positively correlated with immediate postpartum care quality (β = 0.48, p < 0.001, and β = 0.29, p < 0.001, respectively).

Conclusion

Quality improvement strategies must target both providers and health facilities, and different inputs are needed depending on the stage in the care continuum.

Defining, conceptualizing, and measuring perceived maternal care quality in low- to high-income countries: a scoping review protocol

BACKGROUND

Health practitioners and researchers must be able to measure and assess maternal care quality in facilities to monitor, intervene, and reduce global maternal mortality rates. On the global scale, there is a general lack of consensus on how maternal care quality is defined, conceptualized, and measured. Much of the literature addressing this problem has focused primarily on defining, conceptualizing, and measuring clinical indicators of maternal care quality. Less attention has been given in this regard to perceived maternal care quality among women which is known to influence care utilization and adherence. Therefore, there is a need to map the literature focused on defining, conceptualizing, and measuring perceived maternal care quality across low-, middle-, and high-income country contexts.

METHODS

This scoping review protocol will follow the Arksey and O'Malley methodological framework. A comprehensive search strategy will be used to search for articles published from inception to 2020 in Ovid MEDLINE, Embase, AMED, and WHO Global Index Medicus. Gray literature will be included. Two independent reviewers will screen articles by title and abstract, then by full-text based on pre-determined inclusion/exclusion criteria. A third reviewer will arbitrate any discrepancies. This protocol outlines a four-step analytic approach that includes numerical, graphical, tabular, and narrative summaries to provide a comprehensive description of the body of literature.

DISCUSSION

The findings from this scoping review will provide a comprehensive overview of the existing evidence on perceived maternal care quality. The findings are expected to inform future work on building consensus around the definition and conceptualization of perceived maternal care quality, and lay the groundwork for future research aimed at developing measures of perceived maternal care quality that can be applied across country contexts. Consequently, this review may aid in facilitating coordinated efforts to measure and improve maternal care quality across diverse country contexts (i.e., low-, middle-, and high-income country contexts).

REVIEW REGISTRATION

This scoping review has been registered in the Open Science Framework (osf.io/k8nqh).

Quality of intrapartum care: direct observations in a low-resource tertiary hospital

Background

The majority of the world’s perinatal deaths occur in low- and middle-income countries. A substantial proportion occurs intrapartum and is avoidable with better care. At a low-resource tertiary hospital, this study assessed the quality of intrapartum care and adherence to locally-tailored clinical guidelines.

Methods

A non-participatory, structured, direct observation study was held at Mnazi Mmoja Hospital, Zanzibar, Tanzania, between October and November 2016. Women in active labour were followed and structure, processes of labour care and outcomes of care systematically recorded. Descriptive analyses were performed on the labour observations and compared to local guidelines and supplemented by qualitative findings. A Poisson regression analysis assessed factors affecting foetal heart rate monitoring (FHRM) guidelines adherence.

Results

161 labouring women were observed. The nurse/midwife-to-labouring-women ratio of 1:4, resulted in doctors providing a significant part of intrapartum monitoring. Care during labour and two-thirds of deliveries was provided in a one-room labour ward with shared beds. Screening for privacy and communication of examination findings were done in 50 and 34%, respectively. For the majority, there was delayed recognition of labour progress and insufficient support in second stage of labour. While FHRM was generally performed suboptimally with a median interval of 105 (interquartile range 57–160) minutes, occurrence of an intrapartum risk event (non-reassuring FHR, oxytocin use or poor progress) increased assessment frequency significantly (rate ratio 1.32 (CI 1.09–1.58)).

Conclusions

Neither international nor locally-adapted standards of intrapartum routine care were optimally achieved. This was most likely due to a grossly inadequate capacity of birth attendants; without whom innovative interventions at birth are unlikely to succeed. This calls for international and local stakeholders to address the root causes of unsafe intrafacility care in low-resource settings, including the number of skilled birth attendants required for safe and respectful births.

Quality of maternal obstetric and neonatal care in low-income countries: development of a composite index

BACKGROUND

In low-income countries, studies demonstrate greater access and utilization of maternal and neonatal health services, yet mortality rates remain high with poor quality increasingly scrutinized as a potential point of failure in achieving expected goals. Comprehensive measures reflecting the multi-dimensional nature of quality of care could prove useful to quality improvement. However, existing tools often lack a systematic approach reflecting all aspects of quality considered relevant to maternal and newborn care. We aim to address this gap by illustrating the development of a composite index using a step-wise approach to evaluate the quality of maternal obstetric and neonatal healthcare in low-income countries.

METHODS

The following steps were employed in creating a composite index: 1) developing a theoretical framework; 2) metric selection; 3) imputation of missing data; 4) initial data analysis 5) normalization 6) weighting and aggregating; 7) uncertainty and sensitivity analysis of resulting composite score; 8) and deconstruction of the index into its components. Based on this approach, we developed a base composite index and tested alternatives by altering the decisions taken at different stages of the construction process to account for missing values, normalization, and aggregation. The resulting single composite scores representing overall maternal obstetric and neonatal healthcare quality were used to create facility rankings and further disaggregated into sub-composites of quality of care.

RESULTS

The resulting composite scores varied considerably in absolute values and ranges based on method choice. However, the respective coefficients produced by the Spearman rank correlations comparing facility rankings by method choice showed a high degree of correlation. Differences in method of aggregation had the greatest amount of variation in facility rankings compared to the base case. Z-score standardization most closely aligned with the base case, but limited comparability at disaggregated levels.

CONCLUSIONS

This paper illustrates development of a composite index reflecting the multi-dimensional nature of maternal obstetric and neonatal healthcare. We employ a step-wise process applicable to a wide range of obstetric quality of care assessment programs in low-income countries which is adaptable to setting and context. In exploring alternative approaches, certain decisions influencing the interpretation of a given index are highlighted.

Measuring the quality of maternal and care processes at the time of delivery in sub-Saharan Africa: development and validation of a short index

BACKGROUND

There is a growing recognition that quality of care must improve in facility-based deliveries to achieve further global reductions in maternal and newborn mortality and morbidity. Better measurement of care quality is needed, but the unpredictable length of labor and delivery hinders the feasibility of observation, the gold standard in quality assessment. This study evaluated whether a measure restricted to actions at or immediately following delivery could provide a valid assessment of the quality of the process of intrapartum and immediate postpartum care (QoPIIPC), including essential newborn care.

METHODS

The study used a comprehensive QoPIIPC index developed through a modified Delphi process and validated by delivery observation data as a starting point. A subset of items from this index assessed at or immediately following delivery was identified to create a "delivery-only" index. This delivery-only index was evaluated across content and criterion validation domains using delivery observation data from Kenya, Madagascar, and Tanzania, including Zanzibar.

RESULTS

The delivery-only index included 13 items and performed well on most validation criteria, including correct classification of poorly and well-performed deliveries. Relative to the comprehensive QoPIIPC index, the delivery-only index had reduced content validity, representing fewer dimensions of QoPIIPC. The delivery-only index was also less strongly associated with overall quality performance in observed deliveries than the comprehensive QoPIIPC index.

CONCLUSIONS

Where supervision resources are limited, a measure of the quality of labor and delivery care targeting the time of delivery may mitigate challenges in observation-based assessment. The delivery-only index may enable increased use of observation-based quality assessment within maternal and newborn care programs in low-resource settings.

"Every Newborn-BIRTH" protocol: observational study validating indicators for coverage and quality of maternal and newborn health care in Bangladesh, Nepal and Tanzania

Background

To achieve Sustainable Development Goals and Universal Health Coverage, programmatic data are essential. The Every Newborn Action Plan, agreed by all United Nations member states and >80 development partners, includes an ambitious Measurement Improvement Roadmap. Quality of care at birth is prioritised by both Every Newborn and Ending Preventable Maternal Mortality strategies, hence metrics need to advance from health service contact alone, to content of care. As facility births increase, monitoring using routine facility data in DHIS2 has potential, yet validation research has mainly focussed on maternal recall surveys. The Every Newborn – Birth Indicators Research Tracking in Hospitals (EN-BIRTH) study aims to validate selected newborn and maternal indicators for routine tracking of coverage and quality of facility-based care for use at district, national and global levels.

Methods

EN-BIRTH is an observational study including >20 000 facility births in three countries (Tanzania, Bangladesh and Nepal) to validate selected indicators. Direct clinical observation will be compared with facility register data and a pre-discharge maternal recall survey for indicators including: uterotonic administration, immediate newborn care, neonatal resuscitation and Kangaroo mother care. Indicators including neonatal infection management and antenatal corticosteroid administration, which cannot be easily observed, will be validated using inpatient records. Trained clinical observers in Labour/Delivery ward, Operation theatre, and Kangaroo mother care ward/areas will collect data using a tablet-based customised data capturing application. Sensitivity will be calculated for numerators of all indicators and specificity for those numerators with adequate information. Other objectives include comparison of denominator options (ie, true target population or surrogates) and quality of care analyses, especially regarding intervention timing. Barriers and enablers to routine recording and data usage will be assessed by data flow assessments, quantitative and qualitative analyses.

Conclusions

To our knowledge, this is the first large, multi-country study validating facility-based routine data compared to direct observation for maternal and newborn care, designed to provide evidence to inform selection of a core list of indicators recommended for inclusion in national DHIS2. Availability and use of such data are fundamental to drive progress towards ending the annual 5.5 million preventable stillbirths, maternal and newborn deaths.

Technical quality of delivery care in private- and public-sector health facilities in Enugu and Lagos States, Nigeria

Private-sector providers are increasingly being recognized as important contributors to the delivery of healthcare. Countries with high disease burdens and limited public-sector resources are considering using the private sector to achieve universal health coverage. However, evidence for the technical quality of private-sector care is lacking. This study assesses the technical quality of maternal healthcare during delivery in public- and private-sector facilities in resource-limited settings, from a systems and programmatic perspective. A summary index (the skilled attendance index, SAI), was used. Two-staged cluster sampling with stratification was used to select representative samples of case records in public- and private-sector facilities in Enugu and Lagos States, Nigeria. Information to assess criteria was extracted, and the SAI calculated. Linear regression models examined the relationship between SAI and the private and public sectors, controlling for confounders. The median SAI was 54.8% in Enugu and 85.7% in Lagos. The private for-profit sector's SAI was lower than and the private not-for-profit sector's SAI was higher than the public sector in Enugu [coefficient = -3.6 (P = 0.018) and 12.6 (P < 0.001), respectively]. In Lagos, the private for-profit sector's SAI was higher and the private not-for-profit sector's SAI was lower than the public sector [3.71 (P = 0.005) and -3.92 (P < 0.001)]. Results indicate that the technical quality of private for-profit providers' care was poorer than public providers where the public provision of care was weak, while private for-profit facilities provided better technical quality care than public facilities where the public sector was strong and there was a relatively strong regulatory body. Our findings raise important considerations relating to the quality of maternity care, the public-private mix and needs for regulation in global efforts to achieve universal healthcare.