Criterion-based clinical audit to assess quality of obstetrical care in low- and middle-income countries: a systematic review

A multi-dimensional incomplete stepped-wedge trial design to estimate the impact of standards-based audit

A clinical audit is a low-cost process used for quality improvement in healthcare. Such audits are however infrequently used in resource poor countries, where the need for and potential impact of quality improvement is higher. Sets of standards for use in maternal and newborn care have been established based on internal guidelines and evidence. The before-after design of a clinical audit is prone to bias in the estimation of the impact of conducting a clinical audit. A trial design that would provide an unbiased estimate of the impact of implementing a clinical audit process on the attainment of standards selected (a standards-based audit) was needed. The aim of this paper is to introduce and describe the design of trials we developed to meet this need. A novel randomised stepped-wedge trial design to estimate the impact of conducting standards-based audits is presented. A multi-dimensional incomplete stepped-wedge cluster randomised trial design suitable for estimation of the impact of Standards-based audits on compliance with standard is proposed; two variants are described in detail. A method for sample size estimation is described. Analyses can be performed for the binary outcome using a generalised linear mixed model framework to estimate the impact of the approach on compliance with standards subjected to a standards-based audit; additional terms to consider including in sensitivity analyses are considered. The design presented has the potential to estimate the impact of introducing the standards-based audit process on compliance with standard, while providing participating healthcare providers opportunity to gain experience of implementing the standards-based audit process. The design may be applicable in other areas in which multiple processes are to be studied.

Pulmonary oedema in the course of severe maternal outcome in South Africa: A cohort study combined with clinical audit

OBJECTIVES

To describe the incidence and outcomes of pulmonary oedema in women with severe maternal outcome during childbirth and identify possible modifiable factors through audit.

METHODS

All women with severe maternal outcome (maternal deaths or near misses) who were referred to Tygerberg referral hospital from health facilities in Metro East district, South Africa, during 2014-2015 were included. Women with severe maternal outcome and pulmonary oedema during pregnancy or childbirth were evaluated using three types of critical incident audit: criterion-based case review by one consultant gynaecologist, monodisciplinary critical incident audit by a team of gynaecologists, multidisciplinary audit with expert review from anaesthesiologists and cardiologists.

RESULTS

Of 32,161 pregnant women who gave birth in the study period, 399 (1.2%) women had severe maternal outcome and 72/399 (18.1%) had pulmonary oedema with a case fatality rate of 5.6% (4/72). Critical incident audit demonstrated that pre-eclampsia/HELLP-syndrome and chronic hypertension were the main conditions underlying pulmonary oedema (44/72, 61.1%). Administration of volumes of intravenous fluids in already sick women, undiagnosed underlying cardiac illness, administration of magnesium sulphate as part of pre-eclampsia management and oxytocin for augmentation of labour were identified as possible contributors to the pathophysiology of pulmonary oedema. Women-related factors (improved antenatal care attendance) and health care-related factors (earlier diagnosis and management) would potentially have improved maternal outcome.

CONCLUSIONS

Although pulmonary oedema in pregnancy is rare, among women with severe maternal outcome a considerable proportion had pulmonary oedema (18.1%). Audit identified options for prevention of pulmonary oedema and improved outcome. These included early detection and management of preeclampsia with close monitoring of fluid intake and cardiac evaluation in case of suspected pulmonary oedema. Therefore, a multidisciplinary clinical approach is recommended.

Perinatal mortality audit in a rural referral hospital in Tanzania to inform future interventions: A descriptive study

Background

Clear evidence exists that perinatal audit and feedback can lead to important improvements in practice. The death audit can lead to the identification of existing potential delays which are the decision to seek medical care, reaching an appropriate facility, and receiving timely adequate care at the facility. Such an audit potentially initiates a positive discussion, which may foster the implementation of changes that aims at saving more lives.

Objective

To review the perinatal deaths case notes and identify potential gaps in care provision and health-seeking behavior to foster best practice.

Methods

The stillbirths and neonatal death case notes that occurred between January 2019 and May 2020 at the hospital were reviewed using an adapted WHO checklist. The completed review case notes were entered into an electronic system and a quality control check-up was done. Data were analysed descriptively, and findings were presented in tables.

Results

There were 4,898 births, and 1,175 neonatal admissions, out of these there were 135 recorded stillbirths (2.8%) and 201(4.1% of the total hospital births) early neonatal deaths. Out of the 1,175 neonates, 635 (54%) were born within the hospital and 540 (46%) were admitted from other facilities and home deliveries. In total 86 stillbirths and 140 early neonatal deaths case notes were retrieved and audited. Out of 86 stillbirths’ case notes audited, 30 (34.9%) seemed to have died during labor, and of these 5 had audible fetal heart rate during admission. Apgar scores less than 7 at 5 minutes, prematurity, and meconium aspiration were the top three recorded causes of neonatal deaths. Inadequate/late antenatal care visits and home delivery were the maternal factors likely to have contributed to perinatal deaths. Inadequate labor monitoring (12%) and documentation (62%) were among the providers’ factors likely to have contributed to perinatal deaths.

Conclusion

This audit shows that there are high rates of preventable intrapartum stillbirths and early neonatal deaths. Both women and providers’ factors were found to have contributed to the stillbirths and neonatal deaths. There is a need to encourage women to adequately attend antenatal care, utilize health facilities during birth, and improve maternity and neonatal care at the health facilities.

Surgical service monitoring and quality control systems at district hospitals in Malawi, Tanzania and Zambia: a mixed-methods study

BACKGROUND

In low-income and middle-income countries, an estimated one in three clinical adverse events happens in non-complex situations and 83% are preventable. Poor quality of care also leads to inefficient use of human, material and financial resources for health. Improving outcomes and mitigating the risk of adverse events require effective monitoring and quality control systems.

AIM

To assess the state of surgical monitoring and quality control systems at district hospitals (DHs) in Malawi, Tanzania and Zambia.

METHODS

A mixed-methods cross-sectional study of 75 DHs: Malawi (22), Tanzania (30) and Zambia (23). This included a questionnaire, interviews and visual inspection of operating theatre (OT) registers. Data were collected on monitoring and quality systems for surgical activity, processes and outcomes, as well as perceived barriers.

RESULTS

53% (n=40/75) of DHs use more than one OT register to record surgical operations. With the exception of standardised printed OT registers in Zambia, the register format (often handwritten books) and type of data collected varied between DHs. Monthly reports were seldom analysed by surgical teams. Less than 30% of all surveyed DHs used surgical safety checklists (n=22/75), and <15% (n=11/75) performed surgical audits. 73% (n=22/30) of DHs in Tanzania and less than half of DHs in Malawi (n=11/22) and Zambia (n=10/23) conducted surgical case reviews. Reports of surgical morbidity and mortality were compiled in 65% (n=15/23) of Zambian DHs, and in less than one-third of DHs in Tanzania (n=9/30) and Malawi (n=4/22). Reported barriers to monitoring and quality systems included an absence of formalised guidelines, continuous training opportunities as well as inadequate accountability mechanisms.

CONCLUSIONS

Surgical monitoring and quality control systems were not standard among sampled DHs. Improvements are needed in standardisation of quality measures used; and in ensuring data completeness, analysis and utilisation for improving patient outcomes.

Defining, conceptualizing, and measuring perceived maternal care quality in low- to high-income countries: a scoping review protocol

BACKGROUND

Health practitioners and researchers must be able to measure and assess maternal care quality in facilities to monitor, intervene, and reduce global maternal mortality rates. On the global scale, there is a general lack of consensus on how maternal care quality is defined, conceptualized, and measured. Much of the literature addressing this problem has focused primarily on defining, conceptualizing, and measuring clinical indicators of maternal care quality. Less attention has been given in this regard to perceived maternal care quality among women which is known to influence care utilization and adherence. Therefore, there is a need to map the literature focused on defining, conceptualizing, and measuring perceived maternal care quality across low-, middle-, and high-income country contexts.

METHODS

This scoping review protocol will follow the Arksey and O'Malley methodological framework. A comprehensive search strategy will be used to search for articles published from inception to 2020 in Ovid MEDLINE, Embase, AMED, and WHO Global Index Medicus. Gray literature will be included. Two independent reviewers will screen articles by title and abstract, then by full-text based on pre-determined inclusion/exclusion criteria. A third reviewer will arbitrate any discrepancies. This protocol outlines a four-step analytic approach that includes numerical, graphical, tabular, and narrative summaries to provide a comprehensive description of the body of literature.

DISCUSSION

The findings from this scoping review will provide a comprehensive overview of the existing evidence on perceived maternal care quality. The findings are expected to inform future work on building consensus around the definition and conceptualization of perceived maternal care quality, and lay the groundwork for future research aimed at developing measures of perceived maternal care quality that can be applied across country contexts. Consequently, this review may aid in facilitating coordinated efforts to measure and improve maternal care quality across diverse country contexts (i.e., low-, middle-, and high-income country contexts).

REVIEW REGISTRATION

This scoping review has been registered in the Open Science Framework (osf.io/k8nqh).

Use of a participatory quality assessment and improvement tool for maternal and neonatal hospital care. Part 1: Review of implementation features and observed quality gaps in 25 countries

BACKGROUND

A substantial proportion of maternal and neonatal mortality and morbidity is attributable to gaps in quality of care. A systematic, standard-based tool for quality assessment and improvement for maternal and neonatal hospital care (QA/QI MN tool) was developed in 2009 by the World Health Organization (WHO). The tool guides the assessment process along the whole continuum from admission to discharge, collects the views of the recipients of care and engages hospital mangers and staff in identifying gaps and drafting an action plan.

METHODS

Publications describing use of the WHO QA/QI MN tool from 2009 to 2017 and reports retrievable from WHO or other development partners' websites were searched and considered for inclusion in the review. Only assessments of hospitals were considered. Quality gaps were classified as regarding case management in maternal care, case management in neonatal care, hospital infrastructure, hospital policies and according to severity and frequency. Quotations from women regarding key issues in effective communication, respect and dignity, emotional support and costs incurred were selected.

RESULTS

In the period 2009-2017, use of the WHO QA/QI MN tool was documented in 25 countries, belonging to Central and Eastern Europe (8), Central Asia (4), Sub-Saharan Africa (11), Latin America (1) and Middle East (1). Overall, 133 hospitals were assessed. The tool allowed to identify in great detail serious quality gaps including: insufficient or incomplete adherence to recommended evidence-based procedures for normal childbirth and maternal and neonatal complications; excess of inappropriate or unnecessary interventions; insufficient infection control; failure to provide respectful care, adequate communication and emotional support to mothers and babies; poor use of information generated locally to analyse processes and outcomes. These gaps were observed in all countries. Significant differences were observed among facilities belonging to the same health systems, ie, with very similar staffing, infrastructure and equipment.

CONCLUSIONS

The experience made, the largest of this kind, provides comprehensive and detailed insight into the existing quality gaps in a wide variety of settings. QI cycles at facility level should be primarily based on assessments made by multidisciplinary teams of professionals to identify the parts of the care pathways which require improvement through a participatory approach involving managers, staff and patients.

Harnessing the health systems strengthening potential of quality improvement using realist evaluation: an example from southern Tanzania

Quality improvement (QI) is a problem-solving approach in which stakeholders identify context-specific problems and create and implement strategies to address these. It is an approach that is increasingly used to support health system strengthening, which is widely promoted in Sub-Saharan Africa. However, few QI initiatives are sustained and implementation is poorly understood. Here, we propose realist evaluation to fill this gap, sharing an example from southern Tanzania. We use realist evaluation to generate insights around the mechanisms driving QI implementation. These insights can be harnessed to maximize capacity strengthening in QI and to support its operationalization, thus contributing to health systems strengthening. Realist evaluation begins by establishing an initial programme theory, which is presented here. We generated this through an elicitation approach, in which multiple sources (theoretical literature, a document review and previous project reports) were collated and analysed retroductively to generate hypotheses about how the QI intervention is expected to produce specific outcomes linked to implementation. These were organized by health systems building blocks to show how each block may be strengthened through QI processes. Our initial programme theory draws from empowerment theory and emphasizes the self-reinforcing nature of QI: the more it is implemented, the more improvements result, further empowering people to use it. We identified that opportunities that support skill- and confidence-strengthening are essential to optimizing QI, and thus, to maximizing health systems strengthening through QI. Realist evaluation can be used to generate rich implementation data for QI, showcasing how it can be supported in ‘real-world’ conditions for health systems strengthening.

Socioeconomic differences in caesarean section - are they explained by medical need? An analysis of patient record data of a large Kenyan hospital

BACKGROUND

Caesarean section (C-section) rates are often low among the poor and very high among the better-off in low- and middle-income countries. We examined to what extent these differences are explained by medical need in an African context.

METHODS

We analyzed electronic records of 12,209 women who gave birth in a teaching hospital in Kenya in 2014. C-section rates were calculated by socioeconomic position (SEP), using maternal occupation (professional, small business, housewife, student) as indicator. We assessed if women had documented clinical indications according to hospital guidelines and if socioeconomic differences in C-section rates were explained by indication.

RESULTS

Indication for C-section according to hospital guidelines was more prevalent among professionals than housewives (16% vs. 9% of all births). The C-section rate was also higher among professionals than housewives (21.1% vs. 15.8% [OR 1.43; 95%CI 1.23-1.65]). This C-section rate difference was largely explained by indication (4.7 of the 5.3 percentage point difference between professionals and housewives concerned indicated C-sections, often with previous C-section as indication). Repeat C-sections were near-universal (99%). 43% of primary C-sections had no documented indication. Over-use was somewhat higher among professionals than housewives (C-section rate among women without indication: 6.6 and 5.5% respectively), which partly explained socioeconomic differences in primary C-section rate.

CONCLUSIONS

Socioeconomic differences in C-section rates can be largely explained by unnecessary primary C-sections and higher supposed need due to previous C-section. Prevention of unnecessary primary C-sections and promoting safe trial of labor should be priorities in addressing C-section over-use and reducing inequalities. Unnecessary primary C-sections and ubiquitous repeat C-sections drive overall C-section rates and C-section inequalities.

Health workers' views on audit in maternal and newborn healthcare in LMICs: a qualitative evidence synthesis

OBJECTIVES

To identify and summarise health workers' views on the use of audit as a method to improve the quality of maternal and newborn healthcare in low- and middle-income countries (LMICs).

METHODS

We conducted a qualitative evidence synthesis. PubMed, CINAHL and Global Health databases were searched using keywords, synonyms and MeSH headings for 'audit', 'views' and 'health workers' to find papers that used qualitative methods to explore health workers' views on audit in LMICs. Titles and abstracts were then screened for inclusion. The remaining full-text papers were then screened. The final included papers were quality assessed using the Critical Appraisal Skills Programme tool for qualitative research. Data on audit type and health workers' perceptions were extracted and analysed using thematic synthesis.

RESULTS

Nineteen papers were included in the review, most from sub-Saharan Africa. Health workers generally held favourable views of audit and expressed dedication to the process. Similarly, they described positive experiences conducting audit. The main barriers to implementing audit were the presence of a blame culture, inadequate training and the lack of time and resources to conduct audit. Health workers' motivation and dedication to the audit process helped to overcome such barriers.

CONCLUSIONS

Health workers are dedicated to the process of audit, but must be supported with training, leadership and adequate resources to use it. Decision-makers and technical partners supporting audit should focus on improving audit training and finding ways to conduct audit without requiring too much staff time.

Determinants of surgeons' adherence to preventive intraoperative measures of surgical site infection in Gaza Strip hospitals: a multi-centre cross-sectional study

Background

Surgical site infection (SSI) is one of the most common hospital-acquired infections and is associated with serious impact on the rates of morbidity, mortality as well as healthcare costs. This study examined factors influencing the application of several intraoperative preventive measures of SSI by surgeons and surgical residents in the Gaza Strip.

Methods

A cross-sectional study was conducted from December 2016 to February 2017 at the operation rooms of the three major hospitals located in the Gaza-Strip, Palestine. Inclusion criteria for patients were being adult (aged ≥18 years), no history of wound infection at time of operation and surgical procedure under general anaesthesia with endotracheal intubation. The association between different patient- and procedure-related SSI risk factors and adherence to several intraoperative SSI preventive measures was tested.

Results

In total, 281 operations were observed. The mean patient age ± standard deviation (SD) was 38.4 ± 14.6 years and the mean duration of surgery ± SD was 58.2 ± 32.1 minutes. A hundred-thirty-two patients (47.0%) were male. Location and time of the operation were found to have significant associations with adherence to all SSI preventive measures except for antibiotic prophylaxis. Type of operation had a significant association with performing all measures except changing surgical instruments. Patient age did not have a statistically significant association with adherence to any measure.

Conclusion

The results suggest that the surgeon could be a major factor that can lead to a better outcome of surgical procedures by reducing postoperative complications of SSI. Operating department professionals would benefit from clinical guidance and continuous training, highlighting the importance of persistent implementation of SSI preventive measures in everyday practice to improve the quality of care provided to surgical patients.

Burden of surgical site infection following cesarean section in sub-Saharan Africa: a narrative review

Cesarean section (CS) is the most common operative procedure performed in sub-Saharan Africa (SSA), accounting for as much as 80% of the surgical workload. In contrast to CSs performed in high-income countries, CSs performed in SSA are accompanied by high morbidity and mortality rates. This operation is the most important known variable associated with an increased probability of postpartum bacterial infection. The objective of this review was to assess surgical outcomes related to CS in SSA. PubMed (including Medline), CINAHL, Embase, and the World Health Organization’s Global Health Library were searched without date or language restrictions. A total of 26 studies reporting surgical site–infection rates after CS were identified, representing 14,063 women from 14 countries. The vast majority (76.7%) of CSs performed were emergency operations. The overall CS rate for women included in this review was 12.4% (range: 1.0%–41.9%). Only 17 of 26 total studies reported a significant proportion of women receiving antimicrobials of any kind. The surgical site–infection rate was 15.6% and the wound-infection rate 10.3%.

Measuring the quality of maternal and care processes at the time of delivery in sub-Saharan Africa: development and validation of a short index

BACKGROUND

There is a growing recognition that quality of care must improve in facility-based deliveries to achieve further global reductions in maternal and newborn mortality and morbidity. Better measurement of care quality is needed, but the unpredictable length of labor and delivery hinders the feasibility of observation, the gold standard in quality assessment. This study evaluated whether a measure restricted to actions at or immediately following delivery could provide a valid assessment of the quality of the process of intrapartum and immediate postpartum care (QoPIIPC), including essential newborn care.

METHODS

The study used a comprehensive QoPIIPC index developed through a modified Delphi process and validated by delivery observation data as a starting point. A subset of items from this index assessed at or immediately following delivery was identified to create a "delivery-only" index. This delivery-only index was evaluated across content and criterion validation domains using delivery observation data from Kenya, Madagascar, and Tanzania, including Zanzibar.

RESULTS

The delivery-only index included 13 items and performed well on most validation criteria, including correct classification of poorly and well-performed deliveries. Relative to the comprehensive QoPIIPC index, the delivery-only index had reduced content validity, representing fewer dimensions of QoPIIPC. The delivery-only index was also less strongly associated with overall quality performance in observed deliveries than the comprehensive QoPIIPC index.

CONCLUSIONS

Where supervision resources are limited, a measure of the quality of labor and delivery care targeting the time of delivery may mitigate challenges in observation-based assessment. The delivery-only index may enable increased use of observation-based quality assessment within maternal and newborn care programs in low-resource settings.

Effect of a novel vital sign device on maternal mortality and morbidity in low-resource settings: a pragmatic, stepped-wedge, cluster-randomised controlled trial

BACKGROUND

In 2015, an estimated 303 000 women died in pregnancy and childbirth. Obstetric haemorrhage, sepsis, and hypertensive disorders of pregnancy account for more than 50% of maternal deaths worldwide. There are effective treatments for these pregnancy complications, but they require early detection by measurement of vital signs and timely administration to save lives. The primary aim of this trial was to determine whether implementation of the CRADLE Vital Sign Alert and an education package into community and facility maternity care in low-resource settings could reduce a composite of all-cause maternal mortality or major morbidity (eclampsia and hysterectomy).

METHODS

We did a pragmatic, stepped-wedge, cluster-randomised controlled trial in ten clusters across Africa, India, and Haiti, introducing the device into routine maternity care. Each cluster contained at least one secondary or tertiary hospital and their main referral facilities. Clusters crossed over from existing routine care to the CRADLE intervention in one of nine steps at 2-monthly intervals, with CRADLE devices replacing existing equipment at the randomly allocated timepoint. A computer-generated randomly allocated sequence determined the order in which the clusters received the intervention. Because of the nature of the intervention, this trial was not masked. Data were gathered monthly, with 20 time periods of 1 month. The primary composite outcome was at least one of eclampsia, emergency hysterectomy, and maternal death. This study is registered with the ISRCTN registry, number ISRCTN41244132.

FINDINGS

Between April 1, 2016, and Nov 30, 2017, among 536 223 deliveries, the primary outcome occurred in 4067 women, with 998 maternal deaths, 2692 eclampsia cases, and 681 hysterectomies. There was an 8% decrease in the primary outcome from 79·4 per 10 000 deliveries pre-intervention to 72·8 per 10 000 deliveries post-intervention (odds ratio [OR] 0·92, 95% CI 0·86-0·97; p=0·0056). After planned adjustments for variation in event rates between and within clusters over time, the unexpected degree of variability meant we were unable to judge the benefit or harms of the intervention (OR 1·22, 95% CI 0·73-2·06; p=0·45).

INTERPRETATION

There was an absolute 8% reduction in primary outcome during the trial, with no change in resources or staffing, but this reduction could not be directly attributed to the intervention due to variability. We encountered unanticipated methodological challenges with this trial design, which can provide valuable learning for future research and inform the trial design of future international stepped-wedge trials.

FUNDING

Newton Fund Global Research Programme: UK Medical Research Council; Department of Biotechnology, Ministry of Science & Technology, Government of India; and UK Department of International Development.

Use of a criteria-based audit to optimize uptake of cesarean delivery in a low-resource setting

OBJECTIVE

To evaluate the impact of a criteria-based audit (CBA) of obstructed labor and fetal distress on cesarean delivery and perinatal outcomes.

METHODS

A cross-sectional study was performed at a tertiary referral hospital in Tanzania. Data were collected before and after CBA (January 2013-November 2013 and July 2015-June 2016). Outcomes of fetal distress (baseline CBA, n=248; re-audit, n=251) and obstructed labor (baseline CBA, n=260; re-audit n=250) were assessed using a checklist. Additionally, 27 960 parturients were assessed using the Robson classification.

RESULTS

Perinatal morbidity and mortality decreased from 42 of 260 (16.2%) to 22 of 250 (8.8%) among patients with obstructed labor after CBA (P=0.012). Cesarean delivery rate decreased for referred term multiparas with induced labor or prelabor cesarean delivery (odds ratio [OR] 0.28, 95% confidence interval [CI] 0.09-0.82). Cesarean delivery rate for preterm pregnancies increased among both referred (OR 1.28, 95% CI 1.02-1.63) and non-referred (OR 2.78, 95% CI 1.98-3.90) groups. Neonatal distress rate decreased for referred term multiparas (OR 0.72, 95% CI 0.56-0.92), referred preterm pregnancies (OR 0.32, 95% CI 0.25-0.39), and non-referred preterm pregnancies (OR 0.26, 95% CI 0.18-0.36).

CONCLUSION

Use of CBA reduced poor perinatal outcomes of obstructed labor and increased uptake of cesarean delivery.

Methods to improve quality performance at scale in lower- and middle-income countries

Universal Health Coverage is one of the Sustainable Development Goal targets. But coverage without quality health services limits benefits to populations. Performance-based financing programs (PBF) use strategic purchasing of services to expand coverage and promote quality by measuring quality and rewarding good performance. The widespread presence of PBF programs in lower and middle-income countries provide an opportunity to introduce and test new approaches for measuring and improving quality at scale. This article describes four approaches to improve quality of health services at scale in PBF programs. These approaches looked at structural and process measures of quality as well as outcome measures like patient satisfaction. Three types of tools were used in these approaches: clinical vignettes, competency tests and patient satisfaction surveys. Specific tools within each of the approaches are used in Kyrgyzstan, Cambodia, Democratic Republic of Congo and the Republic of Congo.

Effectiveness of the facility-based maternal near-miss case reviews in improving maternal and newborn quality of care in low-income and middle-income countries: a systematic review

OBJECTIVES

The maternal near-miss case review (NMCR) has been promoted by WHO as an approach to improve quality of care (QoC) at facility level. This systematic review synthesises evidence on the effectiveness of the NMCR on QoC and maternal and perinatal health outcomes in low-income and middle-income countries (LMICs).

METHODS

Studies were searched for in six electronic databases (MEDLINE, Index Medicus, Web of Science, the Cochrane library, Embase, LILACS), with no language restrictions. Two authors independently screened papers and selected them for inclusion and independently extracted data. Maternal mortality was the primary outcome. Secondary outcomes included any outcome informing on any of the six dimensions of QoC: efficacy, safety, efficiency, equity, accessibility and timely care, acceptability and patient-centred care.

RESULTS

Out of 24 822 papers retrieved, 17 studies from 11 countries were included. Maternal mortality measured before and after the implementation of the NMCR cycle significantly decreased (OR 0.77, 95% CI 0.61 to 0.98, eight studies, 55 573 043 women; I2=39%). A statistically significant reduction in the incidence of uterine rupture, postpartum haemorrhage and maternal sepsis was observed in three out of six studies. Ten studies reporting on maternal care process all showed some significant improvement when measured against predefined standards. All studies reported that the NMCR resulted in some amelioration of the facility structure (physical structure, staffing, equipment, training, organisation of care). Newborn outcomes were overall poorly reported; four studies showed no significant difference in perinatal mortality. Patient satisfaction and equity were also poorly reported.

CONCLUSIONS

Policy makers may consider implementing the maternal NMCR cycle approach among strategies aiming at improving QoC and reducing maternal mortality and morbidity in LMIC. Future studies should better document the effectiveness of the NMCR cycle particularly on outcomes reflecting patient-centred care and cost-effectiveness.

Gaps in obstetric care processes - we can only improve what is being measured

A multifaceted intervention at all six obstetric units in the Stockholm Health Region was performed in 2008-2011 in order to increase safety for the newborn infants. Case-controlled criterion-based reviews of care processes during labor and delivery have been used to assess factors associated with suboptimal care during labor and delivery. Categories of increased risk of adverse outcome during labor and delivery were defined. Cases with low Apgar scores and healthy controls were scrutinized and compared to data from a study with an identical design performed before the intervention. The risk of suboptimal care increased twice among controls and three times among cases when reviewing specific criteria after a multifaceted intervention. There are still gaps in care processes that need attention. Improving guidelines is important but not enough alone, and the management of fetal surveillance needs further improvement. The complexity of reviewing care processes using criterion-based research methodology is highlighted.

Rubber stamp templates for improving clinical documentation: A paper-based, m-Health approach for quality improvement in low-resource settings

BACKGROUND

The United Nations' Sustainable Development Goal #3.8 targets 'access to quality essential healthcare services'. Clinical practice guidelines are an important tool for ensuring quality of clinical care, but many challenges prevent their use in low-resource settings. Monitoring the use of guidelines relies on cumbersome clinical audits of paper records, and electronic systems face financial and other limitations. Here we describe a unique approach to generating digital data from paper using guideline-based templates, rubber stamps and mobile phones.

INTERVENTION

The Guidelines Adherence in Slums Project targeted ten private sector primary healthcare clinics serving informal settlements in Nairobi, Kenya. Each clinic was provided with rubber stamp templates to support documentation and management of commonly encountered outpatient conditions. Participatory design methods were used to customize templates to the workflows and infrastructure of each clinic. Rubber stamps were used to print templates into paper charts, providing clinicians with checklists for use during consultations. Templates used bubble format data entry, which could be digitized from images taken on mobile phones. Besides rubber stamp templates, the intervention included booklets of guideline compilations, one Android phone for digitizing images of templates, and one data feedback/continuing medical education session per clinic each month. In this paper we focus on the effect of the intervention on documentation of three non-communicable diseases in one clinic.

METHODS

Seventy charts of patients enrolled in the chronic disease program (hypertension/diabetes, n=867; chronic respiratory diseases, n=223) at one of the ten intervention clinics were sampled. Documentation of each individual patient encounter in the pre-intervention (January-March 2016) and post-intervention period (May-July) was scored for information in four dimensions - general data, patient assessment, testing, and management. Control criteria included information with no counterparts in templates (e.g. notes on presenting complaints, vital signs). Documentation scores for each patient were compared between both pre- and post-intervention periods and between encounters documented with and without templates (post-intervention only).

RESULTS

The total number of patient encounters in the pre-intervention (282) and post-intervention periods (264) did not differ. Mean documentation scores increased significantly in the post-intervention period on average by 21%, 24% and 17% for hypertension, diabetes and chronic respiratory diseases, respectively. Differences were greater (47%, 43% and 27%, respectively) when documentation with and without templates was compared. Changes between pre- vs.post-intervention, and with vs.without template, varied between individual dimensions of documentation. Overall, documentation improved more for general data and patient assessment than in testing or management.

CONCLUSION

The use of templates improves paper-based documentation of patient care, a first step towards improving the quality of care. Rubber stamps provide a simple and low-cost method to print templates on demand. In combination with ubiquitously available mobile phones, information entered on paper can be easily and rapidly digitized. This 'frugal innovation' in m-Health can empower small, private sector facilities, where large numbers of urban patients seek healthcare, to generate digital data on routine outpatient care. These data can form the basis for evidence-based quality improvement efforts at large scale, and help deliver on the SDG promise of quality essential healthcare services for all.

Evaluation of a quality improvement intervention for obstetric and neonatal care in selected public health facilities across six states of India

Background

While increase in the number of women delivering in health facilities has been rapid, the quality of obstetric and neonatal care continues to be poor in India, contributing to high maternal and neonatal mortality.

Methods

The USAID ASSIST Project supported health workers in 125 public health facilities (delivering approximately 180,000 babies per year) across six states to use quality improvement (QI) approaches to provide better care to women and babies before, during and immediately after delivery. As part of this intervention, each month, health workers recorded data related to nine elements of routine care alongside data on perinatal mortality. We aggregated facility level data and conducted segmented regression to analyse the effect of the intervention over time.

Results

Care improved to 90–99% significantly (p < 0.001) for eight of the nine process elements. A significant (p < 0.001) positive change of 30–70% points was observed during post intervention for all the indicators and 3–17% points month-to-month progress shown from the segmented results. Perinatal mortality declined from 26.7 to 22.9 deaths/1000 live births (p < 0.01) over time, however, it is not clear that the intervention had any significant effect on it.

Conclusion

These results demonstrate the effectiveness of QI approaches in improving provision of routine care, yet these approaches are underused in the Indian health system. We discuss the implications of this for policy makers.

Electronic supplementary material

The online version of this article (doi:10.1186/s12884-017-1318-4) contains supplementary material, which is available to authorized users.

Assessment of quality of care among in-patients with postpartum haemorrhage and severe pre-eclampsia at st. Francis hospital nsambya: a criteria-based audit

BACKGROUND

The maternal mortality ratio of Uganda is still high and the leading causes of maternal mortality are postpartum haemorrhage (PPH), severe pre-eclampsia and eclampsia. Criteria-based audit (CBA) is a way of improving quality of care that has not been commonly used in low income countries. This study aimed at finding out the quality of care provided to patients with these conditions and to find out if the implementation of recommendations from the audit cycle resulted in improvement in quality of care.

METHODS

This study was a CBA following a time series study design. It was done in St. Francis Hospital Nsambya and it involved assessment of adherence to standards of care for PPH, severe pre-eclampsia and eclampsia. An initial audit was done for 3 consecutive months, then findings were presented to health workers and recommendations made; we implemented the recommendations in a subsequent month and this comprised three interventions namely continuing medical education (CME), drills and displaying guidelines; a re-audit was done in the proceeding 3 consecutive months and analysis compared adherence rates of the initial audit with those of the re-audit.

RESULTS

Pearson Chi-Square test revealed that the adherence rates of 7 out of 10 standards of care for severe pre-eclampsia/eclampsia were statistically significantly higher in the re-audit than in the initial audit; also, the adherence rates of 3 out of 4 standards of care for PPH were statistically significantly higher in the re-audit than in the initial audit.

CONCLUSION

The giving of feedback on quality of care and the implementation of recommendations made during the CBA including CME, drills and displaying guidelines was associated with improvements in the quality of care for patients with PPH, severe pre-eclampsia and eclampsia.

Improving Standards of Care in Obstructed Labour: A Criteria-Based Audit at a Referral Hospital in a Low-Resource Setting in Tanzania

Objective

In low-resource settings, obstructed labour is strongly associated with severe maternal morbidity and intrapartum asphyxia, and consequently maternal and perinatal deaths. This study evaluated the impact of a criteria-based audit of the diagnosis and management of obstructed labour in a low-resource setting.

Methods

A baseline criteria-based audit was conducted from October 2013 to March 2014, followed by a workshop in which stakeholders gave feedback on interventions agreed upon to improve obstetric care. The implemented interventions included but were not limited to introducing standard guidelines for diagnosis and management of obstructed labour, agreeing on mandatory review by specialist for cases that are assigned caesarean section, re-training and supervision on use and interpretation of partograph and, strengthening team work between doctors, mid-wives and theatre staff. After implementing these interventions in March, a re-audit was performed from July 2015 to November, 2015, and the results were compared to those of the baseline audit.

Results

Two hundred and sixty deliveries in the baseline survey and 250 deliveries in the follow-up survey were audited. Implementing the new criteria improved the diagnosis from 74% to 81% (p = 0.049) and also the management of obstructed labour from 4.2% at baseline audit to 9.2% at re-audit (p = 0.025). Improved detection of prolonged labour through heightened observation of regular contractions, protracted cervical dilatation, protracted descent of presenting part, arrested cervical dilation, and severe moulding contributed to improved standards of diagnosis (all p < 0.04). Patient reviews by senior obstetricians increased from 34% to 43% (p = 0.045) and reduced time for caesarean section intervention from the median time of 120 to 90 minutes (p = 0.001) improved management (all p < 0.05). Perinatal outcomes, neonatal distress and fresh stillbirths, were reduced from 16% to. 8.8% (p = 0.01).

Conclusion

A criteria-based audit proved to be a feasible and useful tool in improving diagnosis and management of obstructed labour using available resources. Some of the observed changes in practice were of modest magnitude implying demand for further improvements, while sustaining those already put in place.

Criteria-based audit to improve quality of care of foetal distress: standardising obstetric care at a national referral hospital in a low resource setting, Tanzania

BACKGROUND

In Tanzania, substandard intrapartum management of foetal distress contributes to a third of perinatal deaths, and the majority are term deliveries. We conducted a criteria-based audit with feedback to determine whether standards of diagnosis and management of foetal distress would be improved in a low-resource setting.

METHODS

During 2013-2015, a criteria-based audit was performed at the national referral hospital in Dar es Salaam. Case files of deliveries with a diagnosis of foetal distress were identified and audited. Two registered nurses under supervision of a nurse midwife, a specialist obstetrician and a consultant obstetrician, reviewed the case files. Criteria for standard diagnosis and management of foetal distress were developed based on international and national guidelines, and literature reviews, and then, stepwise applied, in an audit cycle. During the baseline audit, substandard care was identified, and recommendations for improvement of care were proposed and implemented. The effect of the implementations was assessed by the differences in percentage of standard diagnosis and management between the baseline and re-audit, using Chi-square test or Fisher's exact test, when appropriate.

RESULTS

In the baseline audit and re-audit, 248 and 251 deliveries with a diagnosis of foetal distress were identified and audited, respectively. The standard of diagnosis increased significantly from 52 to 68 % (p < 0.001). Standards of management improved tenfold from 0.8 to 8.8 % (p < 0.001). Improved foetal heartbeat monitoring using a Fetal Doppler was the major improvement in diagnoses, while change of position of the mother and reduced time interval from decision to perform caesarean section to delivery were the major improvements in management (all p < 0.001). Percentage of cases with substandard diagnosis and management was significantly reduced in both referred public and non-referred private patients (all p ≤ 0.01) but not in non-referred public and referred private patients.

CONCLUSION

The criteria-based audit was able to detect substandard diagnosis and management of foetal distress and improved care using feedback and available resources.

Effective non-drug interventions for improving outcomes and quality of maternal health care in sub-Saharan Africa: a systematic review

BACKGROUND

Many interventions have been implemented to improve maternal health outcomes in sub-Saharan Africa (SSA). Currently, however, systematic information on the effectiveness of these interventions remains scarce. We conducted a systematic review of published evidence on non-drug interventions that reported effectiveness in improving outcomes and quality of care in maternal health in SSA.

METHODS

African Journals Online, Bioline, MEDLINE, Ovid, Science Direct, and Scopus databases were searched for studies published in English between 2000 and 2015 and reporting on the effectiveness of interventions to improve quality and outcomes of maternal health care in SSA. Articles focusing on interventions that involved drug treatments, medications, or therapies were excluded. We present a narrative synthesis of the reported impact of these interventions on maternal morbidity and mortality outcomes as well as on other dimensions of the quality of maternal health care (as defined by the Institute of Medicine 2001 to comprise safety, effectiveness, efficiency, timeliness, patient centeredness, and equitability).

RESULTS

Seventy-three studies were included in this review. Non-drug interventions that directly or indirectly improved quality of maternal health and morbidity and mortality outcomes in SSA assumed a variety of forms including mobile and electronic health, financial incentives on the demand and supply side, facility-based clinical audits and maternal death reviews, health systems strengthening interventions, community mobilization and/or peer-based programs, home-based visits, counseling and health educational and promotional programs conducted by health care providers, transportation and/or communication and referrals for emergency obstetric care, prevention of mother-to-child transmission of HIV, and task shifting interventions. There was a preponderance of single facility and community-based studies whose effectiveness was difficult to assess.

CONCLUSIONS

Many non-drug interventions have been implemented to improve maternal health care in SSA. These interventions have largely been health facility and/or community based. While the evidence on the effectiveness of interventions to improve maternal health is varied, study findings underscore the importance of implementing comprehensive interventions that strengthen different components of the health care systems, both in the community and at the health facilities, coupled with a supportive policy environment.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42015023750.

[Quality of caesarean delivery: A cross-sectional study in 12 hospitals in Benin]

BACKGROUND

Caesarean section (CS) is a major obstetric intervention, widely recognized as an effective means to reduce maternal and perinatal mortality, when appropriately performed. CS numbers and rates are regularly published but quality is rarely taken into account. This study aims to describe the quality of caesarean delivery in selected hospitals in Benin.

METHODS

A cross-sectional study was performed among women who had undergone a CS between 18 December 2013 and 8 February 2014 in one randomly selected hospital in each of the 12 administrative districts of Benin. The quality of CS was defined according to the analytical framework of Dujardin and Delvaux (1998) with its four pillars (access, diagnosis, procedure, postoperative care). Data were collected from hospital files and questionnaires from women and hospital directors. Data analysis was performed using Epi Info 3.5.1.

RESULTS

Six hundred and thirty-two women delivered by CS during the period and 579 were eligible for the study. They were aged 26.5±6.3 years, 73.2% living more than 5km from the hospital, 63.0% referred to a health facility of whom 46.0% and 21.8% were transported by motorcycle and by ambulance respectively. The median expenditure by family was FCFA 30 000, ranging from 0 to FCFA 200 000. The admission examination was complete in 12.6% of women and the partograph used in 32.6%. The average CS rate was 37.6%, the average response time, 124minutes. Emergency CS was performed in 80.7%, for absolute maternal indications in 48.0% and under spinal anesthesia in 84.2% (98.3% of which were conducted by a nurse or midwife anesthetist). Maternal mortality was 2000 maternal deaths per 100 000 deliveries, while perinatal mortality was 7.4% (88.4% due to stillbirths).

CONCLUSION

CS in Benin hospitals partially fulfilled quality criteria. However access to CS remains difficult and errors of diagnosis or excessive delay are too frequent. Quality CS is not yet a reality in Benin hospitals.

Maternal death and obstetric care audits in Nigeria: a systematic review of barriers and enabling factors in the provision of emergency care

Background

Maternal death reviews and obstetric audits identify causes and circumstances related to occurrence of a maternal death or serious complication and inform improvements in quality of care. Given Nigeria’s high maternal mortality, the lessons learned from past experiences can provide a good evidence base for informed decision making. We aimed to synthesise findings from maternal death reviews and other obstetric audits conducted in Nigeria through a systematic review, seeking to identify common barriers and enabling factors related to the provision of emergency obstetric care.

Methods

We searched for maternal death reviews and obstetric care audits reported in the published literature from 2000–2014. A ‘best-fit’ framework approach was used to extract data using a structured data extraction form. The articles that met the inclusion criteria were assessed using a nine point quality score.

Results

Of the 1,841 abstracts and titles at initial screening, 329 full text articles were reviewed and 43 papers fulfilled the inclusion criteria. Four types of barriers were reported related to: transport and referral; health workers; availability of services; and organisational factors. Three elements stand out in Nigeria as contributing to maternal mortality: delays in Caesarean section, unavailability of magnesium sulphate and lack of safe blood transfusion services.

Conclusions

Obstetric care reviews and audits are useful activities to undertake and should be promoted by improving the processes used to conduct them, as well as extending their implementation to rural and basic level health facilities and to the community. Urgent areas for quality improvement in obstetric care, even in tertiary and teaching hospitals should focus on organisational factors to reduce delays in conducting Caesarean section and making blood and magnesium sulphate available for all who need these interventions.

Assessment of the quality of clinical documentation in India's JSY cash transfer program for facility births in Madhya Pradesh

OBJECTIVE

To gain insight into the quality of care in facilities implementing the Janani Suraksha Yojana (JSY) cash transfer program in Madhya Pradesh, India, by reviewing the level of documentation in the clinical records of women who delivered.

METHODS

The present retrospective, descriptive study reviewed case records of women who delivered at 73 primary, secondary, and tertiary level facilities in three districts of Madhya Pradesh between 2012 and 2013. Twenty elements of care were assessed encompassing clinical history and admission details, care during delivery and postnatal period, and discharge details.

RESULTS

A total of 1239 records were reviewed. The extent of documentation varied among the elements assessed-e.g. 24 (1.9%) records documented advice at discharge, 171 (13.8%) documented postnatal blood pressure, 437 (35.3%) documented fetal heart rate, and 1220 (98.5%) documented admission date. The extent of documentation was better at higher level facilities.

CONCLUSION

The quality of clinical documentation in the JSY program was found to be unacceptably poor in Madhya Pradesh. Improving staff skills and practices in clinical documentation and record keeping will be required to enable clinical processes to be assessed and quality of care to be improved.

Early detection of maternal deaths in Senegal through household-based death notification integrating verbal and social autopsy: a community-level case study

Background

Reliable detection of maternal deaths is an essential prerequisite for successful diagnosis of barriers to care and formulation of relevant targeted interventions. In a community-level case study, the use of household-level surveillance in Senegal unveiled an apparent increase in maternal deaths, which triggered a rapid-cycle collaborative response to implement a multipronged set of quick-win and sustained interventions intended to improve quality care.

Methods

Part of a multi-country effort, the Millennium Villages Project is implementing a routine community-level information system in Senegal, able to detect maternal deaths in real-time and uncover clinical and social factors contributing to mortality. Within this geographically demarcated area of approximately 32 000 inhabitants, with a well-structured health system with patient referral services, deaths were registered and notified by community health workers, followed by timely verbal and social autopsies. Using the Pathway to Survival conceptual framework, case analysis and mortality reviews were conducted for evaluation and quality improvement purposes.

Results

The estimated maternal mortality rates rose from 67/100000 births in 2009 (1 death), to 202/100000 births in 2010 (3 deaths) and 392/100000 births (5 deaths) in 2011. Although absolute numbers of maternal deaths remained too small for robust statistical analysis, following verbal autopsy analyses in 2011, it became evident that an unexpectedly high proportion of maternal deaths were occurring at the referral hospital, mostly post-Caesarian section. Inadequate case management of post-partum haemorrhage at the referral hospital was the most frequently identified probable cause of death. A joint task team systematically identified several layers of inefficiencies, with a potential negative impact on a larger catchment area than the study community.

Conclusions

In this study, routine community-based surveillance identified inefficiencies at a tertiary level of care. Community-level surveillance systems that include pregnancy, birth and death tracking through household visits by community health workers , combined with verbal and social autopsy can identify barriers within the continuum of maternal care. Use of mHealth data collection tools sensitive enough to detect small changes in community-level mortality trends in real-time, can facilitate rapid-cycle quality improvement interventions, particularly when associated with social accountability structures of mortality reviews.

Audit-identified avoidable factors in maternal and perinatal deaths in low resource settings: a systematic review

BACKGROUND

Audits provide a rational framework for quality improvement by systematically assessing clinical practices against accepted standards with the aim to develop recommendations and interventions that target modifiable deficiencies in care. Most childbirth-associated mortality audits in developing countries are focused on a single facility and, up to now, the avoidable factors in maternal and perinatal deaths cataloged in these reports have not been pooled and analyzed. We sought to identity the most frequent avoidable factors in childbirth-related deaths globally through a systematic review of all published mortality audits in low and lower-middle income countries.

METHODS

We performed a systematic review of published literature from 1965 to November 2011 in Pubmed, Embase, CINAHL, POPLINE, LILACS and African Index Medicus. Inclusion criteria were audits from low and lower-middle income countries that identified at least one avoidable factor in maternal or perinatal mortality. Each study included in the analysis was assigned a quality score using a previously published instrument. A meta-analysis was performed for each avoidable factor taking into account the sample sizes and quality score from each individual audit. The study was conducted and reported according to PRISMA guidelines for systematic reviews.

RESULTS

Thirty-nine studies comprising 44 datasets and a total of 6,205 audited deaths met inclusion criteria. The analysis yielded 42 different avoidable factors, which fell into four categories: health worker-oriented factors, patient-oriented factors, transport/referral factors, and administrative/supply factors. The top three factors by attributable deaths were substandard care by a health worker, patient delay, and deficiencies in blood transfusion capacity (accounting for 688, 665, and 634 deaths attributable, respectively). Health worker-oriented factors accounted for two-thirds of the avoidable factors identified.

CONCLUSIONS

Audits provide insight into where systematic deficiencies in clinical care occur and can therefore provide crucial direction for the targeting of interventions to mitigate or eliminate health system failures. Given that the main causes of maternal and perinatal deaths are generally consistent across low resource settings, the specific avoidable factors identified in this review can help to inform the rational design of health systems with the aim of achieving continued progress towards Millennium Development Goals Four and Five.

A root-cause analysis of maternal deaths in Botswana: towards developing a culture of patient safety and quality improvement

Background

In 2007, 95% of women in Botswana delivered in health facilities with 73% attending at least 4 antenatal care visits. HIV-prevalence in pregnant women was 28.7%. The maternal mortality ratio in 2010 was 163 deaths per 100 000 live births versus the government target of 130 for that year, indicating that the Millennium Development Goal 5 was unlikely to be met. A root-cause analysis was carried out with the aim of determining the underlying causes of maternal deaths reported in 2010, to categorise contributory factors and to prioritise appropriate interventions based on the identified causes, to prevent further deaths.

Methods

Case-notes for maternal deaths were reviewed by a panel of five clinicians, initially independently then discussed together to achieve consensus on assigning contributory factors, cause of death and whether each death was avoidable or not at presentation to hospital. Factors contributing to maternal deaths were categorised into organisational/management, personnel, technology/equipment/supplies, environment and barriers to accessing healthcare.

Results

Fifty-six case notes were available for review from 82 deaths notified in 2010, with 0–4 contributory factors in 19 deaths, 5–9 in 27deaths and 9–14 in nine. The cause of death in one case was not ascertainable since the notes were incomplete. The high number of contributory factors demonstrates poor quality of care even where deaths were not avoidable: 14/23 (61%) of direct deaths were considered avoidable compared to 12/32 (38%) indirect deaths. Highest ranking categories were: failure to recognise seriousness of patients’ condition (71% of cases); lack of knowledge (67%); failure to follow recommended practice (53%); lack of or failure to implement policies, protocols and guidelines (44%); and poor organisational arrangements (35%). Half the deaths had some barrier to accessing health services.

Conclusions

Root-cause analysis demonstrates the interactions between patients, health professionals and health system in generating adverse outcomes for patients. The lessons provided indicate where training of undergraduate and postgraduate medical, midwifery and nursing students need to be intensified, with emphasis on evidence-based practice and adherence to protocols. Action plans and interventions aimed at changing the circumstances that led to maternal deaths can be implemented and re-evaluated.

Using direct clinical observation to assess the quality of cesarean delivery in Afghanistan: an exploratory study

Background

As part of a National Emergency Obstetric and Newborn Care (EmONC) Needs Assessment, a special study was undertaken in July 2010 to examine the quality of cesarean deliveries in Afghanistan and examine the utility of direct clinical observation as an assessment method in low-resource settings.

Methods

This cross-sectional assessment of the quality of cesareans at 14 facilities in Afghanistan included a survey of surgeons regarding their routine cesarean practices, direct observation of 29 cesarean deliveries and comparison of observations with facility records for 34 additional cesareans conducted during the 3 days prior to the observation period at each facility. For both observed cases and record reviews, we assessed time intervals between specified points of care-arrival to the ward, first evaluation, detection of a complication, decision for cesarean, incision, and birth.

Results

All time intervals with the exception of “decision to skin incision” were longer in the record reviews than in observed cases. Prior cesarean was the most common primary indication for all cases. All mothers in both groups observed survived through one hour postpartum. Among newborns there were two stillbirths (7%) in observed births and seven (21%) record reviews. Although our sample is too small to show statistical significance, the difference is noteworthy. In six of the reviewed cesareans resulting in stillbirth, a fetal heart rate was recorded in the operating theater, although four were recorded as macerated. For the two fresh stillbirths, the cesarean surgeries were recorded as scheduled and not urgent.

Conclusions

Direct observation of cesarean deliveries enabled us to assess a number of preoperative, postoperative, and intraoperative procedures that are often not described in medical records in low resource settings. Comparison of observations with findings from provider interviews and facility records allowed us to infer whether observed practices were typical of providers and facilities and detect potential Hawthorne effects.

Facilitators and barriers to quality of care in maternal, newborn and child health: a global situational analysis through metareview

OBJECTIVE

Conduct a global situational analysis to identify the current facilitators and barriers to improving quality of care (QoC) for pregnant women, newborns and children.

STUDY DESIGN

Metareview of published and unpublished systematic reviews and meta-analyses conducted between January 2000 and March 2013 in any language. Assessment of Multiple Systematic Reviews (AMSTAR) is used to assess the methodological quality of systematic reviews.

SETTINGS

Health systems of all countries. Study outcome: QoC measured using surrogate indicators--effective, efficient, accessible, acceptable/patient centred, equitable and safe.

ANALYSIS

Conducted in two phases (1) qualitative synthesis of extracted data to identify and group the facilitators and barriers to improving QoC, for each of the three population groups, into the six domains of WHO's framework and explore new domains and (2) an analysis grid to map the common facilitators and barriers.

RESULTS

We included 98 systematic reviews with 110 interventions to improve QoC from countries globally. The facilitators and barriers identified fitted the six domains of WHO's framework--information, patient-population engagement, leadership, regulations and standards, organisational capacity and models of care. Two new domains, 'communication' and 'satisfaction', were generated. Facilitators included active and regular interpersonal communication between users and providers; respect, confidentiality, comfort and support during care provision; engaging users in decision-making; continuity of care and effective audit and feedback mechanisms. Key barriers identified were language barriers in information and communication; power difference between users and providers; health systems not accounting for user satisfaction; variable standards of implementation of standard guidelines; shortage of resources in health facilities and lack of studies assessing the role of leadership in improving QoC. These were common across the three population groups.

CONCLUSIONS

The barriers to good-quality healthcare are common for pregnant women, newborns and children; thus, interventions targeted to address them will have uniform beneficial effects. Adopting the identified facilitators would help countries strengthen their health systems and ensure high-quality care for all.

Delays in receiving obstetric care and poor maternal outcomes: results from a national multicentre cross-sectional study

Background

The vast majority of maternal deaths in low-and middle-income countries are preventable. Delay in obtaining access to appropriate health care is a fairly common problem which can be improved. The objective of this study was to explore the association between delay in providing obstetric health care and severe maternal morbidity/death.

Methods

This was a multicentre cross-sectional study, involving 27 referral obstetric facilities in all Brazilian regions between 2009 and 2010. All women admitted to the hospital with a pregnancy-related cause were screened, searching for potentially life-threatening conditions (PLTC), maternal death (MD) and maternal near-miss (MNM) cases, according to the WHO criteria. Data on delays were collected by medical chart review and interview with the medical staff. The prevalence of the three different types of delays was estimated according to the level of care and outcome of the complication. For factors associated with any delay, the PR and 95%CI controlled for cluster design were estimated.

Results

A total of 82,144 live births were screened, with 9,555 PLTC, MNM or MD cases prospectively identified. Overall, any type of delay was observed in 53.8% of cases; delay related to user factors was observed in 10.2%, 34.6% of delays were related to health service accessibility and 25.7% were related to quality of medical care. The occurrence of any delay was associated with increasing severity of maternal outcome: 52% in PLTC, 68.4% in MNM and 84.1% in MD.

Conclusions

Although this was not a population-based study and the results could not be generalized, there was a very clear and significant association between frequency of delay and severity of outcome, suggesting that timely and proper management are related to survival.

Training and nutritional components of PMTCT programmes associated with improved intrapartum quality of care in Mali and Senegal

OBJECTIVE

Scale-up of prevention of mother-to-child transmission (PMTCT) of HIV programmes in sub-Saharan Africa has stimulated interest to assess whether these programmes can indirectly affect other health priorities. This study assesses whether PMTCT programmes, or components of these programmes, are associated with better obstetrical quality of care and how PMTCT may reinforce existing maternal health programmes.

DESIGN

Cross-sectional analysis of data from a cluster-randomized trial called QUARITE.

SETTING

Mali and Senegal, West Africa.

PARTICIPANTS

Thirty-one referral hospitals and 612 obstetrical patients.

INTERVENTION

The exposure of interest was PMTCT measured with a scale containing 10 components describing different prongs of a hospital PMTCT programme. Other variables of interest included: presence of a quality of care improvement programme, hospital resources and patient demographic characteristics.

MAIN OUTCOME MEASURE

Obstetrical quality of care measured through a validated chart abstraction tool.

RESULTS

Of 45 points, the mean hospital PMTCT score was 26.1 (SD: 6.7). Total PMTCT score was not significantly associated with quality of care, but programme component scores were. After adjustment for known predictors of quality of care, staff training in PMTCT (P = 0.03) and complementary nutritional services (P = 0.03) were significantly associated with better quality obstetrical care. A point increase in scores for either of these components was associated with 40% greater odds of good obstetrical care.

CONCLUSIONS

PMTCT training and nutritional components are significantly associated with better quality intrapartum care. Health professionals' training in maternal healthcare and PMTCT could be combined to improve the quality of obstetric care in the region.

Do strategies to improve quality of maternal and child health care in lower and middle income countries lead to improved outcomes? A review of the evidence

OBJECTIVES

Efforts to scale-up maternal and child health services in lower and middle income countries will fail if services delivered are not of good quality. Although there is evidence of strategies to increase the quality of health services, less is known about the way these strategies affect health system goals and outcomes. We conducted a systematic review of the literature to examine this relationship.

METHODS

We undertook a search of MEDLINE, SCOPUS and CINAHL databases, limiting the results to studies including strategies specifically aimed at improving quality that also reported a measure of quality and at least one indicator related to health system outcomes. Variation in study methodologies prevented further quantitative analysis; instead we present a narrative review of the evidence.

FINDINGS

Methodologically, the quality of evidence was poor, and dominated by studies of individual facilities. Studies relied heavily on service utilisation as a measure of strategy success, which did not always correspond to improved quality. The majority of studies targeted the competency of staff and adequacy of facilities. No strategies addressed distribution systems, public-private partnership or equity. Key themes identified were the conflict between perceptions of patients and clinical measures of quality and the need for holistic approaches to health system interventions.

CONCLUSION

Existing evidence linking quality improvement strategies to improved MNCH outcomes is extremely limited. Future research would benefit from the inclusion of more appropriate indicators and additional focus on non-facility determinants of health service quality such as health policy, supply distribution, community acceptability and equity of care.

Effect of a facility-based multifaceted intervention on the quality of obstetrical care: a cluster randomized controlled trial in Mali and Senegal

Background

Maternal mortality in referral hospitals in Mali and Senegal surpasses 1% of obstetrical admissions. Poor quality obstetrical care contributes to high maternal mortality; however, poor care is often linked to insufficient hospital resources. One promising method to improve obstetrical care is maternal death review. With a cluster randomized trial, we assessed whether an intervention, based on maternal death review, could improve obstetrical quality of care.

Methods

The trial began with a pre-intervention year (2007), followed by two years of intervention activities and a post-intervention year. We measured obstetrical quality of care in the post-intervention year using a criterion-based clinical audit (CBCA). We collected data from 32 of the 46 trial hospitals (16 in each trial arm) and included 658 patients admitted to the maternity unit with a trial of labour. The CBCA questionnaire measured 5 dimensions of care- patient history, clinical examination, laboratory examination, delivery care and postpartum monitoring. We used adjusted mixed models to evaluate differences in CBCA scores by trial arms and examined how levels of hospital human and material resources affect quality of care differences associated with the intervention.

Results

For all women, the mean percentage of care criteria met was 66.3 (SD 13.5). There were significantly greater mean CBCA scores in women treated at intervention hospitals (68.2) compared to control hospitals (64.5). After adjustment, women treated at intervention sites had 5 points’ greater scores than those at control sites. This difference was mostly attributable to greater clinical examination and post-partum monitoring scores. The association between the intervention and quality of care was the same, irrespective of the level of resources available to a hospital; however, as resources increased, so did quality of care scores in both arms of the trial.

Trial registration

The QUARITE trial is registered on the Current Controlled Trials website under ISRCTN46950658

Private sector delivery of health services in developing countries: a mixed-methods study on quality assurance in social franchises

Background

Across the developing world health care services are most often delivered in the private sector and social franchising has emerged, over the past decade, as an increasingly popular method of private sector health care delivery. Social franchising aims to strengthen business practices through economies of scale: branding clinics and purchasing drugs in bulk at wholesale prices. While quality is one of the established goals of social franchising, there is no published documentation of how quality levels might be set in the context of franchised private providers, nor what quality assurance measures can or should exist within social franchises. The aim of this study was to better understand the quality assurance systems currently utilized in social franchises, and to determine if there are shared standards for practice or quality outcomes that exist across programs.

Methods

The study included three data sources and levels of investigation: 1) Self-reported program data; 2) Scoping telephone interviews; and 3) In-depth field interviews and clinic visits.

Results

Social Franchises conceive of quality assurance not as an independent activity, but rather as a goal that is incorporated into all areas of franchise operations, including recruitment, training, monitoring of provider performance, monitoring of client experience and the provision of feedback.

Conclusions

These findings are the first evidence to support the 2002 conceptual model of social franchising which proposed that the assurance of quality was one of the three core goals of all social franchises. However, while quality is important to franchise programs, quality assurance systems overall are not reflective of the evidence to-date on quality measurement or quality improvement best practices. Future research in this area is needed to better understand the details of quality assurance systems as applied in social franchise programs, the process by which quality assurance becomes a part of the organizational culture, and the components of a quality assurance system that are most correlated with improved quality of clinical care for patients.

Translating coverage gains into health gains for all women and children: the quality care opportunity

Wendy Graham and colleagues reflect on quality of maternal health care, the focus of Year 1 of the PLOS-MHTF Maternal Health Collection and its 18 new articles.

The role of delays in severe maternal morbidity and mortality: expanding the conceptual framework

Maternal mortality has gained importance in research and policy since the mid-1980s. Thaddeus and Maine recognized early on that timely and adequate treatment for obstetric complications were a major factor in reducing maternal deaths. Their work offered a new approach to examining maternal mortality, using a three-phase framework to understand the gaps in access to adequate management of obstetric emergencies: phase I--delay in deciding to seek care by the woman and/or her family; phase II--delay in reaching an adequate health care facility; and phase III--delay in receiving adequate care at that facility. Recently, efforts have been made to strengthen health systems' ability to identify complications that lead to maternal deaths more rapidly. This article shows that the combination of the "three delays" framework with the maternal "near-miss" approach, and using a range of information-gathering methods, may offer an additional means of recognizing a critical event around childbirth. This approach can be a powerful tool for policymakers and health managers to guarantee the principles of human rights within the context of maternal health care, by highlighting the weaknesses of systems and obstetric services.

Improved quality of management of eclampsia patients through criteria based audit at Muhimbili National Hospital, Dar es Salaam, Tanzania. Bridging the quality gap

BACKGROUND

Criteria-based audits (CBA) have been used to improve clinical management in developed countries, but have only recently been introduced in the developing world. This study discusses the use of a CBA to improve quality of care among eclampsia patients admitted at a University teaching hospital in Dar es Salaam Tanzania.

OBJECTIVE

The prevalence of eclampsia in MNH is high (≈6%) with the majority of cases arriving after start of convulsions. In 2004-2005 the case-fatality rate in eclampsia was 5.1% of all pregnant women admitted for delivery (MNH obstetric data base). A criteria-based audit (CBA) was used to evaluate the quality of care for eclamptic mothers admitted at Muhimbili National Hospital (MNH), Dar es Salaam, Tanzania after implementation of recommendations of a previous audit.

METHODS

A CBA of eclampsia cases was conducted at MNH. Management practices were evaluated using evidence-based criteria for appropriate care. The Ministry of Health (MOH) guidelines, local management guidelines, the WHO manual supplemented by the WHO Reproductive Health Library, standard textbooks, the Cochrane database and reviews in peer reviewed journals were adopted. At the initial audit in 2006, 389 case notes were assessed and compared with the standards, gaps were identified, recommendations made followed by implementation. A re-audit of 88 cases was conducted in 2009 and compared with the initial audit.

RESULTS

There was significant improvement in quality of patient management and outcome between the initial and re-audit: Review of management plan by senior staff (76% vs. 99%; P=0.001), urine for albumin test (61% vs. 99%; P=0.001), proper use of partogram to monitor labour (75% vs. 95%; P=0.003), treatment with steroids for lung maturity (2.0% vs. 24%; P=0.001), Caesarean section within 2 hours of decision (33% vs. 61%; P=0.005), full blood count (28% vs. 93%; P=0.001), serum urea and creatinine (44% vs. 86%; P=0.001), liver enzymes (4.0% vs. 86%; P=0.001), and specialist review within 2 hours of admission (25% vs. 39%; P=0.018). However, there was no significant change in terms of delivery within 24 hours of admission (69% vs. 63%; P=0.33). There was significant reduction of maternal deaths (7.7% vs. 0%; P=0.001).

CONCLUSION

CBA is applicable in low resource setting and can help to improve quality of care in obstetrics including management of pre-eclampsia and eclampsia.

Validity and reliability of criterion based clinical audit to assess obstetrical quality of care in West Africa

Background

In Mali and Senegal, over 1% of women die giving birth in hospital. At some hospitals, over a third of infants are stillborn. Many deaths are due to substandard medical practices. Criterion-based clinical audits (CBCA) are increasingly used to measure and improve obstetrical care in resource-limited settings, but their measurement properties have not been formally evaluated. In 2011, we published a systematic review of obstetrical CBCA highlighting insufficient considerations of validity and reliability. The objective of this study is to develop an obstetrical CBCA adapted to the West African context and assess its reliability and validity. This work was conducted as a sub-study within a cluster randomized trial known as QUARITE.

Methods

Criteria were selected based on extensive literature review and expert opinion. Early 2010, two auditors applied the CBCA to identical samples at 8 sites in Mali and Senegal (n = 185) to evaluate inter-rater reliability. In 2010–11, we conducted CBCA at 32 hospitals to assess construct validity (n = 633 patients). We correlated hospital characteristics (resource availability, facility perinatal and maternal mortality) with mean hospital CBCA scores. We used generalized estimating equations to assess whether patient CBCA scores were associated with perinatal mortality.

Results

Results demonstrate substantial (ICC = 0.67, 95% CI 0.54; 0.76) to elevated inter-rater reliability (ICC = 0.84, 95% CI 0.77; 0.89) in Senegal and Mali, respectively. Resource availability positively correlated with mean hospital CBCA scores and maternal and perinatal mortality were inversely correlated with hospital CBCA scores. Poor CBCA scores, adjusted for hospital and patient characteristics, were significantly associated with perinatal mortality (OR 1.84, 95% CI 1.01-3.34).

Conclusion

Our CBCA has substantial inter-rater reliability and there is compelling evidence of its validity as the tool performs according to theory.

Trial registration

Current Controlled Trials ISRCTN46950658

Relating the construction and maintenance of maternal ill-health in rural Indonesia

Estimates suggest that over 350,000 deaths and more than 20 million severe disabilities result from the complications of pregnancy, childbirth or its management each year. Death and disability occur predominately among disadvantaged women in resource-poor settings and are largely preventable with adequate delivery care. This paper presents the substantive findings and policy implications from a programme of PhD research, of which the overarching objective was to assess quality of, and access to, care in obstetric emergencies. Three critical incident audits were conducted in two rural districts on Java, Indonesia: a confidential enquiry, a verbal autopsy survey, and a community-based review. The studies examined cases of maternal mortality and severe morbidity from the perspectives of local service users and health providers. A range of inter-related determining factors was identified. When unexpected delivery complications occurred, women and families were often uninformed, unprepared, found care unavailable, unaffordable, and many relied on traditional providers. Midwives in villages made important contributions by stabilising women and facilitating referrals but were often scarce in remote areas and lacked sufficient clinical competencies and payment incentives to treat the poor. Emergency transport was often unavailable and private transport was unreliable and incurred costs. In facilities, there was a reluctance to admit poorer women and those accepted were often admitted to ill-equipped, under-staffed wards. As a result, referrals between hospitals were also common. Otherwise, social health insurance, designed to reduce financial barriers, was particularly problematic, constraining quality and access within and outside facilities. Health workers and service users provided rich and explicit assessments of care and outcomes. These were used to develop a conceptual model in which quality and access are conceived of as social processes, observable through experience and reflective of the broader relationships between individuals and health systems. According to this model, differential quality and access can become both socially legitimate (imposed by structural arrangements) and socially legitimised (reciprocally maintained through the actions of individuals). This interpretation suggests that in a context of commodified care provision, adverse obstetric outcomes will occur and recur for disadvantaged women. Health system reform should focus on the unintended effects of market-based service provision to exclude those without the ability to pay for delivery care directly.

Improving global maternal health: progress, challenges, and promise

PURPOSE OF REVIEW

This review discusses the unprecedented global commitment to improve maternal health and scientific advancements in the field achieved during the last year.

RECENT FINDINGS

Achievements at political, scientific, and programmatic levels targeted at improving maternal health, especially in low-resource settings, are described. Remaining challenges are discussed and the most promising areas of research and practice aimed at addressing these challenges are identified.

SUMMARY

For the first time in decades, it is evident that progress in reducing mortality on a global scale is possible. Results showing increases in coverage of key maternal health interventions and the establishment of a system for promoting accountability are key determinants of that progress.