Improving the quality of hospital care for children by supportive supervision: a cluster randomized trial, Kyrgyzstan

Quality of inpatient paediatric and newborn care in district hospitals: WHO indicators, measurement, and improvement

Poor-quality paediatric and neonatal care in district hospitals in low-income and middle-income countries (LMICs) was first highlighted more than 20 years ago. WHO recently developed more than 1000 paediatric and neonatal quality indicators for hospitals. Prioritising these indicators should account for the challenges in producing reliable process and outcome data in these settings, and their measurement should not unduly narrow the focus of global and national actors to reports of measured indicators. A three-tier, long-term strategy for the improvement of paedicatric and neonatal care in LMIC district hospitals is needed, comprising quality measurement, governance, and front-line support. Measurement should be better supported by integrating data from routine information systems to reduce the future cost of surveys. Governance and quality management processes need to address system-wide issues and develop supportive institutional norms and organisational culture. This strategy requires governments, regulators, professions, training institutions, and others to engage beyond the initial consultation on indicator selection, and to tackle the pervasive constraints that undermine the quality of district hospital care. Institutional development must be combined with direct support to hospitals. Too often the focus of indicator measurement as an improvement strategy is on reporting up to regional or national managers, but not on providing support down to hospitals to attain quality care.

Unnecessary hospitalisations and polypharmacy practices in Tajikistan: a health system evaluation for strengthening primary healthcare

BACKGROUND

Children and pregnant women require multiple contacts with the healthcare system. While most conditions can be managed by primary healthcare (PHC) providers, hospitalisations are common. This health system evaluation in Tajikistan quantifies unnecessary and unnecessarily prolonged hospitalisations and assesses antibiotic and polypharmacy practices.

METHODS

Data were retrospectively collected from randomly selected medical records from 15 hospitals. Inclusion criteria were children 2-59 months of age with a primary diagnosis of acute respiratory infection or diarrhoea, or pregnant women with threatened preterm labour, threatened miscarriages, premature rupture of membranes or mild pre-eclampsia, hospitalised between January and September 2021.

RESULTS

Among 440 children and 422 pregnant women, unnecessary hospitalisations accounted for 40.5% and 69.2% of hospitalisations, respectively, ranging from 0% to 92.7% across the hospitals. Among necessary hospitalisations, 63.0% and 39.2% were unnecessarily prolonged in children and women, respectively.Prior to admission, 36.8% of children had received antibiotics, in which more than half intramuscularly. During hospitalisation, 92.5% of children and 28.9% of women received antibiotics. Children and women received an average of 5 and 6.5 drugs, respectively; most were not indicated or with no evidence of benefits.

CONCLUSIONS

The methodology is applicable across all health systems and can provide important insights on health service use and resource waste. Findings of this assessment in Tajikistan have led to evidence-based decisions and actions from stakeholders and policy makers with the goal of strengthening PHC and improving the management of common diseases in children and pregnant women.

Regional Experience in Improving the Quality and Cost-Effectiveness of Medical Care for Children with Acute Respiratory Pathology in the Rostov Region

One of the priorities of the modern world medical community is the continuous comprehensive improvement of medical care quality. Evaluation of medical care quality and material costs level for the management of patients with acute respiratory pathology (ARP) was performed in one city medical facility, as well as cost-effectiveness analysis of the project “Improvement of medical care quality for children of the Rostov region”. The first step of this study was retrospective audit of source medical records (n = 154) of Children’s hospital via the adapted World Health Organization questionnaire “Evaluation of in-patient care quality for children” recommended for Europe and revised in 2015. Inclusion criteria: hospitalization of patients with acute conditions; outcome — recovery with no complications; presence of one of the clinical manifestations (acute nasopharyngitis, acute non-obstructive bronchitis, acute obstructive bronchitis, acute obstructive laryngitis, acute community-acquired pneumonia). The cost-effectiveness evaluation was performed considering the direct treatment costs and the coefficient of economic costs per patient (CECPP). Analysis of the study’s first stage has revealed defects in medical care quality, significant and irrational material costs of the medical facility at all stages of medical and diagnostic care for children with ARP. CECPP peak indicators came under notice in all observation groups due to high expenses on medications and specifically those not included in clinical practice guidelines, vast amount of unreasonable hospitalizations and diagnostic procedures, expenses on physical therapy (PT), etc. Analysis of the study’s second stage medical records (n = 146) of patients with ARP took place after the initial audit followed by quarterly monitoring and hospital staff training (endpoint — 12 months). Significant improvements in the health care quality and cost-effectiveness for children with ARP have been shown.

WHO standards-based tools to measure service providers' and service users' views on the quality of hospital child care: development and validation in Italy

OBJECTIVES

Evidence showed that, even in high-income countries, children and adolescents may not receive high quality of care (QOC). We describe the development and initial validation, in Italy, of two WHO standards-based questionnaires to conduct an assessment of QOC for children and young adolescents at inpatient level, based on the provider and user perspectives.

DESIGN

Multiphase, mixed-methods study.

SETTING, PARTICIPANTS AND METHODS

The two questionnaires were developed in four phases equally conducted for each tool. Phase 1 which included the prioritisation of the WHO Quality Measures according to predefined criteria and the development of the draft questionnaires. In phase 2 content face validation of the draft questionnaires was assessed among both experts and end-users. In phase 3 the optimised questionnaires were field tested to assess acceptability, perceived utility and comprehensiveness (N=163 end-users). In phase 4 intrarater reliability and internal consistency were evaluated (N=170 and N=301 end-users, respectively).

RESULTS

The final questionnaires included 150 WHO Quality Measures. Observed face validity was excellent (kappa value of 1). The field test resulted in response rates of 98% and 76% for service users and health providers, respectively. Among respondents, 96.9% service users and 90.4% providers rated the questionnaires as useful, and 86.9% and 93.9%, respectively rated them as comprehensive. Intrarater reliability was good, with Cohen's kappa values exceeding 0.70. Cronbach alpha values ranged from 0.83 to 0.95, indicating excellent internal consistency.

CONCLUSIONS

Study findings suggest these tools developed have good content and face validity, high acceptability and perceived utility, and good intrarater reliability and internal consistency, and therefore could be used in health facilities in Italy and similar contexts. Priority areas for future research include how tools measuring paediatric QOC can be more effectively used to help health professionals provide the best possible care.

WHO standards-based tool to measure women's views on the quality of care around the time of childbirth at facility level in the WHO European region: development and validation in Italy

OBJECTIVES

A comprehensive WHO standards-based tool to measure women's perceived quality of maternal and newborn care (QMNC) in health facilities is needed to allow for comparisons of data across settings and over time. This paper describes the development of such a tool, and its validation in Italy.

DESIGN

A multiphase, mixed-methods study involving qualitative and quantitative research methods.

SETTING

Nine health facilities in Italy.

METHODS

The questionnaire was developed in six phases: (1) Defining the scope, characteristics and a potential list of measures for the tool; (2) initial content and construct validation; (3) first field testing to assess acceptability and perceived utility for end-users (1244 women, 35 decision makers) and further explore construct validity; (4) content optimisation and score development; (5) assessment of face validity, intrarater reliability and internal consistency and (6) second field testing in nine maternity hospitals (4295 women, 78 decision-makers).

RESULTS

The final version of the tool included 116 questions accounting for 99 out of the 350 of the extended lists of WHO Quality Measures. Observed face validity was very good, with 100% agreement for 101 (87%) questions and Kappa exceeding 0.60 for remaining ones. Reliability was good, with either high agreement or Kappa exceeding 0.60 for all items. Cronbach alpha values ranged from 0.84 to 0.88, indicating very good internal consistency. Acceptability across seven hospitals was good (mean response rate: 57.4%, 95% CI 44.4% to 70.5%). The questionnaire proved to be useful, driving the development of actions plan to improve the QMNC in each facility.

CONCLUSIONS

Study findings suggest that the tool has good content, construct, face validity, intrarater reliability and internal consistency, while being acceptable and useful. Therefore, it could be used in health facilities in Italy and similar context. More research should investigate how effectively use the tool in different countries for improving the QMNC.

Mixed‐methods evaluation of a continuing education approach to improving district hospital care for children in Lao PDR

Objective

To understand the impact of a multifaceted intervention on improving acute hospital care provided to children in two district hospitals in northern Lao PDR.

Methods

We developed a continuing education intervention, which integrated separate program content using a common pool of facilitators and low‐fidelity simulation scenarios. Coaching was delivered over one year through two‐day hospital visits to each hospital six to eight weeks apart with visits incorporating feedback. A comparative case study was conducted between two hospital sites. Medical record abstraction from inpatient cases was performed at each visit. Focus groups and interviews with staff were conducted to understand perceived changes to case management.

Results

Inpatient case management scores showed incremental improvement over time, from 50% at baseline to 80% at the end of one year at Hospital A and 52% to 97% at Hospital B. The key themes that emerged from the qualitative data from both hospitals were the value of the educational method and increased belief in capability. Hospital B showed more incremental and sustained improvement. Qualitative data revealed that the directors of Hospital B demonstrated modelling and behavioural reinforcement.

Conclusion

Improving the quality of care in low‐resource settings is feasible. A hands‐on practical approach with repeated coaching visits reinforced by feedback can lead to behaviour change. Optimal impact requires harnessing leadership and motivation for change among health workers.

Assessing the quality of care for children attending health facilities: a systematic review of assessment tools

INTRODUCTION

Assessing quality of healthcare is integral in determining progress towards equitable health outcomes worldwide. Using the WHO 'Standards for improving quality of care for children and young adolescents in health facilities' as a reference standard, we aimed to evaluate existing tools that assess quality of care for children.

METHODS

We undertook a systematic literature review of publications/reports between 2008 and 2020 that reported use of quality of care assessment tools for children (<15 years) in health facilities. Identified tools were reviewed against the 40 quality statements and 510 quality measures from the WHO Standards to determine the extent each tool was consistent with the WHO Standards. The protocol was registered in PROSPERO ID: CRD42020175652.

RESULTS

Nine assessment tools met inclusion criteria. Two hospital care tools developed by WHO-Europe and WHO-South-East Asia Offices had the most consistency with the WHO Standards, assessing 291 (57·1%) and 208 (40·8%) of the 510 quality measures, respectively. Remaining tools included between 33 (6·5%) and 206 (40·4%) of the 510 quality measures. The WHO-Europe tool was the only tool to assess all 40 quality statements. The most common quality measures absent were related to experience of care, particularly provision of educational, emotional and psychosocial support to children and families, and fulfilment of children's rights during care.

CONCLUSION

Quality of care assessment tools for children in health facilities are missing some key elements highlighted by the WHO Standards. The WHO Standards are, however, extensive and applying all the quality measures in every setting may not be feasible. A consensus of key indicators to monitor the WHO Standards is required. Existing tools could be modified to include priority indicators to strengthen progress reporting towards delivering quality health services for children. In doing so, a balance between comprehensiveness and practical utility is needed.

PROSPERO REGISTRATION NUMBER

CRD42020175652.

Quality of maternal and newborn hospital care in Brazil: a quality improvement cycle using the WHO assessment and quality tool

BACKGROUND

Increasing efforts toward quality improvement (QI) are necessary in low- and middle-income countries (LMICs) to reduce maternal and perinatal mortality and morbidity and to promote respectful care. In Brazil, perinatal health indicators are below targets in several states despite universal access to perinatal services and very high rates of institutional births, indicating poor quality of care (QoC) as a key issue to be addressed. However, research efforts to develop and test QoC improvement interventions are scarce.

OBJECTIVES

We assessed the effects of a 1-year comprehensive QI cycle using a World Health Organization (WHO) assessment and quality tool on maternal and newborn care at hospital level and documented QIs obtained after a 1-year comprehensive QI cycle.

METHODS

Uncontrolled, unblinded, pre-post study carried out in six maternity hospitals in Pernambuco, Brazil, accounting for 29 128 live births in 2014. A standards-based and participatory approach based on a WHO quality assessment and improvement tool for maternal and neonatal care at hospital level was used. A national team of assessors supervised by international experts carried out baseline and final assessments. An action plan was developed and implemented to address key quality gaps emerging from the baseline assessment and from two supportive supervision visits.

RESULTS

At baseline, hospitals presented a variety of quality gaps, the majority common to all participating centers. Gaps in case management of normal and complicated deliveries and in respectful and holistic care were predominant, in both teaching/tertiary and secondary care hospitals. After one year, several improvements were observed, particularly in respectful care during labor and at delivery, in case management of normal labor and delivery and in neonatal care.

CONCLUSIONS

A systematic participatory approach based on a WHO tool produced important QIs in a relatively short time and should be considered for use for large-scale QI programs in Brazil and other LMICs. Its comprehensive, peer-to-peer and action-oriented nature and its capability to document QI over time and to build a QI culture represent important comparative advantages over other QI interventions.

Quality of healthcare for children with severe acute malnutrition in a refugee setting: cross-sectional study in West Nile Region, Uganda

OBJECTIVES

5.0 million annual deaths in low-income and middle-income countries are due to poor quality of care (QOC). We evaluated the QOC provided to malnourished children in West Nile Region in Uganda.

DESIGN

Cross-sectional study.

SETTING

West Nile Region, an area hosting over one million refugees.

PARTICIPANTS

Among 148 facilities providing nutritional services, 30 randomly selected facilities (20%) and the records of 1467 children with severe acute malnutrition (100% of those attending the 30 facilities during last year) were assessed.

OUTCOMES

The national Nutrition Service Delivery Assessment (NSDA) tool was used to assess capacity areas related to QOC. Case management, data quality and health outcomes were assessed from official health records. Multivariate analysis was performed to explore factors significantly associated with better cure rates.

RESULTS

Of 305 NSDA scores allocated to 30 participating centres, 201 (65.9%) were 'good' or 'excellent'. However, 20 (66.7%) facilities had 'poor' 'quality improvement mechanisms' and 13 (43.3%) had 'poor' 'human resources'. Overall data quality in official records was poor, while recorded quality of case management was overall fair. Average cure rate was significantly lower than international Sphere standards (50.4% vs 75% p<0.001) with a higher default rate (23.2% vs 15% p<0.001). Large heterogeneity among facilities was detected for all indicators. Refugee-hosting and non-refugee-hosting facilities had a similar cure rate (47.1% vs 52.1%) though transfer rates were higher for those hosting refugees (21.5% vs 1.9%, p<0.001) despite better 'equipment and supplies'. 'Good/excellent' 'equipment' and 'store management' were significantly associated with better cure rates in outpatient therapeutic centres (+55.9, p<0.001; +65.4, p=0.041, respectively) in multivariate analysis.

CONCLUSIONS

Though most NSDA capacity areas were rated good or excellent, health outcomes of malnourished children in West Nile Region, both in refugee-hosting and non-refugee-hosting facilities, are significantly below international standards. Effective and sustainable approaches to improve malnourished child health outcomes are needed.

Assessing quality of newborn care at district facilities in Malawi

Background

Malawi is celebrated as one of the few countries in sub-Saharan Africa to meet the Millennium Development Goal of reducing under-5 mortality by two-thirds between 1990 and 2015. However, within this age range neonatal mortality rates are the slowest to decline, even though rates of facility births are increasing. Examining the quality of neonatal care at district-level facilities where most deliveries occur is warranted.

Objective

The objective of this paper is to evaluate the quality of neonatal care in three district hospitals and one primary health centre in southern Malawi as well as to report the limitations and lessons learned on using the WHO integrated quality of care assessment tool.

Methods

These facility assessments were part of the “Integrating a neonatal healthcare package for Malawi” project, a part of the Innovating for Maternal and Child Health in Africa (IMCHA) initiative. The WHO integrated quality of care assessment tool was used to assess quality of care and availability and quantity of supplies and resources. The modules on infrastructure, neonatal care and labour and delivery were included. Facility assessments were administered in November 2017 and aspects of care were scored on a Likert scale from one to five (a score of 5 indicating compliance with WHO standards of care; one as lowest indicating inadequate care).

Results

The continuum of labour, delivery and neonatal care were assessed to identify areas that required improvements to meet standards of care. Critical areas for improvements included infection control (mean score 2.9), equipment, supplies and setup for newborn care in the labor ward (2.3), in the surgical theater (3.3), and nursery (3.4 nursery facilities, 3.0 supplies and equipment), as well as for management of sick newborns (3.2), monitoring and follow-up (3.6). Only one of the 12 domains, laboratory, met the standards of care with only minor improvements needed (4.0).

Conclusion

The WHO integrated quality of care assessment tool is a validated tool that can shed light on the complex quality of care challenges faced by district-level health facilities. The results reveal that the quality of care needs improvement, particularly for sick and vulnerable newborns.

Nutritional services for children in Beira, Mozambique: a study reporting on participatory use of data to generate quality improvement recommendations

Background

Existing literature suggest frequent gaps in the quality of care (QoC) provided to children with malnutrition in low-income and middle-income countries. Beira is the second largest city in Mozambique. This study included two phases: phase 1 was a systematic assessment of the QoC provided to malnourished children in Beira; phase 2 aimed at using findings of the assessment to develop recommendations, with a participatory approach, to improve QoC.

Methods

In phase 1, all facilities offering nutritional care to children in Beira were included, and exit health outcomes were reviewed against international SPHERE standards. A sample of four (66%) facilities was randomly selected for a comprehensive assessment of all areas contributing to QoC using an adapted WHO tool. In phase 2, key stakeholders were identified, and using a participatory approach, a list of actions for improving the QoC for malnourished children was agreed.

Results

In phase 1, outcomes of 1428 children with either severe acute malnutrition or moderate acute malnutrition (MAM) were reviewed. In-hospital recovery rate (70.1%) was almost in line with the SPHERE standard (75%), while at outpatient level, it was significantly lower (48.2%, risk ratio (RR) 0.68, p<0.0001). Recovery rate was significantly lower in HIV seropositive compared with seronegative (39.2% vs 52.8%, RR 1.34, p=0.005). High heterogeneity in MAM recovery rate was detected among facilities (range 32.5%-61.0%). Overall, out of all domains contributing to QoC in the sample, 28/46 (60.8%) indicated suboptimal care with significant health hazards and 13/46 (28.2%) indicated totally inadequate care with severe health hazards. In phase 2, a list of 38 actions to improve QoC for malnourished children was agreed among 33 local and national stakeholders.

Conclusions

Large heterogeneity in QoC for malnourished children in Beria was detected. The study documents a concrete example of using data proactively, for agreeing actions to improve QoC.

Towards improved health service quality in Tanzania: contribution of a supportive supervision approach to increased quality of primary healthcare

Background

Universal Health Coverage only leads to the desired health outcomes if quality of health services is ensured. In Tanzania, quality has been a major concern for many years, including the problem of ineffective and inadequate routine supportive supervision of healthcare providers by council health management teams. To address this, we developed and assessed an approach to improve quality of primary healthcare through enhanced routine supportive supervision.

Methods

Mixed methods were used, combining trends of quantitative quality of care measurements with qualitative data mainly collected through in-depth interviews. The former allowed for identification of drivers of quality improvements and the latter investigated the perceived contribution of the new supportive supervision approach to these improvements.

Results

The results showed that the new approach managed to address quality issues that could be solved either solely by the healthcare provider, or in collaboration with the council. The new approach was able to improve and maintain crucial primary healthcare quality standards across different health facility level and owner categories in various contexts.

Conclusion

Together with other findings reported in companion papers, we could show that the new supportive supervision approach not only served to assess quality of primary healthcare, but also to improve and maintain crucial primary healthcare quality standards. The new approach therefore presents a powerful tool to support, guide and drive quality improvement measures within council. It can thus be considered a suitable option to make routine supportive supervision more effective and adequate.

Supportive supervision to improve the quality and outcome of outpatient care among malnourished children: a cluster randomised trial in Arua district, Uganda

Introduction

Suboptimal quality of paediatric care has been reported in resource-limited settings, but little evidence exists on interventions to improve it in such settings. This study aimed at testing supportive supervision (SS) for improving health status of malnourished children, quality of case management, overall quality of care, and the absolute number of children enrolled in the nutritional services.

Methods

This was a cluster randomised trial conducted in Arua district. Six health centres (HCs) with the highest volume of work were randomised to either SS or no intervention. SS was delivered by to HCs staff (phase 1), and later extended to community health workers (CHWs) (phase 2). The primary outcome was the cure rate, measured at children level. Quality of case management was assessed by six pre-defined indicators. Quality of care was assessed using the national Nutrition Service Delivery Assessment (NSDA) tool. Access to care was estimated with the number of children accessing HC nutritional services.

Results

Overall, 737 children were enrolled. In the intervention arm, the cure rate (83.8% vs 44.9%, risk ratio (RR)=1.91, 95% CI: 1.56–2.34, p=0.001), quality of care as scored by NSDA (RR=1.57, 95% CI: 1.01–2.44, p=0.035) and correctness in complementary treatment (RR=1.52, 95% CI: 1.40–1.67, p=0.001) were significantly higher compared with control. With the extension of SS to CHWs (phase 2), there was a significant 38.6% more children accessing care in the intervention HCs (RR=1.26, 95% CI: 1.11–1.44, p=0.001) compared with control.

Conclusion

SS significantly improved the cure rate of malnourished children, and the overall quality of care, SS to CHWs significantly increased the crude number of children enrolled in the nutritional services. More studies should confirm these results, and evaluate the cost-effectiveness of SS.

Implementation of the WHO manual for Robson classification: an example from Sri Lanka using a local database for developing quality improvement recommendations

OBJECTIVES

This study aimed at describing the use of a prospective database on hospital deliveries for analysing caesarean section (CS) practices according to the WHO manual for Robson classification, and for developing recommendations for improving the quality of care (QoC).

DESIGN

Observational study.

SETTING

University Obstetric Unit at De Soysa Hospital for Women, the largest maternity unit in Sri Lanka.

DATA COLLECTION AND ANALYSIS

For each childbirth, 150 variables were routinely collected in a standardised form and entered into a database. Data were routinely monitored for ensuring quality. Information on deliveries occurring from July 2015 to June 2017 were analysed according the WHO Robson classification manual. Findings were discussed internally to develop quality improvement recommendations.

RESULTS

7504 women delivered in the hospital during the study period and at least one maternal or fetal pathological condition was reported in 2845 (37.9%). The CS rate was 30.0%, with 11.9% CS being performed prelabour. According to the Robson classification, Group 3 and Group 1 were the most represented groups (27.0% and 23.1% of population, respectively). The major contributors to the CS rate were group 5 (29.6%), group 1 (14.0%), group 2a (13.3%) and group 10 (11.5%). The most commonly reported indications for CS included abnormal cardiotocography/suspected fetal distress, past CS and failed progress of labour or failed induction. These suggested the need for further discussion on CS practices. Overall, 18 recommendations were agreed on. Besides updating protocols and hands-on training, activities agreed on included monitoring and supervision, criterion-based audits, risk management meetings and appropriate information for patients, and recommendations to further improve the quality of data.

CONCLUSIONS

This study provides an example on how the WHO manual for Robson classification can be used in an action-oriented manner for developing recommendations for improving the QoC, and the quality of data collected.

Towards improved health service quality in Tanzania: An approach to increase efficiency and effectiveness of routine supportive supervision

Effective supportive supervision of healthcare services is crucial for improving and maintaining quality of care. However, this process can be challenging in an environment with chronic shortage of qualified human resources, overburdened healthcare providers, multiple roles of district managers, weak supply chains, high donor fragmentation and inefficient allocation of limited financial resources. Operating in this environment, we systematically evaluated an approach developed in Tanzania to strengthen the implementation of routine supportive supervision of primary healthcare providers. The approach included a systematic quality assessment at health facilities using an electronic tool and subsequent result dissemination at council level. Mixed methods were used to compare the new supportive supervision approach with routine supportive supervision. Qualitative data was collected through in-depth interviews in three councils. Observational data and informal communication as well as secondary data complemented the data set. Additionally, an economic costing analysis was carried out in the same councils. Compared to routine supportive supervision, the new approach increased healthcare providers’ knowledge and skills, as well as quality of data collected and acceptance of supportive supervision amongst stakeholders involved. It also ensured better availability of evidence for follow-up actions, including budgeting and planning, and higher stakeholder motivation and ownership of subsequent quality improvement measures. The new approach reduced time and cost spent during supportive supervision. This increased feasibility of supportive supervision and hence the likelihood of its implementation. Thus, the results presented together with previous findings suggested that if used as the standard approach for routine supportive supervision the new approach offers a suitable option to make supportive supervision more efficient and effective and therewith more sustainable. Moreover, the new approach also provides informed guidance to overcome several problems of supportive supervision and healthcare quality assessments in low- and middle income countries.

What is the quality of the maternal near-miss case reviews in WHO European Region? Cross-sectional study in Armenia, Georgia, Latvia, Republic of Moldova and Uzbekistan

OBJECTIVES

The maternal near-miss case review (NMCR) cycle is a type of clinical audit aiming at improving quality of maternal healthcare by discussing near-miss cases. In several countries this approach has been introduced and supported by WHO and partners since 2004, but information on the quality of its implementation is missing. This study aimed at evaluating the quality of the NMCR implementation in selected countries within WHO European Region.

DESIGN

Cross-sectional study.

SETTINGS

Twenty-three maternity units in Armenia, Georgia, Latvia, Moldova and Uzbekistan.

ASSESSMENT TOOLS

A predefined checklist including 50 items, according to WHO methodology. Quality in the NMCR implementation was defined by summary scores ranging from 0 (totally inappropriate) to 3 (appropriate).

RESULTS

Quality of the NMCR implementation was heterogeneous among different countries, and within the same country. Overall, the first part of the audit cycle (from case identification to case analysis) was fairly well performed (mean score 2.00, 95% CI 1.94 to 2.06), with the exception of the 'inclusion of users' views' (mean score 0.66, 95% CI 0.11 to 1.22), while the second part (developing recommendations, implementing them and ensuring quality) was poorly performed (mean score 0.66, 95% CI 0.11 to 1.22). Each country had at least one champion facility, where quality of the NMCR cycle was acceptable. Quality of the implementation was not associated with its duration. Gaps in implementation were of technical, organisational and attitudinal nature.

CONCLUSIONS

Ensuring quality in the NMCR may be difficult but achievable. The high heterogeneity in results within the same country suggests that quality of the NMCR implementation depends, to a large extent, from hospital factors, including staff's commitment, managerial support and local coordination. Efforts should be put in preventing and mitigating common barriers that hamper successful NMCR implementation.