Development of paediatric quality of inpatient care indicators for low-income countries - A Delphi study

Newborn signal functions in Bangladesh: Identification through expert consultation and assessment of readiness among public health facilities

Background

This study aimed to identify a set of newborn signal functions (NSFs) that can categorize health facilities and assist policymakers and health managers in appropriately planning and adequately monitoring the progress and performance of health facilities delivering newborn health care in Bangladesh and similar low-income settings.

Methods

A modified Delphi method was used to identify a set of NSFs and a cross-sectional health facility assessment among the randomly selected facilities was conducted to test them in public health facilities in Bangladesh. In the modified Delphi approach, three main steps of listing, prioritizing, and testing were followed to identify the set of NSFs. Then, to finalize the set of NSFs and its variables, a total of five Delphi workshops and three rounds of Delphi surveys were conducted. Finally, 205 public health facilities located in 41 randomly selected districts were assessed for the availability and readiness of finalized NSFs using the updated tool of Bangladesh Health Facility Survey (BHFS) 2017.

Results

Twenty NSFs were identified and finalized, nine of which were categorized as primary NSFs, 13 as basic NSFs, 18 as comprehensive NSFs, and 20 as advanced NSFs. Almost all district hospitals (DHs), Upazila health complexes (UHCs,) and maternal and child welfare centres (MCWCs) performed the primary NSFs in the last three months. However, around one-third of the union health and family welfare centres (UH&FWCs) and very few community clinics (CCs) performed them during the same period. The basic, comprehensive, and advanced NSF readiness was inadequate and inappropriate across all types of facilities, including DHs and UHCs.

Conclusions

In the absence of internationally or nationally agreed-upon NSFs to measure a health facility's service availability and readiness for providing newborn care, this study becomes the first to identify and finalize a set of NSFs and to incorporate relevant variables in the health facility assessment tool which can be used to monitor the availability and readiness of a newborn care facility. The identified NSFs can also be adapted for the countries with similar contexts and can serve as a standard base to determine a global set of NSFs.

Global core indicators for measuring WHO's paediatric quality-of-care standards in health facilities: development and expert consensus

BACKGROUND

There are currently no global recommendations on a parsimonious and robust set of indicators that can be measured routinely or periodically to monitor quality of hospital care for children and young adolescents. We describe a systematic methodology used to prioritize and define a core set of such indicators and their metadata for progress tracking, accountability, learning and improvement, at facility, (sub) national, national, and global levels.

METHODS

We used a deductive methodology which involved the use of the World Health Organization Standards for improving the quality-of-care for children and young adolescents in health facilities as the organizing framework for indicator development. The entire process involved 9 complementary steps which included: a rapid literature review of available evidence, the application of a peer-reviewed systematic algorithm for indicator systematization and prioritization, and multiple iterative expert consultations to establish consensus on the proposed indicators and their metadata.

RESULTS

We derived a robust set of 25 core indicators and their metadata, representing all 8 World Health Organization quality standards, 40 quality statements and 520 quality measures. Most of these indicators are process-related (64%) and 20% are outcome/impact indicators. A large proportion (84%) of indicators were proposed for measurement at both outpatient and inpatient levels. By virtue of being a parsimonious set and given the stringent criteria for prioritizing indicators with "quality measurement" attributes, the recommended set is not evenly distributed across the 8 quality standards.

CONCLUSIONS

To support ongoing global and national initiatives around paediatric quality-of-care programming at country level, the recommended indicators can be adopted using a tiered approach that considers indicator measurability in the short-, medium-, and long-terms, within the context of the country's health information system readiness and maturity. However, there is a need for further research to assess the feasibility of implementing these indicators across contexts, and the need for their validation for global common reporting.

Situational Analysis of Management of Childhood Diarrhea and Pneumonia in 13 District Hospitals in India

Objective

To generate evidence on the current situation of hospital care (emergency, inpatient and outpatient), for managing children presenting with diarrhea and pneumonia at 13 district hospitals in India.

Design

Facility-based assessment of district hospitals.

Settings

13 district hospitals in four states of Bihar, Madhya Pradesh, Odisha and Rajasthan.

Participants

Staff nurses and doctors.

Intervention

None.

Methods

An assessment was done across 13 district hospitals in four states by a group or trained assessors using an adapted quality assurance tool developed by Government of India where each aspect of care was scored (maximum score 5). Emergency services and triage, case management practices, laboratory support, and record maintenance for diarrhea and pneumonia were assessed.

Results

Separate diarrhea treatment unit was not earmarked in any of the DHs surveyed. Overall score obtained for adequate management of diarrhea and pneumonia was 2 and 2.2 which were poor. Pediatric beds were 6.8% of the total bed strength against the recommended 8–10%. There was a 65 percent shortfall in the numbers of medical officers in position and 48 percent shortfall of nurses. There were issues with availability and utilization of drugs and equipment at appropriate places with cumulative score of 2.8. Triage for sick children was absent in all the facilities.

Conclusion

The standards of pediatric care for management of diarrhea and pneumonia were far from satisfactory. This calls for improvement of pediatric care units and implementation of operational guidelines for improving management of diarrhea and pneumonia.

Newborn signal functions in Bangladesh: identification through expert consultation and assessment of readiness among public health facilities-study protocol using Delphi technique

INTRODUCTION

There is a set of globally accepted and nationally adapted signal functions for categorising health facilities for maternal services. Newborn resuscitation is the only newborn intervention which is included in the WHO recommended list of emergency obstetric care signal functions. This is not enough to comprehensively assess the readiness of a health facility for providing newborn services. In order to address the major causes of newborn death, the Government of Bangladesh has prioritised a set of newborn interventions for national scale-up, the majority of which are facility-based. Effective delivery of these interventions depends on a core set of functions (skills and services). However, there is no standardised and approved set of newborn signal functions (NSFs) based on which the service availability and readiness of a health facility can be assessed for providing newborn services. Thus, this study will be the first of its kind to identify such NSFs. These NSFs can categorise health facilities and assist policymakers and health managers to appropriately plan and adequately monitor the progress and performance of health facilities delivering newborn healthcare.

METHODS AND ANALYSIS

We will adopt the Delphi technique of consensus building for identification of NSFs and 1-2 indicator for each function while employing expert consultation from relevant experts in Bangladesh. Based on the identified NSFs and signal function indicators, the existing health facility assessment (HFA) tools will be updated, and an HFA survey will be conducted to assess service availability and readiness of public health facilities in relation to the new NSFs. Descriptive statistics (proportion) with a 95% CI will be used to report the level of service availability and readiness of public facilities regarding NSFs.

ETHICS AND DISSEMINATION

Ethical approval was obtained from Research Review and Ethical Review Committee of icddr, b (PR-17089). Results will be disseminated through meetings, seminars, conference presentations and international peer-review journal articles.

A new approach to assess the capability of health facilities to provide clinical care for sexual violence against women: a pilot study

Several tools have been developed to collect information on health facility preparedness to provide sexual violence response services; however, little guidance exists on how this information can be used to better understand which functions a facility can perform. Our study therefore aims to propose a set of signal functions that provide a framework for monitoring the availability of clinical sexual violence services. To illustrate the potential insights that can be gained from using our proposed signal functions, we used the framework to analyse data from a health facility census conducted in Central Province, Zambia. We collected the geographic coordinates of health facilities and police stations to assess women's proximity to multi-sectoral sexual violence response services. We defined three key domains of clinical sexual violence response services, based on the timing of the visit to the health facility in relation to the most recent sexual assault: (1) core services, (2) immediate care, and (3) delayed and follow-up care. Combining information from all three domains, we estimate that just 3% of facilities were able to provide a comprehensive response to sexual violence, and only 16% could provide time-sensitive immediate care services such as HIV post-exposure prophylaxis and emergency contraception. Services were concentrated in hospitals, with few health centres and no health posts fulfilling the signal functions for any of the three domains. Only 23% of women lived within 15 km of comprehensive clinical sexual violence health services, and 38% lived within 15 km of immediate care. These findings point to a need to develop clear strategies for decentralizing sexual violence services to maximize coverage and ensure equity in access. Overall, our findings suggest that our proposed signal functions could be a simple and valuable approach for assessing the availability of clinical sexual violence response services, identifying areas for improvement and tracking improvements over time.

Clinical indicators for common paediatric conditions: Processes, provenance and products of the CareTrack Kids study

BACKGROUND

In order to determine the extent to which care delivered to children is appropriate (in line with evidence-based care and/or clinical practice guidelines (CPGs)) in Australia, we developed a set of clinical indicators for 21 common paediatric medical conditions for use across a range of primary, secondary and tertiary healthcare practice facilities.

METHODS

Clinical indicators were extracted from recommendations found through systematic searches of national and international guidelines, and formatted with explicit criteria for inclusion, exclusion, time frame and setting. Experts reviewed the indicators using a multi-round modified Delphi process and collaborative online wiki to develop consensus on what constituted appropriate care.

RESULTS

From 121 clinical practice guidelines, 1098 recommendations were used to draft 451 proposed appropriateness indicators. In total, 61 experts (n = 24 internal reviewers, n = 37 external reviewers) reviewed these indicators over 40 weeks. A final set of 234 indicators resulted, from which 597 indicator items were derived suitable for medical record audit. Most indicator items were geared towards capturing information about under-use in healthcare (n = 551, 92%) across emergency department (n = 457, 77%), hospital (n = 450, 75%) and general practice (n = 434, 73%) healthcare facilities, and based on consensus level recommendations (n = 451, 76%). The main reason for rejecting indicators was 'feasibility' (likely to be able to be used for determining compliance with 'appropriate care' from medical record audit).

CONCLUSION

A set of indicators was developed for the appropriateness of care for 21 paediatric conditions. We describe the processes (methods), provenance (origins and evolution of indicators) and products (indicator characteristics) of creating clinical indicators within the context of Australian healthcare settings. Developing consensus on clinical appropriateness indicators using a Delphi approach and collaborative online wiki has methodological utility. The final indicator set can be used by clinicians and organisations to measure and reflect on their own practice.

Clinical cascades as a novel way to assess physical readiness of facilities for the care of small and sick neonates in Kenya and Uganda

BACKGROUND

Globally, there were 2.7 million neonatal deaths in 2015. Significant mortality reduction could be achieved by improving care in low- and middle-income countries (LMIC), where the majority of deaths occur. Determining the physical readiness of facilities to identify and manage complications is an essential component of strategies to reduce neonatal mortality.

METHODS

We developed clinical cascades for 6 common neonatal conditions then utilized these to assess 23 health facilities in Kenya and Uganda at 2 time-points in 2016 and 2017. We calculated changes in resource availability over time by facility using McNemar's test. We estimated mean readiness and loss of readiness for the 6 conditions and 3 stages of care (identification, treatment, monitoring-modifying treatment). We estimated overall mean readiness and readiness loss across all conditions and stages. Finally, we compared readiness of facilities with a newborn special care unit (NSCU) to those without using the two-sample test of proportions.

RESULTS

The cascade model estimated mean readiness of 26.3-26.6% across the 3 stages for all conditions. Mean readiness ranged from 11.6% (respiratory distress-apnea) to 47.8% (essential newborn care) across both time-points. The model estimated overall mean readiness loss of 30.4-31.9%. There was mild to moderate variability in the timing of readiness loss, with the majority occurring in the identification stage. Overall mean readiness was higher among facilities with a NSCU (36.8%) compared to those without (20.0%).

CONCLUSION

The cascade model provides a novel approach to quantitatively assess physical readiness for neonatal care. Among 23 facilities in Kenya and Uganda, we identified a consistent pattern of 30-32% readiness loss across cascades and stages. This aggregate measure could be used to monitor and compare readiness at the facility-, health system-, or national-level. Estimates of readiness and loss of readiness may help guide strategies to improve care, prioritize resources, and promote neonatal survival in LMICs.

Quality indicators for responsible use of medicines: a systematic review

OBJECTIVE

All healthcare systems require valid ways to evaluate service delivery. The objective of this study was to identify existing content validated quality indicators (QIs) for responsible use of medicines (RUM) and classify them using multiple frameworks to identify gaps in current quality measurements.

DESIGN

Systematic review without meta-analysis.

SETTING

All care settings.

SEARCH STRATEGY

CINAHL, Embase, Global Health, International Pharmaceutical Abstract, MEDLINE, PubMed and Web of Science databases were searched up to April 2018. An internet search was also conducted. Articles were included if they described medication-related QIs developed using consensus methods. Government agency websites listing QIs for RUM were also included.

ANALYSIS

Several multidimensional frameworks were selected to assess the scope of QI coverage. These included Donabedian's framework (structure, process and outcome), the Anatomical Therapeutic Chemical (ATC) classification system and a validated classification for causes of drug-related problems (c-DRPs; drug selection, drug form, dose selection, treatment duration, drug use process, logistics, monitoring, adverse drug reactions and others).

RESULTS

2431 content validated QIs were identified from 131 articles and 5 websites. Using Donabedian's framework, the majority of QIs were process indicators. Based on the ATC code, the largest number of QIs pertained to medicines for nervous system (ATC code: N), followed by anti-infectives for systemic use (J) and cardiovascular system (C). The most common c-DRPs pertained to 'drug selection', followed by 'monitoring' and 'drug use process'.

CONCLUSIONS

This study was the first systematic review classifying QIs for RUM using multiple frameworks. The list of the identified QIs can be used as a database for evaluating the achievement of RUM. Although many QIs were identified, this approach allowed for the identification of gaps in quality measurement of RUM. In order to more effectively evaluate the extent to which RUM has been achieved, further development of QIs may be required.

Association of the Paediatric Admission Quality of Care score with mortality in Kenyan hospitals: a validation study

Background

Measuring the quality of hospital admission care is essential to ensure that standards of practice are met and continuously improved to reduce morbidity and mortality associated with the illnesses most responsible for inpatient deaths. The Paediatric Admission Quality of Care (PAQC) score is a tool for measuring adherence to guidelines for children admitted with acute illnesses in a low-income setting. We aimed to explore the external and criterion-related validity of the PAQC score by investigating its association with mortality using data drawn from a diverse sample of Kenyan hospitals.

Methods

We identified children admitted to Kenyan hospitals for treatment of malaria, pneumonia, diarrhoea, or dehydration from datasets from three sources: an observational study, a clinical trial, and a national cross-sectional survey. We extracted variables describing the process of care provided to patients at admission and their eventual outcomes from these data. We applied the PAQC scoring algorithm to the data to obtain a quality-of-care score for each child. We assessed external validity of the PAQC score by its systematic replication in datasets that had not been previously used to investigate properties of the PAQC score. We assessed criterion-related validity by using hierarchical logistic regression to estimate the association between PAQC score and the outcome of mortality, adjusting for other factors thought to be predictive of the outcome or responsible for heterogeneity in quality of care.

Findings

We found 19 065 eligible admissions in the three validation datasets that covered 27 hospitals, of which 12 969 (68%) were complete cases. Greater guideline adherence, corresponding to higher PAQC scores, was associated with a reduction in odds of death across the three datasets, ranging between 9% (odds ratio 0·91, 95% CI 0·84–0·99; p=0·031) and 30% (0·70, 0·63–0·78; p<0·0001) adjusted reduction per unit increase in the PAQC score, with a pooled estimate of 17% (0·83, 0·78–0·89; p<0·0001). These findings were consistent with a multiple imputation analysis that used information from all observations in the combined dataset.

Interpretation

The PAQC score, designed as an index of the technical quality of care for the three commonest causes of admission in children, is also associated with mortality. This finding suggests that it could be a meaningful summary measure of the quality of care for common inpatient conditions and supports a link between process quality and outcome. It might have potential for application in low-income countries with similar disease profiles and in which paediatric practice recommendations are based on WHO guidelines.

Funding

The Wellcome Trust.

Effective coverage of essential inpatient care for small and sick newborns in a high mortality urban setting: a cross-sectional study in Nairobi City County, Kenya

BACKGROUND

Effective coverage requires that those in need can access skilled care supported by adequate resources. There are, however, few studies of effective coverage of facility-based neonatal care in low-income settings, despite the recognition that improving newborn survival is a global priority.

METHODS

We used a detailed retrospective review of medical records for neonatal admissions to public, private not-for-profit (mission) and private-for-profit (private) sector facilities providing 24×7 inpatient neonatal care in Nairobi City County to estimate the proportion of small and sick newborns receiving nationally recommended care across six process domains. We used our findings to explore the relationship between facility measures of structure and process and estimate effective coverage.

RESULTS

Of 33 eligible facilities, 28 (four public, six mission and 18 private), providing an estimated 98.7% of inpatient neonatal care in the county, agreed to partake. Data from 1184 admission episodes were collected. Overall performance was lowest (weighted mean score 0.35 [95% confidence interval or CI: 0.22-0.48] out of 1) for correct prescription of fluid and feed volumes and best (0.86 [95% CI: 0.80-0.93]) for documentation of demographic characteristics. Doses of gentamicin, when prescribed, were at least 20% higher than recommended in 11.7% cases. Larger (often public) facilities tended to have higher process and structural quality scores compared with smaller, predominantly private, facilities. We estimate effective coverage to be 25% (estimate range: 21-31%). These newborns received high-quality inpatient care, while almost half (44.5%) of newborns needed care but did not receive it and a further 30.4% of newborns received an inadequate service.

CONCLUSIONS

Failure to receive services and gaps in quality of care both contribute to a shortfall in effective coverage in Nairobi City County. Three-quarters of small and sick newborns do not have access to high-quality facility-based care. Substantial improvements in effective coverage will be required to tackle high neonatal mortality in this urban setting with high levels of poverty.

Assessing process of paediatric care in a resource-limited setting: a cross-sectional audit of district hospitals in Rwanda

BACKGROUND

Routine assessment of quality of care helps identify deficiencies which need to be improved. While gaps in the emergency care of children have been documented across sub-Saharan Africa, data from Rwanda are lacking.

OBJECTIVE

To assess the care of sick infants and children admitted to Rwandan district hospitals and the extent to which it follows currently recommended clinical practice guidelines in Rwanda.

METHODS

Data were gathered during a retrospective cross-sectional audit of eight district hospitals across Rwanda in 2012/2013. Medical records were randomly selected from each hospital and were reviewed to assess the process of care, focusing on the leading causes of under-5 mortality, including neonatal conditions, pneumonia, malaria and dehydration/diarrhoea.

RESULTS

Altogether, 522 medical records were reviewed. Overall completion of a structured neonatal admission record was above 85% (range 78.6-90.0%) and its use was associated with better documentation of key neonatal signs (median score 6/8 and 2/8 when used and not used, respectively). Deficiencies in the processes of care were identified across hospitals and there were rural/urban disparities for some indicators. For example, neonates admitted to urban district hospitals were more likely to receive treatment consistent with currently recommended guidelines [e.g. gentamicin (OR 2.52, 95% CI 1.03-6.43) and fluids (OR 2.69, 95% CI 1.2-6.2)] than those in rural hospitals. Likewise, children with pneumonia admitted to urban hospitals were more likely to receive the correct dosage of gentamicin (OR 4.47, 95% CI 1.21-25.1) and to have their treatment monitored (OR 3.75, 95% CI 1.57-8.3) than in rural hospitals. Furthermore, children diagnosed with malaria and admitted to urban hospitals were more likely to have their treatment (OR 2.7, 95% CI 1.15-6.41) monitored than those in rural hospitals.

CONCLUSIONS

Substantial gaps were identified in the process of neonatal and paediatric care across district hospitals in Rwanda. There is a need to (i) train health care professionals in providing neonatal and paediatric care according to nationally adopted clinical practice guidelines (e.g. ETAT+); (ii) establish a supervision and mentoring programme to ensure that the guidelines are available and used appropriately in district hospitals; and (iii) use admission checklists (e.g. neonatal and paediatric admission records) in district hospitals.

Does audit and feedback improve the adoption of recommended practices? Evidence from a longitudinal observational study of an emerging clinical network in Kenya

Background

Audit and feedback (A&F) is widely used in healthcare but there are few examples of how to deploy it at scale in low-income countries. Establishing the Clinical Information Network (CIN) in Kenya provided an opportunity to examine the effect of A&F delivered as part of a wider set of activities to promote paediatric guideline adherence.

Methods

We analysed data collected from medical records on discharge for children aged 2–59 months from 14 Kenyan hospitals in the CIN. Hospitals joined CIN in phases and for each we analysed their initial 25 months of participation that occurred between December 2013 and March 2016. A total of 34 indicators of adherence to recommendations were selected for evaluation each classified by form of feedback (passive, active and none) and type of task (simple or difficult documentation and those requiring cognitive work). Performance change was explored graphically and using generalised linear mixed models with attention given to the effects of time and use of a standardised paediatric admission record (PAR) form.

Results

Data from 60 214 admissions were eligible for analysis. Adherence to recommendations across hospitals significantly improved for 24/34 indicators. Improvements were not obviously related to nature of feedback, may be related to task type and were related to PAR use in the case of documentation indicators. There was, however, marked variability in adoption and adherence to recommended practices across sites and indicators. Hospital-specific factors, low baseline performance and specific contextual changes appeared to influence the magnitude of change in specific cases.

Conclusion

Our observational data suggest some change in multiple indicators of adherence to recommendations (aspects of quality of care) can be achieved in low-resource hospitals using A&F and simple job aides in the context of a wider network approach.

Identifying priorities for quality improvement at an emergency Department in Ghana

Background

Healthcare quality improvement (QI) is a global priority, and understanding the perspectives of frontline healthcare workers can help guide sustainable and meaningful change. We report a qualitative investigation of emergency department (ED) staff priorities for QI at a tertiary care hospital in Ghana. The aims of the study were to educate staff about the World Health Organization’s (WHO) definition of quality in healthcare, and to identify an initial focus for building a departmental QI program.

Methods

Semi-structured interviews were conducted with ED staff using open-ended questions to probe their understanding and valuation of the six dimensions of quality defined by the WHO. Participants were then asked to rank the dimensions in order of importance for QI. Qualitative responses were thematically analyzed, and ordinal rank-order was determined for quantitative data regarding QI priorities.

Results

Twenty (20) members of staff of different cadres participated, including ED physicians, nurses, orderlies, a security officer, and an accountant. A majority of participants (61%) ranked access to emergency healthcare as high priority for QI. Two recurrent themes - financial accessibility and hospital bed availability - accounted for the majority of discussions, each linked to all the dimensions of healthcare quality.

Conclusions

ED staff related all of the WHO quality dimensions to their work, and prioritized access to emergency care as the most important area for improvement. Participants expressed a high degree of motivation to improve healthcare quality, and the study helped with the development of a departmental QI program focused on the broad topic of access to ED services.

Electronic supplementary material

The online version of this article (10.1186/s12873-017-0139-0) contains supplementary material, which is available to authorized users.

Prioritising minimum standards of emergency care for children in resource-limited settings

BACKGROUND

There is global variation in the ability of hospital-based emergency centres to provide paediatric emergency medicine (PEM) services. Although minimum standards have been proposed, they may not be applicable in resource-limited settings.

OBJECTIVE

The goal was to identify reasonable minimum standards to provide safe and effective care for acutely ill children in resource-limited settings.

METHODS

Using previously proposed standards from the International Federation of Emergency Medicine (IFEM), a modified Delphi approach was used to reach agreement regarding minimum standards for PEM in resource-limited settings. Three rounds of surveys were electronically distributed to physicians working in resource-limited settings. Those standards with >67% agreement advanced to the subsequent round.

RESULTS

The categories of the surviving criteria included integrated service design, child and family-friendly care, initial assessment of the ill child, stabilising and treating an ill child, staff training and competence, equipment, supplies and medications, quality and safety, child protection, and advanced training and academic research.

CONCLUSIONS

Experts with experience in acute care of children in resource-limited settings have prioritised standards for paediatric emergency care. They identified 26 variables in nine domains from the original IFEM list of standards and two additional free text standards for the care of acutely ill children. This list may serve as a helpful guide for emergency centres to provide medical treatment for acutely ill children in resource-limited settings.

Pediatric emergency care capacity in a low-resource setting: An assessment of district hospitals in Rwanda

BACKGROUND

Health system strengthening is crucial to improving infant and child health outcomes in low-resource countries. While the knowledge related to improving newborn and child survival has advanced remarkably over the past few decades, many healthcare systems in such settings remain unable to effectively deliver pediatric advance life support management. With the introduction of the Emergency Triage, Assessment and Treatment plus Admission care (ETAT+)-a locally adapted pediatric advanced life support management program-in Rwandan district hospitals, we undertook this study to assess the extent to which these hospitals are prepared to provide this pediatric advanced life support management. The results of the study will shed light on the resources and support that are currently available to implement ETAT+, which aims to improve care for severely ill infants and children.

METHODS

A cross-sectional survey was undertaken in eight district hospitals across Rwanda focusing on the availability of physical and human resources, as well as hospital services organizations to provide emergency triage, assessment and treatment plus admission care for severely ill infants and children.

RESULTS

Many of essential resources deemed necessary for the provision of emergency care for severely ill infants and children were readily available (e.g. drugs and laboratory services). However, only 4/8 hospitals had BVM for newborns; while nebulizer and MDI were not available in 2/8 hospitals. Only 3/8 hospitals had F-75 and ReSoMal. Moreover, there was no adequate triage system across any of the hospitals evaluated. Further, guidelines for neonatal resuscitation and management of malaria were available in 5/8 and in 7/8 hospitals, respectively; while those for child resuscitation and management of sepsis, pneumonia, dehydration and severe malnutrition were available in less than half of the hospitals evaluated.

CONCLUSIONS

Our assessment provides evidence to inform new strategies to enhance the capacity of Rwandan district hospitals to provide pediatric advanced life support management. Identifying key gaps in the health care system is required in order to facilitate the implementation and scale up of ETAT+ in Rwanda. These findings also highlight a need to establish an outreach/mentoring program, embedded within the ongoing ETAT+ program, to promote cross-hospital learning exchanges.

Assessment of Parents' Perception of Quality of Pediatric Oncology Inpatient Care at Kenyatta National Hospital

OBJECTIVE

Adequate knowledge of parents' perception of quality of pediatric cancer care helps to identify the areas of care improvement which would contribute to disease outcome in regard to the quality of life and satisfaction with the care provided. The aim of the study was to assess the parents' perception of the quality of Pediatric Oncology Inpatient Care at Kenyatta National Hospital.

METHODS

A cross-sectional descriptive quantitative and qualitative study was undertaken using a pretested semi-structured questionnaire and a focused group discussion guide. Assessment of parents' perception of quality of care was done in relation to the institution's structures and care delivery processes. These included the ward environment, resources for cancer treatment, care processes, service providers, and parents' knowledge empowerment. Participants were systematically selected. Parents' perception was defined as satisfaction or dissatisfaction with the care provided. Data were analyzed using SPSS version 20.0 (Armonk, NY: IBM Corp.) and presented as frequencies and percentages. Chi-square was used to test the significant association between variables. Level of significance was set at a P ≤ 0.05.

RESULTS

A total of 107 respondents were interviewed and 57.9% were satisfied with the overall quality of care they received. The determinants of overall satisfaction in this study were found to be related to resources for cancer treatment (odds ratio [OR] =3.10; 95% confidence interval [CI] =1.39-6.90; P = 0.005), care delivery processes (OR = 2.87; 95% CI = 1.28-6.43; P = 0.009), and the ward environment (OR = 2.59; 95% CI = 1.17-5.74; P = 0.018).

CONCLUSIONS

The parents were moderately satisfied with the oncology care services their children received. The gaps identified in service delivery included those related to the availability of the required resources for efficient care delivery and also educational as well as psychosocial needs of the parents.

Improving documentation of clinical care within a clinical information network: an essential initial step in efforts to understand and improve care in Kenyan hospitals

In many low income countries health information systems are poorly equipped to provide detailed information on hospital care and outcomes. Information is thus rarely used to support practice improvement. We describe efforts to tackle this challenge and to foster learning concerning collection and use of information. This could improve hospital services in Kenya. We are developing a Clinical Information Network, a collaboration spanning 14 hospitals, policy makers and researchers with the goal of improving information available on the quality of inpatient paediatric care across common childhood illnesses in Kenya. Standardised data from hospitals' paediatric wards are collected using non-commercial and open source tools. We have implemented procedures for promoting data quality which are performed prior to a process of semi-automated analysis and routine report generation for hospitals in the network. In the first phase of the Clinical Information Network, we collected data on over 65 000 admission episodes. Despite clinicians' initial unfamiliarity with routine performance reporting, we found that, as an initial focus, both engaging with each hospital and providing them information helped improve the quality of data and therefore reports. The process has involved mutual learning and building of trust in the data and should provide the basis for collaborative efforts to improve care, to understand patient outcome, and to evaluate interventions through shared learning. We have found that hospitals are willing to support the development of a clinically focused but geographically dispersed Clinical Information Network in a low-income setting. Such networks show considerable promise as platforms for collaborative efforts to improve care, to provide better information for decision making, and to enable locally relevant research.

Signal functions for measuring the ability of health facilities to provide abortion services: an illustrative analysis using a health facility census in Zambia

Background

Annually, around 44 million abortions are induced worldwide. Safe termination of pregnancy (TOP) services can reduce maternal mortality, but induced abortion is illegal or severely restricted in many countries. All abortions, particularly unsafe induced abortions, may require post-abortion care (PAC) services to treat complications and prevent future unwanted pregnancy. We used a signal-function approach to look at abortion care services and illustrated its utility with secondary data from Zambia.

Methods

We refined signal functions for basic and comprehensive TOP and PAC services, including family planning (FP), and assessed functions currently being collected via multi-country facility surveys. We then used the 2005 Zambian Health Facility Census to estimate the proportion of 1369 health facilities that could provide TOP and PAC services under three scenarios. We linked facility and population data, and calculated the proportion of the Zambian population within reach of such services.

Results

Relevant signal functions are already collected in five facility assessment tools. In Zambia, 30 % of facilities could potentially offer basic TOP services, 3.7 % comprehensive TOP services, 2.6 % basic PAC services, and 0.3 % comprehensive PAC services (four facilities). Capability was highest in hospitals, except for FP functions. Nearly two-thirds of Zambians lived within 15 km of a facility theoretically capable of providing basic TOP, and one-third within 15 km of comprehensive TOP services. However, requiring three doctors for non-emergency TOP, as per Zambian law, reduced potential access to TOP services to 30 % of the population. One-quarter lived within 15 km of basic PAC and 13 % of comprehensive PAC services. In a scenario not requiring FP functions, one-half and one-third of the population were within reach of basic and comprehensive PAC respectively. There were huge urban-rural disparities in access to abortion care services. Comprehensive PAC services were virtually unavailable to the rural population.

Conclusions

Secondary data from facility assessments can highlight gaps in abortion service provision and coverage, but it is necessary to consider TOP and PAC separately. This approach, especially when combined with population data using geographic coordinates, can also be used to model the impact of various policy scenarios on access, such as requiring three medical doctors for non-emergency TOP. Data collection instruments could be improved with minor modifications and used for multi-country comparisons.

Improving quality for maternal care - a case study from Kerala, India

Background: The implementation of maternal health guidelines remains unsatisfactory, even for simple, well established interventions. In settings where most births occur in health facilities, as is the case in Kerala, India, preventing maternal mortality is linked to quality of care improvements.

Context: Evidence-informed quality standards (QS), including quality statements and measurable structure and process indicators, are one innovative way of tackling the guideline implementation gap. Having adopted a zero tolerance policy to maternal deaths, the Government of Kerala worked in partnership with the Kerala Federation of Obstetricians & Gynaecologists (KFOG) and NICE International to select the clinical topic, develop and initiate implementation of the first clinical QS for reducing maternal mortality in the state.

Description of practice: The NICE QS development framework was adapted to the Kerala context, with local ownership being a key principle. Locally generated evidence identified post-partum haemorrhage as the leading cause of maternal death, and as the key priority for the QS. A multidisciplinary group (including policy-makers, gynaecologists and obstetricians, nurses and administrators) was established. Multi-stakeholder workshops convened by the group ensured that the statements, derived from global and local guidelines, and their corresponding indicators were relevant and acceptable to clinicians and policy-makers in Kerala. Furthermore, it helped identify practical methods for implementing the standards and monitoring outcomes.

Lessons learned: An independent evaluation of the project highlighted the equal importance of a strong evidence-base and an inclusive development process. There is no one-size-fits-all process for QS development; a principle-based approach might be a better guide for countries to adapt global evidence to their local context.

A Review of Pediatric Critical Care in Resource-Limited Settings: A Look at Past, Present, and Future Directions

Fifteen years ago, United Nations world leaders defined millenium development goal 4 (MDG 4): to reduce under-5-year mortality rates by two-thirds by the year 2015. Unfortunately, only 27 of 138 developing countries are expected to achieve MDG 4. The majority of childhood deaths in these settings result from reversible causes, and developing effective pediatric emergency and critical care services could substantially reduce this mortality. The Ebola outbreak highlighted the fragility of health care systems in resource-limited settings and emphasized the urgent need for a paradigm shift in the global approach to healthcare delivery related to critical illness. This review provides an overview of pediatric critical care in resource-limited settings and outlines strategies to address challenges specific to these areas. Implementation of these tools has the potential to move us toward delivery of an adequate standard of critical care for all children globally, and ultimately decrease global child mortality in resource-limited settings.

Innovating to enhance clinical data management using non-commercial and open source solutions across a multi-center network supporting inpatient pediatric care and research in Kenya

Objective To share approaches and innovations adopted to deliver a relatively inexpensive clinical data management (CDM) framework within a low-income setting that aims to deliver quality pediatric data useful for supporting research, strengthening the information culture and informing improvement efforts in local clinical practice.

Materials and methods The authors implemented a CDM framework to support a Clinical Information Network (CIN) using Research Electronic Data Capture (REDCap), a noncommercial software solution designed for rapid development and deployment of electronic data capture tools. It was used for collection of standardized data from case records of multiple hospitals’ pediatric wards. R, an open-source statistical language, was used for data quality enhancement, analysis, and report generation for the hospitals.

Results In the first year of CIN, the authors have developed innovative solutions to support the implementation of a secure, rapid pediatric data collection system spanning 14 hospital sites with stringent data quality checks. Data have been collated on over 37 000 admission episodes, with considerable improvement in clinical documentation of admissions observed. Using meta-programming techniques in R, coupled with branching logic, randomization, data lookup, and Application Programming Interface (API) features offered by REDCap, CDM tasks were configured and automated to ensure quality data was delivered for clinical improvement and research use.

Conclusion A low-cost clinically focused but geographically dispersed quality CDM (Clinical Data Management) in a long-term, multi-site, and real world context can be achieved and sustained and challenges can be overcome through thoughtful design and implementation of open-source tools for handling data and supporting research.

Exploring sources of variability in adherence to guidelines across hospitals in low-income settings: a multi-level analysis of a cross-sectional survey of 22 hospitals

Background

Variability in processes of care and outcomes has been reported widely in high-income settings (at geographic, hospital, physician group and individual physician levels); however, such variability and the factors driving it are rarely examined in low-income settings.

Methods

Using data from a cross-sectional survey undertaken in 22 hospitals (60 case records from each hospital) across Kenya that aimed at evaluating the quality of routine hospital services, we sought to explore variability in four binary inpatient paediatric process indicators. These included three prescribing tasks and use of one diagnostic. To examine for sources of variability, we examined intra-class correlation coefficients (ICC) and their changes using multi-level mixed models with random intercepts for hospital and clinician levels and adjusting for patient and clinician level covariates.

Results

Levels of performance varied substantially across indicators and hospitals. The absolute values for ICCs also varied markedly ranging from a maximum of 0.48 to a minimum of 0.09 across the models for HIV testing and prescription of zinc, respectively. More variation was attributable at the hospital level than clinician level after allowing for nesting of clinicians within hospitals for prescription of quinine loading dose for malaria (ICC = 0.30), prescription of zinc for diarrhoea patients (ICC = 0.11) and HIV testing for all children (ICC = 0.43). However, for prescription of correct dose of crystalline penicillin, more of the variability was explained by the clinician level (ICC = 0.21). Adjusting for clinician and patient level covariates only altered, marginally, the ICCs observed in models for the zinc prescription indicator.

Conclusions

Performance varied greatly across place and indicator. The variability that could be explained suggests interventions to improve performance might be best targeted at hospital level factors for three indicators and clinician factors for one. Our data suggest that better understanding of performance and sources of variation might help tailor improvement interventions although further data across a larger set of indicators and sites would help substantiate these findings.

Moving towards routine evaluation of quality of inpatient pediatric care in Kenya

Background

Regular assessment of quality of care allows monitoring of progress towards system goals and identifies gaps that need to be addressed to promote better outcomes. We report efforts to initiate routine assessments in a low-income country in partnership with government.

Methods

A cross-sectional survey undertaken in 22 ‘internship training’ hospitals across Kenya that examined availability of essential resources and process of care based on review of 60 case-records per site focusing on the common childhood illnesses (pneumonia, malaria, diarrhea/dehydration, malnutrition and meningitis).

Results

Availability of essential resources was 75% (45/61 items) or more in 8/22 hospitals. A total of 1298 (range 54–61) case records were reviewed. HIV testing remained suboptimal at 12% (95% CI 7–19). A routinely introduced structured pediatric admission record form improved documentation of core admission symptoms and signs (median score for signs 22/22 and 8/22 when form used and not used respectively). Correctness of penicillin and gentamicin dosing was above 85% but correctness of prescribed intravenous fluid or oral feed volumes for severe dehydration and malnutrition were 54% and 25% respectively. Introduction of Zinc for diarrhea has been relatively successful (66% cases) but use of artesunate for malaria remained rare. Exploratory analysis suggests considerable variability of the quality of care across hospitals.

Conclusion

Quality of pediatric care in Kenya has improved but can improve further. The approach to monitoring described in this survey seems feasible and provides an opportunity for routine assessments across a large number of hospitals as part of national efforts to sustain improvement. Understanding variability across hospitals may help target improvement efforts.

Assessment of neonatal care in clinical training facilities in Kenya

OBJECTIVE

An audit of neonatal care services provided by clinical training centres was undertaken to identify areas requiring improvement as part of wider efforts to improve newborn survival in Kenya.

DESIGN

Cross-sectional study using indicators based on prior work in Kenya. Statistical analyses were descriptive with adjustment for clustering of data.

SETTING

Neonatal units of 22 public hospitals.

PATIENTS

Neonates aged <7 days.

MAIN OUTCOME MEASURES

Quality of care was assessed in terms of availability of basic resources (principally equipment and drugs) and audit of case records for documentation of patient assessment and treatment at admission.

RESULTS

All hospitals had oxygen, 19/22 had resuscitation and phototherapy equipment, but some key resources were missing—for example kangaroo care was available in 14/22. Out of 1249 records, 56.9% (95% CI 36.2% to 77.6%) had a standard neonatal admission form. A median score of 0 out of 3 for symptoms of severe illness (IQR 0-3) and a median score of 6 out of 8 for signs of severe illness (IQR 4-7) were documented. Maternal HIV status was documented in 674/1249 (54%, 95% CI 41.9% to 66.1%) cases. Drug doses exceeded recommendations by >20% in prescriptions for penicillin (11.6%, 95% CI 3.4% to 32.8%) and gentamicin (18.5%, 95% CI 13.4% to 25%), respectively.

CONCLUSIONS

Basic resources are generally available, but there are deficiencies in key areas. Poor documentation limits the use of routine data for quality improvement. Significant opportunities exist for improvement in service delivery and adherence to guidelines in hospitals providing professional training.

A retrospective evaluation of the quality of malaria case management at twelve health facilities in four districts in Zambia

OBJECTIVE

To establish the appropriateness of malaria case management at health facility level in four districts in Zambia.

METHODS

This study was a retrospective evaluation of the quality of malaria case management at health facilities in four districts conveniently sampled to represent both urban and rural settings in different epidemiological zones and health facility coverage. The review period was from January to December 2008. The sample included twelve lower level health facilities from four districts. The Pearson Chi-square test was used to identify characteristics which affected the quality of case management.

RESULTS

Out of 4 891 suspected malaria cases recorded at the 12 health facilities, more than 80% of the patients had a temperature taken to establish their fever status. About 67% (CI 95 66.1-68.7) were tested for parasitemia by either rapid diagnostic test or microscopy, whereas the remaining 22.5% (CI 95 21.3.1-23.7) were not subjected to any malaria test. Of the 2 247 malaria cases reported (complicated and uncomplicated), 71% were parasitologically confirmed while 29% were clinically diagnosed (unconfirmed). About 56% (CI 95 53.9-58.1) of the malaria cases reported were treated with artemether-lumefantrine (AL), 35% (CI 95 33.1-37.0) with sulphadoxine-pyrimethamine, 8% (CI 95 6.9-9.2) with quinine and 1% did not receive any anti-malarial. Approximately 30% of patients WHO were found negative for malaria parasites were still prescribed an anti-malarial, contrary to the guidelines. There were marked inter-district variations in the proportion of patients in WHOm a diagnostic tool was used, and in the choice of anti-malarials for the treatment of malaria confirmed cases. Association between health worker characteristics and quality of case malaria management showed that nurses performed better than environmental health technicians and clinical officers on the decision whether to use the rapid diagnostic test or not. Gender, in service training on malaria, years of residence in the district and length of service of the health worker at the facility were not associated with diagnostic and treatment choices.

CONCLUSIONS

Malaria case management was characterised by poor adherence to treatment guidelines. The non-adherence was mainly in terms of: inconsistent use of confirmatory tests (rapid diagnostic test or microscopy) for malaria; prescribing anti-malarials which are not recommended (e.g. sulphadoxine-pyrimethamine) and prescribing anti-malarials to cases testing negative. Innovative approaches are required to improve health worker adherence to diagnosis and treatment guidelines.

Using health worker opinions to assess changes in structural components of quality in a Cluster Randomized Trial

BACKGROUND

The 'resource readiness' of health facilities to provide effective services is captured in the structure component of the classical Donabedian paradigm often used for assessment of the quality of care in the health sector. Periodic inventories are commonly used to confirm the presence (or absence) of equipment or drugs by physical observation or by asking those in charge to indicate whether an item is present or not. It is then assumed that this point observation is representative of the everyday status. However the availability of an item (consumables) may vary. Arguably therefore a more useful assessment for resources would be one that captures this fluctuation in time. Here we report an approach that may circumvent these difficulties.

METHODS

We used self-administered questionnaires (SAQ) to seek health worker views of availability of key resources supporting paediatric care linked to a cluster randomized trial of a multifaceted intervention aimed at improving this care conducted in eight rural Kenyan district hospitals. Four hospitals received a full intervention and four a partial intervention. Data were collected pre-intervention and after 6 and 18 months from health workers in three clinical areas asked to score item availability using an 11-point scale. Mean scores for items common to all 3 areas and mean scores for items allocated to domains identified using exploratory factor analysis (EFA) were used to describe availability and explore changes over time.

RESULTS

SAQ were collected from 1,156 health workers. EFA identified 11 item domains across the three departments. Mean availability scores for these domains were often <5/10 at baseline reflecting lack of basic resources such as oxygen, nutrition and second line drugs. An improvement in mean scores occurred in 8 out of 11 domains in both control and intervention groups. A calculation of difference in difference of means for intervention vs. control suggested an intervention effect resulting in greater changes in 5 out of 11 domains.

CONCLUSION

Using SAQ data to assess resource availability experienced by health workers provides an alternative to direct observations that provide point prevalence estimates. Further the approach was able to demonstrate poor access to resources, change over time and variability across place.

Development of performance tracking for a pediatric hospitalist division

OBJECTIVES

Our goal was to develop a comprehensive performance tracking process for a large pediatric hospitalist division. We aimed to use established dimensions and theory of health care quality to identify measures relevant to common inpatient diagnoses, reflective of current standards of clinical care, and applicable to individual physician performance. We also sought to implement a reproducible data collection strategy that minimizes manual data collection and measurement bias.

METHODS

Washington University Division of Pediatric Hospital Medicine provides clinical care in 17 units within 3 different hospitals. Hospitalist services were grouped into 5 areas, and a task group was created of divisional leaders representing clinical services. The group was educated on the health care quality theory and tasked to search clinical practice standards and quality resources. The groups proposed a broad spectrum of performance questions that were screened for electronic data availability and modified into measurable formulas.

RESULTS

Eighty-seven performance questions were identified and analyzed for their alignment with known clinical guidelines and value in measuring performance. Questions were distributed across quality domains, with most addressing safety. They reflected structure, outcome, and, most commonly, process. Forty-seven questions were disease specific, and 79 questions reflected individual physician performance; 52 questions had electronically available data.

CONCLUSIONS

We describe a systematic approach to the development of performance indicators for a pediatric hospitalist division that can be used to measure performance on a division and physician level. We outline steps to develop a broad-spectrum quality tracking process to standardize clinical care and build invaluable resources for quality improvement research.

A multifaceted intervention to improve the quality of care of children in district hospitals in Kenya: a cost-effectiveness analysis

BACKGROUND

To improve care for children in district hospitals in Kenya, a multifaceted approach employing guidelines, training, supervision, feedback, and facilitation was developed, for brevity called the Emergency Triage and Treatment Plus (ETAT+) strategy. We assessed the cost effectiveness of the ETAT+ strategy, in Kenyan hospitals. Further, we estimate the costs of scaling up the intervention to Kenya nationally and potential cost effectiveness at scale.

METHODS AND FINDINGS

Our cost-effectiveness analysis from the provider's perspective used data from a previously reported cluster randomized trial comparing the full ETAT+ strategy (n = 4 hospitals) with a partial intervention (n = 4 hospitals). Effectiveness was measured using 14 process measures that capture improvements in quality of care; their average was used as a summary measure of quality. Economic costs of the development and implementation of the intervention were determined (2009 US$). Incremental cost-effectiveness ratios were defined as the incremental cost per percentage improvement in (average) quality of care. Probabilistic sensitivity analysis was used to assess uncertainty. The cost per child admission was US$50.74 (95% CI 49.26-67.06) in intervention hospitals compared to US$31.1 (95% CI 30.67-47.18) in control hospitals. Each percentage improvement in average quality of care cost an additional US$0.79 (95% CI 0.19-2.31) per admitted child. The estimated annual cost of nationally scaling up the full intervention was US$3.6 million, approximately 0.6% of the annual child health budget in Kenya. A "what-if" analysis assuming conservative reductions in mortality suggests the incremental cost per disability adjusted life year (DALY) averted by scaling up would vary between US$39.8 and US$398.3.

CONCLUSION

Improving quality of care at scale nationally with the full ETAT+ strategy may be affordable for low income countries such as Kenya. Resultant plausible reductions in hospital mortality suggest the intervention could be cost-effective when compared to incremental cost-effectiveness ratios of other priority child health interventions.

New signal functions to measure the ability of health facilities to provide routine and emergency newborn care

Based upon an expert survey and consensus method, Sabine Gabrysch and colleagues recommend new signal functions to monitor and track facilities' provision of routine and emergency newborn care.