Performance of health workers in the management of seriously sick children at a Kenyan tertiary hospital: before and after a training intervention

Comparison between the Smart Triage model and the Emergency Triage Assessment and Treatment guidelines in triaging children presenting to the emergency departments of two public hospitals in Kenya

Several triage systems have been developed, but little is known about their performance in low-resource settings. Evaluating and comparing novel triage systems to existing triage scales provides essential information about their added value, reliability, safety, and effectiveness before adoption. This study included children aged < 15 years who presented to the emergency departments of two public hospitals in Kenya between February and December 2021. We compared the performance of Emergency Triage Assessment and Treatment (ETAT) guidelines and Smart Triage (ST) models (ST model with independent triggers, and recalibrated ST model with independent triggers) in categorizing children into emergency, priority, and non-urgent triage categories. Sankey diagrams were used to visualize the distribution of children into similar or different triage categories by ETAT and ST models. Sensitivity, specificity, negative and positive predictive values for mortality and admission were calculated. 5618 children were enrolled, and the majority (3113, 55.4%) were aged between one and five years of age. Overall admission and mortality rates were 7% and 0.9%, respectively. ETAT classified 513 (9.2%) children into the emergency category compared to 1163 (20.8%) and 1161 (20.7%) by the ST model with independent triggers and recalibrated model with independent triggers, respectively. ETAT categorized 3089 (55.1%) children as non-urgent compared to 2097 (37.4%) and 2617 (46.7%) for the respective ST models. ETAT classified 191/395 (48.4%) admitted patients as emergencies compared to more than half by all the ST models. ETAT and ST models classified 25/49 (51%) and 39/49 (79.6%) deceased children as emergencies. Sensitivity for admission and mortality was 48.4% and 51% for ETAT and 74.9% and 79.6% for the ST models, respectively. Smart Triage shows potential for identifying critically ill children in low-resource settings, particularly when combined with independent triggers and performs comparably to ETAT. Evaluation of Smart Triage in other contexts and comparison to other triage systems is required.

Systematic review: What is the impact of triage implementation on clinical outcomes and process measures in low- and middle-income country emergency departments?

INTRODUCTION

Triage is widely regarded as an essential function of emergency care (EC) systems, especially in resource-limited settings. Through a systematic search and review of the literature, we investigated the effect of triage implementation on clinical outcomes and process measures in low- and middle-income country (LMIC) emergency departments (EDs).

METHODS

Structured searches were conducted using MEDLINE, CENTRAL, EMBASE, CINAHL, and Global Health. Eligible articles identified through screening and full-text review underwent risk-of-bias assessment using the Newcastle-Ottawa Scale. The quality of evidence for each effect measure was summarized using GRADE.

RESULTS

Among 10,394 articles identified through the search strategy, 58 underwent full-text review and 16 were included in the final synthesis. All utilized pre-/postintervention methods and a majority were single center. Effect measures included mortality, waiting time, length of stay, admission rate, and patient satisfaction. Of these, ED mortality and time to clinician assessment were evaluated most frequently. The majority of studies using these outcomes identified a positive effect, namely a reduction in deaths and waiting time among patients presenting for EC. The quality of the evidence was moderate for these measures but low or very low for all other outcomes and process indicators.

CONCLUSIONS

There is moderate quality of evidence supporting an association between the introduction of triage and a reduction in deaths and waiting time. Although the available data support the value of triage in LMIC EDs, the risk of confounding and publication bias is significant. Future studies will benefit from more rigorous research methods.

Receive, Sustain, and Flow: A simple heuristic for facilitating the identification and treatment of critically ill patients during their hospital journeys

Background

Hospital patients can become critically ill anywhere in a hospital but their survival is affected by problems of identification and adequate, timely, treatment. This is issue of particular concern in lower middle-income countries' (LMICs) hospitals where specialised units are scarce and severely under-resourced. "Cross-sectional" approaches to improving narrow, specific aspects of care will not attend to issues that affect patients' care across the length of their experience. A simpler approach to understanding key issues across the "hospital journey" could help to deliver life-saving treatments to those patients who need it, wherever they are in the facility.

Methods

We carried out 31 narrative interviews with frontline health workers in five Kenyan and five Tanzanian hospitals from November 2020 to December 2021 during the COVID-19 pandemic and analysed using a thematic analysis approach. We also followed 12 patient hospital journeys, through the course of treatment of very sick patients admitted to the hospitals we studied.

Results

Our research explores gaps in hospital systems that result in lapses in effective, continuous care across the hospital journeys of patients in Tanzania and Kenya. We organise these factors according to the Systems Engineering Initiative for Patient Safety (SEIPS) approach to patient safety, which we extend to explore how these issues affect patients across the course of care. We discern three repeating, recursive phases we term Receive, Sustain, and Flow. We use this heuristic to show how gaps and weaknesses in service provision affect critically ill patients' hospital journeys.

Conclusion

Receive, Sustain, and Flow offers a heuristic for hospital management to identify and ameliorate limitations in human and technical resources for the care of the critically ill.

Developing and testing a clinical care bundle incorporating caffeine citrate to manage apnoea of prematurity in a resource-constrained setting: a mixed methods clinical feasibility study protocol

BACKGROUND

Apnoea of prematurity (AOP) is a common condition among preterm infants. Methylxanthines, such as caffeine and aminophylline/theophylline, can help prevent and treat AOP. Due to its physiological benefits and fewer side effects, caffeine citrate is recommended for the prevention and treatment of AOP. However, caffeine citrate is not available in most resource-constrained settings (RCS) due to its high cost. Challenges in RCS using caffeine citrate to prevent AOP include identifying eligible preterm infants where gestational age is not always known and the capability for continuous monitoring of vital signs to readily identify apnoea. We aim to develop an evidence-based care bundle that includes caffeine citrate to prevent and manage AOP in tertiary healthcare facilities in Kenya.

METHODS

This protocol details a prospective mixed-methods clinical feasibility study on using caffeine citrate to manage apnoea of prematurity in a single facility tertiary-care newborn unit (NBU) in Nairobi, Kenya. This study will include a 4-month formative research phase followed by the development of an AOP clinical-care-bundle prototype over 2 months. In the subsequent 4 months, implementation and improvement of the clinical-care-bundle prototype will be undertaken. The baseline data will provide contextualised insights on care practices within the NBU that will inform the development of a context-sensitive AOP clinical-care-bundle prototype. The clinical care bundle will be tested and refined further during an implementation phase of the quality improvement initiative using a PDSA framework underpinned by quantitative and qualitative clinical audits and stakeholders' engagement. The quantitative component will include all neonates born at gestation age < 34 weeks and any neonate prescribed aminophylline or caffeine citrate admitted to the NBU during the study period.

DISCUSSION

There is a need to develop evidence-based and context-sensitive clinical practice guidelines to standardise and improve the management of AOP in RCS. Concerns requiring resolution in implementing such guidelines include diagnosis of apnoea, optimal timing, dosing and administration of caffeine citrate, standardisation of monitoring devices and alarm limits, and discharge protocols. We aim to provide a feasible standardised clinical care bundle for managing AOP in low and middle-income settings.

Emergency Triage Assessment and Treatment Plus (ETAT+): adapting training to strengthen quality improvement and task-sharing in emergency paediatric care in Sierra Leone

Background

Over the past 25 years Sierra Leone has made progress in reducing maternal and child mortality, but the burden of preventable paediatric deaths remains high. Further progress towards achieving the Sustainable Development Goals will require greater strengthening of the health care system, including hospital care for perinatal and paediatric conditions. Emergency Triage Assessment and Treatment Plus (ETAT+) may offer a useful tool.

Methods

The five-day ETAT+ course was adapted as a six-month programme of in-situ training and mentoring integrated with patient flow and service delivery improvements in 14 regional and district government hospitals across the country. Nurses were trained to carry out the initial resuscitation and assessment of the sick paediatric patient, and to administer the first dose of medication per protocol. The course was for all clinical staff; most participants were nurses.

Results

The intervention was associated with an improvement in the quality of paediatric care and a reduction in mortality. In 2017 mortality decreased by 33.1%, from 14.5% at baseline to 9.7% after six months of the intervention. Mortality at the start of the 2018 intervention was 8.5% and reduced over six months to 6.5%. Care quality indicators showed improvement across the two intervention periods, with some evidence of sustained effect.

Conclusions

These results suggest that adapted ETAT+ training with in-situ mentoring alongside improved patient flow and service delivery supports improvements in the quality of paediatric care in Sierra Leonean hospitals. ETAT+ may provide an affordable framework for improving the quality of secondary paediatric care in Sierra Leone and a model of nurse-led resuscitation may allow for prompt and timely emergency paediatric care in Sierra Leonean hospitals where there are fewer physicians and other resources for care.

Impact of a Multifaceted Intervention to Improve Emergency Care on Newborn and Child Health Outcomes in Rwanda

Implementing context-appropriate neonatal and pediatric advanced life support management interventions has increasingly been recommended as one of the approaches to reduce under-five mortality in resource-constrained settings like Rwanda. One such intervention is ETAT+, which stands for Emergency Triage, Assessment and Treatment plus Admission care for severely ill newborns and children. In 2013, ETAT+ was implemented in Rwandan district hospitals. We evaluated the impact of the ETAT+ intervention on newborn and child health outcomes. We used monthly time series data from the DHIS2-enabled Rwanda Health Management Information System from 2012 to 2016 to examine neonatal and pediatric hospital mortality rate. Each hospital contributed data for 12 and 36 months before and after ETAT+ implementation, respectively. Using controlled interrupted time series analysis and segmented regression model, we estimated longitudinal changes in neonatal and pediatric hospital mortality rate in intervention hospitals relative to matched concurrent control hospitals. We also studied changes in case fatality rate specifically for ETAT+ targeted conditions. Our study cohort consisted of seven intervention hospitals and fourteen matched control hospitals contributing 142,424 neonatal and pediatric hospital admissions. After controlling for secular trends and autocorrelation, we found that the ETAT+ implementation had no statistically significant impact on the rate of all-cause neonatal and pediatric hospital mortality in intervention hospitals relative to control hospitals. However, the case fatality rate for ETAT+ targeted neonatal conditions decreased immediately following implementation by 5% (95% CI: -9.25, -0.77) and over time by 0.8% monthly (95% CI: -1.36, -0.25), in intervention hospitals compared with control hospitals. Case fatality rate for ETAT+ targeted pediatric conditions did not decrease following the ETAT+ implementation. While ETAT+ focuses on improving quality of hospital care for both newborns and children, we only found an impact on neonatal hospital mortality for ETAT+ targeted conditions that should be interpreted with caution given the relatively short pre-intervention period and potential regression to the mean.

Derivation and internal validation of a data-driven prediction model to guide frontline health workers in triaging children under-five in Nairobi, Kenya

Background: Many hospitalized children in developing countries die from infectious diseases. Early recognition of those who are critically ill coupled with timely treatment can prevent many deaths. A data-driven, electronic triage system to assist frontline health workers in categorizing illness severity is lacking. This study aimed to develop a data-driven parsimonious triage algorithm for children under five years of age. Methods: This was a prospective observational study of children under-five years of age presenting to the outpatient department of Mbagathi Hospital in Nairobi, Kenya between January and June 2018. A study nurse examined participants and recorded history and clinical signs and symptoms using a mobile device with an attached low-cost pulse oximeter sensor. The need for hospital admission was determined independently by the facility clinician and used as the primary outcome in a logistic predictive model. We focused on the selection of variables that could be quickly and easily assessed by low skilled health workers. Results: The admission rate (for more than 24 hours) was 12% (N=138/1,132). We identified an eight-predictor logistic regression model including continuous variables of weight, mid-upper arm circumference, temperature, pulse rate, and transformed oxygen saturation, combined with dichotomous signs of difficulty breathing, lethargy, and inability to drink or breastfeed. This model predicts overnight hospital admission with an area under the receiver operating characteristic curve of 0.88 (95% CI 0.82 to 0.94). Low- and high-risk thresholds of 5% and 25%, respectively were selected to categorize participants into three triage groups for implementation.  Conclusion: A logistic regression model comprised of eight easily understood variables may be useful for triage of children under the age of five based on the probability of need for admission. This model could be used by frontline workers with limited skills in assessing children. External validation is needed before adoption in clinical practice.

Situational Analysis of Management of Childhood Diarrhea and Pneumonia in 13 District Hospitals in India

Objective

To generate evidence on the current situation of hospital care (emergency, inpatient and outpatient), for managing children presenting with diarrhea and pneumonia at 13 district hospitals in India.

Design

Facility-based assessment of district hospitals.

Settings

13 district hospitals in four states of Bihar, Madhya Pradesh, Odisha and Rajasthan.

Participants

Staff nurses and doctors.

Intervention

None.

Methods

An assessment was done across 13 district hospitals in four states by a group or trained assessors using an adapted quality assurance tool developed by Government of India where each aspect of care was scored (maximum score 5). Emergency services and triage, case management practices, laboratory support, and record maintenance for diarrhea and pneumonia were assessed.

Results

Separate diarrhea treatment unit was not earmarked in any of the DHs surveyed. Overall score obtained for adequate management of diarrhea and pneumonia was 2 and 2.2 which were poor. Pediatric beds were 6.8% of the total bed strength against the recommended 8–10%. There was a 65 percent shortfall in the numbers of medical officers in position and 48 percent shortfall of nurses. There were issues with availability and utilization of drugs and equipment at appropriate places with cumulative score of 2.8. Triage for sick children was absent in all the facilities.

Conclusion

The standards of pediatric care for management of diarrhea and pneumonia were far from satisfactory. This calls for improvement of pediatric care units and implementation of operational guidelines for improving management of diarrhea and pneumonia.

Derivation and internal validation of a data-driven prediction model to guide frontline health workers in triaging children under-five in Nairobi, Kenya

Background: Many hospitalized children in developing countries die from infectious diseases. Early recognition of those who are critically ill coupled with timely treatment can prevent many deaths. A data-driven, electronic triage system to assist frontline health workers in categorizing illness severity is lacking. This study aimed to develop a data-driven parsimonious triage algorithm for children under five years of age. Methods: This was a prospective observational study of children under-five years of age presenting to the outpatient department of Mbagathi Hospital in Nairobi, Kenya between January and June 2018. A study nurse examined participants and recorded history and clinical signs and symptoms using a mobile device with an attached low-cost pulse oximeter sensor. The need for hospital admission was determined independently by the facility clinician and used as the primary outcome in a logistic predictive model. We focused on the selection of variables that could be quickly and easily assessed by low skilled health workers. Results: The admission rate (for more than 24 hours) was 12% (N=138/1,132). We identified an eight-predictor logistic regression model including continuous variables of weight, mid-upper arm circumference, temperature, pulse rate, and transformed oxygen saturation, combined with dichotomous signs of difficulty breathing, lethargy, and inability to drink or breastfeed. This model predicts overnight hospital admission with an area under the receiver operating characteristic curve of 0.88 (95% CI 0.82 to 0.94). Low- and high-risk thresholds of 5% and 25%, respectively were selected to categorize participants into three triage groups for implementation.  Conclusion: A logistic regression model comprised of eight easily understood variables may be useful for triage of children under the age of five based on the probability of need for admission. This model could be used by frontline workers with limited skills in assessing children. External validation is needed before adoption in clinical practice.

Nurse-led implementation of ETAT+ is associated with reduced mortality in a children's hospital in Freetown, Sierra Leone

BACKGROUND

In the wake of the Ebola virus disease (EVD) epidemic in Sierra Leone, secondary care facilities faced an increase in admissions with few members of medical staff available to assess and treat patients. This led to long waiting times in hospital outpatient departments. The study was undertaken in the outpatient department of Ola During Children's Hospital (the tertiary paediatric hospital for Sierra Leone) in the period immediately following the EVD epidemic of 2014-2015.

AIMS

This retrospective analysis of operational programme data aimed to assess whether a quality-improvement approach and task-sharing between medical and nursing staff improved the quality of triage and the timeliness of care.

METHODS

All staff working in the outpatient department were offered a 4-week training course, followed by on-the-job supervision and support for 6 months. Nurses who successfully completed the course were given responsibility for the initial assessment of sick patients and for prescribing and giving initial treatment. Data were collected at three points: before intervention and at 3 and 6 months after initiation of the intervention. All children presenting to the hospital for medical attention between 0800 and 1400 Monday to Friday were included. Triage assessment by the outpatient nurse was compared to that made by a clinically experienced observer, and the time taken for each child to be triaged, assessed and given initial treatment was recorded.

RESULTS

Between months 0 and 6 of the intervention, detection of emergency signs by the triage nurse improved from 30% to 100%, and detection of priority signs improved from 34% to 100%. For children presenting with emergency signs, the median time between triage and full assessment improved from 57 minutes before intervention to 17 minutes at 3 months and 5 minutes at 6 months (p < 0.0005). For the same group, median time between triage and first antibiotic or antimalarial treatment improved from 220 minutes before intervention to 40 minutes at 3 months and 18 minutes at 6 months (p = 0.006).

CONCLUSION

The results indicate that, with appropriate training and support, extending the emergency assessment and treatment of sick children to nursing staff in West African hospitals may improve the accuracy of triage and the time to assessment and treatment of children presenting with signs of serious illness.

Derivation and internal validation of a data-driven prediction model to guide frontline health workers in triaging children under-five in Nairobi, Kenya

Background: Many hospitalized children in developing countries die from infectious diseases. Early recognition of those who are critically ill coupled with timely treatment can prevent many deaths. A data-driven, electronic triage system to assist frontline health workers in categorizing illness severity is lacking. This study aimed to develop a data-driven parsimonious triage algorithm for children under five years of age. Methods: This was a prospective observational study of children under-five years of age presenting to the outpatient department of Mbagathi Hospital in Nairobi, Kenya between January and June 2018. A study nurse examined participants and recorded history and clinical signs and symptoms using a mobile device with an attached low-cost pulse oximeter sensor. The need for hospital admission was determined independently by the facility clinician and used as the primary outcome in a logistic predictive model. We focused on the selection of variables that could be quickly and easily assessed by low skilled health workers. Results: The admission rate (for more than 24 hours) was 12% (N=138/1,132). We identified an eight-predictor logistic regression model including continuous variables of weight, mid-upper arm circumference, temperature, pulse rate, and transformed oxygen saturation, combined with dichotomous signs of difficulty breathing, lethargy, and inability to drink or breastfeed. This model predicts overnight hospital admission with an area under the receiver operating characteristic curve of 0.88 (95% CI 0.82 to 0.94). Low- and high-risk thresholds of 5% and 25%, respectively were selected to categorize participants into three triage groups for implementation.  Conclusion: A logistic regression model comprised of eight easily understood variables may be useful for triage of children under the age of five based on the probability of need for admission. This model could be used by frontline workers with limited skills in assessing children. External validation is needed before adoption in clinical practice.

Inadequate management of pneumonia among children in South Ethiopia: findings from descriptive study

BACKGROUND

Health system support is crucial for quality child healthcare. Therefore, this baseline survey, which is part of the community-based management study of severe pneumonia, was conducted to assess the state of health system support of IMNCI and iCCM, and health workers' knowledge in managing childhood pneumonia at health facilities.

METHODS

A survey was conducted in 99 government health institutions in South Ethiopia from 07 to 14 January, 2018. A questionnaire for health system support and case scenario for the management of severe pneumonia was adapted from the WHO health facility survey tool. The questionnaire's interview, facility observation, case scenario and retrospective record review were all used as data collection methods. Indicators of health system support in the context of an integrated management of childhood illness were used. Proportions for categorical variables and means for continuous variables were also computed for each indicator. Mean score was analysed for assessing the knowledge of health workers in managing the case scenario.

RESULTS

In the study area, only 12 (34%) of health centres and 18 (29%) of health posts received supervision, which included the observation of case management. The mean number of essential oral antibiotics for the home treatment of pneumonia available at the facility was 1.1 (95% CI 0.9 to 1.3), whereas the mean number of pre-referral drugs for the treatment of severe pneumonia was 1.3 (95% CI 1.0 to 1.6). Approximately 47 (48%; 95% CI 37.7 to 57.3) of the surveyed health facilities had materials and equipment to support vaccination services, and 71 (72%; 95% CI 62.8 to 80.6) of them had the vaccines on the day of the survey. Only four (4%; 95% CI 0.3 to 8.3) of the health facilities had all the essential job aids and supplies for providing services for pneumonia. The providers' mean knowledge score for the management of severe childhood pneumonia was 14.9 out of 22 correct answers.

CONCLUSION

There is a room to improve the health system support to integrated management of neonatal and childhood illness through supply chain management and knowledge of health workers in the management of severe pneumonia by providing training.

Adherence to clinical guidelines is associated with reduced inpatient mortality among children with severe anemia in Ugandan hospitals

BACKGROUND

In resource limited settings, there is variability in the level of adherence to clinical guidelines in the inpatient management of children with common conditions like severe anemia. However, there is limited data on the effect of adherence to clinical guidelines on inpatient mortality in children managed for severe anemia.

METHODS

We analyzed data from an uncontrolled before and after in-service training intervention to improve quality of care in Lira and Jinja regional referral hospitals in Uganda. Inpatient records of children aged 0 to 5 years managed as cases of 'severe anemia (SA)' were reviewed to ascertain adherence to clinical guidelines and compare inpatient deaths in SA children managed versus those not managed according to clinical guidelines. Logistic regression analysis was conducted to evaluate the relationship between clinical care factors and inpatient deaths amongst patients managed for SA.

RESULTS

A total of 1,131 children were assigned a clinical diagnosis of 'severe anemia' in the two hospitals. There was improvement in the level of care after the in-service training intervention with more children being managed according to clinical guidelines compared to the period before, 218/510 (42.7%) vs 158/621 (25.4%) (p < 0.001). Overall, children managed according to clinical guidelines had reduced risk of inpatient mortality compared to those not managed according to clinical guidelines, [OR 0.28, (95%, CI 0.14, 0.55), p = 0.001]. Clinical care factors associated with decreased risk of inpatient death included, having pre-transfusion hemoglobin done to confirm diagnosis [OR 0.5; 95% CI 0.29, 0.87], a co-morbid diagnosis of severe malaria [OR 0.4; 95% CI 0.25, 0.76], and being reviewed after admission by a clinician [OR 0.3; 95% CI 0.18, 0.59], while a co-morbid diagnosis of severe acute malnutrition was associated with increased risk of inpatient death [OR 4.2; 95% CI 2.15, 8.22].

CONCLUSION

Children with suspected SA who are managed according to clinical guidelines have lower in-hospital mortality than those not managed according to the guidelines. Efforts to reduce inpatient mortality in SA children in resource-limited settings should focus on training and supporting health workers to adhere to clinical guidelines.

Examining clinical leadership in Kenyan public hospitals through the distributed leadership lens

Clinical leadership is recognized as a crucial element in health system strengthening and health policy globally yet it has received relatively little attention in low and middle income countries (LMICs). Moreover, analyses of clinical leadership tend to focus on senior-level individual leaders, overlooking a wider constellation of middle-level leaders delivering health care in practice in a way affected by their health care context. Using the theoretical lens of ‘distributed leadership’, this article examines how middle-level leadership is practised and affected by context in Kenyan county hospitals, providing insights relevant to health care in other LMICs. The article is based on empirical qualitative case studies of clinical departmental leadership in two Kenyan public hospitals, drawing on data gathered through ethnographic observation, interviews and focus groups. We inductively and iteratively coded, analysed and theorized our findings. We found the distributed leadership lens useful for the purpose of analysing middle-level leadership in Kenyan hospitals, although clinical departmental leadership was understood locally in more individualized terms. Our distributed lens revealed medical and nursing leadership occurring in parallel and how only doctors in leadership roles were able to directly influence behaviour among their medical colleagues, using inter-personal skills, power and professional expertize. Finally, we found that Kenyan hospital contexts were characterized by cultures, norms and structures that constrained the way leadership was practiced. We make a theoretical contribution by demonstrating the utility of using distributed leadership as a lens for analysing leadership in LIMC health care contexts, revealing how context, power and inter-professional relationships moderate individual leaders’ ability to bring about change. Our findings, have important implications for how leadership is conceptualized and the way leadership development and training are provided in LMICs health systems.

The Call and the Challenge of Pediatric Resuscitation and Simulation Research in Low-Resource Settings

STATEMENT

The greatest burden of younger than 5 years mortality is in low- and middle-income nations where education resources are often few. The World Health Organization recommends scale-up of simulation in these settings, but it has been poorly studied. Although there has been an increase of contextualized resuscitation simulation programs designed for these settings, sustaining clinical outcomes and provider skill retention have remained research gaps. Our team designed a study to evaluate skill retention after an initial Helping Babies Breathe training at a rural Kenya referral hospital between randomized learner groups receiving supervised mock codes with debriefing versus just-in-time training with a peer. Although we saw sustained skills retention and some clinical improvements, we were unable to answer our research question because of numerous challenges, mainly that hospital leadership preferred the implementation of 1 arm of the study over another because of lack of protected education time and resources, eliminating differences between randomized study groups. Further challenges included lack of familiarity with simulation and debriefing and lack of protected educational resources and time, cultural differences in giving feedback, undeveloped systems for documentation, and high acuity and clinical volume. Our experience teaches many important lessons in how best to implement and study simulation in low-resource settings. Best practices include long-term partnerships, flexibility, community and staff engagement, mixed methodologies including community-based participatory methods, and careful attention to educational and research capacity building.

High rate of inappropriate blood transfusions in the management of children with severe anemia in Ugandan hospitals

BACKGROUND

Severe anaemia (SA) is a common reason for hospitalisation of children in sub-Saharan Africa but the extent to which blood transfusion is used appropriately in the management of severe anemia has hitherto remained unknown. We report on the use of blood transfusion in the management of anemic children in two hospitals in Uganda.

METHODS

Inpatient records of children 0-5 years of age admitted to Lira and Jinja regional referral hospitals in Uganda were reviewed for children admitted on selected days between June 2016 and May 2017. Data was extracted on the results, if any, of pre-transfusion hemoglobin (Hb) level, whether or not a blood transfusion was given and inpatient outcome for all children with a diagnosis of 'severe anemia'. Qualitative data was also collected from health workers to explain the reasons for the clinical practices at the two hospitals.

RESULTS

Overall, 574/2275 (25.2%) of the children admitted in the two hospitals were assigned a diagnosis of SA. However 551 (95.9%) of children assigned a diagnosis of SA received a blood transfusion, accounting for 551/560 (98.4%) of the blood transfusions in the pediatric wards. Of the blood transfusions in SA children, only 245 (44.5%) was given appropriately per criteria (Pre-transfusion Hb ≤ 6 g/dL), while 306 (55.5%) was given inappropriately; (pre-transfusion Hb not done, n = 216, or when a transfusion is not indicated [Hb > 6.0 g/dl], n = 90). SA children transfused appropriately per Hb criteria had lower inpatient mortality compared to those transfused inappropriately, (7 (2.9%) vs. 22 (7.2%), [OR 0.4, 95% CI 0.16, 0.90]). Major issues identified by health workers as affecting use of blood transfusion included late presentation of SA children to hospital and unreliable availability of equipment for measurement of Hb.

CONCLUSION

More than half the blood transfusions given in the management of anemic children admitted to Lira and Jinja hospitals was given inappropriately either without pre-transfusion Hb testing or when not indicated. Verification of Hb level by laboratory testing and training of health workers to adhere to transfusion guidelines could result in a substantial decrease in inappropriate blood transfusion in Ugandan hospitals.

Prevalence, outcome and quality of care among children hospitalized with severe acute malnutrition in Kenyan hospitals: A multi-site observational study

Background

Severe acute malnutrition (SAM) remains a major cause of admission and inpatient mortality worldwide in children aged less than 5 years. In this study, we explored SAM prevalence and outcomes in children admitted in 13 Kenyan hospitals participating in a Clinical Information Network (CIN). We also describe their immediate in-patient management.

Methods

We analyzed data for children aged 1–59 months collected retrospectively from medical records after discharge. Mean, median and ranges were used to summarize pooled and age-specific prevalence and mortality associated with SAM. Documentation of key signs and symptoms (S/S) and performance of indicators of quality of care for selected aspects of the WHO management steps were assessed. Logistic regression models were used to evaluate associations between documented S/S and mortality among SAM patients aged 6–59 months. Loess curves were used to explore performance change over time for indicators of selected SAM management steps.

Results

5306/54140 (9.8%) children aged 1–59 months admitted with medical conditions in CIN hospitals between December 2013 and November 2016 had SAM. SAM prevalence identified by clinicians and case fatality varied widely across hospitals with median proportion (range) of 10.1% (4.6–18.2%) and 14.8% (6.0–28.6%) respectively. Seventeen variables were associated with increased mortality. Performance change over time of management steps varied across hospitals and across selected indicators but suggests some effect of regular audit and feedback.

Conclusion

Identification of SAM patients, their mortality and adherence to in-patient management recommendations varied across hospitals. An important group of SAM patients are aged less than 6 months. Continued efforts are required to improve management of SAM in routine settings as part of efforts to reduce inpatient mortality.

Assessing process of paediatric care in a resource-limited setting: a cross-sectional audit of district hospitals in Rwanda

BACKGROUND

Routine assessment of quality of care helps identify deficiencies which need to be improved. While gaps in the emergency care of children have been documented across sub-Saharan Africa, data from Rwanda are lacking.

OBJECTIVE

To assess the care of sick infants and children admitted to Rwandan district hospitals and the extent to which it follows currently recommended clinical practice guidelines in Rwanda.

METHODS

Data were gathered during a retrospective cross-sectional audit of eight district hospitals across Rwanda in 2012/2013. Medical records were randomly selected from each hospital and were reviewed to assess the process of care, focusing on the leading causes of under-5 mortality, including neonatal conditions, pneumonia, malaria and dehydration/diarrhoea.

RESULTS

Altogether, 522 medical records were reviewed. Overall completion of a structured neonatal admission record was above 85% (range 78.6-90.0%) and its use was associated with better documentation of key neonatal signs (median score 6/8 and 2/8 when used and not used, respectively). Deficiencies in the processes of care were identified across hospitals and there were rural/urban disparities for some indicators. For example, neonates admitted to urban district hospitals were more likely to receive treatment consistent with currently recommended guidelines [e.g. gentamicin (OR 2.52, 95% CI 1.03-6.43) and fluids (OR 2.69, 95% CI 1.2-6.2)] than those in rural hospitals. Likewise, children with pneumonia admitted to urban hospitals were more likely to receive the correct dosage of gentamicin (OR 4.47, 95% CI 1.21-25.1) and to have their treatment monitored (OR 3.75, 95% CI 1.57-8.3) than in rural hospitals. Furthermore, children diagnosed with malaria and admitted to urban hospitals were more likely to have their treatment (OR 2.7, 95% CI 1.15-6.41) monitored than those in rural hospitals.

CONCLUSIONS

Substantial gaps were identified in the process of neonatal and paediatric care across district hospitals in Rwanda. There is a need to (i) train health care professionals in providing neonatal and paediatric care according to nationally adopted clinical practice guidelines (e.g. ETAT+); (ii) establish a supervision and mentoring programme to ensure that the guidelines are available and used appropriately in district hospitals; and (iii) use admission checklists (e.g. neonatal and paediatric admission records) in district hospitals.

Does audit and feedback improve the adoption of recommended practices? Evidence from a longitudinal observational study of an emerging clinical network in Kenya

Background

Audit and feedback (A&F) is widely used in healthcare but there are few examples of how to deploy it at scale in low-income countries. Establishing the Clinical Information Network (CIN) in Kenya provided an opportunity to examine the effect of A&F delivered as part of a wider set of activities to promote paediatric guideline adherence.

Methods

We analysed data collected from medical records on discharge for children aged 2–59 months from 14 Kenyan hospitals in the CIN. Hospitals joined CIN in phases and for each we analysed their initial 25 months of participation that occurred between December 2013 and March 2016. A total of 34 indicators of adherence to recommendations were selected for evaluation each classified by form of feedback (passive, active and none) and type of task (simple or difficult documentation and those requiring cognitive work). Performance change was explored graphically and using generalised linear mixed models with attention given to the effects of time and use of a standardised paediatric admission record (PAR) form.

Results

Data from 60 214 admissions were eligible for analysis. Adherence to recommendations across hospitals significantly improved for 24/34 indicators. Improvements were not obviously related to nature of feedback, may be related to task type and were related to PAR use in the case of documentation indicators. There was, however, marked variability in adoption and adherence to recommended practices across sites and indicators. Hospital-specific factors, low baseline performance and specific contextual changes appeared to influence the magnitude of change in specific cases.

Conclusion

Our observational data suggest some change in multiple indicators of adherence to recommendations (aspects of quality of care) can be achieved in low-resource hospitals using A&F and simple job aides in the context of a wider network approach.

Some sustained improvements in pneumonia case management four and five years following implementation of paediatric hospital guidelines in Lao PDR

In 2010, WHO paediatric hospital guidelines were implemented in Lao PDR, along with training workshops and feedback audits, achieving significant improvements in pneumonia case management when assessed one-year post-intervention. The sustainability of these improvements is hereby assessed, four and five years post-intervention. Medical records of children aged 1-59 months, diagnosed with pneumonia in 2010, 2011, 2014 and 2015 from a central Lao hospital were reviewed. Information relating to clinical steps in pneumonia case management was extracted and a scoring system applied based on the documentation of each clinical step, producing a pneumonia assessment score for each case. Comparisons of clinical steps and mean assessment score across study years were performed using Pearson's chi-squared and t-tests, respectively. Of 231 pneumonia cases, the mean assessment scores in 2010, 2011, 2014 and 2015 were 57%, 96%, 69% and 69% respectively, showing a significant reduction from the immediate post-intervention period (2011) to 2015 (p < 0.01). Mean assessment score in 2014/2015 was significantly higher than in 2010 (p < 0.01). The high standards of pneumonia case management in 2011 were not observed in 2014/2015 in the absence of ongoing intervention but overall quality of care remained higher than pre-intervention levels, suggesting some degree of sustainability in the long-term.

Bubble continuous positive airway pressure in the treatment of severe paediatric pneumonia in Malawi: a cost-effectiveness analysis

OBJECTIVES

Pneumonia is the largest infectious cause of death in children under 5 years globally, and limited resource settings bear an overwhelming proportion of this disease burden. Bubble continuous positive airway pressure (bCPAP), an accepted supportive therapy, is often thought of as cost-prohibitive in these settings. We hypothesise that bCPAP is a cost-effective intervention in a limited resource setting and this study aims to determine the cost-effectiveness of bCPAP, using Malawi as an example.

DESIGN

Cost-effectiveness analysis.

SETTING

District and central hospitals in Malawi.

PARTICIPANTS

Children aged 1 month-5 years with severe pneumonia, as defined by WHO criteria.

INTERVENTIONS

Using a decision tree analysis, we compared standard of care (including low-flow oxygen and antibiotics) to standard of care plus bCPAP.

PRIMARY AND SECONDARY OUTCOME MEASURES

For each treatment arm, we determined the costs, clinical outcomes and averted disability-adjusted life years (DALYs). We assigned input values from a review of the literature, including applicable clinical trials, and calculated an incremental cost-effectiveness ratio (ICER).

RESULTS

In the base case analysis, the cost of bCPAP per patient was $15 per day and $41 per hospitalisation, with an incremental net cost of $64 per pneumonia episode. bCPAP averts 5.0 DALYs per child treated, with an ICER of $12.88 per DALY averted compared with standard of care. In one-way sensitivity analyses, the most influential uncertainties were case fatality rates (ICER range $9-32 per DALY averted). In a multi-way sensitivity analysis, the median ICER was $12.97 per DALY averted (90% CI, $12.77 to $12.99).

CONCLUSION

bCPAP is a cost-effective intervention for severe paediatric pneumonia in Malawi. These results may be used to inform policy decisions, including support for widespread use of bCPAP in similar settings.

Pediatric emergency care capacity in a low-resource setting: An assessment of district hospitals in Rwanda

BACKGROUND

Health system strengthening is crucial to improving infant and child health outcomes in low-resource countries. While the knowledge related to improving newborn and child survival has advanced remarkably over the past few decades, many healthcare systems in such settings remain unable to effectively deliver pediatric advance life support management. With the introduction of the Emergency Triage, Assessment and Treatment plus Admission care (ETAT+)-a locally adapted pediatric advanced life support management program-in Rwandan district hospitals, we undertook this study to assess the extent to which these hospitals are prepared to provide this pediatric advanced life support management. The results of the study will shed light on the resources and support that are currently available to implement ETAT+, which aims to improve care for severely ill infants and children.

METHODS

A cross-sectional survey was undertaken in eight district hospitals across Rwanda focusing on the availability of physical and human resources, as well as hospital services organizations to provide emergency triage, assessment and treatment plus admission care for severely ill infants and children.

RESULTS

Many of essential resources deemed necessary for the provision of emergency care for severely ill infants and children were readily available (e.g. drugs and laboratory services). However, only 4/8 hospitals had BVM for newborns; while nebulizer and MDI were not available in 2/8 hospitals. Only 3/8 hospitals had F-75 and ReSoMal. Moreover, there was no adequate triage system across any of the hospitals evaluated. Further, guidelines for neonatal resuscitation and management of malaria were available in 5/8 and in 7/8 hospitals, respectively; while those for child resuscitation and management of sepsis, pneumonia, dehydration and severe malnutrition were available in less than half of the hospitals evaluated.

CONCLUSIONS

Our assessment provides evidence to inform new strategies to enhance the capacity of Rwandan district hospitals to provide pediatric advanced life support management. Identifying key gaps in the health care system is required in order to facilitate the implementation and scale up of ETAT+ in Rwanda. These findings also highlight a need to establish an outreach/mentoring program, embedded within the ongoing ETAT+ program, to promote cross-hospital learning exchanges.

Perceptions of the preparedness of medical graduates for internship responsibilities in district hospitals in Kenya: a qualitative study

BACKGROUND

Aga Khan University is developing its undergraduate medical education curriculum for East Africa. In Kenya, a 1 year internship is mandatory for medical graduates' registration as practitioners. The majority of approved internship training sites are at district hospitals. The purposes of this study were to determine: (1) whether recent Kenyan medical graduates are prepared for their roles as interns in district hospitals upon graduation from medical school; (2) what working and training conditions and social support interns are likely to face in district hospital; and (3) what aspects of the undergraduate curriculum need to be addressed to overcome perceived deficiencies in interns' competencies.

METHODS

Focus group discussions and semi-structured interviews were conducted with current interns and clinical supervisors in seven district hospitals in Kenya. Perceptions of both interns and supervisors regarding interns' responsibilities and skills, working conditions at district hospitals, and improvements required in medical education were obtained.

RESULTS

Findings included agreement across informants on deficiencies in interns' practical skills and experience of managing clinical challenges. Supervisors were generally critical regarding interns' competencies, whereas interns were more specific about their weaknesses. Supervisor expectations were higher in relation to surgical procedures than those of interns. There was agreement on the limited learning, clinical facilities and social support available at district hospitals including, according to interns, inadequate supervision. Supervisors felt they provided adequate supervision and that interns lacked the ability to initiate communication with them. Both groups indicated transition challenges from medical school to medical practice attributable to inadequate practical experience. They indicated the need for more direct patient care responsibilities and clinical experience at a district hospital during undergraduate training.

CONCLUSION

Perception of medical graduates' unpreparedness seemed to stem from a failure to implement the apprenticeship model of learning in medical school and lack of prior exposure to district hospitals. These findings will inform curriculum development to meet stakeholder requirements, improve the quality of graduates, and increase satisfaction with transition to practice.

Perceptions of the preparedness of medical graduates for internship responsibilities in district hospitals in Kenya: a qualitative study

BACKGROUND

Aga Khan University is developing its undergraduate medical education curriculum for East Africa. In Kenya, a 1 year internship is mandatory for medical graduates' registration as practitioners. The majority of approved internship training sites are at district hospitals. The purposes of this study were to determine: (1) whether recent Kenyan medical graduates are prepared for their roles as interns in district hospitals upon graduation from medical school; (2) what working and training conditions and social support interns are likely to face in district hospital; and (3) what aspects of the undergraduate curriculum need to be addressed to overcome perceived deficiencies in interns' competencies.

METHODS

Focus group discussions and semi-structured interviews were conducted with current interns and clinical supervisors in seven district hospitals in Kenya. Perceptions of both interns and supervisors regarding interns' responsibilities and skills, working conditions at district hospitals, and improvements required in medical education were obtained.

RESULTS

Findings included agreement across informants on deficiencies in interns' practical skills and experience of managing clinical challenges. Supervisors were generally critical regarding interns' competencies, whereas interns were more specific about their weaknesses. Supervisor expectations were higher in relation to surgical procedures than those of interns. There was agreement on the limited learning, clinical facilities and social support available at district hospitals including, according to interns, inadequate supervision. Supervisors felt they provided adequate supervision and that interns lacked the ability to initiate communication with them. Both groups indicated transition challenges from medical school to medical practice attributable to inadequate practical experience. They indicated the need for more direct patient care responsibilities and clinical experience at a district hospital during undergraduate training.

CONCLUSION

Perception of medical graduates' unpreparedness seemed to stem from a failure to implement the apprenticeship model of learning in medical school and lack of prior exposure to district hospitals. These findings will inform curriculum development to meet stakeholder requirements, improve the quality of graduates, and increase satisfaction with transition to practice.

Admission Risk Score to Predict Inpatient Pediatric Mortality at Four Public Hospitals in Uganda

Mortality rates among hospitalized children in many government hospitals in sub-Saharan Africa are high. Pediatric emergency services in these hospitals are often sub-optimal. Timely recognition of critically ill children on arrival is key to improving service delivery. We present a simple risk score to predict inpatient mortality among hospitalized children. Between April 2010 and June 2011, the Uganda Malaria Surveillance Project (UMSP), in collaboration with the National Malaria Control Program (NMCP), set up an enhanced sentinel site malaria surveillance program for children hospitalized at four public hospitals in different districts: Tororo, Apac, Jinja and Mubende. Clinical data collected through March 2013, representing 50249 admissions were used to develop a mortality risk score (derivation data set). One year of data collected subsequently from the same hospitals, representing 20406 admissions, were used to prospectively validate the performance of the risk score (validation data set). Using a backward selection approach, 13 out of 25 clinical parameters recognizable on initial presentation, were selected for inclusion in a final logistic regression prediction model. The presence of individual parameters was awarded a score of either 1 or 2 based on regression coefficients. For each individual patient, a composite risk score was generated. The risk score was further categorized into three categories; low, medium, and high. Patient characteristics were comparable in both data sets. Measures of performance for the risk score included the receiver operating characteristics curves and the area under the curve (AUC), both demonstrating good and comparable ability to predict deathusing both the derivation (AUC =0.76) and validation dataset (AUC =0.74). Using the derivation and validation datasets, the mortality rates in each risk category were as follows: low risk (0.8% vs. 0.7%), moderate risk (3.5% vs. 3.2%), and high risk (16.5% vs. 12.6%), respectively. Our analysis resulted in development of a risk score that ably predicted mortality risk among hospitalized children. While validation studies are needed, this approach could be used to improve existing triage systems.

Under treatment of pneumonia among children under 5 years of age in a malaria-endemic area: population-based surveillance study conducted in Manhica district- rural, Mozambique

BACKGROUND

Integrated Management of Childhood Illness (IMCI) guidelines were developed to decrease morbidity and mortality, yet implementation varies across settings. Factors associated with poor adherence are not well understood.

METHODS

We used data from Manhiça District Hospital outpatient department and five peripheral health centers to examine pneumonia management for children <5 years old from January 2008 to June 2011. Episodes of IMCI-defined pneumonia (cough or difficult breathing plus tachypnea), severe pneumonia (pneumonia plus chest wall in-drawing), and/or clinician-diagnosed pneumonia (based on discharge diagnosis) were included.

RESULTS

Among severe pneumonia episodes, 96.2% (2,918/3,032) attended in the outpatient department and 70.0% (291/416) attended in health centers were appropriately referred to the emergency department. Age<1 year, malnutrition and various physical exam findings were associated with referral. For non-severe pneumonia episodes, antibiotics were prescribed in 45.7% (16,094/35,224). Factors associated with antibiotic prescription included age <1 year, abnormal auscultatory findings, and clinical diagnosis of pneumonia; diagnosis of malaria or gastroenteritis and pallor were negatively associated with antibiotic prescription.

CONCLUSION

Adherence to recommended management of severe pneumonia was high in a hospital outpatient department, but suboptimal in health centers. Antibiotics were prescribed in fewer than half of non-severe pneumonia episodes, and diagnosis of malaria was the strongest risk factor for incorrect management.

In-service training for health professionals to improve care of seriously ill newborns and children in low-income countries

BACKGROUND

A variety of in-service emergency care training courses are currently being promoted as a strategy to improve the quality of care provided to seriously ill newborns and children in low-income countries. Most courses have been developed in high-income countries. However, whether these courses improve the ability of health professionals to provide appropriate care in low-income countries remains unclear. This is the first update of the original review.

OBJECTIVES

To assess the effects of in-service emergency care training on health professionals' treatment of seriously ill newborns and children in low-income countries.

SEARCH METHODS

For this update, we searched the Cochrane Database of Systematic Reviews, part of The Cochrane Library (www.cochranelibrary.com); MEDLINE, Ovid SP; EMBASE, Ovid SP; the Cochrane Central Register of Controlled Trials (CENTRAL), part of The Cochrane Library (www.cochranelibrary.com) (including the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register); Science Citation Index and Social Sciences Citation Index, Institute for Scientific Information (ISI) Web of Knowledge/Science and eight other databases. We performed database searches in February 2015. We also searched clinical trial registries, websites of relevant organisations and reference lists of related reviews. We applied no date, language or publication status restrictions when conducting the searches.

SELECTION CRITERIA

Randomised trials, non-randomised trials, controlled before and after studies and interrupted-time-series studies that compared the effects of in-service emergency care training versus usual care were eligible for inclusion. We included only hospital-based studies and excluded community-based studies. Two review authors independently screened and selected studies for inclusion.

DATA COLLECTION AND ANALYSIS

Two review authors independently extracted data and assessed study risk of bias and confidence in effect estimates (certainty of evidence) for each outcome using GRADE (Grades of Recommendation, Assessment, Development and Evaluation). We described results and presented them in GRADE tables.

MAIN RESULTS

We identified no new studies in this update. Two randomised trials (which were included in the original review) met the review eligibility criteria. In the first trial, newborn resuscitation training compared with usual care improved provider performance of appropriate resuscitation (trained 66% vs usual care 27%, risk ratio 2.45, 95% confidence interval (CI) 1.75 to 3.42; moderate certainty evidence) and reduced inappropriate resuscitation (trained mean 0.53 vs usual care 0.92, mean difference 0.40, 95% CI 0.13 to 0.66; moderate certainty evidence). Effect on neonatal mortality was inconclusive (trained 28% vs usual care 25%, risk ratio 0.77, 95% CI 0.40 to 1.48; N = 27 deaths; low certainty evidence). Findings from the second trial suggest that essential newborn care training compared with usual care probably slightly improves delivery room newborn care practices (assessment of breathing, preparedness for resuscitation) (moderate certainty evidence).

AUTHORS' CONCLUSIONS

In-service neonatal emergency care courses probably improve health professionals' treatment of seriously ill babies in the short term. Further multi-centre randomised trials evaluating the effects of in-service emergency care training on long-term outcomes (health professional practice and patient outcomes) are needed.

Sepsis guidelines: Suggestions to improve adherence

The context in which a sepsis guideline is to be used is important and to a large extent determines whether it will be implemented successfully. Factors such as lack of time and resources, lack of reimbursement and organizational constraints may also preclude adoption of guidelines. Thus, sepsis guidelines have been adapted to suit the resources in both resource rich and poor regions of the world. However, even when resources are present, physicians' may not follow guidelines due a myriad of reasons including a lack of agreement with the sepsis guideline or with guidelines in general, as well as lack of motivation and expectations of the desired outcomes. A holistic approach is necessary to address all issues that may be impediments to guideline adoption and adherence. This approach would include a rigorous transparent method to craft the guideline, which includes both clinicians and policy makers and addresses cultural and resource issues.

Moving towards routine evaluation of quality of inpatient pediatric care in Kenya

Background

Regular assessment of quality of care allows monitoring of progress towards system goals and identifies gaps that need to be addressed to promote better outcomes. We report efforts to initiate routine assessments in a low-income country in partnership with government.

Methods

A cross-sectional survey undertaken in 22 ‘internship training’ hospitals across Kenya that examined availability of essential resources and process of care based on review of 60 case-records per site focusing on the common childhood illnesses (pneumonia, malaria, diarrhea/dehydration, malnutrition and meningitis).

Results

Availability of essential resources was 75% (45/61 items) or more in 8/22 hospitals. A total of 1298 (range 54–61) case records were reviewed. HIV testing remained suboptimal at 12% (95% CI 7–19). A routinely introduced structured pediatric admission record form improved documentation of core admission symptoms and signs (median score for signs 22/22 and 8/22 when form used and not used respectively). Correctness of penicillin and gentamicin dosing was above 85% but correctness of prescribed intravenous fluid or oral feed volumes for severe dehydration and malnutrition were 54% and 25% respectively. Introduction of Zinc for diarrhea has been relatively successful (66% cases) but use of artesunate for malaria remained rare. Exploratory analysis suggests considerable variability of the quality of care across hospitals.

Conclusion

Quality of pediatric care in Kenya has improved but can improve further. The approach to monitoring described in this survey seems feasible and provides an opportunity for routine assessments across a large number of hospitals as part of national efforts to sustain improvement. Understanding variability across hospitals may help target improvement efforts.

Implementation of an in-patient pediatric mortality reduction intervention, Gondar University Hospital, Ethiopia

SETTING

Gondar University Hospital (GUH) is a resource-limited tertiary care hospital in northern Ethiopia.

OBJECTIVE

To evaluate the aggregate effect of care standardization, institutional guidelines, and simulation-based training on pediatric mortality at a resource-limited hospital.

DESIGN

Uncontrolled pre-post study. GUH in-patients aged from 30 days to 14 years were included in the program evaluation (baseline 11 September-18 November 2010; intervention 19 September-9 December 2011). Interns attached to the GUH pediatrics department from 6 September to 9 December 2011 were included in the training evaluation. Institution-specific management guidelines were prepared for choking, respiratory distress, dehydration, sepsis, congestive heart failure, coma, and seizure. Approval for the protocols was obtained from each pediatric faculty member. Interns received a 3.5 h simulation-based training in triage, procedural skills, and protocol usage. Primary outcome was overall deaths (%); secondary outcomes were deaths within 24 h of admission (%) and median pre/post-training emergency management test scores (%).

RESULTS

No difference in mortality (OR 0.72, 95%CI 0.40-1.29, P = 0.265) or first 24 h mortality (crude OR 0.97, 95%CI 0.37-2.55) was observed. Trainee examination scores improved from 33% to 74% (P < 0.001).

CONCLUSION

Combining care standardization, management protocols, and simulation-based training did not reduce mortality among pediatric in-patients. Focused, simulation-based training improved short-term test scores among interns.

Emergency and urgent care capacity in a resource-limited setting: an assessment of health facilities in western Kenya

OBJECTIVE

Injuries, trauma and non-communicable diseases are responsible for a rising proportion of death and disability in low-income and middle-income countries. Delivering effective emergency and urgent healthcare for these and other conditions in resource-limited settings is challenging. In this study, we sought to examine and characterise emergency and urgent care capacity in a resource-limited setting.

METHODS

We conducted an assessment within all 30 primary and secondary hospitals and within a stratified random sampling of 30 dispensaries and health centres in western Kenya. The key informants were the most senior facility healthcare provider and manager available. Emergency physician researchers utilised a semistructured assessment tool, and data were analysed using descriptive statistics and thematic coding.

RESULTS

No lower level facilities and 30% of higher level facilities reported having a defined, organised approach to trauma. 43% of higher level facilities had access to an anaesthetist. The majority of lower level facilities had suture and wound care supplies and gloves but typically lacked other basic trauma supplies. For cardiac care, 50% of higher level facilities had morphine, but a minority had functioning ECG, sublingual nitroglycerine or a defibrillator. Only 20% of lower level facilities had glucometers, and only 33% of higher level facilities could care for diabetic emergencies. No facilities had sepsis clinical guidelines.

CONCLUSIONS

Large gaps in essential emergency care capabilities were identified at all facility levels in western Kenya. There are great opportunities for a universally deployed basic emergency care package, an advanced emergency care package and facility designation scheme, and a reliable prehospital care transportation and communications system in resource-limited settings.

Poor adherence to the World Health Organization guidelines of treatment of severe pneumonia in children at Khartoum, Sudan

BACKGROUND

Community-acquired pneumonia (CAP) is as a major cause for childhood morbidity and mortality worldwide. This study was conducted to investigate the adherence and response of the WHO guidelines for treatment of severe pneumonia.

METHOD

A cross-sectional study was conducted in the period of June 2009 to July 2010 at Khartoum Hospital, Sudan. Children admitted and treated for severe pneumonia were enrolled.

RESULTS

Only 39 (18.8%) out of 208 enrolled children received prescriptions that were adherent to the WHO guidelines of treatment of severe pneumonia. In logistic regression none of the investigated variable (age, gender, and clinical presentations) was associated with the adherence to the WHO guidelines. There was no significant difference in the response between adherent and non-adherent prescriptions. There was no association between the demographic, clinical data, treatment-adherence to the guidelines and the patients' response.

CONCLUSION

There is a poor (18.8%) adherence to the WHO guidelines of the treatment of severe pneumonia in the region regardless to the age, gender and clinical presentation.

Prevalence and correlates of treatment failure among Kenyan children hospitalised with severe community-acquired pneumonia: a prospective study of the clinical effectiveness of WHO pneumonia case management guidelines

Objective

To determine the extent and pattern of treatment failure (TF) among children hospitalised with community-acquired pneumonia at a large tertiary hospital in Kenya.

Methods

We followed up children aged 2–59 months with WHO-defined severe pneumonia (SP) and very severe pneumonia (VSP) for up to 5 days for TF using two definitions: (i) documentation of pre-defined clinical signs resulting in change of treatment (ii) primary clinician's decision to change treatment with or without documentation of the same pre-defined clinical signs.

Results

We enrolled 385 children. The risk of TF varied between 1.8% (95% CI 0.4–5.1) and 12.4% (95% CI 7.9–18.4) for SP and 21.4% (95% CI 15.9–27) and 39.3% (95% CI 32.5–46.4) for VSP depending on the definition applied. Higher rates were associated with early changes in therapy by clinician in the absence of an obvious clinical rationale. Non-adherence to treatment guidelines was observed for 70/169 (41.4%) and 67/201 (33.3%) of children with SP and VSP, respectively. Among children with SP, adherence to treatment guidelines was associated with the presence of wheeze on initial assessment (P = 0.02), while clinician non-adherence to guideline-recommended treatments for VSP tended to occur in children with altered consciousness (P < 0.001). Using propensity score matching to account for imbalance in the distribution of baseline clinical characteristics among children with VSP revealed no difference in TF between those treated with the guideline-recommended regimen vs. more costly broad-spectrum alternatives [risk difference 0.37 (95% CI −0.84 to 0.51)].

Conclusion

Before revising current pneumonia case management guidelines, standardised definitions of TF and appropriate studies of treatment effectiveness of alternative regimens are required.

Objectif

Déterminer l'ampleur et les caractéristiques de l’échec du traitement (ET) chez les enfants hospitalisés avec une pneumonie acquise dans la communauté dans un grand hôpital tertiaire du Kenya.

Méthodes

Nous avons suivi des enfants âgés de 2 à 59 mois avec une pneumonie sévère (PS) et une pneumonie très sévère (PTS) telles que définies par l’OMS, sur un maximum de cinq jours pour l’ET, en utilisant deux définitions: (a) documentation des signes cliniques prédéfinis ayant entraîné un changement du traitement, (b) décision primaire du clinicien de changer de traitement avec ou sans documentation des mêmes signes cliniques prédéfinis.

Résultats

Nous avons recruté 385 enfants. Le risque d’ET variait de 1,8% (IC95%: 0,4 à 5,1) à 12,4% (IC95%: 7,9 à 18,4) pour la PS et de 21,4% (IC95%: 15,9 à 27) à 39,3% (IC95%: 32,5 à 46,4) pour la PTS selon la définition appliquée. Des taux plus élevés étaient associés à des changements précoces du traitement par le clinicien en l'absence d'une justification clinique évidente. Le non-respect des directives de traitement a été observé pour 70/169 (41,4%) et 67/201 (33,3%) enfants avec une PS et une PTS respectivement. Chez les enfants avec une PS, le respect des directives de traitement était associé avec la présence d'une respiration sifflante au cours l’évaluation initiale (P = 0,02) tandis que le non respect par les cliniciens des traitements recommandés pour la PTS tendait à se produire chez les enfants avec une altération de la conscience (P <0,001). L'utilisation du score de propension correspondant pour tenir compte du déséquilibre dans la répartition des caractéristiques cliniques de base chez les enfants avec une PTS n'a révélé aucune différence dans l’ET entre ceux traités avec le régime recommandé par les directives et ceux traités par des alternatives plus coûteuses à large spectre (différence de risque: 0,37 (IC95%: -0,84 à 0,51).

Conclusion

Avant la révision des directives actuelles de prise en charge des cas de pneumonie, des définitions standard d’ET et des études appropriées de l'efficacité des traitements alternatifs sont nécessaires.

Objetivo

Determinar la extensión y el patrón del fallo en el tratamiento (FT) en niños hospitalizados con una neumonía adquirida en la comunidad, ingresados en un gran hospital terciario de Kenia.

Métodos

Hemos seguido a niños con edades entre los 2-59 meses con una neumonía severa (NS) y neumonía muy severa (NMS) según definición de la OMS de hasta cinco días para FT utilizando dos definiciones: (a) documentación de signos clínicos pre-definidos que resultaron en un cambio de tratamiento (b) decisión del clínico principal de cambiar el tratamiento con o sin documentación de los mismos signos clínicos pre-definidos.

Resultados

Incluimos a 385 niños. El riesgo de FT varió entre un 1.8% (IC 95% 0.4 a 5.1) y 12.4% (IC 95% 7.9 a 18.4) para NS y 21.4% (IC 95% 15.9 a 27) y 39.3% (IC 95% 32.5 a 46.4) para NMS dependiendo de la definición que se aplicase. Unas mayores tasas estaban asociadas con cambios tempranos en la terapia por el clínico y en ausencia de un razonamiento clínico obvio. Se observaba una no adherencia a las guías de tratamiento en 70/169 (41.4%) y 67/201 (33.3%) de los niños con NS y NMS respectivamente. Entre los niños con SP, la adherencia a las guías de tratamiento estaba asociada con la presencia de sibilancias en la evaluación inicial (P=0.02) mientras que la no adherencia del clínico a los tratamientos recomendados por las guías para NMS tendían a ocurrir en niños con un estado alterado de consciencia (P<0.001). Utilizando el pareamiento por puntaje de propensión para equilibrar los grupos en la distribución de las características clínicas de base de los niños con NMS, se observó que no existían diferencias en FT entre aquellos tratados con el régimen recomendado por las guías versus alternativas más costosas de amplio espectro (diferencias de riesgo 0.37 (IC 95% -0.84 a 0.51).

Conclusión

Antes de revisar las actuales guías de manejo de casos de neumonía, se requieren definiciones estandarizadas de FT y estudios apropiados de la efectividad del tratamiento de regímenes alternativos.

Assessment of paediatric inpatient care during a multifaceted quality improvement intervention in Kenyan district hospitals--use of prospectively collected case record data

Background

In assessing quality of care in developing countries, retrospectively collected data are usually used given their availability. Retrospective data however suffer from such biases as recall bias and non-response bias. Comparing results obtained using prospectively and retrospectively collected data will help validate the use of the easily available retrospective data in assessing quality of care in past and future studies.

Methods

Prospective and retrospective datasets were obtained from a cluster randomized trial of a multifaceted intervention aimed at improving paediatric inpatient care conducted in eight rural Kenyan district hospitals by improving management of children admitted with pneumonia, malaria and diarrhea and/or dehydration. Four hospitals received a full intervention and four a partial intervention. Data were collected through 3 two weeks surveys conducted at baseline, after 6 and 18 months. Retrospective data was sampled from paediatric medical records of patients discharged in the preceding six months of the survey while prospective data was collected from patients discharged during the two week period of each survey. Risk Differences during post-intervention period of16 quality of care indicators were analyzed separately for prospective and retrospective datasets and later plotted side by side for comparison.

Results

For the prospective data there was strong evidence of an intervention effect for 8 of the indicators and weaker evidence of an effect for one indicator, with magnitude of effect sizes varying from 23% to 60% difference. For the retrospective data, 10 process (these include the 8 indicators found to be statistically significant in prospective data analysis) indicators had statistically significant differences with magnitude of effects varying from 10% to 42%. The bar-graph comparing results from the prospective and retrospective datasets showed similarity in terms of magnitude of effects and statistical significance for all except two indicators.

Conclusion

Multifaceted interventions can help improve adoption of clinical guidelines and hence improve the quality of care. The similar inference reached after analyses based on prospective assessment of case management is a useful finding as it supports the utility of work based on examination of retrospectively assembled case records allowing longer time periods to be studied while constraining costs.

Trial registration

Current Controlled Trials ISRCTN42996612. Trial registration date: 20/11/2008

Adoption of recommended practices and basic technologies in a low-income setting

OBJECTIVE

In global health considerable attention is focused on the search for innovations; however, reports tracking their adoption in routine hospital settings from low-income countries are absent.

DESIGN AND SETTING

We used data collected on a consistent panel of indicators during four separate cross-sectional, hospital surveys in Kenya to track changes over a period of 11 years (2002-2012).

MAIN OUTCOME MEASURES

Basic resource availability, use of diagnostics and uptake of recommended practices.

RESULTS

There appeared little change in availability of a panel of 28 basic resources (median 71% in 2002 to 82% in 2012) although availability of specific feeds for severe malnutrition and vitamin K improved. Use of blood glucose and HIV testing increased but remained inappropriately low throughout. Commonly (malaria) and uncommonly (lumbar puncture) performed diagnostic tests frequently failed to inform practice while pulse oximetry, a simple and cheap technology, was rarely available even in 2012. However, increasing adherence to prescribing guidance occurred during a period from 2006 to 2012 in which efforts were made to disseminate guidelines.

CONCLUSIONS

Findings suggest changes in clinical practices possibly linked to dissemination of guidelines at reasonable scale. However, full availability of basic resources was not attained and major gaps likely exist between the potential and actual impacts of simple diagnostics and technologies representing problems with availability, adoption and successful utilisation. These findings are relevant to debates on scaling up in low-income settings and to those developing novel therapeutic or diagnostic interventions.

Explaining the uptake of paediatric guidelines in a Kenyan tertiary hospital--mixed methods research

Background

Evidence-based standards for management of the seriously sick child have existed for decades, yet their translation in clinical practice is a challenge. The context and organization of institutions are known determinants of successful translation, however, research using adequate methodologies to explain the dynamic nature of these determinants in the quality-of-care improvement process is rarely performed.

Methods

We conducted mixed methods research in a tertiary hospital in a low-income country to explore the uptake of locally adapted paediatric guidelines. The quantitative component was an uncontrolled before and after intervention study that included an exploration of the intervention dose-effect relationship. The qualitative component was an ethnographic research based on the theoretical perspective of participatory action research. Interpretive integration was employed to derive meta-inferences that provided a more complete picture of the overall study results that reflect the complexity and the multifaceted ontology of the phenomenon studied.

Results

The improvement in health workers’ performance in relation to the intensity of the intervention was not linear and was characterized by improved and occasionally declining performance. Possible root causes of this performance variability included challenges in keeping knowledge and clinical skills updated, inadequate commitment of the staff to continued improvement, limited exposure to positive professional role models, poor teamwork, failure to maintain professional integrity and mal-adaptation to institutional pressures.

Conclusion

Implementation of best-practices is a complex process that is largely unpredictable, attributed to the complexity of contextual factors operating predominantly at professional and organizational levels. There is no simple solution to implementation of best-practices. Tackling root causes of inadequate knowledge translation in this tertiary care setting will require long-term planning, with emphasis on promotion of professional ethics and values and establishing an organizational framework that enhances positive aspects of professionalism. This study has significant implications for the quality of training in medical institutions and the development of hospital leadership.

Factors influencing performance of health workers in the management of seriously sick children at a Kenyan tertiary hospital--participatory action research

BACKGROUND

Implementation of World Health Organization case management guidelines for serious childhood illnesses remains a challenge in hospitals in low-income countries. Facilitators of and barriers to implementation of locally adapted clinical practice guidelines (CPGs) have not been explored.

METHODS

This ethnographic study based on the theory of participatory action research (PAR) was conducted in Kenyatta National Hospital, Kenya's largest teaching hospital. The primary intervention consisted of dissemination of locally adapted CPGs. The PRECEDE-PROCEED health education model was used as the conceptual framework to guide and examine further reinforcement activities to improve the uptake of the CPGs. Activities focussed on introduction of routine clinical audits and tailored educational sessions. Data were collected by a participant observer who also facilitated the PAR over an eighteen-month period. Naturalistic inquiry was utilized to obtain information from all hospital staff encountered while theoretical sampling allowed in-depth exploration of emerging issues. Data were analysed using interpretive description.

RESULTS

Relevance of the CPGs to routine work and emergence of a champion of change facilitated uptake of best-practices. Mobilization of basic resources was relatively easily undertaken while activities that required real intellectual and professional engagement of the senior staff were a challenge. Accomplishments of the PAR were largely with the passive rather than active involvement of the hospital management. Barriers to implementation of best-practices included i) mismatch between the hospital's vision and reality, ii) poor communication, iii) lack of objective mechanisms for monitoring and evaluating quality of clinical care, iv) limited capacity for planning strategic change, v) limited management skills to introduce and manage change, vi) hierarchical relationships, and vii) inadequate adaptation of the interventions to the local context.

CONCLUSIONS

Educational interventions, often regarded as 'quick-fixes' to improve care in low-income countries, may be necessary but are unlikely to be sufficient to deliver improved services. We propose that an understanding of organizational issues that influence the behaviour of individual health professionals should guide and inform the implementation of best-practices.

Hospital outcomes for paediatric pneumonia and diarrhoea patients admitted in a tertiary hospital on weekdays versus weekends: a retrospective study

Background

Quality of patient care in hospitals has been shown to be inconsistent during weekends and night-time hours, and is often associated with reduced patient monitoring, poor antibiotic prescription practices and poor patient outcomes. Poorer care and outcomes are commonly attributed to decreased levels of staffing, supervision and expertise and poorer access to diagnostics. However, there are few studies examining this issue in low resource settings where mortality from common childhood illnesses is high and health care systems are weak.

Methods

This study uses data from a retrospective cross-sectional study aimed at “evaluating the uptake of best practice clinical guidelines in a tertiary hospital” with a pre and post intervention approach that spanned the period 2005 to 2009. We evaluated a primary hypothesis that mortality for children with pneumonia and/or dehydration aged 2–59 months admitted on weekends differed from those admitted on weekdays. A secondary hypothesis that poor quality of care could be a mechanism for higher mortality was also explored. Logistic regression was used to examine the association between mortality and the independent predictors of mortality.

Results

Our analysis indicates that there is no difference in mortality on weekends compared to weekdays even after adjusting for the significant predictors of mortality (OR = 1.15; 95% CI 0.90 -1.45; p = 0.27). There were similarly no significant differences between weekends and weekdays for the quality of care indicators, however, there was an overall improvement in mortality and quality of care through the period of study.

Conclusion

Mortality and the quality of care does not differ by the day of admission in a Kenyan tertiary hospital, however mortality remains high suggesting that continued efforts to improve care are warranted.

Designing a theory-informed, contextually appropriate intervention strategy to improve delivery of paediatric services in Kenyan hospitals

BACKGROUND

District hospital services in Kenya and many low-income countries should deliver proven, effective interventions that could substantially reduce child and newborn mortality. However such services are often of poor quality. Researchers have therefore been challenged to identify intervention strategies that go beyond addressing knowledge, skill, or resource inadequacies to support health systems to deliver better services at scale. An effort to develop a system-oriented intervention tailored to local needs and context and drawing on theory is described.

METHODS

An intervention was designed to improve district hospital services for children based on four main strategies: a reflective process to distill root causes for the observed problems with service delivery; developing a set of possible intervention approaches to address these problems; a search of literature for theory that provided the most appropriate basis for intervention design; and repeatedly moving backwards and forwards between identified causes, proposed interventions, identified theory, and knowledge of the existing context to develop an overarching intervention that seemed feasible and likely to be acceptable and potentially sustainable.

RESULTS AND DISCUSSION

In addition to human and resource constraints key problems included failures of relevant professionals to take responsibility for or ownership of the challenge of pediatric service delivery; inadequately prepared, poorly supported leaders of service units (mid-level managers) who are often professionally and geographically isolated and an almost complete lack of useful information for routinely monitoring or understanding service delivery practice or outcomes. A system-oriented intervention recognizing the pivotal role of leaders of service units but addressing the outer and inner setting of hospitals was designed to help shape and support an appropriate role for these professionals. It aims to foster a sense of ownership while providing the necessary understanding, knowledge, and skills for mid-level managers to work effectively with senior managers and frontline staff to improve services. The intervention will include development of an information system, feedback mechanisms, and discussion fora that promote positive change. The vehicle for such an intervention is a collaborative network partnering government and national professional associations. This case is presented to promote discussion on approaches to developing context appropriate interventions particularly in international health.