Improving and sustaining quality of child health care through IMCI training and supervision: experience from rural Bangladesh

Optimized segmented regression models for the transition period of intervention effects

BACKGROUND

The interrupted time series (ITS) design is a widely used approach to examine the effects of interventions. However, the classic segmented regression (CSR) method, the most popular statistical technique for analyzing ITS data, may not be adequate when there is a transitional period between the pre- and post-intervention phases.

METHODS

To address this issue and better capture the distribution patterns of intervention effects during the transition period, we propose using different cumulative distribution functions in the CSR model and developing corresponding optimized segmented regression (OSR) models. This study illustrates the application of OSR models to estimate the long-term impact of a national free delivery service policy intervention in Ethiopia.

RESULTS

Regardless of the choice of transition length ([Formula: see text]) and distribution patterns of intervention effects, the OSR models outperformed the CSR model in terms of mean square error (MSE), indicating the existence of a transition period and the validity of our model's assumptions. However, the estimates of long-term impacts using OSR models are sensitive to the selection of L, highlighting the importance of reasonable parameter specification. We propose a data-driven approach to select the transition period length to address this issue.

CONCLUSIONS

Overall, our OSR models provide a powerful tool for modeling intervention effects during the transition period, with a superior model fit and more accurate estimates of long-term impacts. Our study highlights the importance of appropriate statistical methods for analyzing ITS data and provides a useful framework for future research.

A qualitative assessment of facility readiness and barriers to the facility-based management of childhood severe acute malnutrition in the public healthcare settings in Bangladesh

OBJECTIVE

To assess facility readiness and identify barriers to the facility-based management of childhood severe acute malnutrition (SAM) in public healthcare settings.

DESIGN

Qualitative methods were applied to assess readiness and identify different perspectives on barriers to the facility-based management of children with SAM. Data collection was done using in-depth interviews, key informant interviews, exit interviews and pre-tested observation tools.

SETTINGS

Two tertiary care and four district hospitals in Rangpur and Sylhet Divisions of Bangladesh.

PARTICIPANTS

Healthcare professionals and caregivers of children with SAM.

RESULTS

Anthropometric tools, glucometer, medicines, F-75, F-100 and national guidelines for facility-based management of childhood SAM were found unavailable in some of the hospitals. Sitting and sleeping arrangements for the caregivers were absent in all of the chosen facilities. We identified a combination of health system and contextual barriers that inhibited the facility-based management of SAM. The health system barriers include inadequate manpower, rapid turnover of staff, increased workload, lack of training and lack of adherence to management protocol. The major facility barriers were insufficient space and unavailability of required equipment, medicines and foods for hospitalised children with SAM. The reluctance of caregivers to complete the treatment regimen, their insufficient knowledge regarding proper feeding, increased number of attendants and poverty of parents were the principal contextual barriers.

CONCLUSIONS

The study findings provide insights on barriers that are curbing the facility-based management of SAM and emphasise policy efforts to develop feasible interventions to reduce the barriers and ensure the preparedness of the facilities for effective service delivery.

Factors influencing quality nutrition service provision at antenatal care contacts: Findings from a public health facility-based observational study in 21 districts of Bangladesh

Malnutrition during pregnancy is associated with increased maternal morbidity and mortality and has a long-term negative impact on child growth and development. Antenatal care (ANC) is the formal point of contact for pregnant women to receive preventive health and nutrition services. We assessed the quality of nutrition service delivery during ANC and examined its influencing factors related to the health facility, health care provider (HCP) and client characteristics. We conducted a cross-sectional assessment in 179 facilities, including 1,242 ANC observations and exit interviews of pregnant women from 21 districts in Bangladesh. We considered four essential nutrition services at each ANC contact including maternal weight measurement, anaemia assessment, nutrition counselling and iron-folic acid (IFA) supplement provision. We defined a composite ‘quality nutrition service’ outcome by counting the number of services (out of four) provided at each ANC from observation data. We explored both the supply-side and the client-level factors of quality nutrition service using multilevel Poisson regression. Overall, only 15% of clients received all four nutrition services. Performance of weight measurement (79%) was higher than IFA provision (56%), anaemia assessment (52%) and nutrition counselling (52%). The multivariable analysis showed that quality nutrition service delivery is positively associated with good logistical readiness of the facilities (aIRR: 1.23, 95% CI: 1.08–1.39), consultation by paramedics (aIRR 1.23, 95% CI: 1.06–1.42) and community health care providers (aIRR 1.32, 95% CI: 1.12–1.57), HCPs’ knowledge on maternal nutrition (aIRR 1.04; 95% CI: 1.01–1.08), better HCP-client communication (aIRR 1.14; 95% CI: 1.04–1.26) and use visual aids or ANC card (aIRR 1.18; 95% CI: 1.11–1.27). We found limited associations between HCP training and external supervision with the quality of nutrition services. In conclusion, the quality of nutrition service provision during ANC is suboptimal. Public health nutrition programmers should ensure the facilities’ logistical readiness, and revisit and reinforce the content and modality of training and supportive supervision of the HCPs. They should also emphasize positive HCP-client communication and the use of job aids to improve the quality of nutrition service provision during ANC.

Quality of maternal and newborn hospital care in Brazil: a quality improvement cycle using the WHO assessment and quality tool

BACKGROUND

Increasing efforts toward quality improvement (QI) are necessary in low- and middle-income countries (LMICs) to reduce maternal and perinatal mortality and morbidity and to promote respectful care. In Brazil, perinatal health indicators are below targets in several states despite universal access to perinatal services and very high rates of institutional births, indicating poor quality of care (QoC) as a key issue to be addressed. However, research efforts to develop and test QoC improvement interventions are scarce.

OBJECTIVES

We assessed the effects of a 1-year comprehensive QI cycle using a World Health Organization (WHO) assessment and quality tool on maternal and newborn care at hospital level and documented QIs obtained after a 1-year comprehensive QI cycle.

METHODS

Uncontrolled, unblinded, pre-post study carried out in six maternity hospitals in Pernambuco, Brazil, accounting for 29 128 live births in 2014. A standards-based and participatory approach based on a WHO quality assessment and improvement tool for maternal and neonatal care at hospital level was used. A national team of assessors supervised by international experts carried out baseline and final assessments. An action plan was developed and implemented to address key quality gaps emerging from the baseline assessment and from two supportive supervision visits.

RESULTS

At baseline, hospitals presented a variety of quality gaps, the majority common to all participating centers. Gaps in case management of normal and complicated deliveries and in respectful and holistic care were predominant, in both teaching/tertiary and secondary care hospitals. After one year, several improvements were observed, particularly in respectful care during labor and at delivery, in case management of normal labor and delivery and in neonatal care.

CONCLUSIONS

A systematic participatory approach based on a WHO tool produced important QIs in a relatively short time and should be considered for use for large-scale QI programs in Brazil and other LMICs. Its comprehensive, peer-to-peer and action-oriented nature and its capability to document QI over time and to build a QI culture represent important comparative advantages over other QI interventions.

A Checklist for Implementing Rural Pathways to Train, Develop and Support Health Workers in Low and Middle-Income Countries

Background: There is an urgent need to scale up global action on rural workforce development. This World Health Organization-sponsored research aimed to develop a Rural Pathways Checklist. Its purpose was to guide the practical implementation of rural workforce training, development, and support strategies in low and middle-income countries (LMICs). It was intended for any LMICs, stakeholder, health worker, context, or health problem. Method: Multi-methods involved: (1) focus group concept testing; (2) a policy analysis; (3) a scoping review of LMIC literature; (4) consultation with a global Expert Reference Group and; (5) field-testing over an 18-month period. Results: The Checklist included eight actions for implementing rural pathways in LMICs: establishing community needs; policies and partners; exploring existing workers and scope; selecting health workers; education and training; working conditions for recruitment and retention; accreditation and recognition of workers; professional support/up-skilling and; monitoring and evaluation. For each action, a summary of LMICs-specific evidence and prompts was developed to stimulate reflection and learning. To support implementation, rural pathways exemplars from different WHO regions were also compiled. Field-testing showed the Checklist is fit for purpose to guide holistic planning and benchmarking of rural pathways, irrespective of LMICs, stakeholder, or health worker type. Conclusion: The Rural Pathways Checklist provides an agreed global conceptual framework for the practical implementation of "grow your own" strategies in LMICs. It can be applied to scale-up activity for rural workforce training and development in LMICs, where health workers are most limited and health needs are greatest.

Improving the Assessment and Classification of Sick Children according to the Integrated Management of Childhood Illness (IMCI) Protocol at Sanja Primary Hospital, Northwest Ethiopia: A Pre-Post Interventional Study

Background

A complete and consistent use of integrated management of childhood illness (IMCI) protocol is a strategic implementation that has been used to promote the accurate assessment and classifications of childhood illnesses, ensures appropriate combined treatment, strengthens the counseling of caregiver, and speeds up the referrals to decrease child mortality and morbidity. However, there is limited evidence about the complete and consistent use of IMCI protocol during the assessment and classifications of childhood illness in Ethiopia. Therefore, this intervention was implemented to improve the assessment and classifications of childhood illness according to the IMCI protocol in Sanja primary hospital, northwest Ethiopia.

Methods

A pre-post interventional study was used in Sanja primary hospital from January 01 to May 30, 2019. A total of 762 (381 for pre and 381 for postintervention) children from 2 months up to 5 years of age were involved in the study. Data were collected using a structured questionnaire prepared from the IMCI guideline, and a facility checklist was used. A five-month in-service training, weekly supportive supervision, daily morning session, and availing essential drugs and materials were done. Both the descriptive statistics and independent t-test were done. In the independent t-test, a p value of <0.05 and a mean difference with 95% CI were used to declare the significance of the interventions.

Results

The findings revealed that the overall completeness of the assessment was improved from 37.8 to 79.8% (mean difference: 0.17; 95% CI: 0.10-0.22), consistency of assessment with classification from 47.5 to 76.9% (mean difference: 0.34; 95% CI: 0.27-0.39), classification with treatment from 42.3 to 75.4% (mean difference: 0.35; 95% CI: 0.28-0.47), and classification with follow-up from 32.8 to 73.0% (mean difference: 0.36; 95% CI: 0.29-0.42).

Conclusion

The intervention has a significant improvement in the assessment and classification of childhood illness according to the IMCI protocol. Therefore, steps must be taken to ensure high quality of training, adequate supervision including the observation of health workers managing sick children during supervisory visits, and a constant supply of essential drugs and job aids for successful implementation of IMCI in the hospital and also to other facilities.

Evaluating implementation of "management of Possible Serious Bacterial Infection (PSBI) when referral is not feasible" in primary health care facilities in Sindh province, Pakistan

Background

The World Health Organization (WHO) launched a guideline in 2015 for managing Possible Serious Bacterial Infection (PSBI) when referral is not feasible in young infants aged 0–59 days. This guideline was implemented across 303 Basic Health Unit (BHU) Plus primary health care (PHC) facilities in peri-urban and rural settings of Sindh, Pakistan. We evaluated the implementation of PSBI guideline, and the quality of care provided to sick young infants at these facilities.

Methods

Thirty (10%) out of 303 BHU Plus facilities were randomly selected for evaluation. A survey team visited each facility for one day, assessed the health system support, observed the management of sick young infants by health care providers (HCP), validated their management, interviewed HCPs and caretakers of sick infants. HCPs who were unable to see a young infant on the day of survey were evaluated using pre-prepared case scenarios.

Results

Thirty (100%) BHU Plus facilities had oral amoxicillin, injectable gentamicin, thermometers, baby weighing scales and respiratory timers available; 29 (97%) had disposable syringes and needles; 28 (93%) had integrated management of childhood illness (IMCI)/PSBI chart booklets and job aids and 18 (60%) had a functional ambulance. Each facility had at least one HCP trained in PSBI, and 21 (70%) facilities had been visited by a supervisor in the preceding six months. Of 42 HCPs, 19 (45.3%) were trained within the preceding 12 months. During the survey, 26 sick young infants were identified in 18 facilities. HCPs asked about history of breastfeeding in 23 (89%) infants, history of vomiting in 17 (65%), and history of convulsions in 14 (54%); weighed 25 (97%) infants; measured respiratory rate in all (100%) and temperature in 24 (92%); assessed 20 (77%) for movement and 14 (54%) for chest indrawing. HCPs identified two infants with fast breathing pneumonia and managed them correctly per IMCI/PSBI protocol. HCPs identified six (23%) infants with clinical severe infection (CSI), two of them were referred to a higher-level facility, only one accepted the referral advice. Only one CSI patient was managed correctly per IMCI/PSBI protocol at the outpatient level. HCPs described the PSBI danger signs to eight (31%) caretakers. Caretakers of five infants with CSI and two with pneumonia were not counselled for PSBI danger signs. Five of the six CSI cases categorized by HCPs were validated as CSI on re-examination, whereas one had pneumonia. Similarly, one of the two pneumonia patients categorized by HCPs had CSI and one identified as local bacterial infection was classified as CSI upon re-examination.

Conclusion

Health system support was adequate but clinical management and counselling by HCPs was sub-optimal particularly with CSI cases who are at higher risk of adverse outcomes. Scaling up PSBI management is potentially feasible in PHC facilities in Pakistan, provided that HCPs are trained well and mentored, receive refresher training to appropriately manage sick young infants, and have adequate supplies and counselling skills.

Quality of healthcare for children with severe acute malnutrition in a refugee setting: cross-sectional study in West Nile Region, Uganda

OBJECTIVES

5.0 million annual deaths in low-income and middle-income countries are due to poor quality of care (QOC). We evaluated the QOC provided to malnourished children in West Nile Region in Uganda.

DESIGN

Cross-sectional study.

SETTING

West Nile Region, an area hosting over one million refugees.

PARTICIPANTS

Among 148 facilities providing nutritional services, 30 randomly selected facilities (20%) and the records of 1467 children with severe acute malnutrition (100% of those attending the 30 facilities during last year) were assessed.

OUTCOMES

The national Nutrition Service Delivery Assessment (NSDA) tool was used to assess capacity areas related to QOC. Case management, data quality and health outcomes were assessed from official health records. Multivariate analysis was performed to explore factors significantly associated with better cure rates.

RESULTS

Of 305 NSDA scores allocated to 30 participating centres, 201 (65.9%) were 'good' or 'excellent'. However, 20 (66.7%) facilities had 'poor' 'quality improvement mechanisms' and 13 (43.3%) had 'poor' 'human resources'. Overall data quality in official records was poor, while recorded quality of case management was overall fair. Average cure rate was significantly lower than international Sphere standards (50.4% vs 75% p<0.001) with a higher default rate (23.2% vs 15% p<0.001). Large heterogeneity among facilities was detected for all indicators. Refugee-hosting and non-refugee-hosting facilities had a similar cure rate (47.1% vs 52.1%) though transfer rates were higher for those hosting refugees (21.5% vs 1.9%, p<0.001) despite better 'equipment and supplies'. 'Good/excellent' 'equipment' and 'store management' were significantly associated with better cure rates in outpatient therapeutic centres (+55.9, p<0.001; +65.4, p=0.041, respectively) in multivariate analysis.

CONCLUSIONS

Though most NSDA capacity areas were rated good or excellent, health outcomes of malnourished children in West Nile Region, both in refugee-hosting and non-refugee-hosting facilities, are significantly below international standards. Effective and sustainable approaches to improve malnourished child health outcomes are needed.

Towards improved health service quality in Tanzania: contribution of a supportive supervision approach to increased quality of primary healthcare

Background

Universal Health Coverage only leads to the desired health outcomes if quality of health services is ensured. In Tanzania, quality has been a major concern for many years, including the problem of ineffective and inadequate routine supportive supervision of healthcare providers by council health management teams. To address this, we developed and assessed an approach to improve quality of primary healthcare through enhanced routine supportive supervision.

Methods

Mixed methods were used, combining trends of quantitative quality of care measurements with qualitative data mainly collected through in-depth interviews. The former allowed for identification of drivers of quality improvements and the latter investigated the perceived contribution of the new supportive supervision approach to these improvements.

Results

The results showed that the new approach managed to address quality issues that could be solved either solely by the healthcare provider, or in collaboration with the council. The new approach was able to improve and maintain crucial primary healthcare quality standards across different health facility level and owner categories in various contexts.

Conclusion

Together with other findings reported in companion papers, we could show that the new supportive supervision approach not only served to assess quality of primary healthcare, but also to improve and maintain crucial primary healthcare quality standards. The new approach therefore presents a powerful tool to support, guide and drive quality improvement measures within council. It can thus be considered a suitable option to make routine supportive supervision more effective and adequate.

Supportive supervision to improve the quality and outcome of outpatient care among malnourished children: a cluster randomised trial in Arua district, Uganda

Introduction

Suboptimal quality of paediatric care has been reported in resource-limited settings, but little evidence exists on interventions to improve it in such settings. This study aimed at testing supportive supervision (SS) for improving health status of malnourished children, quality of case management, overall quality of care, and the absolute number of children enrolled in the nutritional services.

Methods

This was a cluster randomised trial conducted in Arua district. Six health centres (HCs) with the highest volume of work were randomised to either SS or no intervention. SS was delivered by to HCs staff (phase 1), and later extended to community health workers (CHWs) (phase 2). The primary outcome was the cure rate, measured at children level. Quality of case management was assessed by six pre-defined indicators. Quality of care was assessed using the national Nutrition Service Delivery Assessment (NSDA) tool. Access to care was estimated with the number of children accessing HC nutritional services.

Results

Overall, 737 children were enrolled. In the intervention arm, the cure rate (83.8% vs 44.9%, risk ratio (RR)=1.91, 95% CI: 1.56–2.34, p=0.001), quality of care as scored by NSDA (RR=1.57, 95% CI: 1.01–2.44, p=0.035) and correctness in complementary treatment (RR=1.52, 95% CI: 1.40–1.67, p=0.001) were significantly higher compared with control. With the extension of SS to CHWs (phase 2), there was a significant 38.6% more children accessing care in the intervention HCs (RR=1.26, 95% CI: 1.11–1.44, p=0.001) compared with control.

Conclusion

SS significantly improved the cure rate of malnourished children, and the overall quality of care, SS to CHWs significantly increased the crude number of children enrolled in the nutritional services. More studies should confirm these results, and evaluate the cost-effectiveness of SS.

Effect of community-based intervention on improving access to treatment for sick under-five children in hard-to-reach communities in Niger State, Nigeria

BACKGROUND

Access to prompt and appropriate treatment is key to survival for children with malaria, pneumonia and diarrhoea. Community-based services are vital to extending care to remote populations. Malaria Consortium supported Niger state Ministry of Health, Nigeria, to introduce and implement an integrated community case management (iCCM) programme for four years in six local government areas (LGAs). The objective was to increase coverage of effective treatment for malaria, pneumonia and diarrhoea among children aged 2-59 months.

METHODS

The programme involved training, equipping, ongoing support and supervision of 1320 community volunteers (CORPs) to provide iCCM services to their communities in all six LGAs. Demand creation activities were also conducted; these included community dialogues, household mobilization, sensitization and mass media campaigns targeted at programme communities. To assess the level of changes in care seeking and treatment, baseline and endline household surveys were conducted in 2014 and 2017 respectively. For both surveys, a 30×30 multi-stage cluster sampling method was used, the sampling frame being RAcE programme communities.

RESULTS

Care-seeking from an appropriate provider increased overall and for each iCCM illness from 78% to 94% for children presenting with fever (P < 0.01), from 72% to 91% for diarrhoea cases (P < 0.01), and from 76% to 89% for cases of cough with difficult or fast breathing (P < 0.05). For diagnosis and treatment, the coverage of fevers tested for malaria increased from 34% to 77% (P < 0.001) and ACT treatments from 57% to 73% (<0.005); 56% of cases of cough or fast breathing who sought care from a CORP, had their respiratory rate counted and 61% with cough or fast breathing received amoxicillin. At endline caregivers sought care from CORPs in their communities for most cases of childhood illnesses (84%) compared to other providers at hospitals (1%) or health centres (9%).This aligns with caregivers' belief that CORPs are trusted providers (94%) who provide quality services (96%).

CONCLUSION

Implementation of iCCM with focused demand creation activities can improve access to quality lifesaving interventions from frontline community providers in Nigeria. This can contribute towards achieving SDGs if iCCM is scaled up to hard-to-reach areas of all states in the country.

Towards improved health service quality in Tanzania: An approach to increase efficiency and effectiveness of routine supportive supervision

Effective supportive supervision of healthcare services is crucial for improving and maintaining quality of care. However, this process can be challenging in an environment with chronic shortage of qualified human resources, overburdened healthcare providers, multiple roles of district managers, weak supply chains, high donor fragmentation and inefficient allocation of limited financial resources. Operating in this environment, we systematically evaluated an approach developed in Tanzania to strengthen the implementation of routine supportive supervision of primary healthcare providers. The approach included a systematic quality assessment at health facilities using an electronic tool and subsequent result dissemination at council level. Mixed methods were used to compare the new supportive supervision approach with routine supportive supervision. Qualitative data was collected through in-depth interviews in three councils. Observational data and informal communication as well as secondary data complemented the data set. Additionally, an economic costing analysis was carried out in the same councils. Compared to routine supportive supervision, the new approach increased healthcare providers’ knowledge and skills, as well as quality of data collected and acceptance of supportive supervision amongst stakeholders involved. It also ensured better availability of evidence for follow-up actions, including budgeting and planning, and higher stakeholder motivation and ownership of subsequent quality improvement measures. The new approach reduced time and cost spent during supportive supervision. This increased feasibility of supportive supervision and hence the likelihood of its implementation. Thus, the results presented together with previous findings suggested that if used as the standard approach for routine supportive supervision the new approach offers a suitable option to make supportive supervision more efficient and effective and therewith more sustainable. Moreover, the new approach also provides informed guidance to overcome several problems of supportive supervision and healthcare quality assessments in low- and middle income countries.

Consistency of Integrated Management of Newborn and Childhood Illness (IMNCI) in Shire Governmental Health Institution in 2017

Objective

In an effort to reduce infant mortality and morbidity, the World Health Organization and other technical partners developed the Integrated Management of Newborn and Childhood Illness (IMNCI). This study focuses on assessment of consistency and completeness of integrated management of neonatal and child hood illness in primary health care units.

Results

A total of 384 cases were taken from 3562 cases both from young infant registration (under-2 month old) and child registration (2 months–5 year old). Out of 384 cases, 241 (62.8%) cases were correctly classified and 143 (37.2%) were incorrect classifications. Similarly 164 (42.7%) cases were treated correctly where as 220 (57.3%) treated incorrectly. Only 95 (24.7%) cases have given appropriate appointments where as 289 (75.3%) cases were appointed incorrectly. The overall consistency of IMNCI management is poor. Unless continuous follow up of and training was given, children are not treated as expected. More over using electronic method of IMNCI may alleviate the problem.

Can task-shifting work at scale?: Comparing clinical knowledge of non-physician clinicians to physicians in Nigeria

Background

In contexts with severe physician shortages, the World Health Organization advocates task shifting to cadres with shorter training. To investigate the effects of task shifting at scale in primary health care, we assessed the clinical knowledge of non-physician clinicians versus physicians working in public primary care facilities in Nigeria.

Methods

We assessed 4138 health workers using clinical vignettes of hypothetical patients suffering from illnesses commonly seen in primary care. Facility-level fixed effects models were used to compare health worker knowledge of (i) consultation guidelines, (ii) diagnostic accuracy and (iii) treatment guidelines.

Results

Unadjusted averages of overall health worker knowledge were low across all types of worker except medical officers. After adjustment for potential confounding, the differences across all three measures between cadres became small or statistically insignificant.

Conclusion

Non-physician clinicians can provide the same quality of primary care, for a set of common illnesses, as Medical Officers with similar personal characteristics, but clinical skills across cadres need strengthening.

An Alternative Approach for Supportive Supervision and Skill Measurements of Health Workers for Integrated Management of Neonatal and Childhood Illnesses Program in 10 Districts of Haryana

Context:

“Integrated Management of Neonatal and Childhood Illnesses” (IMNCI) needs regular supportive supervision (SS).

Aims:

The aim of this study was to find suitable SS model for implementing IMNCI.

Settings and Design:

This was a prospective interventional study in 10 high-focus districts of Haryana.

Subjects and Methods:

Two methods of SS were used: (a) visit to subcenters and home visits (model 1) and (b) organization of IMNCI clinics/camps at primary health center (PHC) and community health center (CHC) (model 2). Skill scores were measured at different time points. Routine IMNCI data from study block and randomly selected control block of each district were retrieved for 4 months before and after the training and supervision.

Statistical Analysis Used:

Change in percentage mean skill score difference and percentage difference in median number of children were assessed in two areas.

Results:

Mean skill scores increased significantly from 2.1 (pretest) to 7.0 (posttest 1). Supportive supervisory visits sustained and improved skill scores. While model 2 of SS could positively involve health system officials, model 1 was not well received. Outcome indicator in terms of number of children assessed showed a significant improvement in intervention areas.

Conclusions:

SS in IMNCI clinics/camps at PHC/CHC level and innovative skill scoring method is a promising approach.

Estimates of Side Effects Counseling in Family Planning Using Three Data Sources: Implications for Monitoring and Survey Design

With growing attention to monitoring and improving quality of care, it is critical to have evidence-based recommendations to measure quality of care indicators and guidelines to interpret estimates from different data sources. This study facilitates methodological discussion regarding measurement of counseling for side effects in family planning, a critical component of quality. The study assesses and compares estimates of side effects counseling based on three data sources. Data came from nationally representative facility and household surveys, Service Provision Assessments, and Demographic and Health Surveys in four countries. The level of side effects counseling was unacceptably low and varied systematically by data source. Compared to observation data in the facility survey, exit interview data from the survey overestimated the level substantially, and its reporting had poor predictive value. Estimates from household surveys were comparable with the observation-based estimates applying the minimum definition of counseling. In monitoring quality of care, data sources should be carefully reviewed, and estimates may need to be adjusted if the sources are inconsistent.

Adherence to the integrated management of childhood illness guidelines in Namibia, Kenya, Tanzania and Uganda: evidence from the national service provision assessment surveys

Background

Integrated Management of Childhood Illness (IMCI) is regarded as a standard public health approach to lowering child mortality in developing countries. However, little is known about how health workers adhere to the guidelines at the national level in sub-Saharan African countries.

Methods

Data from the Service Provision Assessment surveys of Namibia (NA) (survey year: 2009), Kenya (KE) (2010), Tanzania (TZ) (2006) and Uganda (UG) (2007) were analysed for adherence to the IMCI guidelines by health workers. Potential influencing factors included the survey country, patient’s age, the different levels of the national health system, the training level of the health care provider (physician, non-physician clinician, nurse-midwife, auxiliary staff), and the status of re-training in IMCI.

Results

In total, 6856 children (NA: 1495; KE: 1890; TZ: 2469; UG: 1002 / male 51.2–53.5%) aged 2–73 months (2–24 months, 65.3%; median NA: 19 months; KE: 18 months; TZ: 16 months; UG: 15 months) were clinically assessed by 2006 health workers during the surveys.

Less than 33% of the workers carried out assessment of all three IMCI danger signs, namely inability to eat/drink, vomiting everything, and febrile convulsions (NA: 11%; KE: 11%; TZ: 14%; UG: 31%) while the rate for assessing all three of the IMCI main symptoms of cough/difficult breathing, diarrhoea, and fever was < 60% (NA: 48%; KE: 34%; TZ: 50%; UG: 57%). Physical examination rates for fever (temperature) (NA: 97%; KE: 87%; TZ: 73%; UG: 90%), pneumonia (respiration rate/auscultation) (NA: 43%; KE: 24%; TZ: 25%; UG: 20%) and diarrhoea (dehydration status) (NA: 29%; KE: 19%; TZ: 20%; UG: 39%) varied widely and were highest when assessing children with the actual diagnosis of pneumonia and diarrhoea.

Adherence rates tended to be higher in children ≤ 24 months, at hospitals, among higher-qualified staff (physician/non-physician clinician) and among those with recent IMCI re-training.

Conclusion

Despite nationwide training in IMCI the adherence rates for assessment and physical examination remained low in all four countries. IMCI training should continue to be provided to all health staff, particularly nurses, midwives, and auxiliary staff, with periodic re-training and an emphasis to equally target children of all age groups.

Support and performance improvement for primary health care workers in low- and middle-income countries: a scoping review of intervention design and methods

Primary health care workers (HCWs) in low- and middle-income settings (LMIC) often work in challenging conditions in remote, rural areas, in isolation from the rest of the health system and particularly specialist care. Much attention has been given to implementation of interventions to support quality and performance improvement for workers in such settings. However, little is known about the design of such initiatives and which approaches predominate, let alone those that are most effective. We aimed for a broad understanding of what distinguishes different approaches to primary HCW support and performance improvement and to clarify the existing evidence as well as gaps in evidence in order to inform decision-making and design of programs intended to support and improve the performance of health workers in these settings. We systematically searched the literature for articles addressing this topic, and undertook a comparative review to document the principal approaches to performance and quality improvement for primary HCWs in LMIC settings. We identified 40 eligible papers reporting on interventions that we categorized into five different approaches: (1) supervision and supportive supervision; (2) mentoring; (3) tools and aids; (4) quality improvement methods, and (5) coaching. The variety of study designs and quality/performance indicators precluded a formal quantitative data synthesis. The most extensive literature was on supervision, but there was little clarity on what defines the most effective approach to the supervision activities themselves, let alone the design and implementation of supervision programs. The mentoring literature was limited, and largely focused on clinical skills building and educational strategies. Further research on how best to incorporate mentorship into pre-service clinical training, while maintaining its function within the routine health system, is needed. There is insufficient evidence to draw conclusions about coaching in this setting, however a review of the corporate and the business school literature is warranted to identify transferrable approaches. A substantial literature exists on tools, but significant variation in approaches makes comparison challenging. We found examples of effective individual projects and designs in specific settings, but there was a lack of comparative research on tools across approaches or across settings, and no systematic analysis within specific approaches to provide evidence with clear generalizability. Future research should prioritize comparative intervention trials to establish clear global standards for performance and quality improvement initiatives. Such standards will be critical to creating and sustaining a well-functioning health workforce and for global initiatives such as universal health coverage.

Quality of nutrition services in primary health care facilities: Implications for integrating nutrition into the health system in Bangladesh

Background

In 2011, the Bangladesh Government introduced the National Nutrition Services (NNS) by leveraging the existing health infrastructure to deliver nutrition services to pregnant woman and children. This study examined the quality of nutrition services provided during antenatal care (ANC) and management of sick children younger than five years.

Methods

Service delivery quality was assessed across three dimensions; structural readiness, process and outcome. Structural readiness was assessed by observing the presence of equipment, guidelines and register/reporting forms in ANC rooms and consulting areas for sick children at 37 primary healthcare facilities in 12 sub-districts. In addition, the training and knowledge relevant to nutrition service delivery of 95 healthcare providers was determined. The process of nutrition service delivery was assessed by observing 381 ANC visits and 826 sick children consultations. Satisfaction with the service was the outcome and was determined by interviewing 541 mothers/caregivers of sick children.

Results

Structural readiness to provide nutrition services was higher for ANC compared to management of sick children; 73% of ANC rooms had >5 of the 13 essential items while only 13% of the designated areas for management of sick children had >5 of the 13 essential items. One in five (19%) healthcare providers had received nutrition training through the NNS. Delivery of the nutrition services was poor: <30% of women received all four key antenatal nutrition services, 25% of sick children had their weight checked against a growth-chart and <1% had their height measured. Nevertheless, most mothers/caregivers rated their satisfaction of the service above average.

Conclusions

Strengthening the provision of equipment and increasing the coverage of training are imperative to improve nutrition services. Inherent barriers to implementing nutrition services in primary health care, especially high caseloads during the management of sick under-five children, should be considered to identify alternative and appropriate service delivery platforms before nationwide scale up.

Improving the quality of hospital care for children by supportive supervision: a cluster randomized trial, Kyrgyzstan

OBJECTIVE

To determine whether periodic supportive supervision after a training course improved the quality of paediatric hospital care in Kyrgyzstan, where inappropriate care was common but in-hospital postnatal mortality was low.

METHODS

In a cluster, randomized, parallel-group trial, 10 public hospitals were allocated to a 4-day World Health Organization (WHO) course on hospital care for children followed by periodic supportive supervision by paediatricians for 1 year, while 10 hospitals had no intervention. We assessed prospectively 10 key indicators of inappropriate paediatric case management, as indicated by WHO guidelines. The primary indicator was the combination of the three indicators: unnecessary hospitalization, increased iatrogenic risk and unnecessary painful procedures. An independent team evaluated the overall quality of care.

FINDINGS

We prospectively reviewed the medical records of 4626 hospitalized children aged 2 to 60 months. In the intervention hospitals, the mean proportion of the primary indicator decreased from 46.9% (95% confidence interval, CI: 24.2 to 68.9) at baseline to 6.8% (95% CI: 1.1 to 12.1) at 1 year, but was unchanged in the control group (45.5%, 95% CI: 25.2 to 67.9, to 64.7%, 95% CI: 43.3 to 86.1). At 1 year, the risk ratio for the primary indicator in the intervention versus the control group was 0.09 (95% CI: 0.06 to 0.13). The proportions of the other nine indicators also decreased in the intervention group (P < 0.0001 for all). Overall quality of care improved significantly in intervention hospitals.

CONCLUSION

Periodic supportive supervision for 1 year after a training course improved both adherence to WHO guidelines on hospital care for children and the overall quality of paediatric care.

Embedding systematic quality assessments in supportive supervision at primary healthcare level: application of an electronic Tool to Improve Quality of Healthcare in Tanzania

Background

Assessing quality of health services, for example through supportive supervision, is essential for strengthening healthcare delivery. Most systematic health facility assessment mechanisms, however, are not suitable for routine supervision. The objective of this study is to describe a quality assessment methodology using an electronic format that can be embedded in supervision activities and conducted by council health staff.

Methods

An electronic Tool to Improve Quality of Healthcare (e-TIQH) was developed to assess the quality of primary healthcare provision. The e-TIQH contains six sub-tools, each covering one quality dimension: infrastructure and equipment of the facility, its management and administration, job expectations, clinical skills of the staff, staff motivation and client satisfaction. As part of supportive supervision, council health staff conduct quality assessments in all primary healthcare facilities in a given council, including observation of clinical consultations and exit interviews with clients. Using a hand-held device, assessors enter data and view results in real time through automated data analysis, permitting immediate feedback to health workers. Based on the results, quality gaps and potential measures to address them are jointly discussed and actions plans developed.

Results

For illustrative purposes, preliminary findings from e-TIQH application are presented from eight councils of Tanzania for the period 2011–2013, with a quality score <75 % classed as ‘unsatisfactory’. Staff motivation (<50 % in all councils) and job expectations (≤50 %) scored lowest of all quality dimensions at baseline. Clinical practice was unsatisfactory in six councils, with more mixed results for availability of infrastructure and equipment, and for administration and management. In contrast, client satisfaction scored surprisingly high. Over time, each council showed a significant overall increase of 3–7 % in mean score, with the most pronounced improvements in staff motivation and job expectations.

Conclusions

Given its comprehensiveness, convenient handling and automated statistical reports, e-TIQH enables council health staff to conduct systematic quality assessments. Therefore e-TIQH may not only contribute to objectively identifying quality gaps, but also to more evidence-based supervision. E-TIQH also provides important information for resource planning. Institutional and financial challenges for implementing e-TIQH on a broader scale need to be addressed.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-016-1809-4) contains supplementary material, which is available to authorized users.

Challenges to the implementation of the integrated management of childhood illness (IMCI) at community health centres in West Java province, Indonesia

BACKGROUND

The integrated management of childhood illness (IMCI) is a comprehensive approach to child health, which has been adopted in Indonesia since 1997. This study aims to provide an overview of IMCI implementation at community health centres (puskesmas) in West Java province, Indonesia.

METHODS

Data were derived from a cross-sectional study conducted in 10 districts of West Java province, from November to December 2012. Semi-structured interviews were used to obtain information from staff at 80 puskesmas, including the heads (80 informants), pharmacy staff (79 informants) and midwives/nurses trained in IMCI (148 informants), using semi-structured interviews. Quantitative data were analysed using frequency tabulations and qualitative data were analysed by identifying themes that emerged in informants' responses.

RESULTS

Almost all (N = 79) puskesmas implemented the IMCI strategy; however, only 64% applied it to all visiting children. Several barriers to IMCI implementation were identified, including shortage of health workers trained in IMCI (only 43% of puskesmas had all health workers in the child care unit trained in IMCI and 40% of puskesmas conducted on-the-job training). Only 19% of puskesmas had all the essential drugs and equipment for IMCI. Nearly all health workers acknowledged the importance of IMCI in their routine services and very few did not perceive its benefits. Lack of supervision from district health office staff and low community awareness regarding the importance of IMCI were reported. Complaints received from patients'families were generally related to the long duration of treatment and no administration of medication after physical examination.

CONCLUSION

Interventions aiming to create local regulations endorsing IMCI implementation; promoting monitoring and supervision; encouraging on-the-job training for health workers; and strengthening training programmes, counselling and other promotional activities are important for promoting IMCI implementation in West Java province, and are also likely to be useful elsewhere in the country.