Training And Supervision Did Not Meaningfully Improve Quality Of Care For Pregnant Women Or Sick Children In Sub-Saharan Africa

Factors influencing healthcare workers' and health system preparedness for the COVID-19 pandemic: A qualitative study in Ghana

Adequate preparedness of health systems, particularly healthcare workers (HCWs), to respond to COVID-19 is critical for the effective control of the virus, especially in low- and middle-income countries where health systems are overburdened. We examined Ghanaian HCWs' perceived preparedness to respond to the pandemic and the factors that shaped their preparedness and that of the health system. Semi-structured in-depth interviews were conducted with n = 26 HCWs responsible for the clinical management of COVID-19 patients and three administrators responsible for developing and implementing COVID-19 policies at the facility level. Interviews were conducted over the phone in English, transcribed, and analyzed using a thematic analysis approach. Generally, HCWs felt inadequately prepared to contain the spread of COVID-19 due to resource shortages and inadequate training. HCWs, similarly, perceived the health system to be unprepared due to insufficient clinical infrastructure and logistical challenges. The few who felt prepared identified readiness in managing high consequence infectious disease cases and pre-existing protocols as enablers of HCW preparedness. The health system and HCWs were unprepared to manage the COVID-19 pandemic due to inadequate training, logistical challenges, and weak clinical infrastructure. Interventions are urgently needed to improve the health system's preparedness for future pandemics.

Development, assessment and educational impact of a blended e-learning training program on pharmacovigilance implemented in four African countries

Introduction

Efforts to improve medication access in low-and middle-income countries, particularly in Sub-Saharan Africa, have made progress, especially in the fight against infectious diseases such as tuberculosis. However, challenges exist in establishing effective pharmacovigilance systems. The PhArmacoVIgilance Africa (PAVIA) project was committed to enhancing pharmacovigilance in Tanzania, Eswatini, Nigeria, and Ethiopia, with an emphasis on anti-tuberculosis drugs, utilizing various methods, including training. This study evaluates the PAVIA training program's effectiveness and its adaptation during the COVID-19 pandemic.

Methods

A blended e-learning program, incorporating two courses and a platform for educational materials, was developed. This program, designed to train healthcare professionals in pharmacovigilance, was incorporated into a Training of Trainers model. To evaluate the program effectiveness, we used multiple measures such as assessing knowledge gain through pre-and post-test scores, assessing learners' satisfaction and attitudes via questionnaires, and analyzing Individual Case Safety Reports (ICSRs) in VigiBase to determine the impact on spontaneous reporting systems in the PAVIA countries.

Results

121 learners enrolled in the pilot trainings, including 36 from Tanzania, 34 from Eswatini, 25 from Nigeria, and 26 from Ethiopia. Notably, post-test scores were significantly higher than pre-test scores in all four countries. Following the pilot trainings, multiple step-down training sessions were held in Tanzania, Eswatini, and Nigeria, with a total of 827 learners registering and 421 successfully completing the program. Learners' scores on the post-tests were significantly higher than on the pre-tests for both courses in all three countries. Learners' feedback on the training was overwhelmingly positive. Additionally, a qualitative analysis of ICSRs revealed a substantial increase in reports after the training in Tanzania, Eswatini, and Nigeria.

Discussion

An innovative e-learning program trained healthcare professionals in pharmacovigilance and anti-tuberculosis drug safety over 3 years in four PAVIA countries. The program effectively improved participants' knowledge, received positive feedback, and likely had an impact on reporting rates in Tanzania, Eswatini, and Nigeria, although a direct causal link could not be definitively established due to data limitations and other factors, such as the heightened reporting rates associated with COVID-19 vaccines, that could have contributed to the notable increase in ICSRs.

Regional determinants of quality of care for sick children: A multilevel analysis in four countries

Background

The limited impact of increased access to care on improvements in health outcomes during the Millennium Development Goal era has been attributed, in part, to inadequate quality of care. We identified regional factors associated with health service quality for sick child care in low-income countries and examined whether provider factors interact with regional factors to affect the quality of care.

Methods

We conducted cross-sectional random intercept four-level linear regression using the most recent Service Provision Assessment and Demographic Health Survey data from four countries (467 from the Democratic Republic of Congo 2018, 2425 from Afghanistan 2018, 2072 from Nepal 2015, and 813 from Senegal 2017). The outcome variable was the service quality score for sick child care, which was measured as the percentage of clinically recommended tasks completed in the integrated management of childhood illness (ranging from 0 to 100). Regional factors were selected based on the High-Quality Health System Framework.

Results

The service quality score was found to be positively associated with the proportion of large facilities (β = 8.61; P = 0.004) and the proportion of providers ranked in the top fifth for service quality score (β = 30.15; P < 0.001) in the region. We identified significant cross-level interactions between provider qualifications (β = -16.6; P < 0.001) or job descriptions (β = 12.01; P = 0.002) and the proportion of providers in the top fifth for service quality scores within the region. As the proportion of top-performing providers in a region increased, the increase in the service quality score was more pronounced among providers who were nonmedical doctors or did not have job descriptions than among their counterparts.

Conclusions

Our findings indicate that the quality of care for sick children in a region improves with a greater proportion of high-performing providers or larger facilities. Providers who are not medical doctors, or those who have specific job descriptions, tend to benefit more from the presence of these top-performing providers.

Know-do gap for sick child care and drivers of knowledge and practice among health extension workers in four regions of Ethiopia: a cross-sectional study

OBJECTIVE

Though efforts were made to expand community-based sick child healthcare in Ethiopia, the quality of care provided remained low. Improving quality of care requires understanding providers' knowledge of appropriate care and their actual execution of tasks. This study examined gap between what health extension workers (HEWs) knew and did during the management of sick children in Ethiopia.

DESIGN

Facility-based cross-sectional study was conducted.

SETTING

The study was carried out in 52 districts across 4 regions in Ethiopia.

PARTICIPANTS

We interviewed 274 HEWs and performed observations of consultations done by 150 HEWs supplemented with facility assessment from December 2018 to February 2019.

OUTCOME

We compared providers' knowledge and performance in the management of childhood pneumonia and diarrhoea. Know-do gap implies the difference in proportion between knowledge and actual practice of HEWs. Logistic regression was used to identify predictors of knowledge and actual practice.

RESULTS

Providers' correct knowledge ranged from 27.8% to 76.0% for signs and symptoms of pneumonia, and 32.0% to 84% for dehydration signs. Their actual practices ranged from 15.1% to 47.3% for pneumonia and 27.0% to 42.6% for dehydration. The correct knowledge and actual practices for pneumonia and dehydration management were 88.3% vs 15.6% and 93.9% vs 51.3%, respectively. There was significant know-do gap in assessments (16.7%, p=0.002) and management of childhood conditions (68.5%, p<0.0001). Mentorships were associated with providers' knowledge of clinical management, while medicines availability was associated with their actual management practice.

CONCLUSIONS

While knowledge and actual practice for assessment and management of pneumonia and dehydration ranged from very low to high, what is more concerning is the huge know-do gap among HEWs. Our findings suggest that knowledge-based training is necessary but not sufficient for ensuring correct assessment and management of sick children by HEWs. Continuous support through mentorships and the supply of commodities are critically needed.

Selecting implementation strategies to improve implementation of integrated PrEP for pregnant and postpartum populations in Kenya: a sequential explanatory mixed methods analysis

BACKGROUND

There is a higher risk for HIV acquisition during pregnancy and postpartum. Pre-exposure prophylaxis (PrEP) is recommended during this period for those at high risk of infection; integrated delivery in maternal and child health (MCH) clinics is feasible and acceptable but requires implementation optimization.

METHODS

The PrEP in Pregnancy, Accelerating Reach and Efficiency study (PrEPARE; NCT04712994) engaged stakeholders to prioritize determinants of PrEP delivery (using Likert scores) and prioritize PrEP delivery implementation strategies. Using a sequential explanatory mixed methods design, we conducted quantitative surveys with healthcare workers at 55 facilities in Western Kenya and a stakeholder workshop (including nurses, pharmacists, counselors, and county and national policymakers), yielding visual plots of stakeholders' perceived feasibility and effectiveness of the strategies. A stepwise elimination process was used to identify seven strategies for empirical testing. Facilitator debriefing reports from the workshop were used to qualitatively assess the decision-making process.

RESULTS

Among 146 healthcare workers, the strongest reported barriers to PrEP delivery were insufficient providers and inadequate training, insufficient space, and high volume of patients. Sixteen strategies were assessed, 14 of which were included in the final analysis. Among rankings from 182 healthcare workers and 44 PrEP policymakers and implementers, seven strategies were eliminated based on low post-workshop ranking scores (bottom 50th percentile) or being perceived as low feasibility or low effectiveness for at least 50% of the workshop groups. The top seven strategies included delivering PrEP within MCH clinics instead of pharmacies, fast-tracking PrEP clients to reduce waiting time, delivering PrEP-related health talks in waiting bays, task shifting PrEP counseling, task shifting PrEP risk assessments, training different providers to deliver PrEP, and retraining providers on PrEP delivery. All top seven ranked strategies were grouped into bundles for subsequent testing. Facilitator debriefing reports generally aligned with rankings but noted how stakeholders' decision-making changed when considering the impact of strategies on facility staff and non-PrEP clients.

CONCLUSIONS

The most impactful barriers to integrated PrEP delivery in MCH clinics were insufficient staffing and space. Implementation strategies prioritized through multiple methods of stakeholder input focused on co-location of services and increasing clinic efficiency. Future testing of these stakeholder-prioritized strategy bundles will be conducted to assess the effectiveness and implementation outcomes.

Comparing in-person, blended and virtual training interventions; a real-world evaluation of HIV capacity building programs in 16 countries in sub-Saharan Africa

We sought to evaluate the impact of transitioning a multi-country HIV training program from in-person to online by comparing digital training approaches implemented during the pandemic with in-person approaches employed before COVID-19. We evaluated mean changes in pre-and post-course knowledge scores and self-reported confidence scores for learners who participated in (1) in-person workshops (between October 2019 and March 2020), (2) entirely asynchronous, Virtual Workshops [VW] (between May 2021 and January 2022), and (3) a blended Online Course [OC] (between May 2021 and January 2022) across 16 SSA countries. Learning objectives and evaluation tools were the same for all three groups. Across 16 SSA countries, 3023 participants enrolled in the in-person course, 2193 learners participated in the virtual workshop, and 527 in the online course. The proportions of women who participated in the VW and OC were greater than the proportion who participated in the in-person course (60.1% and 63.6%, p<0.001). Nursing and midwives constituted the largest learner group overall (1145 [37.9%] vs. 949 [43.3%] vs. 107 [20.5%]). Across all domains of HIV knowledge and self-perceived confidence, there was a mean increase between pre- and post-course assessments, regardless of how training was delivered. The greatest percent increase in knowledge scores was among those participating in the in-person course compared to VW or OC formats (13.6% increase vs. 6.0% and 7.6%, p<0.001). Gains in self-reported confidence were greater among learners who participated in the in-person course compared to VW or OC formats, regardless of training level (p<0.001) or professional cadre (p<0.001). In this multi-country capacity HIV training program, in-person, online synchronous, and blended synchronous/asynchronous strategies were effective means of training learners from diverse clinical settings. Online learning approaches facilitated participation from more women and more diverse cadres. However, gains in knowledge and clinical confidence were greater among those participating in in-person learning programs.

Health service quality in 2929 facilities in six low-income and middle-income countries: a positive deviance analysis

BACKGROUND

Primary care is of insufficient quality in many low-income and middle-income countries. Some health facilities perform better than others despite operating in similar contexts, although the factors that characterise best performance are not well known. Existing best-performance analyses are concentrated in high-income countries and focus on hospitals. We used the positive deviance approach to identify the factors that differentiate best from worst primary care performance among health facilities across six low-resource health systems.

METHODS

This positive deviance analysis used nationally representative samples of public and private health facilities from Service Provision Assessments of the Democratic Republic of the Congo, Haiti, Malawi, Nepal, Senegal, and Tanzania. Data were collected starting June 11, 2013, in Malawi and ending Feb 28, 2020, in Senegal. We assessed facility performance through completion of the Good Medical Practice Index (GMPI) of essential clinical actions (eg, taking a thorough history, conducting an adequate physical examination) according to clinical guidelines and measured with direct observations of care. We identified hospitals and clinics in the top decile of performance (defined as best performers) and conducted a quantitative, cross-national positive deviance analysis to compare them with facilities performing below the median (defined as worst performers) and identify facility-level factors that explain the gap between best and worst performance.

FINDINGS

We identified 132 best-performing and 664 worst-performing hospitals, and 355 best-performing and 1778 worst-performing clinics based on clinical performance across countries. The mean GMPI score was 0·81 (SD 0·07) for the best-performing hospitals and 0·44 (0·09) for the worst-performing hospitals. Among clinics, mean GMPI scores were 0·75 (0·07) for the best performers and 0·34 (0·10) for the worst performers. High-quality governance, management, and community engagement were associated with best performance compared with worst performance. Private facilities out-performed government-owned hospitals and clinics.

INTERPRETATION

Our findings suggest that best-performing health facilities are characterised by good management and leaders who can engage staff and community members. Governments should look to best performers to identify scalable practices and conditions for success that can improve primary care quality overall and decrease quality gaps between health facilities.

FUNDING

Bill & Melinda Gates Foundation.

Quality of sick child management by health extension workers: role of a complex improvement intervention

BACKGROUND

Despite the expansion of the Integrated Community Case Management services for childhood illness, quality and utilization of services have remained low. To address the problem, the Government of Ethiopia introduced a complex intervention that included community engagement, capacity building of health workers and enhanced district-level ownership of sick child management. We examined whether this complex intervention was associated with improved management of sick children by health extension workers.

METHODS

The study was conducted in four Ethiopian regions. A baseline survey was conducted in 26 intervention and 26 comparison districts from December 2016 to February 2017, followed by an end-line survey 24 months later. We observed health extension workers' consultations of sick 2-59 months old children. The analysis has evaluated if children with pneumonia, diarrhoea and malnutrition were assessed, classified and treated according to guidelines, and included difference-in-difference analyses.

RESULTS

We observed 1325 consultations of sick children. At baseline, 86% of the sick children with cough in the intervention areas and 85% in comparison areas were assessed according to the guidelines, without any change at end-line associated with the intervention (difference-in-difference = -21%, p = 0.55). Sixty-two percent of children were assessed for dehydration at baseline in intervention and 47% in comparison areas, with no improvement associated with the intervention. Similarly, 87% of sick children in intervention and 91% in comparison areas were assessed for malnutrition, with no change over time associated with the intervention (difference-in-difference = 5%, p = 0.16). Appropriate pneumonia treatment with antibiotics declined and diarrhea treatment increased in both areas. Half of the malnourished children received ready-to-use therapeutic foods without any improvement associated with the intervention.

CONCLUSION

The intervention was not associated with improved quality of the health extension workers' management of sick children. The lack of association may be linked to low fidelity in the implementation of the intervention. Our findings suggest that training healthcare providers without continued clinical mentoring and support does not improve the quality of care. Community-based programs can be strengthened by ensuring high coverage and continued clinical mentorships, supportive supervision, and supply of medicines and other essential commodities.

TRIAL REGISTRATION NUMBER

ISRCTN12040912, retrospectively registered on 19/12/ 2017.

Health care providers’ knowledge of clinical protocols for postpartum hemorrhage care in Kenya: a cross-sectional study

Background

Postpartum hemorrhage (PPH) remains the leading cause of maternal death worldwide despite its often-preventable nature. Understanding health care providers’ knowledge of clinical protocols is imperative for improving quality of care and reducing mortality. This is especially pertinent in referral and teaching hospitals that train nursing and medical students and interns in addition to managing emergency and referral cases.

Methods

This study aimed to (1) measure health care providers’ knowledge of clinical protocols for risk assessment, prevention, and management of PPH in 3 referral hospitals in Kenya and (2) examine factors associated with providers’ knowledge. We developed a knowledge assessment tool based on past studies and clinical guidelines from the World Health Organization and the Kenyan Ministry of Health. We conducted in-person surveys with health care providers in three high-volume maternity facilities in Nairobi and western Kenya from October 2018-February 2019. We measured gaps in knowledge using a summative index and examined factors associated with knowledge (such as age, gender, qualification, experience, in-service training attendance, and a self-reported measure of peer-closeness) using linear regression.

Results

We interviewed 172 providers including consultants, medical officers, clinical officers, nurse-midwives, and students. Overall, knowledge was lowest for prevention-related protocols (an average of 0.71 out of 1.00; 95% CI 0.69–0.73) and highest for assessment-related protocols (0.81; 95% CI 0.79–0.83). Average knowledge scores did not differ significantly between qualified providers and students. Finally, we found that being a qualified nurse, having a specialization, being female, having a bachelor's degree and self-reported closer relationships with colleagues were statistically significantly associated with higher knowledge scores.

Conclusion

We found gaps in knowledge of PPH care clinical protocols in Kenya. There is a clear need for innovations in clinical training to ensure that providers in teaching referral hospitals are prepared to prevent, assess, and manage PPH. It is possible that training interventions focused on learning by doing and teamwork may be beneficial.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12884-022-05128-6.

Do in-service training materials for midwifery care providers in sub-Saharan Africa meet international competency standards? A scoping review 2000-2020

BACKGROUND

Levels of maternal and neonatal mortality remain high in sub-Saharan Africa, with an estimated 66% of global maternal deaths occurring in this region. Many deaths are linked to poor quality of care, which in turn has been linked to gaps in pre-service training programmes for midwifery care providers. In-service training packages have been developed and implemented across sub-Saharan Africa in an attempt to overcome the shortfalls in pre-service training. This scoping review has aimed to summarize in-service training materials used in sub-Saharan Africa for midwifery care providers between 2000 and 2020 and mapped their content to the International Confederation of Midwives (ICM) Essential Competencies for Midwifery Practice.

METHODS

Searches were conducted for the years 2000-2020 in Cumulative Index of Nursing and Allied Health Literature, PubMed/MEDLINE, Social Science Citation Index, African Index Medicus and Google Scholar. A manual search of reference lists from identified studies and a search of grey literature from international organizations was also performed. Identified in-service training materials that were accessible freely on-line were mapped to the ICM Essential Competencies for midwifery practice.

RESULTS

The database searches identified 1884 articles after removing duplicates. After applying exclusion criteria, 87 articles were identified for data extraction. During data extraction, a further 66 articles were excluded, leaving 21 articles to be included in the review. From these 21 articles, six different training materials were identified. The grey literature yielded 35 training materials, bringing the total number of in-service training materials that were reviewed to 41. Identified in-service training materials mainly focused on emergency obstetric care in a limited number of sub-Saharan Africa countries. Results also indicate that a significant number of in-service training materials are not readily and/or freely accessible. However, the content of in-service training materials largely met the ICM Essential Competencies, with gaps noted in the aspect of woman-centred care and shared decision making.

CONCLUSION

To reduce maternal and newborn morbidity and mortality midwifery care providers should have access to evidence-based in-service training materials that include antenatal care and routine intrapartum care, and places women at the centre of their care as shared decision makers.

The effect of national antenatal care guidelines and provider training on obstetric danger sign counselling: a propensity score matching analysis of the 2014 Ethiopia service provision assessment plus survey

Background

Most pregnant women in low and lower-middle-income countries do not receive all components of antenatal care (ANC), including counselling on obstetric danger signs. Facility-level ANC guidelines and provider in-service training are major factors influencing ANC counselling. In Ethiopia, little is known about the extent to which guidelines and provider in-service training can increase the quality of ANC counselling.

Methods

We examined the effect of national ANC guidelines and ANC provider in-service training on obstetric danger sign counselling for pregnant women receiving ANC using the 2014 Ethiopian service provision assessment plus (ESPA +) survey data. We created two analysis samples by applying a propensity score matching method. The first sample consisted of women who received ANC at health facilities with guidelines matched with those who received ANC at health facilities without guidelines. The second sample consisted of women who received ANC from the providers who had undertaken in-service training in the last 24 months matched with women who received ANC from untrained providers. The outcome variable was the number of obstetric danger signs described during ANC counselling, ranging from zero to eight. The covariates included women’s socio-demographic characteristics, obstetric history, health facility characteristics, and ANC provider characteristics.

Results

We found that counselling women about obstetric danger signs during their ANC session varied according to the availability of ANC guidelines (61% to 70%) and provider training (62% to 68%). After matching the study participants by the measured covariates, the availability of ANC guidelines at the facility level significantly increased the average number of obstetric danger signs women received during counselling by 24% (95% CI: 12–35%). Similarly, providing refresher training for ANC providers increased the average number of obstetric danger signs described during counselling by 37% (95% CI: 26–48%).

Conclusion

The findings suggest that the quality of ANC counselling in Ethiopia needs strengthening by ensuring that ANC guidelines are available at every health facility and that the providers receive regular ANC related in-service training.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12978-022-01442-6.

Maternal death from preventable pregnancy-related complications remains a global health challenge. In 2017, there were 295,000 maternal deaths worldwide, and about two-thirds of these deaths were from Sub-Saharan Africa. Ethiopia is a Sub-Saharan African country with 401 maternal deaths per 100,000 live births in 2017, and this rate is higher than the target indicated in sustainable development goals. Most maternal deaths are due to obstetric complications and could have been averted through early detection and treatment. Providing antenatal care counselling about obstetric danger signs enhances women’s awareness of obstetric complications and encourages women to seek treatment from a skilled care provider. However, most women from low-income settings, including Ethiopia, do not receive counselling about obstetric danger signs. Facility-level antenatal care guidelines and provider in-service training improve antenatal care counselling. In Ethiopia, little is known to what extent antenatal care guidelines and provider training increase counselling on obstetric danger signs. The present study used the 2014 Ethiopian service provision assessment data and estimated the effect of antenatal care guidelines and provider training on counselling about obstetric danger signs. The analysis involved a propensity score matching method and included 1725 pregnant women. The study found that antenatal care guidelines at health facilities and antenatal care provider in-service training significantly increase counselling on obstetric danger signs by 24% and 37%, respectively. The finding suggests improving the quality of antenatal care counselling in Ethiopia needs antenatal care guidelines at each antenatal care clinic and refresher training for the providers.

Improving health and social systems for all children in LMICs: structural innovations to deliver high-quality services

Despite health gains over the past 30 years, children and adolescents are not reaching their health potential in many low-income and middle-income countries (LMICs). In addition to health systems, social systems, such as schools, communities, families, and digital platforms, can be used to promote health. We did a targeted literature review of how well health and social systems are meeting the needs of children in LMICs using the framework of The Lancet Global Health Commission on high-quality health systems and we reviewed evidence for structural reforms in health and social sectors. We found that quality of services for children is substandard across both health and social systems. Health systems have deficits in care competence (eg, diagnosis and management), system competence (eg, timeliness, continuity, and referral), user experience (eg, respect and usability), service provision for common and serious conditions (eg, cancer, trauma, and mental health), and service offerings for adolescents. Education and social services for child health are limited by low funding and poor coordination with other sectors. Structural reforms are more likely to improve service quality substantially and at scale than are micro-level efforts. Promising approaches include governing for quality (eg, leadership, expert management, and learning systems), redesigning service delivery to maximise outcomes, and empowering families to better care for children and to demand quality care from health and social systems. Additional research is needed on health needs across the life course, health system performance for children and families, and large-scale evaluation of promising health and social programmes.

Financially incentivized knowledge assessments to improve provider compliance with treatment guidelines: a cluster-randomized controlled trial

Background

Despite increasing access to health care, under-5 mortality remains high in many parts of Sub-Saharan Africa. Interventions to improve quality of care have mostly focused on additional training for medical staff, but generally shown little impact. We will assess the impact of financially incentivized quarterly provider knowledge assessment on compliance with Integrated Management of Childhood Illness (IMCI) protocols in Congo, DRC.

Methods

Out of a total of 1738 facilities currently receiving results-based financing under an ongoing health financing program, 110 facilities were chosen for this study. All health care workers providing outpatient services to children under age 5 in these facilities will be included in the study. Facilities were randomized with equal probability to control and treatment. Treatment facilities will receive quarterly medical staff knowledge assessments using interactive vignettes. Performance on these vignettes will be rewarded through financial bonus payments to facilities. A baseline survey of health worker knowledge was conducted in 2018. An endline assessment is scheduled to start in the second half of 2021. The primary outcome of interest is health worker compliance with Integrated Management of Childhood Illness (IMCI) guidelines. Compliance will be verified through direct observation of medical staff-patient interactions.

Discussion

This is to our knowledge the first trial assessing whether linking health financing to health care worker performance on knowledge assessments can increase compliance with under-5 case management protocols.

Trial registration

ClinicalTrials.gov NCT04634019. Registered on November 18, 2020.

Factors influencing health workers' compliance with outpatient malaria 'test and treat' guidelines during the plateauing performance phase in Kenya, 2014-2016

Background

Health workers’ compliance with outpatient malaria ‘test and treat’ guidelines has improved since 2010 but plateaued from 2014 at suboptimal levels in Kenya. This study examined the factors associated with high but suboptimal compliance levels at facilities with available malaria tests and drugs.

Methods

Data from four national, cross-sectional health facility surveys undertaken between 2014 and 2016 in Kenya were analysed. Association between 31 factors and compliance with malaria testing (survey range (SR): 65–69%) and no anti-malarial treatment for test negative patients (SR: 90–92%) were examined using multilevel logistic regression models.

Results

A total of 2,752 febrile patients seen by 594 health workers at 486 health facilities were analysed. Higher odds of malaria testing were associated with lake endemic (aOR = 12.12; 95% CI: 5.3–27.6), highland epidemic (aOR = 5.06; 95% CI: 2.7–9.5) and semi-arid seasonal (aOR = 2.07; 95% CI: 1.2–3.6) compared to low risk areas; faith-based (FBO)/ non-governmental organization (NGO)-owned compared to government-owned facilities (aOR = 5.80; 95% CI: 3.2–10.6); health workers’ perception of malaria endemicity as high-risk (aOR = 3.05; 95% CI: 1.8–5.2); supervision with feedback (aOR = 1.84; 95% CI: 1.2–2.9); access to guidelines (aOR = 1.96; 95% CI: 1.1–3.4); older patients compared to infants, higher temperature measurements and main complaints of fever, diarrhoea, headache, vomiting and chills. Lower odds of testing were associated with febrile patients having main complaints of a cough (aOR = 0.65; 95% CI: 0.5–0.9), a rash (aOR = 0.32; 95% CI: 0.2–0.7) or a running nose (aOR = 0.59; 95% CI: 0.4–0.9). Other factors associated with compliance with test negative results included the type of diagnostic test available at the facility, in-service training, health workers’ age, and correct knowledge of the targeted treatment policy.

Conclusions

To optimize outpatient malaria case-management, reduce testing compliance gaps and eliminate overtreatment of test negative patients, there is a need to focus on compliance within low malaria risk areas in addition to ensuring the universal and continuous availability of ‘test and treat’ commodities. Targeting of older and government health workers; dissemination of updated guidelines; and continuing with in-service training and supportive supervision with feedback is essential. Lastly, there is a need to improve health workers’ knowledge about malaria testing criteria considering their perceptions of endemicity.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12936-022-04093-x.

Three Pivots for Improving Health Care Provider Performance

We share recommendations on 3 important pivots away from longstanding approaches to continued professional development and in-service training programs that have demonstrated a measurable benefit across a diversity of health-related applications and projects.

How does the effectiveness of strategies to improve healthcare provider practices in low-income and middle-income countries change after implementation? Secondary analysis of a systematic review

BACKGROUND

A recent systematic review evaluated the effectiveness of strategies to improve healthcare provider (HCP) performance in low-income and middle-income countries. The review identified strategies with varying effects, including in-service training, supervision and group problem-solving. However, whether their effectiveness changed over time remained unclear. In particular, understanding whether effects decay over time is crucial to improve sustainability.

METHODS

We conducted a secondary analysis of data from the aforementioned review to explore associations between time and effectiveness. We calculated effect sizes (defined as percentage-point (%-point) changes) for HCP practice outcomes (eg, percentage of patients correctly treated) at each follow-up time point after the strategy was implemented. We estimated the association between time and effectiveness using random-intercept linear regression models with time-specific effect sizes clustered within studies and adjusted for baseline performance.

RESULTS

The primary analysis included 37 studies, and a sensitivity analysis included 77 additional studies. For training, every additional month of follow-up was associated with a 0.19 %-point decrease in effectiveness (95% CI: -0.36 to -0.03). For training combined with supervision, every additional month was associated with a 0.40 %-point decrease in effectiveness (95% CI: -0.68 to -0.12). Time trend results for supervision were inconclusive. For group problem-solving alone, time was positively associated with effectiveness, with a 0.50 %-point increase in effect per month (95% CI: 0.37 to 0.64). Group problem-solving combined with training was associated with large improvements, and its effect was not associated with time.

CONCLUSIONS

Time trends in the effectiveness of different strategies to improve HCP practices vary among strategies. Programmes relying solely on in-service training might need periodical refresher training or, better still, consider combining training with group problem-solving. Although more high-quality research is needed, these results, which are important for decision-makers as they choose which strategies to use, underscore the utility of studies with multiple post-implementation measurements so sustainability of the impact on HCP practices can be assessed.

The effect of training and supervision on primary health care workers' competence to deliver maternal depression inclusive health education in Ibadan, Nigeria: a quasi-experimental study

Background

Health workers lack the competence to address maternal depression in the routine health education in Nigeria. Hence, awareness among maternal-child health clients is low. We assessed the effect of training and supervision on knowledge, skills, and self-efficacy of primary healthcare workers in delivering health talks and the clients’ knowledge on maternal depression.

Methods

A quasi-experimental study design was adopted. Five Local Government Area (LGAs) in the Ibadan metropolis were grouped according to geographical proximity and randomly assigned to experimental (Group A = two LGAs) and control (Group B = three LGAs) with 12 primary health centres in each group. All primary health care workers recruited in group A received a one-day training on maternal depression. Good Knowledge Gain (GKG), Good Skill Gain (GSG) and Self-Efficacy (SEG) were assessed in both groups. 1-week post-training, the knowledge of all the PHCs’ attendees in the two groups was assessed. Two weeks post- training, a half of experimental group’s PHCs received supportive supervision and a clinic-based health education delivery skill assessment was conducted. The knowledge of clients and their health seeking were also assessed. Fisher’s exact test, independent t test and Poisson regression were used to analyze differences in percentages and mean/ factors associated with GKG, GSG and SE, using SPSS 25.

Results

Training improved gains in the experimental versus controls as follows: GKG (84.3% vs. 15.7%), GSG (90.7% vs 9.3%) and SEG (100% vs 0%). Training contributed to the good gain in knowledge (RR = 6.03; 95%CI =2.44–16.46; p < 0.01); skill (RR = 1.88; CI = 1.53–2.33; p < 0.01).) and self-efficacy (RR = 2.74; CI = 2.07–2.73; p < 0.01). Clients in the experimental group had higher knowledge gain score than in the control (7.10 ± 2.4 versus − 0.45 ± 2.37); p < 0.01). The rater supervisor observed better motivation in the supervised group than the not supervised. Forty clients sought help in the intervention group while none in the control group. Thirty-five clients sought help in the supervised group while only five did in the not supervised.

Conclusions

Training followed by supervision improved the competence of health workers to transfer knowledge to clients. This intervention is recommended for primary healthcare settings to improve uptake of maternal mental health services.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-07208-3.

Disrupted Service Delivery? The Impact of Conflict on Antenatal Care Quality in Kenya

Introduction: African countries facing conflict have higher levels of maternal mortality. Understanding the gaps in the utilization of high-quality maternal health care is essential to improving maternal survival in these states. Few studies have estimated the impact of conflict on the quality of health care. In this study, we estimated the impact of conflict on the quality of health care in Kenya, a country with multiple overlapping conflicts and significant disparities in maternal survival.

Materials and Methods: We drew on data on the observed quality of 553 antenatal care (ANC) visits between January and April 2010. Process quality was measured as the percentage of elements of client–provider interactions performed in these visits. For structural quality, we measured the percentage of required components of equipment and infrastructure and the management and supervision in the facility on the day of the visit. We spatially linked the analytical sample to conflict events from January to April 2010. We modeled the quality of ANC as a function of exposure to conflict using spatial difference-in-difference models.

Results: ANC visits that occurred in facilities within 10,000 m of any conflict event in a high-conflict month received 18–21 percentage points fewer components of process quality on average and had a mean management and supervision score that was 12.8–13.5 percentage points higher. There was no significant difference in the mean equipment and infrastructure score at the 5% level. The positive impact of conflict exposure on the quality of management and supervision was driven by rural facilities. The quality of management and supervision and equipment and infrastructure did not modify the impact of conflict on process quality.

Discussion: Our study demonstrates the importance of designing maternal health policy based on the context-specific evidence on the mechanisms through which conflict affects health care. In Kenya, deterioration of equipment and infrastructure does not appear to be the main mechanism through which conflict has affected ANC quality. Further research should focus on better understanding the determinants of the gaps in process quality in conflict-affected settings, including provider motivation, competence, and incentives.

Determinants of improvement trends in health workers' compliance with outpatient malaria case-management guidelines at health facilities with available "test and treat" commodities in Kenya

BACKGROUND

Health workers' compliance with outpatient malaria case-management guidelines has been improving in Africa. This study examined the factors associated with the improvements.

METHODS

Data from 11 national, cross-sectional health facility surveys undertaken from 2010-2016 were analysed. Association between 31 determinants and improvement trends in five outpatient compliance outcomes were examined using interactions between each determinant and time in multilevel logistic regression models and reported as an adjusted odds ratio of annual trends (T-aOR).

RESULTS

Among 9,173 febrile patients seen at 1,208 health facilities and by 1,538 health workers, a higher annual improvement trend in composite "test and treat" performance was associated with malaria endemicity-lake endemic (T-aOR = 1.67 annually; p<0.001) and highland epidemic (T-aOR = 1.35; p<0.001) zones compared to low-risk zone; with facilities stocking rapid diagnostic tests only (T-aOR = 1.49; p<0.001) compared to microscopy only services; with faith-based/non-governmental facilities compared to government-owned (T-aOR = 1.15; p = 0.036); with a daily caseload of >25 febrile patients (T-aOR = 1.46; p = 0.003); and with under-five children compared to older patients (T-aOR = 1.07; p = 0.013). Other factors associated with the improvement trends in the "test and treat" policy components and artemether-lumefantrine administration at the facility included the absence of previous RDT stock-outs, community health workers dispensing drugs, access to malaria case-management and Integrated Management of Childhood Illness (IMCI) guidelines, health workers' gender, correct health workers' knowledge about the targeted malaria treatment policy, and patients' main complaint of fever. The odds of compliance at the baseline were variable for some of the factors.

CONCLUSIONS

Targeting of low malaria risk areas, low caseload facilities, male and government health workers, continuous availability of RDTs, improving health workers' knowledge about the policy considering age and fever, and dissemination of guidelines might improve compliance with malaria guidelines. For prompt treatment and administration of the first artemether-lumefantrine dose at the facility, task-shifting duties to community health workers can be considered.

Healthworker preparedness for COVID-19 management and implementation experiences: a mixed methods study in Uganda's refugee-hosting districts

Background

The negative impact of COVID-19 on population health outcomes raises critical questions on health system preparedness and resilience, especially in resource-limited settings. This study examined healthworker preparedness for COVID-19 management and implementation experiences in Uganda’s refugee-hosting districts.

Methods

A cross sectional, mixed-method descriptive study in 17 health facilities in 7 districts from 4 major regions. Total sample size was 485 including > 370 health care workers (HCWs). HCW knowledge, attitude and practices (KAP) was assessed by using a pre-validated questionnaire. The quantitative data was processed and analysed using SPSS 26, and statistical significance assumed at p < 0.05 for all statistical tests. Bloom's cutoff of 80% was used to determine threshold for sufficient knowledge level and practices with scores classified as high (80.0–100.0%), average (60.0–79.0%) and low (≤ 59.0%). HCW implementation experiences and key stakeholder opinions were further explored qualitatively using interviews which were audio-recorded, coded and thematically analysed.

Results

On average 71% of HCWs were knowledgeable on the various aspects of COVID-19, although there is a wide variation in knowledge. Awareness of symptoms ranked highest among 95% (p value < 0.0001) of HCWs while awareness of the criteria for intubation for COVID-19 patients ranked lowest with only 35% (p value < 0.0001). Variations were noted on falsehoods about COVID-19 causes, prevention and treatment across Central (p value < 0.0356) and West Nile (p value < 0.0161) regions. Protective practices include adequate ventilation, virtual meetings and HCW training. Deficient practices were around psychosocial and lifestyle support, remote working and contingency plans for HCW safety. The work environment has immensely changed with increased demands on the amount of work, skills and variation in nature of work. HCWs reported moderate control over their work environment but with a high level of support from supervisors (88%) and colleagues (93%).

Conclusions

HCWs preparedness is inadequate in some aspects. Implementation of healthcare interventions is constrained by the complexity of Uganda’s health system design, top-down approach of the national response to COVID-19 and longstanding health system bottlenecks. We recommend continuous information sharing on COVID-19, a design review with capacity strengthening at all health facility levels and investing in community-facing strategies.

It’s Time to Move Beyond Traditional Health Care Worker Training Approaches

Isn't it time that the global community move beyond traditional training and supportive supervision models to improve health care worker capacity?

A multimodal mentorship intervention to improve surgical quality in Tanzania's Lake Zone: a convergent, mixed methods assessment

BACKGROUND

Safe, high-quality surgical care in many African countries is a critical need. Challenges include availability of surgical providers, improving quality of care, and building workforce capacity. Despite growing evidence that mentoring is effective in African healthcare settings, less is known about its role in surgery. We examined a multimodal approach to mentorship as part of a safe surgery intervention (Safe Surgery 2020) to improve surgical quality. Our goal was to distill lessons for policy makers, intervention designers, and practitioners on key elements of a successful surgical mentorship program.

METHODS

We used a convergent, mixed-methods design to examine the experiences of mentees, mentors, and facility leaders with mentorship at 10 health facilities in Tanzania's Lake Zone. A multidisciplinary team of mentors worked with surgical providers over 17 months using in-person mentorship, telementoring, and WhatsApp. We conducted surveys, in-depth interviews, and focus groups to capture data in four categories: (1) satisfaction with mentorship; (2) perceived impact; (3) elements of a successful mentoring program; and (4) challenges to implementing mentorship. We analyzed quantitative data using frequency analysis and qualitative data using the constant comparison method. Recurrent and unifying concepts were identified through merging the qualitative and quantitative data.

RESULTS

Overall, 96% of mentees experienced the intervention as positive, 88% were satisfied, and 100% supported continuing the intervention in the future. Mentees, mentors, and facility leaders perceived improvements in surgical practice, the surgical ecosystem, and in reducing postsurgical infections. Several themes related to the intervention's success emerged: (1) the intervention's design, including its multimodality, side-by-side mentorship, and standardization of practices; (2) the mentee-mentor relationship, including a friendly, safe, non-hierarchical, team relationship, as well as mentors' understanding of the local context; and (3) mentorship characteristics, including non-judgmental feedback, experience, and accessibility. Challenges included resistance to change, shortage of providers, mentorship dose, and logistics.

CONCLUSIONS

Our study suggests a multimodal mentorship approach is promising in building the capacity of surgical providers. By distilling the experiences of the mentees, mentors, and facility leaders, our lessons provide a foundation for future efforts to establish effective surgical mentorship programs that build provider capacity and ultimately improve surgical quality.

Effect of health systems context on infant and child mortality in sub-Saharan Africa from 1995 to 2015, a longitudinal cohort analysis

Each year, > 3 million children die in sub-Saharan Africa before their fifth birthday. Most deaths are preventable or avoidable through interventions delivered in the primary healthcare system. However, evidence regarding the impact of health system characteristics on child survival is sparse. We assembled a retrospective cohort of > 250,000 children in seven countries in sub-Saharan Africa. We described their health service context at the subnational level using standardized surveys and employed parametric survival models to estimate the effect of three major domains of health services—quality, access, and cost—on infant and child survival, after adjusting for child, maternal, and household characteristics. Between 1995 and 2015 we observed 13,629 deaths in infants and 5149 in children. In fully-adjusted models, the largest effect sizes were related to fees for services. Immunization fees were correlated with poor child survival (HR = 1.20, 95% CI 1.12–1.28) while delivery fees were correlated with poor infant survival (HR = 1.11, 95% CI 1.01–1.21). Accessibility of facilities and greater concentrations of private facilities were associated with improved infant and child survival. The proportion of facilities with a doctor was correlated with increased risk of death in children and infants. We quantify the impact of health service environment on survival up to five years of age. Reducing health care costs and improving the accessibility of health facilities should remain a priority for improving infant and child survival. In the absence of these fundamental investments, more specialized interventions may not achieve their desired impact.

Facilitators and barriers to effective supervision of maternal and newborn care: a qualitative study from Shinyanga region, Tanzania

Background: Despite routine supportive supervision of health service delivery, maternal and newborn outcomes have remained poor in sub-Saharan Africa in general and in Tanzania in particular. There is limited research evidence on factors limiting the effectiveness of supportive supervision in improving the quality of maternal and newborn care.

Objective: This study explored enablers of and barriers to supportive supervision in maternal and newborn care at the district and hospital levels in Shinyanga region in Tanzania.

Methods: This study employed a qualitative case study design. A purposeful sampling approach was employed to recruit a stratified sample of health system actors: members of the council health management team (CHMT), members of health facility management teams (HMTs), heads of units in the maternity department and health workers.

Results: This study identified several barriers to the effectiveness of supportive supervision. First, the lack of a clear policy on supportive supervision. Despite the general acknowledgement of supportive supervision as a managerial mechanism for quality improvement at the district and lower-level health facilities, there is no clear policy guiding it. Second, limitations in measurement of progress in quality improvement; although supportive supervision is routinely conducted to improve maternal and newborn outcomes, efforts to measure progress are limited due to shortfalls in the setting of goals and targets, as well as gaps in M&E. Third, resource constraints and low motivation; that is, the shortage of resources – CHMT supervisors, health staff and funds – results in irregular supervision and low motivation.

Conclusion: Besides resource constraints, lack of clear policies and limitations related to progress measurement impair the effectiveness of supportive supervision in improving maternal and newborn outcomes. There is a need to reform supportive supervision so that it aids and measures progress not only at the district but also at the health facility level.

Quality of clinical assessment and child mortality: a three-country cross-sectional study

This analysis describes specific gaps in the quality of health care in Central Africa and assesses the association between quality of clinical care and mortality at age 2-59 months. Regionally representative facility and household surveys for the Democratic Republic of the Congo, Cameroon and Central African Republic were collected between 2012 and 2016. These data are novel in linking facilities with households in their catchment area. Compliance with diagnostic and danger sign protocols during sick-child visits was observed by trained assessors. We computed facility- and district-level compliance indicators for patients aged 2-59 months and used multivariate multi-level logistic regression models to estimate the association between clinical assessment quality and mortality at age 2-59 months in the catchment areas of the observed facilities. A total of 13 618 live births were analysed and 1818 sick-child visits were directly observed and used to rate 643 facilities. Eight percent of observed visits complied with 80% of basic diagnostic protocols, and 13% of visits fully adhered to select general danger sign protocols. A 10% greater compliance with diagnostic protocols was associated with a 14.1% (adjusted odds ratio (aOR) 95% CI: 0.025-0.244) reduction in the odds of mortality at age 2-59 months; a 10% greater compliance with select general danger sign protocols was associated with a 15.3% (aOR 95% CI: 0.058-0.237) reduction in the same odds. The results of this article suggest that compliance with recommended clinical protocols remains poor in many settings and improvements in mortality at age 2-59 months could be possible if compliance were improved.

Learning from changes concurrent with implementing a complex and dynamic intervention to improve urban maternal and perinatal health in Dar es Salaam, Tanzania, 2011-2019

Introduction

Rapid urbanisation in Dar es Salaam, the main commercial hub in Tanzania, has resulted in congested health facilities, poor quality care, and unacceptably high facility-based maternal and perinatal mortality. Using a participatory approach, the Dar es Salaam regional government in partnership with a non-governmental organisation, Comprehensive Community Based Rehabilitation in Tanzania, implemented a complex, dynamic intervention to improve the quality of care and survival during pregnancy and childbirth. The intervention was rolled out in 22 public health facilities, accounting for 60% of the city’s facility births.

Methods

Multiple intervention components addressed gaps across the maternal and perinatal continuum of care (training, infrastructure, routine data quality strengthening and utilisation). Quality of care was measured with the Standards-Based Management and Recognition tool. Temporal trends from 2011 to 2019 in routinely collected, high-quality data on facility utilisation and facility-based maternal and perinatal mortality were analysed.

Results

Significant improvements were observed in the 22 health facilities: 41% decongestion in the three most overcrowded hospitals and comparable increase in use of lower level facilities, sixfold increase in quality of care, and overall reductions in facility-based maternal mortality ratio (47%) and stillbirth rate (19%).

Conclusions

This collaborative, multipartner, multilevel real-world implementation, led by the local government, leveraged structures in place to strengthen the urban health system and was sustained through a decade. As depicted in the theory of change, it is highly plausible that this complex intervention with the mediators and confounders contributed to improved distribution of workload, quality of maternity care and survival at birth.

How can human resources for health interventions contribute to sexual, reproductive, maternal, and newborn healthcare quality across the continuum in low- and lower-middle-income countries? A systematic review

BACKGROUND

Well-trained, competent, and motivated human resources for health (HRH) are crucial to delivering quality service provision across the sexual, reproductive, maternal, and newborn health (SRMNH) care continuum to achieve the 2030 Sustainable Development Goals (SDGs) maternal and neonatal health targets. This review aimed to identify HRH interventions to support lay and/or skilled personnel to improve SRMNH care quality along the continuum in low- and lower-middle-income countries (LLMICs).

METHODS

A structured search of CINAHL, Cochrane Library/trials, EMBASE, PubMed, SCOPUS, Web of Science, and HRH Global Resource Centre databases was undertaken, guided by the PRISMA framework. The inclusion criteria sought to identify papers with a focus on 1. HRH management, leadership, partnership, finance, education, and/or policy interventions; 2. HRH interventions' impact on two or more quality SRMNH care packages across the continuum from preconception to pregnancy, intrapartum and postnatal care; 3. Skilled and/or lay personnel; and 4. Reported primary research in English from LLMICs. A deductive qualitative content analysis was employed using the World Health Organization-HRH action framework.

RESULTS

Out of identified 2157 studies, 24 intervention studies were included in the review. Studies where ≥ 4 HRH interventions had been combined to target various healthcare system components, were more effective than those implementing ≤ 3 HRH interventions. In primary care, HRH interventions involving skilled and lay personnel were more productive than those involving either skilled or lay personnel alone. Results-based financing (RBF) and its policy improved the quality of targeted maternity services but had no impact on client satisfaction. Local budgeting, administration, and policy to deliver financial incentives to health workers and improve operational activities were more efficacious than donor-driven initiatives. Community-based recruitment, training, deployment, empowerment, supportive supervision, access to m-Health technology, and modest financial and non-financial incentives for community health workers (CHWs) improved the quality of care continuum. Skills-based, regular, short, focused, onsite, and clinical simulation, and/or mobile phone-assisted in-service training of skilled personnel were more productive than knowledge-based, irregular, and donor-funded training. Facility-based maternal and perinatal death reviews, coupled with training and certification of skilled personnel, positively affected SRMNH care quality across the continuum. Preconception care, an essential component of the SRMNH care continuum, lacks studies and services in LLMICs.

CONCLUSIONS

We recommend maternal and perinatal death audits in all health facilities; respectful, woman-centered care as a critical criterion of RBF initiatives; local administration of health worker allowances and incentives; and integration of CHWs into the healthcare system. There is an urgent need to include preconception care in the SRMNH care continuum and studies in LLMICs.

Association between a complex community intervention and quality of health extension workers' performance to correctly classify common childhood illnesses in four regions of Ethiopia

Background

Due to low care utilization, a complex intervention was done for two years to optimize the Ethiopian Health Extension Program. Improved quality of the integrated community case management services was an intermediate outcome of this intervention through community education and mobilization, capacity building of health workers, and strengthening of district ownership and accountability of sick child services. We evaluated the association between the intervention and the health extension workers’ ability to correctly classify common childhood illnesses in four regions of Ethiopia.

Methods

Baseline and endline assessments were done in 2016 and 2018 in intervention and comparison areas in four regions of Ethiopia. Ill children aged 2 to 59 months were mobilized to visit health posts for an assessment that was followed by re-examination. We analyzed sensitivity, specificity, and difference-in-difference of correct classification with multilevel mixed logistic regression in intervention and comparison areas at baseline and endline.

Results

Health extensions workers’ consultations with ill children were observed in intervention (n = 710) and comparison areas (n = 615). At baseline, re-examination of the children showed that in intervention areas, health extension workers’ sensitivity for fever or malaria was 54%, 68% for respiratory infections, 90% for diarrheal diseases, and 34% for malnutrition. At endline, it was 40% for fever or malaria, 49% for respiratory infections, 85% for diarrheal diseases, and 48% for malnutrition. Specificity was higher (89–100%) for all childhood illnesses. Difference-in-differences was 6% for correct classification of fever or malaria [aOR = 1.45 95% CI: 0.81–2.60], 4% for respiratory tract infection [aOR = 1.49 95% CI: 0.81–2.74], and 5% for diarrheal diseases [aOR = 1.74 95% CI: 0.77–3.92].

Conclusion

This study revealed that the Optimization of Health Extension Program intervention, which included training, supportive supervision, and performance reviews of health extension workers, was not associated with an improved classification of childhood illnesses by these Ethiopian primary health care workers.

Trial registration

ISRCTN12040912, http://www.isrctn.com/ISRCTN12040912.

Using Helping Mothers Survive to Improve Intrapartum Care

Data from the past decade have revealed that neonatal mortality represents a growing burden of the under-5 mortality rate. To further reduce these deaths, the focus must expand to include building capacity of the workforce to provide high-quality obstetric and intrapartum care. Obstetric complications, such as hypertensive disorders and obstructed labor, are significant contributors to neonatal morbidity and mortality. A well-prepared workforce with the necessary knowledge, skills, attitudes, and motivation is required to rapidly detect and manage these complications to save both maternal and newborn lives. Traditional off-site, didactic, and lengthy training approaches have not always yielded the desired results. Helping Mothers Survive training was modeled after Helping Babies Breathe and incorporates further evidence-based methodology to deliver training on-site to the entire team of providers, who continue to practice after training with their peers. Research has revealed that significant gains in health outcomes can be reached by using this approach. In the coronavirus disease 2019 era, we must look to translate the best practices of these training programs into a flexible and sustainable model that can be delivered remotely to maintain quality services to women and their newborns.

Quality of clinical assessment and management of sick children by Health Extension Workers in four regions of Ethiopia: A cross-sectional survey

BACKGROUND

Care-seeking for sick children at the Ethiopian primary health care level is low. This problem may partly be due to unfavorable community perceptions of the quality of care provided. There is, however, limited knowledge on the quality of the clinical assessment and management provided by the health extension workers at the health posts. This study aimed to examine the quality of clinical assessment, classification and management provided to sick under-five children by health extension workers in four regions of Ethiopia.

METHODS

Clinical observations of 620 consultations of sick children by health extension workers were conducted from December 2016 to February 2017. A clinical pathway analysis was performed to analyze whether sick children were appropriately assessed, classified and managed according to the integrated Community Case Management guidelines.

RESULTS

Most sick children presented with complaints of cough (58%), diarrhea (36%), and fever (26%).Three quarters of children with respiratory complaints had their respiratory rate counted (74%, 95% CI 69-78), while a third (33%, 95% CI 27-40) of children with diarrhea were assessed for dehydration. Half (53%, 95% CI 49-57) of the sick children were assessed for general danger signs, while a majority (89%, 95% CI 86-92) had their arm circumference measured for malnutrition. Half of the sick children received some treatment and less than one-fifth were referred according to the integrated Community Case management guidelines. Comprehensive counseling was provided to 38% (95% CI 35-42) of the caregivers.

CONCLUSION

The Ethiopian health extension workers' clinical assessment, classification and management of sick children did to a large extent not follow the clinical guidelines. This lack of adherence could lead to misdiagnoses and lack of potentially life-saving treatments.

Quality of clinical management of children diagnosed with malaria: A cross-sectional assessment in 9 sub-Saharan African countries between 2007-2018

BACKGROUND

Appropriate clinical management of malaria in children is critical for preventing progression to severe disease and for reducing the continued high burden of malaria mortality. This study aimed to assess the quality of care provided to children under 5 diagnosed with malaria across 9 sub-Saharan African countries.

METHODS AND FINDINGS

We used data from the Service Provision Assessment (SPA) survey. SPAs are nationally representative facility surveys capturing quality of sick-child care, facility readiness, and provider and patient characteristics. The data set contained 24,756 direct clinical observations of outpatient sick-child visits across 9 countries, including Uganda (2007), Rwanda (2007), Namibia (2009), Kenya (2010), Malawi (2013), Senegal (2013-2017), Ethiopia (2014), Tanzania (2015), and Democratic Republic of the Congo (2018). We assessed the proportion of children with a malaria diagnosis who received a blood test diagnosis and an appropriate antimalarial. We used multilevel logistic regression to assess facility and provider and patient characteristics associated with these outcomes. Subgroup analyses with the 2013-2018 country surveys only were conducted for all outcomes. Children observed were on average 20.5 months old and were most commonly diagnosed with respiratory infection (47.7%), malaria (29.7%), and/or gastrointestinal infection (19.7%). Among the 7,340 children with a malaria diagnosis, 32.5% (95% CI: 30.3%-34.7%) received both a blood-test-based diagnosis and an appropriate antimalarial. The proportion of children with a blood test diagnosis and an appropriate antimalarial ranged from 3.4% to 57.1% across countries. In the more recent surveys (2013-2018), 40.7% (95% CI: 37.7%-43.6%) of children with a malaria diagnosis received both a blood test diagnosis and appropriate antimalarial. Roughly 20% of children diagnosed with malaria received no antimalarial at all, and nearly 10% received oral artemisinin monotherapy, which is not recommended because of concerns regarding parasite resistance. Receipt of a blood test diagnosis and appropriate antimalarial was positively correlated with being seen at a facility with diagnostic equipment in stock (adjusted OR 3.67; 95% CI: 2.72-4.95) and, in the 2013-2018 subsample, with being seen at a facility with Artemisinin Combination Therapies (ACTs) in stock (adjusted OR 1.60; 95% CI:1.04-2.46). However, even if all children diagnosed with malaria were seen by a trained provider at a facility with diagnostics and medicines in stock, only a predicted 37.2% (95% CI: 34.2%-40.1%) would have received a blood test and appropriate antimalarial (44.4% for the 2013-2018 subsample). Study limitations include the lack of confirmed malaria test results for most survey years, the inability to distinguish between a diagnosis of uncomplicated or severe malaria, the absence of other relevant indicators of quality of care including dosing and examinations, and that only 9 countries were studied.

CONCLUSIONS

In this study, we found that a majority of children diagnosed with malaria across the 9 surveyed sub-Saharan African countries did not receive recommended care. Clinical management is positively correlated with the stocking of essential commodities and is somewhat improved in more recent years, but important quality gaps remain in the countries studied. Continued reductions in malaria mortality will require a bigger push toward quality improvements in clinical care.

Simulation-based low-dose, high-frequency plus mobile mentoring versus traditional group-based trainings among health workers on day of birth care in Nigeria; a cluster randomized controlled trial

Background

The aim of this study was to compare health workers knowledge and skills competencies between those trained using the onsite simulation-based, low-dose, high frequency training plus mobile mentoring (LDHF/m-mentoring) and the ones trained through traditional offsite, group-based training (TRAD) approach in Kogi and Ebonyi states, Nigeria, over a 12-month period.

Methods

A prospective cluster randomized controlled trial was conducted by enrolling 299 health workers who provided healthcare to mothers and their babies on the day of birth in 60 health facilities in Kogi and Ebonyi states. These were randomized to either LDHF/m-mentoring (intervention, n = 30 facilities) or traditional group-based training (control, n = 30 facilities) control arm. They received Basic Emergency Obstetrics and Newborn Care (BEmONC) training with simulated practice using anatomic models and role-plays. The control arm was trained offsite while the intervention arm was trained onsite where they worked. Mentorship was done through telephone calls and reminder text messages. The multiple choice questions (MCQs) and objective structured clinical examinations (OSCEs) mean scores were compared; p-value < 0.05 was considered statistically significant. Qualitative data were also collected and content analysis was conducted.

Results

The mean knowledge scores between the two arms at months 3 and 12 post-training were equally high; no statistically significant differences. Both arms showed improvements in composite scores for assessed BEmONC clinical skills from around 30% at baseline to 75% and above at end line (p < 0.05). Overall, the observed improvement and retention of skills was higher in intervention arm compared to the control arm at 12 months post-training, (p < 0.05). Some LDHF/m-mentoring approach trainees reported that mentors’ support improved their acquisition and maintenance of knowledge and skills, which may have led to reductions in maternal and newborn deaths in their facilities.

Conclusion

The LDHF/m-mentoring intervention is more effective than TRAD approach in improving health workers’ skills acquisition and retention. Health care managers should have the option to select the LDHF/m-mentoring learning approach, depending on their country’s priorities or context, as it ensures health workers remain in their place of work during training events thus less disruption to service delivery.

Trial registration

The trial was retrospectively registered on August 24, 2017 at ClinicalTrials.Gov: NCT03269240.

Does frequency of supportive supervisory visits influence health service delivery?-Dose and response study

High quality care—at a minimum—is a combination of the availability of tangible resources as well as a capable and motivated health workforce. Researchers have suggested that supportive supervision can increase both the performance and motivation of health workers and the quality of care. This study is aimed at assessing the required number of visits and time between visits to bring about improvements in health service delivery. The study employed a primary health care performance improvement conceptual framework which depicts building blocks for improved health service delivery using longitudinal program outcome monitoring data collected from July 2017 to December 2019. The analysis presented in this study is based on 3,080 visits made to 1,479 health centers in the USAID Transform: Primary Health Care project’s intervention districts. To assess the effects of the visits on the repeated measure of the outcome variable (Service-Delivery), multilevel linear mixed model (LMM) with maximum likelihood (ML) estimation was employed. The results showed that there was a significant dose-response relationship that consistent and significant improvement on Service-Delivery indicator was observed from first (β = -26.07, t = -7.43, p < 0.001) to second (β = -21.17, t = -6.00, p < 0.01), third (β = -15.20, t = -4.49, p < 0.02), fourth (β = -12.35, t = -3.58, p < 0.04) and fifth (β = -11.18, t = -2.86, p < 0.03) visits. The incremental effect of the visits was not significant from fifth visit to the sixth suggesting five visits are the optimal number of visits to improve service delivery at the health center level. The time interval between visits also suggested visits made between 6 to 9 months (β = -2.86, t = -2.56, p < 0.01) showed more significant contributions. Therefore, we can conclude that five visits each separated by 6 to 9 months elicits a significant service delivery improvement at health centers.

Did a quality improvement intervention improve quality of maternal health care? Implementation evaluation from a cluster-randomized controlled study

OBJECTIVE

To test the success of a maternal healthcare quality improvement intervention in actually improving quality.

DESIGN

Cluster-randomized controlled study with implementation evaluation; we randomized 12 primary care facilities to receive a quality improvement intervention, while 12 facilities served as controls.

SETTING

Four districts in rural Tanzania.

PARTICIPANTS

Health facilities (24), providers (70 at baseline; 119 at endline) and patients (784 at baseline; 886 at endline).

INTERVENTIONS

In-service training, mentorship and supportive supervision and infrastructure support.

MAIN OUTCOME MEASURES

We measured fidelity with indictors of quality and compared quality between intervention and control facilities using difference-in-differences analysis.

RESULTS

Quality of care was low at baseline: the average provider knowledge test score was 46.1% (range: 0-75%) and only 47.9% of women were very satisfied with delivery care. The intervention was associated with an increase in newborn counseling (β: 0.74, 95% CI: 0.13, 1.35) but no evidence of change across 17 additional indicators of quality. On average, facilities reached 39% implementation. Comparing facilities with the highest implementation of the intervention to control facilities again showed improvement on only one of the 18 quality indicators.

CONCLUSIONS

A multi-faceted quality improvement intervention resulted in no meaningful improvement in quality. Evidence suggests this is due to both failure to sustain a high-level of implementation and failure in theory: quality improvement interventions targeted at the clinic-level in primary care clinics with weak starting quality, including poor infrastructure and low provider competence, may not be effective.

Quality of care for children with severe disease in the Democratic Republic of the Congo

BACKGROUND

Despite the almost universal adoption of Integrated Management of Childhood Illness (IMCI) guidelines for the diagnosis and treatment of sick children under the age of five in low- and middle-income countries, child mortality remains high in many settings. One possible explanation of the continued high mortality burden is lack of compliance with diagnostic and treatment protocols. We test this hypothesis in a sample of children with severe illness in the Democratic Republic of the Congo (DRC).

METHODS

One thousand one hundred eighty under-five clinical visits were observed across a regionally representative sample of 321 facilities in the DRC. Based on a detailed list of disease symptoms observed, patients with severe febrile disease (including malaria), severe pneumonia, and severe dehydration were identified. For all three disease categories, treatments were then compared to recommended case management following IMCI guidelines.

RESULTS

Out of 1180 under-five consultations observed, 332 patients (28%) had signs of severe febrile disease, 189 patients (16%) had signs of severe pneumonia, and 19 patients (2%) had signs of severe dehydration. Overall, providers gave the IMCI-recommended treatment in 42% of cases of these three severe diseases. Less than 15% of children with severe disease were recommended to receive in-patient care either in the facility they visited or in a higher-level facility.

CONCLUSIONS

These results suggest that adherence to IMCI protocols for severe disease remains remarkably low in the DRC. There is a critical need to identify and implement effective approaches for improving the quality of care for severely ill children in settings with high child mortality.

Development of summary indices of antenatal care service quality in Haiti, Malawi and Tanzania

INTRODUCTION

Measuring quality of care in low-income and middle-income countries is complicated by the lack of a standard, universally accepted definition for 'quality' for any particular service, as well as limited guidance on which indicators to include in measures of quality of care, and how to incorporate those indicators into summary indices. The aim of this paper is to develop, characterise and compare a set of antenatal care (ANC) indices for facility readiness and provision of care.

METHODS

We created nine indices for facility readiness using three methods for selecting items and three methods for combining items. In addition, we created three indices for provision of care using one method for selecting items and three methods for combining items. For each index, we calculated descriptive statistics, categorised the continuous index scores using tercile cut points to assess comparability of facility classification, and examined the variability and distribution of scores.

RESULTS

Our results showed that, within a country, the indices were quite similar in terms of mean index score, facility classification, coefficient of variation, floor and ceiling effects, and the inclusion of items in an index with a range of variability. Notably, the indices created using principal components analysis to combine the items were the most different from the other indices. In addition, the index created by taking a weighted average of a core set of items had lower agreement with the other indices when looking at facility classification.

CONCLUSIONS

As improving quality of care becomes integral to global efforts to produce better health outcomes, demand for guidance on creating standardised measures of service quality will grow. This study provides health systems researchers with a comparison of methodologies commonly used to create summary indices of ANC service quality and it highlights the similarities and differences between methods.

Assessment Of Maternity Staff Training And Knowledge Of Obstetric Care In Burkina Faso: A Repeated Cross-Sectional Study

Background and aim

The quality of maternity care in low-income countries has often been questioned. The objective of this study was to describe the trend of the percentage of staff trained on selected obstetric care topics and their level of knowledge of maternal care over a 5-year period in Burkina Faso.

Methods

We conducted a secondary analysis of data from two national emergency obstetric and newborn care (EmONC) needs assessments. Staff members’ knowledge scores were determined at the facility level for 2010 and 2014 and were further categorized into low (less than 50%), medium (50 to 74%) or high (at least 75%) levels. We used McNemar’s test with a 5% significance level to compare the distribution of the proportions in 2010 versus 2014.

Results

Out of 789 facilities surveyed in the 2014 assessment, 736 (93.3%) were eligible for this study. Most of them were primary healthcare centers (87.2%). Overall, 21.6% (n=197) of health workers in 2010 and 39% in 2014 were midwives. The proportions of staff who received training on focused antenatal care (FANC) and on how to perform active management of the third stage of labor (AMSTL) have increased by 15.8% and 14.7%, respectively. A significant proportion of facilities had health workers with a low level of knowledge of FANC (p<0.001), the parameters that indicate the start of labor (p<0.001), the monitoring of labor progress (p<0.001) and AMSTL (p<0.001). There was no significant change in staff knowledge in hospitals over the 5-year period.

Conclusion

From 2010 to 2014, the proportion of staff trained in obstetric care has increased. Their level of knowledge also improved, except in hospitals. However, further efforts are needed to reach a high level of knowledge.

Cost-effectiveness of a mentorship and quality improvement intervention to enhance the quality of antenatal care at rural health centers in Rwanda

OBJECTIVE

To estimate cost-effectiveness of Mentorship, Enhanced Supervision for Healthcare and Quality Improvement (MESH-QI) intervention to strengthen the quality of antenatal care at rural health centers in rural Rwanda.

DESIGN

Cost-effectiveness analysis of the MESH-QI intervention using the provider perspective.

SETTING

Kirehe and Rwinkwavu District Hospital catchment areas, Rwanda.

INTERVENTION

MESH-QI.

MAIN OUTCOME MEASURES

Incremental cost per antenatal care visit with complete danger sign and vital sign assessments.

RESULTS

The total annual costs of standard antenatal care supervision was 10 777.21 USD at the baseline, whereas the total costs of MESH-QI intervention was 19 656.53 USD. Human resources (salary and benefits) and transport drove the majority of program expenses, (44.8% and 40%, respectively). Other costs included training of mentors (12.9%), data management (6.5%) and equipment (6.5%). The incremental cost per antenatal care visit attributable to MESH-QI with all assessment items completed was 0.70 USD for danger signs and 1.10 USD for vital signs.

CONCLUSIONS

MESH-QI could be an affordable and effective intervention to improve the quality of antenatal care at health centers in low-resource settings. Cost savings would increase if MESH-QI mentors were integrated into the existing healthcare systems and deployed to sites with higher volume of antenatal care visits.

Supportive supervision to improve service delivery in low-income countries: is there a conceptual problem or a strategy problem?

Supportive supervision is perceived as an intervention that strengthens the health system, enables health workers to offer quality services and improve performance. Unfortunately, numerous studies show that supervisory mechanisms in many low-income countries (LICs) are suboptimal. Further, the understanding of the concept and its implementation is still shrouded in misinterpretations and inconsistencies. This analysis contributes to a deeper understanding of the concept of supportive supervision and how reorganisation of the approach can contribute to improved performance. The effectiveness of supportive supervision is mixed, with some studies noting that evidence on its role, especially in LICs is inconclusive. Quality of care is a core component of universal health coverage which, accentuates the need for supportive supervision. In the context of LICs, it is imperative for supportive supervision to be implemented as an on-going approach. Factors that affect supportive supervision encompass cultural, social, organizational and context dimensions but the capacity of majority of LIC to address these is limited. To this end, we underscore the need to review the supportive supervision approach to improve its effectiveness, and ensure that facility-based supervision embodies as many of the envisioned qualities as possible. We thus make a case for a stronger focus on internal supportive supervision where internal refers to health facility/unit/ward level. Inherent in the approach is what we refer to as ‘supervisee initiated supportive supervision’. The success of this approach must be anchored on a strong system for monitoring, data and information management at the health facility level.

Effectiveness of a multicomponent safe surgery intervention on improving surgical quality in Tanzania's Lake Zone: protocol for a quasi-experimental study

INTRODUCTION

Effective, scalable strategies for improving surgical quality are urgently needed in low-income and middle-income countries; however, there is a dearth of evidence about what strategies are most effective. This study aims to evaluate the effectiveness of Safe Surgery 2020, a multicomponent intervention focused on strengthening five areas: leadership and teamwork, safe surgical and anaesthesia practices, sterilisation, data quality and infrastructure to improve surgical quality in Tanzania. We hypothesise that Safe Surgery 2020 will (1) increase adherence to surgical quality processes around safety, teamwork and communication and data quality in the short term and (2) reduce complications from surgical site infections, postoperative sepsis and maternal sepsis in the medium term.

METHODS AND ANALYSIS

Our design is a prospective, longitudinal, quasi-experimental study with 10 intervention and 10 control facilities in Tanzania's Lake Zone. Participants will be surgical providers, surgical patients and postnatal inpatients at study facilities. Trained Tanzanian medical data collectors will collect data over a 3-month preintervention and postintervention period. Adherence to safety as well as teamwork and communication processes will be measured through direct observation in the operating room. Surgical site infections, postoperative sepsis and maternal sepsis will be identified prospectively through daily surveillance and completeness of their patient files, retrospectively, through the chart review. We will use difference-in-differences to analyse the impact of the Safe Surgery 2020 intervention on surgical quality processes and complications. We will use interviews with leadership and surgical team members in intervention facilities to illuminate the factors that facilitate higher performance.

ETHICS AND DISSEMINATION

The study has received ethical approval from Harvard Medical School and Tanzania's National Institute for Medical Research. We will report results in peer-reviewed publications and conference presentations. If effective, the Safe Surgery 2020 intervention could be a promising approach to improve surgical quality in Tanzania's Lake Zone region and other similar contexts.

"It builds your confidence… you've done well": Healthcare workers' experiences of participating in a low-dose, high-frequency training to improve newborn survival on the day of birth in Ghana

Background: The majority of newborn deaths occur during the first week of life, and 25‒45% occur within the first 24 hours. A low-dose, high-frequency (LDHF) training approach was introduced in 40 hospitals in Ghana to improve newborn survival. The aim of this qualitative study was to explore healthcare workers' experiences with the LDHF approach to in-service training. Methods: A total of 20 in-depth interviews and nine focus group discussions were conducted in 2016 in three regions of Ghana with healthcare workers who participated in implementation of the LDHF training approach. In-depth interviews were conducted with 20 master mentors and peer practice coordinators; 51 practicing doctors, midwives and nurses participated in focus group discussions. Data were analyzed using a thematic analysis approach. Results: Healthcare workers reflected on the differences between the LDHF approach and past learning experiences, highlighting how the skills-based team training approach, coupled with high-frequency practice and mobile mentoring, built their competency and confidence. As participants shared their experiences, they highlighted relationships established between Master Mentors and healthcare workers, and motivation stemming from pride in contributing to reductions in maternal and newborn deaths as critical factors in improving quality of care at participating health facilities. Conclusion: This nested qualitative study documents experiences of healthcare workers and mentors involved in implementation of a multi-faceted intervention that effectively improved maternal and newborn care at health facilities in Ghana. The way the intervention was implemented created an environment conducive to learning within the hospital setting, thus providing an opportunity for professional growth and quality improvement for all staff working in the maternity ward.

"It builds your confidence… you've done well": Healthcare workers' experiences of participating in a low-dose, high-frequency training to improve newborn survival on the day of birth in Ghana

Background: The majority of newborn deaths occur during the first week of life, and 25‒45% occur within the first 24 hours. A low-dose, high-frequency (LDHF) training approach was introduced in 40 hospitals in Ghana to improve newborn survival. The aim of this qualitative study was to explore healthcare workers’ experiences with the LDHF approach to in-service training.

Methods: A total of 20 in-depth interviews and nine focus group discussions were conducted in 2016 in three regions of Ghana with healthcare workers who participated in implementation of the LDHF training approach. In-depth interviews were conducted with 20 master mentors and peer practice coordinators; 51 practicing doctors, midwives and nurses participated in focus group discussions. Data were analyzed using a thematic analysis approach.

Results: Healthcare workers reflected on the differences between the LDHF approach and past learning experiences, highlighting how the skills-based team training approach, coupled with high-frequency practice and mobile mentoring, built their competency and confidence. As participants shared their experiences, they highlighted relationships established between Master Mentors and healthcare workers, and motivation stemming from pride in contributing to reductions in maternal and newborn deaths as critical factors in improving quality of care at participating health facilities.

Conclusion: This nested qualitative study documents experiences of healthcare workers and mentors involved in implementation of a multi-faceted intervention that effectively improved maternal and newborn care at health facilities in Ghana. The way the intervention was implemented created an environment conducive to learning within the hospital setting, thus providing an opportunity for professional growth and quality improvement for all staff working in the maternity ward.

Adherence to standards of first-visit antenatal care among providers: A stratified analysis of Tanzanian facility-based survey for improving quality of antenatal care

INTRODUCTION

Despite the benefits of early antenatal care visits for early prevention, detection, and treatment of potential complications in pregnancy, a high level of provider adherence to first-visit antenatal care standards is needed. However, little information is available regarding provider adherence to antenatal care in Tanzania. This study was performed to assess provider adherence to first-visit antenatal care standards and to apply stratified analysis to identify associated factors in Tanzania.

METHODS

Data from the 2014-2015 Tanzania Service Provision Assessment Survey were used in this study. Provider adherence to first-visit antenatal care standards was measured using 10 domains: client history; aspects of prior pregnancies; danger signs of the current pregnancy; physical examination; routine tests; HIV testing and counseling; maintaining a healthy pregnancy; iron/folate supplements; tetanus toxoid vaccination, and preparation for delivery. A composite score was then created in which the highest quantile (corresponding to ≥60.5%) considered to provider adhering to first-visit antenatal care standards. Initially, a series of unadjusted logistic regression analyses according to the type of facility and managing authority were performed separately at each level (i.e., facility, provider, and client). Thereafter, all variables with P < 0.2 were fitted into the respective stratified multivariable logistic regression analysis using a 5% significance level.

RESULTS

A total of 1756 first-visit antenatal care consultations performed by 822 providers in 648 health facilities were analyzed. The overall median [Interquartile range, IQR] adherence to first-visit antenatal care was relatively low at 47.1% [35.7%-60.5%]. After adjusting for selected variables from each level in specific strata, at dispensary; female providers [AOR = 5.5; 95% CI, 1.8-16.4], at health centre; performance of quality assurance [AOR = 2.2; 95% CI, 1.3-3.9], at hospital; availability of routine tests [AOR = 2.5; 95% CI, 1.3-4.8] and basic medicine [AOR = 2.8; 95% CI, 1.4-5.7], at public facilities; availability of medicine [AOR = 1.8; 95% CI, 1.1-3.2] and receiving refresher training [AOR = 1.8; 95% CI, 1.1-3.1], and at private facility; receiving external fund from government [AOR = 3.0; 95% CI, 1.1-8.4] were significantly associated with better adherence to first-visit antenatal care standards.

CONCLUSIONS

The study highlighted the important factors, including the provision of refresher training, regular distribution of basic medicines, and diagnostics equipment which may influence provider adherence to first-visit ANC standards.

Building health workforce capacity for planning and monitoring through the Strengthening Technical Assistance for routine immunization training (START) approach in Uganda

INTRODUCTION

The Global Vaccine Action Plan identifies workforce capacity building as a key strategy to achieve strong immunization programs. The Strengthening Technical Assistance for Routine Immunization Training (START) approach aimed to utilize practical training methods to build capacity of district and health center staff to implement routine immunization (RI) planning and monitoring activities, as well as build supportive supervision skills of district staff.

METHODS

First implemented in Uganda, the START approach was executed by trained external consultants who used existing tools, resources, and experiences to mentor district-level counterparts and, with them, conducted on-the-job training and mentorship of health center staff over several site visits. Implementation was routinely monitored using daily activity reports, pre and post surveys of resources and systems at districts and health centers and interviews with START consultants.

RESULTS

From July 2013 through December 2014 three START teams of four consultants per team, worked 6 months each across 50 districts in Uganda including the five divisions of Kampala district (45% of all districts). They conducted on-the-job training in 444 selected under-performing health centers, with a median of two visits to each (range 1-7, IQR: 1-3). More than half of these visits were conducted in collaboration with the district immunization officer, providing the opportunity for mentorship of district immunization officers. Changes in staff motivation and awareness of challenges; availability and completion of RI planning and monitoring tools and systems were observed. However, the START consultants felt that potential durability of these changes may be limited by contextual factors, including external accountability, availability of resources, and individual staff attitude.

CONCLUSIONS

Mentoring and on-the-job training offer promising alternatives to traditional classroom training and audit-focused supervision for building health workforce capacity. Further evidence regarding comparative effectiveness of these strategies and durability of observed positive change is needed.

Clinical performance among recent graduates in nine low- and middle-income countries

Objectives

Recent studies have identified large and systematic deficits in clinical care in low‐income countries that are likely to limit health gains. This has focused attention on effectiveness of pre‐service education. One approach to assessing this is observation of clinical performance among recent graduates providing care. However, no studies have assessed performance in a standard manner across countries. We analysed clinical performance among recently graduated providers in nine low‐ or middle‐income countries.

Methods

Service Provision Assessments from Haiti, Kenya, Malawi, Namibia, Nepal, Rwanda, Senegal, Tanzania, and Uganda were used. We constructed a Good Medical Practice Index that assesses completion of essential clinical actions using direct observations of care (range 0–1), calculated index scores by country and clinical cadre, and assessed the role of facility and clinical characteristics using regression analysis.

Results

Our sample consisted of 2223 clinicians with at least one observation of care. The Good Medical Practice score for the sample was 0.50 (SD = 0.20). Nurses and midwives had the highest score at 0.57 (SD = 0.20), followed by associate clinicians at 0.43 (SD = 0.18), and physicians at 0.42 (SD = 0.16). The average national performance varied from 0.63 (SD = 0.18) in Uganda to 0.39 (SD = 0.17) in Nepal, persisting after adjustment for facility and clinician characteristics.

Conclusions

These results show substantial gaps in clinical performance among recently graduated clinicians, raising concerns about models of clinical education. Competency‐based education should be considered to improve quality of care in LMICs. Observations of care offer important insight into the quality of clinical education.

Quality of care in early detection and management of pre-eclampsia/eclampsia in health facilities in Afghanistan

Background

Afghanistan faces a high burden of maternal and neonatal morbidity and mortality. Hypertensive disorders of pregnancy, including pre-eclampsia and eclampsia (PE/E), are among the most common causes of maternal and neonatal complications. Hypertensive disorders of pregnancy can lead to fatal complications for both the mother and fetus. The 2016 Afghanistan National Maternal and Newborn Health Quality of Care Assessment assessed quality of early detection and management of PE/E in health facilities and skilled birth attendants’ (SBAs) perceptions of their working environment.

Methods

All accessible public health facilities with an average of at least five births per day (n = 77), a nationally representative sample of public health facilities with less than five births per day (n = 149), and 20 purposively selected private health facilities were assessed. Methods included a facility inventory and record review, interviews with SBAs, and direct clinical observation of antenatal care (ANC), intrapartum care and immediate postnatal care (PNC), as well as severe PE/E case management.

Results

Most facilities had supplies and medicines for early detection and management of PE/E.

At public health facilities, 357 of 414 (86.2%) clients observed during ANC consultations had their blood pressure checked and 159 (38.4%) were asked if they had experienced symptoms of PE/E. Only 553 of 734 (72.6%) SBAs interviewed were able to correctly identify severe pre-eclampsia described in a case scenario. Of 29 PE/E cases observed, 17 women (59%) received the correct loading dose of magnesium sulfate (MgSO4) and 12 women (41%) received the correct maintenance dose of MgSO4.

At private health facilities, 39 of 45 ANC clients had their blood pressure checked and 9 of 45 (20%) were asked about symptoms of PE/E. Fifty-four of 64(84.4%) SBAs in private facilities correctly identified severe pre-eclampsia described in a case scenario.

Conclusion

Notable gaps in SBAs’ knowledge and clinical practices in detection and management of PE/E in various health facilities increase the risk of maternal and perinatal mortality. Continuing education of health care providers and increased investment in focused quality improvement initiatives will be critical to improve the quality of health care services in Afghanistan.

Health workers' experiences of collaborative quality improvement for maternal and newborn care in rural Tanzanian health facilities: A process evaluation using the integrated 'Promoting Action on Research Implementation in Health Services' framework

Background

Quality Improvement (QI) approaches are increasingly used to bridge the quality gap in maternal and newborn care (MNC) in Sub Saharan Africa. Health workers typically serve as both recipients and implementers of QI activities; their understanding, motivation, and level of involvement largely determining the potential effect. In support of efforts to harmonise and integrate the various QI approaches implemented in parallel in Tanzanian health facilities, our objective was to investigate how different components of a collaborative QI intervention were understood and experienced by health workers, and therefore contributed positively to its mechanisms of effect.

Materials and methods

A qualitative process evaluation of a collaborative QI intervention for MNC in rural Tanzania was carried out. Semi-structured interviews were conducted with 16 health workers in 13 purposively sampled health facilities. A deductive theory-driven qualitative content analysis was employed using the integrated Promoting Action on Research Implementation in Health services (i-PARIHS) framework as a lens with its four constructs innovation, recipients, facilitation, and context as guiding themes.

Results

Health workers valued the high degree of fit between QI topics and their everyday practice and appreciated the intervention’s comprehensive approach. The use of run-charts to monitor progress was well understood and experienced as motivating. The importance and positive experience of on-site mentoring and coaching visits to individual health facilities was expressed by the majority of health workers. Many described the parallel implementation of various health programs as a challenge.

Conclusion

Components of QI approaches that are well understood and experienced as supportive by health workers in everyday practice may enhance mechanisms of effect and result in more significant change. A focus on such components may also guide harmonisation, to avoid duplication and the implementation of parallel programs, and country ownership of QI approaches in resource limited settings.

Peer-assisted learning after onsite, low-dose, high-frequency training and practice on simulators to prevent and treat postpartum hemorrhage and neonatal asphyxia: A pragmatic trial in 12 districts in Uganda

An urgent need exists to improve and maintain intrapartum skills of providers in sub-Saharan Africa. Peer-assisted learning may address this need, but few rigorous evaluations have been conducted in real-world settings. A pragmatic, cluster-randomized trial in 12 Ugandan districts provided facility-based, team training for prevention and management of postpartum hemorrhage and birth asphyxia at 125 facilities. Three approaches to facilitating simulation-based, peer assisted learning were compared. The primary outcome was the proportion of births with uterotonic given within one minute of birth. Outcomes were evaluated using observation of birth and supplemented by skills assessments and service delivery data. Individual and composite variables were compared across groups, using generalized linear models. Overall, 107, 195, and 199 providers were observed at three time points during 1,716 births across 44 facilities. Uterotonic coverage within one minute increased from: full group: 8% (CI 4%‒12%) to 50% (CI 42%‒59%); partial group: 19% (CI 9%‒30%) to 42% (CI 31%‒53%); and control group: 11% (5%‒7%) to 51% (40%‒61%). Observed care of mother and newborn improved in all groups. Simulated skills maintenance for postpartum hemorrhage prophylaxis remained high across groups 7 to 8 months after the intervention. Simulated skills for newborn bag-and-mask ventilation remained high only in the full group. For all groups combined, incidence of postpartum hemorrhage and retained placenta declined 17% and 47%, respectively, from during the intervention period compared to the 6‒9 month period after the intervention. Fresh stillbirths and newborn deaths before discharge decreased by 34% and 62%, respectively, from baseline to after completion, and remained reduced 6‒9 months post-implementation. Significant improvements in uterotonic coverage remained across groups 6 months after the intervention. Findings suggest that while short, simulation-based training at the facility improves care and is feasible, more complex clinical skills used infrequently such as newborn resuscitation may require more practice to maintain skills. Trial Registration: ClinicalTrials.gov NCT03254628.