Implementation of a health management mentoring program: year-1 evaluation of its impact on health system strengthening in Zambézia Province, Mozambique

How capacity building of district health managers has been designed, delivered and evaluated in sub-Saharan Africa: a scoping review and best fit framework analysis

OBJECTIVES

We aimed to understand how capacity building programmes (CBPs) of district health managers (DHMs) have been designed, delivered and evaluated in sub-Saharan Africa. We focused on identifying the underlying assumptions behind leadership and management CBPs at the district level.

DESIGN

Scoping review.

DATA SOURCES

We searched five electronic databases (MEDLINE, Health Systems Evidence, Wiley Online Library, Cochrane Library and Google Scholar) on 6 April 2021 and 13 October 2022. We also searched for grey literature and used citation tracking.

ELIGIBILITY CRITERIA

We included all primary studies (1) reporting leadership or management capacity building of DHMs, (2) in sub-Saharan Africa, (3) written in English or French and (4) published between 1 January 1987 and 13 October 2022.

DATA EXTRACTION AND SYNTHESIS

Three independent reviewers extracted data from included articles. We used the best fit framework synthesis approach to identify an a priori framework that guided data coding, analysis and synthesis. We also conducted an inductive analysis of data that could not be coded against the a priori framework.

RESULTS

We identified 2523 papers and ultimately included 44 papers after screening and assessment for eligibility. Key findings included (1) a scarcity of explicit theories underlying CBPs, (2) a diversity of learning approaches with increasing use of the action learning approach, (3) a diversity of content with a focus on management rather than leadership functions and (4) a diversity of evaluation methods with limited use of theory-driven designs to evaluate leadership and management capacity building interventions.

CONCLUSION

This review highlights the need for explicit and well-articulated programme theories for leadership and management development interventions and the need for strengthening their evaluation using theory-driven designs that fit the complexity of health systems.

Conducting rapid research to aid the design of a health systems governance intervention in the Somali Region of Ethiopia

INTRODUCTION

The rapid research described in this chapter was conducted as an assignment for a UN agency in Ethiopia's Somali Region. The agency's aim was support the implementation of an interim citizen engagement intervention, with a view of supporting of the Ethiopian Government's Citizen Score Card at primary healthcare facilities and hospitals in future. Many health facilities in Somali Region struggle with budget shortages related to ineffective budget planning and budget execution at woreda health office levels. In this context, an intervention to first improve budget accountability, through the implementation of citizen audits, was proposed.

METHODOLOGY

The rapid study focused on five woredas (districts) within Somali Region, where interviews were conducted with the heads of woreda health offices. In the same five woredas, directors of healthcare facilities were interviewed and offices and healthcare facilities were observed. The framework of assessment and analysis was based on health systems literature on fragile and conflict affected states guided the questions for the health authorities and health facility management.

FINDINGS

The research yielded five distinct mini case studies covering woreda health office planning and budgeting capacity and support (or lack thereof), and related impressions of challenges regarding healthcare delivery at health facilities in the same five woredas.

RESULTS

The findings demonstrated that the capacity for healthcare planning and budgeting Somali Region at woreda level varied significantly and that little guidance was available from regional level health authorities. Frontline health services clearly suffered from budget shortages as a result.

CONCLUSION

The research provided an evidence base for the delay of the roll-out of the Community Scorecard implementation across Somali Region. In a context whereby health facilities remain under-resourced due to budgeting constraints, a citizen-service provider-focused accountability intervention would have been of limited utility. The rapid case study research, conducted by condensing the usual case study research process, allowed for the production of evidence that was "robust enough" to demonstrate heterogeneity and challenges regarding budgeting quality across the five research sites. This evidence clearly transcended the hitherto anecdotal evidence that woreda-level health budget planning remains an area that faces significant shortcomings.

Behavioral Determinants of Routine Health Information System Data Use in Senegal: A Qualitative Inquiry Based on the Integrated Behavioral Model

Although behavioral factors are thought to be important barriers to routine data use, they remain understudied particularly in low-income country settings. We show that the integrated behavior model can be a valuable theoretical framework for targeted communication strategies and capacity-building interventions aimed at promoting a culture of data use.

Routine health information system (RHIS) data are essential in driving decision making and planning in health systems as well as health programs. However, despite their importance, these data are underutilized, and the underlying individual-level facilitators and barriers to use remain understudied. In this research, we applied the Integrated Behavior Model (IBM) to examine how attitudes toward RHIS data, perceived norms concerning RHIS data use, and the ability to use RHIS data influence the demand and use of RHIS data among stakeholders in Senegal. Using data from interviews with respondents working at national levels of malaria, HIV, and TB control programs in Senegal, we used a framework analysis approach to apply the IBM behavioral constructs and identify their linkages to RHIS data use. We found that attitudes about the quality, availability, and relevance of RHIS data for decision making were important in driving data use among respondents. Institutional expectations, organizational protocols, policies, and practices around RHIS data ultimately shape social norms around the use of the data. Although we found that perceived ability and self-efficacy to use RHIS data were not barriers to RHIS data use among stakeholders at the strategic levels of their respective organizations, these were reported to be barriers at lower levels of the health system. Low perceived control of the RHIS data production process ultimately reduced RHIS data use for decision making among the strategic-level respondents. We recommend context-specific reexamination of existing RHIS interventions with a renewed emphasis on behavioral aspects of data use. The IBM can help guide practitioners, policy makers, and academics to address multiple socioecological factors that influence data use behavior when recommending RHIS and data use solutions.

A national HIV clinical mentorship program: Enabling Zambia to accelerate control of the HIV epidemic

Although Zambia has increased the proportion of people living with HIV (PLHIV) who are on antiretroviral therapy (ART) in recent years, progress toward HIV epidemic control remains inconsistent. Some districts are still failing to meet the UNAIDS 90/90/90 targets where 90% of PLHIV should know their status, 90% of those diagnosed should be on ART, and 90% of those on ART should achieve viral load suppression (VLS) by 2020. Providing consistently excellent HIV services at all ART health facilities is critical for achieving the UNAIDS 90/90/90 targets and controlling the HIV epidemic in Zambia. Zambia Ministry of Health, in collaboration with the U.S. Centers for Disease Control and Prevention (CDC), aimed to achieve these targets through establishing a national HIV clinical mentorship program in which government-employed mentors were assigned to specific facilities with a mandate to identify and ameliorate programmatic challenges. Mentors were hired, trained and deployed to individual facilities in four provinces to mentor staff on quality HIV clinical and program management. The pre-mentorship period was July 2018-September 2018 and the post-mentorship period was July 2019-September 2019. Review of key programmatic indicators from the pre and post-deployment periods revealed the proportion of people who had a positive HIV test result out of those tested increased from 4.2% to 6.8% (P <0.001) as fewer HIV tests were needed despite the number of PLHIV being identified and placed on ART increasing from 492,613 to 521,775, and VLS increased from 84.8% to 90.1% (p <0.001). Key considerations in the establishment of an HIV clinical mentorship program include having a government-led process of regular site level data review and continuous clinical mentorship underpinned by quality improvement methodology.

Establishing evidence-based decision-making mechanism in a health eco-system and its linkages with health service coverage in 25 high-priority districts of Uttar Pradesh, India

Background

Achievement of successful health outcomes depends on evidence-based programming and implementation of effective health interventions. Routine Health Management Information System is one of the most valuable data sets to support evidence-based programming, however, evidence on systemic use of routine monitoring data for problem-solving and improving health outcomes remain negligible. We attempt to understand the effects of systematic evidence-based review mechanism on improving health outcomes in Uttar Pradesh, India.

Methods

Data comes from decision-tracking system and routine health management information system for period Nov-2017 to Mar-2019 covering 6963 health facilities across 25 high-priority districts of the state. Decision-tracking data captured pattern of decisions taken, actions planned and completed, while the latter one provided information on service coverage outcomes over time. Three service coverage indicators, namely, pregnant women receiving 4 or more times ANC and haemoglobin testing during pregnancy, delivered at the health facility, and receive post-partum care within 48 h of delivery were used as outcomes. Univariate and bivariate analyses were conducted.

Results

Total 412 decisions were taken during the study reference period and a majority were related to ante-natal care services (31%) followed by delivery (16%) and post-natal services (16%). About 21% decisions-taken were focused on improving data quality. By 1 year, 67% of actions planned based on these decisions were completed, 26% were in progress, and the remaining 7% were not completed. We found that, over a year, districts witnessing > 20 percentage-point increase in outcomes were also the districts with significantly higher action completion rates (> 80%) compared to the districts with < 10 percentage-point increase in outcomes having completion of action plans around 50–70%.

Conclusions

Findings revealed a significantly higher improvement in coverage outcomes among the districts which used routine health management data to conduct monthly review meetings and had high actions completion rates. A data-based review-mechanisms could specifically identify programmatic gaps in service delivery leading to strategic decision making by district authorities to bridge the programmatic gaps. Going forward, establishing systematic evidence-based review platforms can be an important strategy to improve health outcomes and promote the use of routine health monitoring system data in any setting.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06172-2.

Evaluation of the partnership between international non-governmental organizations and the State in the health sector in Mozambique

Introduction

Mozambique is one of the poorest nations in the world and its health budget is heavily dependent on external funding. Increasingly, donors prefer to direct their funds through international non-governmental organizations instead of direct donations to the State budget. In the current climate of increased emphasis on health system strengthening, a strong and stable partnership between government and international non-governmental organizations is pivotal for health system strengthening in Mozambique.

Methods

the study evaluates the current partnership through a standardized survey to healthcare workers employed by international non-governmental organizations in health (INGO, private) and the ministry of health (MOH, public). Results of the survey have been analyzed only descriptively and no statistical evaluations have been performed.

Results

out of the valid 109 responses obtained 55.1% were from MOH cadres and 45.0% from INGO cadres. Most have been in the health sector for more than 5 years. Most of the respondents recognize that INGOs assist the government in strengthening the health system (71.6%), see the internal brain drain to INGOs and salary scale difference as major problems (70.6% and 78.0%); 87.2% reported that the coordination between INGOs and government needs to be improved. MOH cadres perceived the migration of cadres to INGOs and the need for improving coordination as major issues more acutely than their INGO counterparts (80.0% vs. 59.2% and 88.3% vs. 85.7% respectively). INGOs were perceived to offer better quality health services by 51.4% of respondents (of these 69.4% were INGO respondents). The quality of health services was alike between INGOs and MOH for 33% of the respondents.

Conclusion

through the various efforts outlined the MOH and INGOs are moving towards an environment of mutual accountability, joint planning and coordination as well as harmonization of activities; but there are still challenges to be addressed. Prioritization and increased funding of the planning unit and planning and cooperation directorate as well as strategies for workforce retention are urgently needed.

Comparison of maternal and child health service performances following a leadership, management, and governance intervention in Ethiopia: a propensity score matched analysis

Background

Leadership, management, and governance (LMG) interventions play a significant role in improving management systems, enhancing the work climate, and creating responsive health systems. Hence, the Ethiopian Ministry of Health with the support of the USAID Transform: Primary Health Care project has been implementing LMG interventions to improve performances of primary healthcare entities. The purpose of this evaluation was to compare maternal and child health service performances and overall health system strengthening measurement results of primary health care entities by LMG intervention exposed groups.

Methods

The study used a cross-sectional study design with a propensity matched score analysis, and was conducted from August 28, 2017, to September 30, 2018, in Amhara, Oromia, Tigray, and Southern Nations, Nationalities, and Peoples’ (SNNP) regions. Data collection took place through interviewer and self-administered questionnaires among 227 LMG intervention exposed and 227 non-exposed health workers. Propensity score matched analysis was used to balance comparison groups with respect to measured covariates.

Results

The mean overall maternal and child health key performance indicator score with standard deviation (± SD) for the LMG intervention exposed group was 63.86 ± 13.16 and 57.02 ± 13.71 for the non-exposed group. The overall health system strengthening score for the LMG intervention exposed group (mean rank = 269.31) and non-exposed group (mean rank = 158.69) had statistically significant differences (U = 10.145, z = − 11.175, p = 0.001). In comparison with its counterpart, the LMG exposed group had higher average performances in 3.54, 3.51, 2.64, 3.00, 1.07, and 3.34 percentage-points for contraceptive acceptance rate, antenatal care, skilled birth attendance, postnatal care, full immunization, and growth monitoring services, respectively.

Conclusion

There were evidences on the positive effects of the LMG intervention on increased maternal and child health services performances at primary healthcare entities. Moreover, health facilities with LMG intervention exposed health workers had higher and statistically significant differences in management systems, work climates, and readiness to face new challenges. Therefore, this study generated evidence for integrating LMG interventions to improve the performance of primary healthcare entities and maternal and child service uptake of community members, which contributes to the reduction of maternal and child deaths.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06873-8.

Key informant perspectives on the challenges and opportunities for using routine health data for decision-making in Senegal

Background

Increasing the performance of routine health information systems (RHIS) is an important policy priority both globally and in Senegal. As RHIS data become increasingly important in driving decision-making in Senegal, it is imperative to understand the factors that determine their use.

Methods

Semi-structured interviews were conducted with 18 high- and mid-level key informants active in the malaria, tuberculosis and HIV programmatic areas in Senegal. Key informants were employed in the relevant divisions of the Senegal Ministry of Health or nongovernmental / civil society organizations. We asked respondents questions related to the flow, quality and use of RHIS data in their organizations. A framework approach was used to analyze the qualitative data.

Results

Although the respondents worked at the strategic levels of their respective organizations, they consistently indicated that data quality and data use issues began at the operational level of the health system before the data made its way to the central level. We classify the main identified barriers and facilitators to the use of routine data into six categories and attempt to describe their interrelated nature. We find that data quality is a central and direct determinant of RHIS data use. We report that a number of upstream factors in the Senegal context interact to influence the quality of routine data produced. We identify the sociopolitical, financial and system design determinants of RHIS data collection, dissemination and use. We also discuss the organizational and infrastructural factors that influence the use of RHIS data.

Conclusions

We recommend specific prescriptive actions with potential to improve RHIS performance in Senegal, the quality of the data produced and their use. These actions include addressing sociopolitical factors that often interrupt RHIS functioning in Senegal, supporting and motivating staff that maintain RHIS data systems as well as ensuring RHIS data completeness and representativeness. We argue for improved coordination between the various stakeholders in order to streamline RHIS data processes and improve transparency. Finally, we recommend the promotion of a sustained culture of data quality assessment and use.

Acceptability and feasibility of inter-related activities to improve agency among African district health managers: A four-country study

District health managers (DHMs) lead and manage Ministry of Health programmes and system performance. We report on the acceptability and feasibility of inter-related activities to increase the agency of DHMs in Kenya, Nigeria, South Africa and Uganda using a cross-sectional rapid appraisal with 372 DHMs employing structured questionnaires. We found differences and similarities between the countries, in particular, who becomes a DHM. The opportunity to provide leadership and effect change and being part of a team were reported as rewarding aspects of DHMs' work. Demotivating factors included limited resources, bureaucracy, staff shortages, lack of support from leadership and inadequate delegation of authority. District managers ranked the acceptability of the inter-related activities similarly despite differences between contexts. Activities highly ranked by DHMs were to employ someone to support primary care staff to compile and analyse district-level data; to undertake study tours to well-functioning districts; and joining an African Regional DHM Association. DHMs rated these activities as feasible to implement. This study confirms that DHMs are in support of a process to promote bottom-up, data-driven, context-specific actions that can promote self-actualisation, recognises the roles DHMs play, provides opportunities for peer learning and can potentially improve quality of care.

Leadership, governance and management for improving district capacity and performance: the case of USAID transform: primary health care

BACKGROUND

Primary health care (PHC) in Ethiopia serves as the main entry point for preventive, promotive and curative health services. The district health office is responsible for the planning, implementation and evaluation of all district health activities. In addition, district health offices manage service delivery facilities working on provision of PHC - primary hospitals, health centers and health posts. As the leader of the health care system tier, district health management must ensure direction, alignment and commitment within teams and organizations and make sure that achievements are consistent with the vision, values and strategy of the organization. USAID Transform: Primary Health Care provides diverse support to improve district health manager competencies including in-service trainings followed by planning and implementation of performance improvement projects and on-the-job mentoring and support.

METHODS

This study was conducted to compare district level capacity and performances between leadership, management and governance (LMG) and non-LMG districts. Project outcome monitoring data that shows the performance of districts was collected from 284 districts from January to December 2019. The study was carried out using a comparative-cross sectional study design, which assessed and compared district health office level indicators. Districts were classified into two categories: LMG and non-LMG districts. The study compared data from 94 LMG and 190 non-LMG districts. Propensity score matching was used to control the effect of differences between LMG and non-LMG districts.

RESULTS

Results of the independent samples t-test revealed that LMG districts scored better average performances of 61.8 ± 121.45 standard deviation (SD) compared to non-LMG districts 56.89 ± 110.39 SD, with t (282243) = - 3.407317 and p < 0.001, two-tailed. The difference of 4.9 percentage unit in the average performance indicated a statistically significant difference between the LMG and non-LMG districts.

CONCLUSION

District level leadership development program contributes to improving district capacity, structure and management practices, and quality of care.

Effectiveness of training and educational programs for hospital managers: A systematic review

BACKGROUND

Developing and strengthening the competencies and skills of health care managers is a key objective in many health systems. Selecting adequate training methods, content, and using appropriate criteria for assessing their impact is fundamental for improving their usefulness and effectiveness. Filling an important gap in knowledge, this review assesses the evidence on the effectiveness of different types of training and educational programmes delivered to hospital managers.

METHODS

In this narrative systematic review, the following electronic databases were searched for literature published between January 1st, 1990 and January 31st, 2019. The Joanna Briggs Institute (JBI) checklist was used to evaluate the quality of the included studies.

RESULTS

In total, 9 articles were included. Results showed that the main topics covered by training programs for hospital managers were: planning, organization and coordination, control and supervision of hospital staff, teamwork, communication, motivation and leadership, monitoring and evaluation, and quality improvement skills. Training in these skills was found to improve managers' strategic and operational planning abilities, change management and behavioural management methods, and leadership.

CONCLUSIONS

The examined training programs had a relatively positive effect on the managerial skills, knowledge and competencies of hospital managers. In general, these capacity-building programs focused on developing three types of skills: technical, interpersonal and conceptual. Training programs focused on developing technical skills among managers were more effective than those focused on developing other types of skills. Increased investment and large-scale planning are needed to develop better the knowledge and competencies of hospital managers.

Redressing the gender imbalance: a qualitative analysis of recruitment and retention in Mozambique's community health workforce

BACKGROUND

Mozambique's community health programme has a disproportionate number of male community health workers (known as Agentes Polivalentes Elementares (APEs)). The Government of Mozambique is aiming to increase the proportion of females to constitute 60% to improve maternal and child health outcomes. To understand the imbalance, this study explored the current recruitment processes for APEs and how these are shaped by gender norms, roles and relations, as well as how they influence the experience and retention of APEs in Maputo Province, Mozambique.

METHODS

We employed qualitative methods with APEs, APE supervisors, community leaders and a government official in two districts within Maputo Province. Interviews were recorded, transcribed and translated. A coding framework was developed in accordance with thematic analysis to synthesise the findings.

FINDINGS

In-depth interviews (n = 30), key informant interviews (n = 1) and focus group discussions (n = 3) captured experiences and perceptions of employment processes. Intra-household decision-making structures mean women may experience additional barriers to join the APE programme, often requiring their husband's consent. Training programmes outside of the community were viewed positively as an opportunity to build a cohort. However, women reported difficulty leaving family responsibilities behind, and men reported challenges in providing for their families during training as other income-generating opportunities were not available to them. These dynamics were particularly acute in the case of single mothers, serving both a provider and primary carer role. Differences in attrition by gender were reported: women are likely to leave the programme when they marry, whereas men tend to leave when offered another job with a higher salary. Age and geographic location were also important intersecting factors: younger male and female APEs seek employment opportunities in neighbouring South Africa, whereas older APEs are more content to remain.

CONCLUSION

Gender norms, roles and power dynamics intersect with other axes of inequity such as marital status, age and geographic location to impact recruitment and retention of APEs in Maputo Province, Mozambique. Responsive policies to support gender equity within APE recruitment processes are required to support and retain a gender-equitable APE cadre.

Monitoring Pharmacy and Test Kit Stocks in Rural Mozambique: U.S. President's Emergency Plan for AIDS Relief Surveillance to Help Prevent Ministry of Health Shortages

Support of human immunodeficiency virus (HIV) and tuberculosis (TB) testing and treatment supported by President's Emergency Plan for AIDS Relief (PEPFAR) in Africa requires immense quantities of tests and medications. We sought to use central pharmacy supply data of Mozambique's rural Zambézia Province (2017 population ≈5.11 million persons; ≈12.6% adult HIV prevalence in 2016) to examine shortages, stockouts, and trends in availability. Using stock surveillance for 60 weeks in 2014-2015, we assessed availability of 36 medications [4 classes: adult antiretroviral (ARV) medications, pediatric ARVs, anti-TB medications, and antibiotics] and diagnostic test kits (2 rapid tests for HIV; 1 each for malaria and syphilis). We contrasted these to 2018-2019 data. We modeled pharmacy data using ordinal logistic regression, characterizing weekly product availability in four categories: good, adequate, shortage, or complete stockout. We found 166 (7_.7%) stockouts and 150 (6.9%) shortages among 2,160 weekly records. Earlier calendar time was associated with reduced medication supplies (p < .001). Certain medication/test kit classes were associated with reduced supply (p < .001). We found an interaction between time and medication class on the odds of reduced supply (p < .001). Pediatric ARVs had a 17.4 (95% confidence interval: 8.8-34.4) times higher odds of reduced medication supply compared with adult ARVs at study midpoint. Trends comparing the first and last weeks showed adult ARVs having 67% and pediatric having 71% lower odds of reduced supplies. Only adult ARV shortages improved amid growing demand. Data from 2018 to 2019 suggest continuing inventory management challenges. Monitoring of drug (especially pediatric) and test kit shortages is vital to ensure quality improvement to guarantee adequate supplies to enable patients and care providers to achieve sustained viral suppression. A central Mozambican drug repository in the nation's second largest Province continues to experience drug and rapid test kit stockouts.

Managerial capacity among district health managers and its association with district performance: A comparative descriptive study of six districts in the Eastern Region of Ghana

INTRODUCTION

District health managers play a pivotal role in the delivery of basic health services in many countries, including Ghana, as they are responsible for converting inputs and resources such as, staff, supplies and equipment into effective services that are responsive to population needs. Weak management capacity among local health managers has been suggested as a major obstacle for responsive health service delivery. However, evidence on district health managers' competencies and its association with health system performance is scarce.

AIM

To examine managerial capacity among district health managers and its association with health system performance in six districts in the Eastern Region of Ghana.

METHODS

Fifty-nine district health managers' in six different performing districts in the Eastern Region of Ghana completed a self-administered questionnaire measuring their management competencies and skills. In addition, the participants provided information on their socio-demographic background; previous management experience and training; the extent of available management support systems, and the dynamics within their district health management teams. A non-parametric one-way analysis was applied to test the association between management capacity and district performance, which was measured by 17 health indicators.

RESULTS

Shortcomings within different aspects of district management were identified, however there were no significant differences observed in the availability of support systems, characteristics and qualifications of district health managers across the different performing districts. Overall management capacity among district health managers were significantly higher in high performing districts compared with lower performing districts (p = 0.02). Furthermore, district health managers in better performing districts reported a higher extent of teamwork (p = 0.02), communication within their teams (p<0.01) and organizational commitment (p<0.01) compared with lower performing districts.

CONCLUSION

The findings demonstrate individual and institutional capacity needs, and highlights the importance of developing management competencies and skills as well as positive team dynamics among health managers at district level.

How Effective are Mentoring Programs for Improving Health Worker Competence and Institutional Performance in Africa? A Systematic Review of Quantitative Evidence

Introduction

Mentoring programs are frequently recommended as innovative and low-cost solutions, and these have been implemented in many healthcare institutions to tackle multiple human resource-related challenges. This review sought to locate, appraise and describe the literature reporting on mentorship programs that were designed to improve healthcare worker competence and institutional performance in Africa.

Methods

This review searched and synthesized reports from studies that assessed the effectiveness of mentorship programs among healthcare workers in Africa. We searched for studies reported in the English language in EMBASE, CINAHL, COCHRANE and MEDLINE. Additional search was conducted in Google Scholar.

Results

We included 30 papers reporting on 24 studies. Diverse approaches of mentorship were reported: a) placing a mentor in health facility for a period of time (embedded mentor), b) visits by a mobile mentor, c) a mentoring approach involving a team of mobile multidisciplinary mentors, d) facility twinning, and e) within-facility mentorship by a focal person or a manager.

Implication for practice

Mentoring interventions were effective in improving the clinical management of infectious diseases, maternal, neonatal and childhood illnesses. Mentoring interventions were also found to improve managerial performance (accounting, human resources, monitoring and evaluation, and transportation management) of health institutions. Additionally, mentoring had improved laboratory accreditation scores. Mentoring interventions may be used to increase adherence of health professionals to guidelines, standards, and protocols. While different types of interventions (embedded mentoring, visits by mobile mentors, facility twinning and within-facility mentorship by a focal person) were reported to be effective, there is no evidence to recommend one model of mentoring over other types of mentoring.

Implications for research

Further research—experimental methods measuring the impact of different mentoring formats and longitudinal studies establishing their long-term effectiveness—is required to compare the effectiveness and cost-effectiveness of different models of mentoring. Further studies are needed to explore why and how different mentoring programs succeed and the meaningfulness of mentoring programs for the different stakeholders are also required.

' It is a question of determination': a case study of monitoring and evaluation of integrated family planning services in urban areas of Togo

Background: Integrating family planning into postabortion and postpartum services can increase contraceptive use and decrease maternal and child death; however, little information exists on the monitoring and evaluation of such programs. This article draws on research completed by the EngenderHealth’s AgirPF project in three urban areas of Togo on the extent to which monitoring and evaluation systems of health services, which operated within the AgirPF project area in Togo, captured integrated family planning services.

Methods: This mixed methods case study used 25 health facility assessments with health service record review in hospitals, large community clinics, a dispensary, and private clinics and 41 key informant interviews with health faculty, individuals working at reproductive health organizations, individuals involved in reproductive health policy and politics, health care workers, and health facility directors.

Results: The study found the reporting system for health care was labor intensive and involved multiple steps for health care workers. The system lacked a standardized method to record family planning services as part of other health care at the patient level, yet the Ministry of Health required integrated family planning services to be reported on district and partner organization reporting forms. Key informants suggested improving the system by using computer-based monitoring, streamlining the reporting process to include all necessary information at the patient level, and standardizing what information is needed for the Ministry of Health and partner organizations.

Conclusion: Future research should focus on assessing the best methods for recording integrated health services and task shifting of reporting. Recommendations for future policy and programming include consolidating data for reproductive health indicators, ensuring type of information needed is captured at all levels, and reducing provider workload for reporting.

Individual factors associated with time to non-adherence to ART pick-up within HIV care and treatment services in three health facilities of Zambézia Province, Mozambique

Introduction

Mozambique has made significant gains in addressing its HIV epidemic, yet adherence to visit schedules remains a challenge. HIV programmatic gains to date could be impaired if adherence and retention to ART remains low. We investigate individual factors associated with non-adherence to ART pick-up in Mozambique.

Methods

This was a retrospective cohort of patients initiating ART between January 2013 and June 2014. Non-adherence to ART pick-up was defined as a delay in pick-up ≥ 15 days. Descriptive statistics were used to calculate socio-demographic and clinical characteristics. Adherence to ART pick-up was assessed using Kaplan Meier estimates. Cox proportional hazards model was used to determine factors associated with non-adherence.

Results

1,413 participants were included (77% female). Median age was 30.4 years. 19% of patients remained adherent to ART pick-up during the evaluation period, while 81% of patients were non-adherent to ART pick-up. Probability of being non-adherent to ART pick-up by 166 days following initiation was 50%. In univariate analysis, being widowed was associated with higher adherence to ART pick-up than other marital status groups (p = 0.01). After adjusting, being ≥35 years (aHR: 0.843, 95% CI: 0.738–0.964, p = 0.012); receiving efavirenz (aHR: 0.932, 95% CI: 0.875–0.992, p = 0.026); and being urban (aHR: 0.754, 95% CI: 0.661–0.861, p<0.0001) were associated with improved adherence. Non-participation in a Community ART Support Group (CASG) was associated with a 43% increased hazard of non-adherence to ART pick-up (aHR 1.431, 1.192–1.717, p<0.0001)

Conclusions

Interventions should focus on the first 6 months following ARV initiation for improvements. Younger persons and widows are two target groups for better understanding facilitators and barriers to visit schedule adherence. Future strategies should explore the benefits of joining CASGs earlier in one´s treatment course. Finally, greater efforts should be made to accelerate the scale-up of viral load capacity and HIV resistance monitoring.

Targeted mentoring for human immunodeficiency virus programme support in South Africa

Background

Mentoring is a required component of health systems strengthening technical assistance interventions in low- and middle-income countries (LMICs). Mentoring is useful because it does not necessarily compromise service delivery and promotes the sharing of newly acquired knowledge and skills. However, there is a lack of research on the implementation of mentoring in the context of the HIV epidemic in southern Africa.

Objectives

This qualitative evaluation focussed on understanding the implementation process of targeted mentoring for clinical practice, data management and pharmacy management, at public health care facilities in South Africa; and on identifying critical factors influencing the effectiveness of mentoring as a technical assistance intervention in this context.

Methods

Purposive sampling was used to select participants from public health facilities in three South African Provinces. Participants were invited to take part in structured interviews. Datawere analysed using thematic analysis, and two core themes were identified: mentoring as knowledge and skills transfer; and mentoring as psychosocial support.

Results

In terms of knowledge and skills transfer, the sequential implementation of proactive and reactive mentoring was critical. Initial proactive mentoring involved mentors initiating training and developing professional relationships with mentees. Thereafter, a reactive mentoring phase allowed mentees to request support when required. This enabled mentors to leverage real-world problems faced by health workers to support their implementation of new knowledge and skills. The availability and accessibility of mentors alongside the relationships between mentors and mentees provided psychosocial support for health care workers which facilitated their self-efficacy in implementing new knowledge and skills.

Conclusion

These findings suggest that the success of mentoring programmes in LMICs may require specific attention to both knowledge transfer and the management of interpersonal relationships.

District-level health management and health system performance

Strengthening district-level management may be an important lever for improving key public health outcomes in low-income settings; however, previous studies have not established the statistical associations between better management and primary healthcare system performance in such settings. To explore this gap, we conducted a cross-sectional study of 36 rural districts and 226 health centers in Ethiopia, a country which has made ambitious investment in expanding access to primary care over the last decade. We employed quantitative measure of management capacity at both the district health office and health center levels and used multiple regression models, accounting for clustering of health centers within districts, to estimate the statistical association between management capacity and a key performance indicator (KPI) summary score based on antenatal care coverage, contraception use, skilled birth attendance, infant immunization, and availability of essential medications. In districts with above median district management capacity, health center management capacity was strongly associated (p < 0.05) with KPI performance. In districts with below median management capacity, health center management capacity was not associated with KPI performance. Having more staff at the district health office was also associated with better KPI performance (p < 0.05) but only in districts with above median management capacity. The results suggest that district-level management may provide an opportunity for improving health system performance in low-income country settings.

Strengthening health district management competencies in Ghana, Tanzania and Uganda: lessons from using action research to improve health workforce performance

BACKGROUND

To achieve Universal Health Coverage (UHC), more health workers are needed; also critical is supporting optimal performance of existing staff. Integrated human resource management (HRM) strategies, complemented by other health systems strategies, are needed to improve health workforce performance, which is possible at district level in decentralised contexts. To strengthen the capacity of district management teams to develop and implement workplans containing integrated strategies for workforce performance improvement, we introduced an action-research-based management strengthening intervention (MSI). This consisted of two workshops, follow-up by facilitators and meetings between participating districts. Although often used in the health sector, there is little evaluation of this approach in middle-income and low-income country contexts. The MSI was tested in three districts in Ghana, Tanzania and Uganda. This paper reports on the appropriateness of the MSI to the contexts and its effects.

METHODS

Documentary evidence (workshop reports, workplans, diaries, follow-up visit reports) was collected throughout the implementation of the MSI in each district and interviews (50) and focus-group discussions (6) were conducted with managers at the end of the MSI. The findings were analysed using Kirkpatrick's evaluation framework to identify effects at different levels.

FINDINGS

The MSI was appropriate to the needs and work patterns of District Health Management Teams (DHMTs) in all contexts. DHMT members improved management competencies for problem analysis, prioritisation and integrated HRM and health systems strategy development. They learnt how to refine plans as more information became available and the importance of monitoring implementation. The MSI produced changes in team behaviours and confidence. There were positive results regarding workforce performance or service delivery; these would increase with repetition of the MSI.

CONCLUSIONS

The MSI is appropriate to the contexts where tested and can improve staff performance. However, for significant impact on service delivery and UHC, a method of scaling up and sustaining the MSI is required.

Improving the ability of districts in Uganda to monitor their HIV programs

BACKGROUND

Although district health teams (DHT) in Uganda are supposed to monitor and support facilities to ensure quality HIV data collection, reporting and use, they are often ill-equipped to do so. We implemented a program designed to build the capacity of districts to manage and use their own HIV-related program data and to assist facilities to collect and evaluate their own data.

METHODS

We conducted a baseline assessment of the monitoring and evaluation (M&E) capacity of 38 districts. In the 10 worst-performing districts, we identified and trained district-level staff to become M&E mentors who in turn trained and supervised facility-level staff. We collected information on action plans developed by facilities to address major issues of concern. Following the intervention, we reassessed M&E capacity of the 10 targeted districts.

RESULTS

Among the 38 districts assessed, one-half did not have a biostatistician, less than one-quarter had staff trained in the basics of M&E or data analysis, and less than one-quarter had an M&E plan. The main concerns of facilities included lack of updated data collection tools, lack of supervision, inaccurate data recording, and limited ability to analyze and use data. In the 10 targeted districts, comparison before and after the intervention showed that the number of districts with trained M&E staff increased (4 to 9), the number of M&E plans increased (3 to 6), and the number using data for programming increased (4 to 8). Implementation of action plans by facilities successfully addressed many issues and led to improved programming.

CONCLUSION

Challenges of district M&E in Uganda mainly result from a lack of skilled human resources. On-the-job training and direct involvement of district staff to provide support to facilities can lead to improvements in data quality and use.

Challenges to implementing Gavi's health system strengthening support in Chad and Cameroon: results from a mixed-methods evaluation

Background

Since 2005, Gavi has provided health system strengthening (HSS) grants to address bottlenecks affecting immunization services. This study is the first to evaluate the Gavi HSS implementation process in either Cameroon or Chad, two countries with significant health system challenges and poor achievement on the child and maternal health Millennium Development Goals.

Methods

We triangulated quantitative and qualitative data including financial records, document review, field visit questionnaires, and key informant interviews (KII) with representatives from the Ministries of Health, Gavi, and other partners. We conducted a Root Cause Analysis of key implementation challenges, guided by the Consolidated Framework for Implementation Research.

Results

We conducted 124 field visits and 43 KIIs in Cameroon, and 57 field visits and 39 KIIs in Chad. Cameroon’s and Chad’s HSS programs were characterized by delayed disbursements, significant deviations from approved expenditures, and reprogramming of funds. Nearly a year after the programs were intended to be complete, many district and facility-level activities were only partially implemented and significant funds remained unabsorbed. Root causes of these challenges included unpredictable Gavi processes and disbursements, poor communication between the countries and Gavi, insufficient country planning without adequate technical assistance, lack of country staff and leadership, and weak country systems to manage finances and promote institutional memory.

Conclusions

Though Chad and Cameroon both critically needed support to strengthen their weak health systems, serious challenges drastically limited implementation of their Gavi HSS programs. Implementation of future HSS programs in these and similar settings can be improved by transparent and reliable procedures and communication from Gavi, proposals that account for countries’ programmatic capacity and the potential for delayed disbursements, implementation practices that foster learning and adaptation, and an early emphasis on developing managerial and other human resources.

Electronic supplementary material

The online version of this article (10.1186/s12992-017-0310-0) contains supplementary material, which is available to authorized users.

Professionalizing Healthcare Management: A Descriptive Case Study

Despite international recognition of the importance of healthcare management in the development of high-performing systems, the path by which countries may develop and sustain a professional healthcare management workforce has not been articulated. Accordingly, we sought to identify a set of common themes in the establishment of a professional workforce of healthcare managers in low- and middle-income country (LMIC) settings using a descriptive case study approach. We draw on a historical analysis of the development of this profession in the United States and Ethiopia to identify five common themes in the professionalization of healthcare management: (1) a country context in which healthcare management is demanded; (2) a national framework that elevates a professional management role; (3) standards for healthcare management, and a monitoring function to promote adherence to standards; (4) a graduatelevel educational path to ensure a pipeline of well-prepared healthcare managers; and (5) professional associations to sustain and advance the field. These five components can to inform the creation of a long-term national strategy for the development of a professional cadre of heathcare managers in LMIC settings.

To what extent do site-based training, mentoring, and operational research improve district health system management and leadership in low- and middle-income countries: a systematic review protocol

BACKGROUND

District health managers play a key role in the effectiveness of decentralized health systems in low- and middle-income countries. Inadequate management and leadership skills often hamper their ability to improve quality of care and effectiveness of health service delivery. Nevertheless, significant investments have been made in capacity-building programmes based on site-based training, mentoring, and operational research. This systematic review aims to review the effectiveness of site-based training, mentoring, and operational research (or action research) on the improvement of district health system management and leadership. Our secondary objectives are to assess whether variations in composition or intensity of the intervention influence its effectiveness and to identify enabling and constraining contexts and underlying mechanisms.

METHODS

We will search the following databases: MEDLINE, PsycInfo, Cochrane Library, CRD database (DARE), Cochrane Effective Practice and Organisation of Care (EPOC) group, ISI Web of Science, Health Evidence.org, PDQ-Evidence, ERIC, EMBASE, and TRIP. Complementary search will be performed (hand-searching journals and citation and reference tracking). Studies that meet the following PICO (Population, Intervention, Comparison, Outcome) criteria will be included: P: professionals working at district health management level; I: site-based training with or without mentoring, or operational research; C: normal institutional arrangements; and O: district health management functions. We will include cluster randomized controlled trials, controlled before-and-after studies, interrupted time series analysis, quasi-experimental designs, and cohort and longitudinal studies. Qualitative research will be included to contextualize findings and identify barriers and facilitators. Primary outcomes that will be reported are district health management and leadership functions. We will assess risk of bias with the Cochrane Collaboration's tools for randomized controlled trials (RCT) and non RCT studies and Critical Appraisal Skills Programme checklists for qualitative studies. We will assess strength of recommendations with the GRADE tool for quantitative studies, and the CERQual approach for qualitative studies. Synthesis of quantitative studies will be performed through meta-analysis when appropriate. Best fit framework synthesis will be used to synthesize qualitative studies.

DISCUSSION

This protocol paper describes a systematic review assessing the effectiveness of site-based training (with or without mentoring programmes or operational research) on the improvement of district health system management and leadership.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42015032351.

Training for Better Management: Avante Zambézia, PEPFAR and Improving the Quality of Administrative Services Comment on "Implementation of a Health Management Mentoring Program: Year-1 Evaluation of Its Impact on Health System Strengthening in Zambézia Province, Mozambique"

The United States President's Emergency Plan for AIDS Relief (PEPFAR) emphasizes health systems strengthening as a cornerstone of programmatic success. Health systems strengthening, among other things, includes effective capacity building for clinical care, administrative management and public health practice. Avante Zambézia is a district-level in-service training program for administrative staff. It is associated with improved accounting practices and human resources and transportation management but not monitoring and evaluation. We discuss other examples of successful administrative training programs that vary in the proportion of time that is spent learning on the job and the proportion of time spent in classrooms. We suggest that these programs be more rigorously evaluated so that lessons learned can be generalized to other countries and regions.

Seriously Implementing Health Capacity Strengthening Programs in Africa: Comment on "Implementation of a Health Management Mentoring Program: Year-1 Evaluation of Its Impact on Health System Strengthening in Zambézia Province, Mozambique"

Faced with the challenges of healthcare reform, skills and new capabilities are needed to support the reform and it is of crucial importance in Africa where shortages affects the health system resilience. Edwards et al provides a good example of the challenge of implementing a mentoring program in one province in a sub-Saharan country. From this example, various aspects of strengthening the capacity of managers in healthcare are examined based on our experience in action-training in Africa, as mentoring shares many characteristics with action-training. What practical lessons can be drawn to promote the strengthening so that managers can better intervene in complex contexts? Deeper involvement of health authorities and more rigorous approaches are seriously desirable for the proper development of health capacity strengthening programs in Africa.