Third party monitoring for health in Afghanistan: the good, the bad and the ugly

Third party monitoring (TPM) is used in development programming to assess deliverables in a contract relationship between purchasers (donors or government) and providers (non-governmental organisations or non-state entities). In this paper, we draw from our experience as public health professionals involved in implementing and monitoring the Basic Package of Health Services (BPHS) and the Essential Package of Hospital Services (EPHS) as part of the SEHAT and Sehatmandi programs in Afghanistan between 2013 and 2021. We analyse our own TPM experience through the lens of the three parties involved: the Ministry of Public Health; the service providers implementing the BPHS/EPHS; and the TPM agency responsible for monitoring the implementation. Despite the highly challenging and fragile context, our findings suggest that the consistent investments and strategic vision of donor programmes in Afghanistan over the past decades have led to a functioning and robust system to monitor the BPHS/EPHS implementation in Afghanistan. To maximise the efficiency, effectiveness and impact of this system, it is important to promote local ownership and use of the data, to balance the need for comprehensive information with the risk of jamming processes, and to address political economy dynamics in pay-for-performance schemes. Our findings are likely to be emblematic of TPM issues in other sectors and other fragile and conflicted affected settings and offer a range of lessons learnt to inform the implementation of TPM schemes.

Lessons learned from implementing the Non-Communicable Diseases Kit in a humanitarian emergency: an operational evaluation in Sudan

Non-communicable diseases (NCDs) are a major global health concern, and their management is particularly challenging in humanitarian contexts where healthcare resources are limited. The WHO Non-Communicable Diseases Kit (WHO-NCDK) is a health system intervention targeted at the primary healthcare (PHC) level and designed to provide essential medicines and equipment for NCDs management in emergency settings, meeting the needs of 10 000 people for 3 months. This operational evaluation aimed to assess the effectiveness and utility of the WHO-NCDK in two PHC facilities in Sudan and identify key contextual factors that may influence its implementation and impact. Using a cross-sectional mixed-methods observational approach that combined quantitative and qualitative data, the evaluation found that the kit played a critical role in maintaining continuity of care when other supply chain solutions were disrupted. However, contextual factors such as local communities' unfamiliarity with healthcare facilities, the national integration of NCDs into PHC, and the existence of monitoring and evaluation systems were identified as important considerations for enhancing the WHO-NCDK's utility and usefulness. The evaluation suggests that the WHO-NCDK can be an effective intervention in emergency settings, provided that contextual factors such as local needs, facility capacity and healthcare worker capacity are considered before kit deployments.

Addressing the challenges of implementing evidence-based prioritisation in global health

Global health requires evidence-based approaches to improve health and decrease inequalities. In a roundtable discussion between health practitioners, funders, academics and policy-makers, we recognised key areas for improvement to deliver better-informed, sustainable and equitable global health practices. These focus on considering information-sharing mechanisms and developing evidence-based frameworks that take an adaptive function-based approach, grounded in the ability to perform and respond to prioritised needs. Increasing social engagement as well as sector and participant diversity in whole-of-society decision-making, and collaborating with and optimising on hyperlocal and global regional entities, will improve prioritisation of global health capabilities. Since the skills required to navigate drivers of pandemics, and the challenges in prioritising, capacity building and response do not sit squarely in the health sector, it is essential to integrate expertise from a broad range of fields to maximise on available knowledge during decision-making and system development. Here, we review the current assessment tools and provide seven discussion points for how improvements to implementation of evidence-based prioritisation can improve global health.

Geographic prioritisation in Kenya and Uganda: a power analysis of donor transition

Introduction Donor transition for HIV/AIDS programmes remains sensitive, marking a significant shift away from the traditional investment model of large-scale, vertical investments to control the epidemic and achieve rapid scaling-up of services. In late 2015, the United States President's Emergency Plan for AIDS Relief (PEPFAR) headquarters instructed their country missions to implement 'geographic prioritisation' (GP), whereby PEPFAR investments would target geographic areas with high HIV burden and reduce or cease support in areas with low burden.Methods Using Gaventa's power cube framework, we compare how power is distributed and manifested using qualitative data collected in an evaluation of the GP's impact in Kenya and Uganda.Results We found that the GP was designed with little space for national and local actors to shape either the policy or its implementation. While decision-making processes limited the scope for national-level government actors to shape the GP, the national government in Kenya claimed such a space, proactively pressuring PEPFAR to change particular aspects of its GP plan. Subnational level actors were typically recipients of top-down decision-making with apparently limited scope to resist or change GP. While civil society had the potential to hold both PEPFAR and government actors accountable, the closed-door nature of policy-making and the lack of transparency about decisions made this difficult.Conclusion Donor agencies should exercise power responsibly, especially to ensure that transition processes meaningfully engage governments and others with a mandate for service delivery. Furthermore, subnational actors and civil society are often better positioned to understand the implications and changes arising from transition. Greater transparency and accountability would increase the success of global health programme transitions, especially in the context of greater decentralisation, requiring donors and country counterparts to be more aware and flexible of working within political systems that have implications for programmatic success.

Measuring experience of and satisfaction with newborn care: a scoping review of tools and measures

BACKGROUND

Standardised measures on experience of care are essential to understanding the care women and newborns receive and to designing appropriate interventions and responses. This review builds on ongoing work in the realm of maternity care and complements it by reviewing existing tools and measures to assess experience of and satisfaction with the care of the newborn.

METHODS

We conducted a scoping review of published literature to identify measures and tools of experience (physiological or indirect) and satisfaction with newborn care. We systematically searched five bibliographic databases from 1 January 2010 through 1 December 2022 and contacted professional networks. Using a predefined evidence template, we extracted data on the studies and the tools' characteristics. We mapped the tools and measures against the WHO quality of care frameworks to identify the most frequent measured domains of care and to highlight existing gaps.

RESULT

We identified 18 292 records of which 72 were eligible. An innovative finding of this review is the inclusion of newborn perspectives through behavioural responses, physiological signals, pain profiles as well as other non-verbal cues as markers of newborn experience. Domains related to parental participation and decision-making, ensuring continuity of care and receiving coordinated care, were the most measured across the included tools.

CONCLUSION

Comprehensive and validated instruments measuring all aspects of care are needed. Developing a robust theoretical ground will be fundamental to the design and utilisation of standardised tools and measures.

PROTOCOL REGISTRATION DETAILS

This review was registered and published on protocol.io (dx.doi.org/10.17504/protocols.io.bvk7n4zn).

The resilience of two departmental health insurance units during the COVID-19 pandemic in Senegal

BACKGROUND

In its pursuit of solutions for universal health coverage (UHC), Senegal has set up two departmental health insurance units (UDAMs) since 2014. Few studies on the resilience of health systems in Africa have examined health insurance organisations. This article aims to understand how these two UDAMs have been resilient during the COVID-19 pandemic and the restrictive measures imposed by the State to maintain services to their members and reimbursements to healthcare providers.

METHODS

This study was a multicase study with multiple levels of analysis using a conceptual framework of resilience and analysis of organisational configurations. Empirical data are derived from document analysis, observations for 6 months and 17 qualitative in-depth interviews.

RESULTS

The results identified three main configurations concerning (1) safety and hygiene, (2) organisation and planning and (3) communication for sustainable payment. The UDAM faced the pandemic with resilience processes to absorb the shock and maintain service to their members. The UDAM learnt positive lessons from crisis management, such as remote work or the ability to support members in their care in hospitals away from their headquarters. They have innovated (transformative resilience) with the organisation of electronic payment and the use of social networks to raise funds and communicate with members. Strengthening their effectiveness after the shock of the departure of the donors in 2017 contributed to the adaptation and even transformation from the pandemic shock of 2020 and 2021. The study shows that leadership, team dynamics and adaptation to contexts are drivers of resilience processes.

CONCLUSION

Both UDAMs adapted to the shocks of the pandemic and government measures to maintain the services of their members and their organisational routine. This resilience confirms that UDAMs are one of the possible solutions for UHC in the Sahel.

Tracking progress towards universal health coverage for essential health services in China, 2008-2018

INTRODUCTION

We comprehensively evaluate whether the Chinese Government's goal of ensuring Universal Health Coverage for essential health services has been achieved.

METHODS

We used data from the 2008, 2013 and 2018 National Health Services Survey to report on the coverage of a range of Sustainable Development Goals (SDG) indicator 3.8.1. We created per capita household income deciles for urban and rural samples separately. We report time trends in coverage and the slope index (SII) and relative index (RII).

RESULTS

Despite much lower levels of income and education, rural populations made as much progress as their urban counterparts for most interventions. Coverage of maternal and child health interventions increased substantially in urban and rural areas, with decreasing rich-poor inequalities except for antenatal care. In rural China, one-fifth women could not access 5 or more antenatal visits. Coverage of 8 or more visits were 34% and 68%, respectively in decile D1 (the poorest) and decile D10 (the richest) (SII 35% (95% CI 22% to 48%)). More than 90% households had access to clean water, but basic sanitation was poor for rural households and the urban poorest, presenting bottom inequality. Effective coverage for non-communicable diseases was low. Medication for hypertension and diabetes were relatively high (>70%). But adequate management, counting in preventive interventions, were much lower and decreased overtime, although inequalities were small in size. Screening of cervical and breast cancer was low in both urban and rural areas, seeing no progress overtime. Cervical cancer screening was only 29% (urban) and 24% (rural) in 2018, presenting persisted top inequalities (SII 25% urban, 14% rural).

CONCLUSION

China has made commendable progress in protecting the poorest for basic care. However, the 'leaving no one behind' agenda needs a strategy targeting the entire population rather than only the poorest. Blunt investing in primary healthcare facilities seems neither effective nor efficient.

Building a network of sentinel centres for the care of women in an abortion situation: advances in Latin America and the Caribbean

Previous reports have already estimated the overall number of abortions and the number of unsafe abortions in Latin America. Conversely, there are few reliable data from this region to inform public policies aiming to meet women’s needs. In this context, the Latin American Centre of Perinatology (Centro Latinoamericano de Perinatología (CLAP)) created a network specialising in the care of women in an abortion situation (CLAP MUSA-Network) in an attempt to strengthen healthcare surveillance in Latin America by using the Perinatal Information System (Sistema Informático Perinatal (SIP)). This system was developed by the CLAP with a special module named SIP Abortion (SIP-A), a data collection tool designed by Latin American experts to be routinely used in cases of legal and incomplete abortions. The SIP-A follows the standards established by WHO, allowing investigators to systematise information, generate local reports and monitor changes after training and follow-up interventions based on national guidelines. This network promotes collaborative work between institutions to strengthen epidemiological surveillance, cooperative investigation and development of a critical mass of professionals skilled in sexual and reproductive health. Currently, 29 sentinel centres from 13 countries jointly work exchanging information to improve surveillance of healthcare indicators of women in an abortion situation. Latin America was the first region in the world to have a network of sentinel centres that continuously monitors healthcare provision to these women. Data collected by this network are already being used to design, implement and evaluate public policies.

The need for standardised methods of data collection, sharing of data and agency coordination in humanitarian settings

Humanitarian crises and emergencies are prevalent all over the world. With a surge in crises in the last decade, humanitarian agencies have increased their presence in these areas. Initiatives such as the Sphere Project and the Minimum Initial Service Package known as MISP were formed to set standards and priorities for humanitarian assistance agencies. MISP was initiated to coordinate and standardise data and collection methods and involve locals for programme sustainability. Developing policies and programmes based on available data in humanitarian crises is necessary to make evidence-based decisions. Data sharing between humanitarian agencies increases the effectiveness of rapid responses and limits duplication of services and research. In addition, standardising data collection methods helps alleviate the risk of inaccurate information and allows for comparison and estimates among different settings. Big data is a new collection method that can help assemble timely data if resources are available and turn the data into information. Further research on setting priority indicators for humanitarian situations can help guide agencies to collect quality data.

‘We are the bridge’: an implementation research study of SEWA Shakti Kendras to improve community engagement in publicly funded health insurance in Gujarat, India

Introduction

India’s efforts towards universal health coverage include a national health insurance scheme that aims to protect the most vulnerable from catastrophic health expenditure. However, emerging evidence on publicly funded health insurance, as well as experience from community-based schemes, indicates that women face specific barriers to access and utilisation. Community engagement interventions have been shown to improve equitable utilisation of public health services, but there is limited research specific to health insurance. We examined how existing community-based resource centres implemented by a women’s organisation could improve women’s access to, and utilisation of, health insurance.

Methods

We conducted an implementation research study in Gujarat, India to examine how SEWA Shakti Kendras, established by the Self-Employed Women’s Association, worked to improve community engagement in health insurance. SEWA organises women in the informal sector and provides social protection through health, insurance and childcare services. We examined administrative data, programme reports and conducted 30 in-depth qualitative interviews with users and staff. Data were analysed thematically to examine intervention content, context, and implementation processes and to identify enablers and barriers to improving women’s access to health insurance through SEWA’s community engagement approach.

Results

The centres worked through multiple channels—doorstep services, centre-based support and health system navigation—to strengthen women’s capability to access health insurance. Each centre’s approach varied by contextual factors, such as women’s digital literacy levels and rural–urban settings. Effective community engagement required local leadership, strong government partnerships and the flexibility to address a range of public services, with implementation by trusted local health workers.

Conclusion

SEWA Shakti Kendras demonstrate how a local, flexible and community-based model can serve as a bridge to improve utilisation of health insurance, by engaging women and their households through multiple channels. Scaling up this approach will require investing in partnerships with community-based organisations as part of strategies towards universal health coverage.

Consumer choice and public-private providers: The role of perceived prices

Governments often encourage health service providers to improve quality of care and reduce prices through competition. The efficacy of competition hinges on the assumption that consumers demand high quality care at low prices for any given health condition. In this paper, we examine this assumption by investigating the role of perceived price and quality on consumer choice for four different health conditions across public and private providers. We use a nationally representative survey in Malaysia to elicit respondents' perception on prices and quality, and their preferred choice of provider. We estimate a mixed logit model and show that consumers value different dimensions of quality depending on the health condition. Furthermore, increasing perceived prices for private providers reduces demand for minor, more frequent health conditions such as flu fever or cough, but increases demand for more complex, severe conditions such as coronary artery bypass graft. These findings provide empirical support for price regulation which differentiates the severity of underlying health conditions.

Learning health systems in low-income and middle-income countries: exploring evidence and expert insights

Introduction

Learning health systems (LHS) is a multifaceted subject. This paper reviewed current concepts as well as real-world experiences of LHS, drawing on published and unpublished knowledge in order to identify and describe important principles and practices that characterise LHS in low/middle-income country (LMIC) settings.

Methods

We adopted an exploratory approach to the literature review, recognising there are limited studies that focus specifically on system-wide learning in LMICs, but a vast set of connected bodies of literature. 116 studies were included, drawn from an electronic literature search of published and grey literature. In addition, 17 interviews were conducted with health policy and research experts to gain experiential knowledge.

Results

The findings were structured by eight domains on learning enablers. All of these interact with one another and influence actors from community to international levels.

We found that learning comes from the connection between information, deliberation, and action. Moreover, these processes occur at different levels. It is therefore important to consider experiential knowledge from multiple levels and experiences. Creating spaces and providing resources for communities, staff and managers to deliberate on their challenges and find solutions has political implications, however, and is challenging, particularly when resources are constrained, funding and accountability are fragmented and the focus is short-term and narrow. Nevertheless, we can learn from countries that have managed to develop institutional mechanisms and human capacities which help health systems respond to changing environments with ‘best fit’ solutions.

Conclusion

Health systems are knowledge producers, but learning is not automatic. It needs to be valued and facilitated. Everyday governance of health systems can create spaces for reflective practice and learning within routine processes at different levels. This article highlights important enablers, but there remains much work to be done on developing this field of knowledge.

Can digitally enabling community health and nutrition workers improve services delivery to pregnant women and mothers of infants? Quasi-experimental evidence from a national-scale nutrition programme in India

Background

India’s 1.4 million community health and nutrition workers (CHNWs) serve 158 million beneficiaries under the Integrated Child Development Services (ICDS) programme. We assessed the impact of a data capture, decision support, and job-aid mobile app for the CHNWs on two primary outcomes—(1) timeliness of home visits and (2) appropriate counselling specific to the needs of pregnant women and mothers of children <12 months.

Methods

We used a quasi-experimental pair-matched controlled trial using repeated cross-sectional surveys to evaluate the intervention in Bihar and Madhya Pradesh (MP) separately using an intention-to-treat analysis. The study was powered to detect difference of 5–9 percentage points (pp) with type I error of 0.05 and type II error of 0.20 with endline sample of 6635 mothers of children <12 months and 2398 pregnant women from a panel of 841 villages.

Results

Among pregnant women and mothers of children <12 months, recall of counselling specific to the trimester of pregnancy or age of the child as per ICDS guidelines was higher in both MP (11.5pp (95% CI 7.0pp to 16.0pp)) and Bihar (8.0pp (95% CI 5.3pp to 10.7pp)). Significant differences were observed in the proportion of mothers of children <12 months receiving adequate number of home visits as per ICDS guidelines (MP 8.3pp (95% CI 4.1pp to 12.5pp), Bihar: 7.9pp (95% CI 4.1pp to 11.6pp)). Coverage of children receiving growth monitoring increased in Bihar (22pp (95% CI 0.18 to 0.25)), but not in MP. No effects were observed on infant and young child feeding practices.

Conclusion

The at-scale app integrated with ICDS improved provision of services under the purview of CHNWs but not those that depended on systemic factors, and was relatively more effective when baseline levels of services were low. Overall, digitally enabling CHNWs can complement but not substitute efforts for strengthening health systems and addressing structural barriers.

Trial registration number

ISRCTN83902145.

The impact of institutional delivery on neonatal and maternal health outcomes: evidence from a road upgrade programme in India

INTRODUCTION

Persistently high rates of neonatal and maternal mortality have been associated with home births in many low-income and middle-income countries (LMICs). However, causal evidence of the effect of institutional deliveries on neonatal and maternal health outcomes is limited in these settings.

METHODS

We investigate the effect of institutional deliveries on neonatal mortality and maternal postpartum complications in rural India using data from the 2015-2016 Indian Demographic and Health Survey and an instrumental variable methodology to overcome selection bias issues inherent in observational studies. Specifically, we exploit plausibly exogenous variation in exposure to a road upgrade programme that quasi-randomly upgraded roads to villages across India.

RESULTS

We find large effects of the road construction programme on the probability that a woman delivered in a health facility: moving from an unconnected village to a connected village increased the probability of an institutional delivery by 13 percentage points, with the biggest increases in institutional delivery observed in public hospitals and among women with lower levels of education and from poorer households. However, we find no evidence that increased institutional delivery rates improved rates of neonatal mortality or postpartum complications, regardless of whether the delivery occurred in a public or private facility, or if it was with a skilled birth attendant.

CONCLUSION

Policies that encourage institutional delivery do not always translate into increased health outcomes and should thus be complemented with efforts to improve the quality of care to improve neonatal and maternal health outcomes in LMICs.

The global health workforce stock and distribution in 2020 and 2030: a threat to equity and 'universal' health coverage?

Objective

The 2016 Global Strategy on Human Resources for Health: Workforce 2030 projected a global shortage of 18 million health workers by 2030. This article provides an assessment of the health workforce stock in 2020 and presents a revised estimate of the projected shortage by 2030.

Methods

Latest data reported through WHO’s National Health Workforce Accounts (NHWA) were extracted to assess health workforce stock for 2020. Using a stock and flow model, projections were computed for the year 2030. The global health workforce shortage estimation was revised.

Results

In 2020, the global workforce stock was 29.1 million nurses, 12.7 million medical doctors, 3.7 million pharmacists, 2.5 million dentists, 2.2 million midwives and 14.9 million additional occupations, tallying to 65.1 million health workers. It was not equitably distributed with a 6.5-fold difference in density between high-income and low-income countries. The projected health workforce size by 2030 is 84 million health workers. This represents an average growth of 29% from 2020 to 2030 which is faster than the population growth rate (9.7%). This reassessment presents a revised global health workforce shortage of 15 million health workers in 2020 decreasing to 10 million health workers by 2030 (a 33% decrease globally). WHO African and Eastern Mediterranean regions’ shortages are projected to decrease by only 7% and 15%, respectively.

Conclusions

The latest NHWA data show progress in the increasing size of the health workforce globally as more jobs are and will continue to be created in the health economy. It however masks considerable inequities, particularly in WHO African and Eastern Mediterranean regions, and alarmingly among the 47 countries on the WHO Support and Safeguards List. Progress should be acknowledged with caution considering the immeasurable impact of COVID-19 pandemic on health workers globally.

Impact of the DREAMS Partnership on social support and general self-efficacy among adolescent girls and young women: causal analysis of population-based cohorts in Kenya and South Africa

INTRODUCTION

The Determined, Resilient, Empowered, AIDS-free, Mentored and Safe (DREAMS) Partnership aimed to influence psychosocial processes that promote empowerment among adolescent girls and young women (AGYW), and reduce HIV incidence. We estimated the impact of DREAMS on aspects of AGYW's collective and individual agency (specifically, social support and self-efficacy), in three settings where DREAMS was implemented from 2016 until at least end 2018.

METHODS

Research cohorts of ~1500 AGYW aged 13-22 were randomly selected from demographic platforms in Kenya (Nairobi; Gem) and South Africa (uMkhanyakude) and followed up from 2017 to 2019. Social support was based on questions about female networks and access to safe places to meet with peers; general self-efficacy was measured using a scale previously validated in other settings. We conducted multivariable logistic regression, and estimated the causal effect of invitation to DREAMS on each outcome in 2018 and 2019 by comparing counter-factual scenarios in which all, vs no, AGYW were DREAMS invitees.

RESULTS

In Nairobi, Gem and uMkhanyakude, respectively, 74%, 57% and 53% were invited to DREAMS by 2018. Social support was higher among DREAMS invitees versus non-invitees (eg, adjusted OR 2.0 (95% CI 1.6 to 2.6), Gem, 2018). In 2018, DREAMS increased social support in all settings and age groups, for example, from 28% if none were DREAMS invitees to 43% if all were invitees (+15% (95% CI 10% to 20%)) in Gem. Effects were strongest in Kenya, but weakened in 2019, particularly among older AGYW. In uMkhanyakude, DREAMS invitees had greater self-efficacy compared with non-invitees in 2018 (+9% (95% CI 3% to 13%), 2018) but less so in 2019. In Kenyan settings, there was weak evidence for impact on self-efficacy among younger AGYW in Gem (+6% (95% CI 0% to 13%)) and older AGYW in Nairobi (+9% (95% CI -3% to +20%)) in 2019.

CONCLUSIONS

DREAMS impacted on social support and, less consistently, on self-efficacy. Weakening effects over time may reflect changes in access to safe spaces and social networks as AGYW age and change circumstances, and withdrawal of DREAMS from uMkhanyakude in 2018, highlighting the importance of programme sustainability and improving programming for older participants.

Clinical research on COVID-19: perceptions and barriers to participation in The Gambia

INTRODUCTION

The need to rapidly identify safe and efficacious drug therapies for COVID-19 has resulted in the implementation of multiple clinical trials investigating potential treatment options. These are being undertaken in an unprecedented research environment and at a higher speed than ever before. It is unclear how West African communities perceive such activities and how such perceptions influence participation in COVID-19 clinical trials. This qualitative study was conducted to assess the level of acceptability of a clinical trial on the prevention and treatment of COVID-19 in The Gambia and identify strategies to better engage communities in participating in such a trial.

METHODS

Data were collected using digitally recorded semistructured interviews (SSIs) and focus group discussions (FGDs) in Brikama and Kanifing local government areas. These are two of the most densely populated administrative subdivisions in The Gambia, where the clinical trial was to be implemented by the MRC Unit The Gambia. 26 men and 22 women aged between 19 and 70 years, with diverse socioeconomic profiles, participated in 8 FGDs (n=36) and 12 SSIs (n=12). Thematic analysis was used to analyse the data.

RESULTS

Fear of stigmatisation of patients with COVID-19 was a recurring theme in most FGDs and SSIs, with detrimental effects on willingness to accept COVID-19 testing and home visits to follow up patients with COVID-19 and their household contacts. Preserving the privacy of individuals enrolled in the study was key to potentially increase trial participation. Trust in the implementing institution and its acknowledged expertise were facilitators to accepting the administration of investigational products to sick individuals and their close contacts.

CONCLUSION

COVID-19 is a stigmatising disease. Developing a research-participant collaboration through an ongoing engagement with community members is crucial to a successful enrolment in COVID-19 clinical trials. Trust and acknowledged expertise of the implementing institution are key facilitators to foster such collaboration.

Improving maternal and child health in Pakistan: a programme evaluation using a difference in difference analysis

Introduction

Pakistan is a country with high maternal and infant mortality. Several large foreign funded projects were targeted at improving maternal, neonatal and child health. The Norway-Pakistan Partnership Initiative (NPPI) was one of these projects. This study aims to evaluate whether NPPI was successful in improving access and use of skilled maternal healthcare.

Methods

We used data from three rounds (2009–2010, 2011–2012 and 2013–2014) of the Pakistan Social and Living Standards Measurement Survey (PSLM). A difference-in-difference regression framework was used to estimate the effectiveness of NPPI and its different programme components with respect to maternal healthcare seeking behaviour of pregnant women. Various parts of the PSLM were combined to examine the healthcare seeking behaviour response of pregnant women to exposure to NPPI.

Results

Trends in maternal care seeking behaviour of pregnant women were similar in districts exposed to NPPI and control districts. Consequently, only a weak and insignificant impact of NPPI on maternal care seeking behaviour was found. However, women in districts which used vouchers or which implemented contracting were more likely to seek skilled assistance with their delivery.

Conclusion

We conclude that the objective to improve access to and use of skilled care was not achieved by NPPI. The small effects identified for vouchers and contracts on skilled birth attendance hold some promise for further experimentation.

Effectiveness of a large-scale home visiting programme (PIM) on early child development in Brazil: quasi-experimental study nested in a birth cohort

BACKGROUND

A large-scale parenting programme with weekly home visits (Primeira Infância Melhor (PIM)) has been implemented in the south of Brazil for nearly two decades, but lacks evaluation of its effects on early childhood development (ECD). This quasi-experimental study aimed to assess the effects of PIM in real-life settings within a population-based birth cohort study.

METHODS

Data from the 2015 Pelotas Birth Cohort Study and the state programme information system were linked to identify study children who received PIM. Propensity score matching was used to create a comparable control group (using one-to-one matching) to estimate the effect of PIM on ECD measured at age 4 years. First, the impact of any enrolment in PIM was evaluated; then the intervention group was stratified according to whether enrolment occurred during pregnancy or after birth. Double adjustment was applied in linear regression to analyse child development scores, and Poisson regression for delayed development (below the 10th percentile of whole cohort). Effect modification due to family income was explored.

RESULTS

There was no evidence that any enrolment in PIM (601 pairs) by age 4 years was associated with child development. However, PIM starting during pregnancy (estimated for 121 pairs) predicted higher development scores (0.27 SD; 95% CI 0.02 to 0.52), and 71% lower prevalence of delayed development (prevalence ratio=0.29; 95% CI 0.13 to 0.69), compared with the control group. There was strong statistical evidence (p=0.003, test of interaction) that the effect of PIM starting in pregnancy was larger than when starting after birth (480 pairs). The effect of PIM starting during pregnancy was found to be restricted to poorer families.

CONCLUSIONS

In a real-life setting, PIM was effective only when starting during pregnancy and only for poorer families. A higher-quality programme might be more effective with a broader population.

Analysing COVID-19 outcomes in the context of the 2019 Global Health Security (GHS) Index

Introduction

The Global Health Security Index benchmarks countries’ capacities to carry out the functions necessary to prevent, detect and respond to biological threats. The COVID-19 pandemic served as an opportunity to evaluate whether the Index contained the correct array of variables that influence countries’ abilities to respond to these threats; assess additional variables that may influence preparedness; and examine how the impact of preparedness components change during public health crises.

Methods

Linear regression models were examined to determine the relationship between excess mortality per capita for the first 500 days of countries’ COVID-19 pandemic and internal Index variables, as well as external variables including social cohesion; island status; perceived corruption; elderly population size; previous epidemic experience; stringency of non-pharmaceutical interventions; and social and political polarisation.

Results

COVID-19 outcomes were significantly associated with sociodemographic, political and governance variables external to the 2019 Index: social cohesion, reduction in social polarisation and reduced perceptions of corruption were consistently correlated with reduced excess mortality throughout the pandemic. The association of other variables assessed by the Index, like epidemiological workforce robustness, changed over time. Fixed country features, including geographic connectedness, larger elderly population and lack of prior coronavirus outbreak experience were detrimental to COVID-19 outcomes. Finally, there was evidence that countries that lacked certain capacities were able to develop these over the course of the pandemic.

Conclusions

Additional sociodemographic, political and governance variables should be included in future indices to improve their ability to characterise preparedness. Fixed characteristics, while not directly addressable, are useful for establishing countries’ inherent risk profile and can motivate those at greater risk to invest in preparedness. Particular components of preparedness vary in their impact on outcomes over the course of the pandemic, which may inform resource direction during ongoing crises. Future research should seek to further characterise time-dependent impacts as additional COVID-19 outcome data become available.

Improving Health in Slums Collaborative. Inequity of healthcare access and use and catastrophic health spending in slum communities: a retrospective, cross-sectional survey in four countries

Introduction

Tracking the progress of universal health coverage (UHC) is typically at a country level. However, country-averages may mask significant small-scale variation in indicators of access and use, which would have important implications for policy choice to achieve UHC.

Methods

We conducted a retrospective cross-sectional household and individual-level survey in seven slum sites across Nigeria, Kenya, Bangladesh and Pakistan. We estimated the adjusted association between household capacity to pay and report healthcare need, use and spending. Catastrophic health expenditure was estimated by five different methods.

Results

We surveyed 7002 households and 6856 adults. Gini coefficients were wide, ranging from 0.32 to 0.48 across the seven sites. The total spend of the top 10% of households was 4–47 times more per month than the bottom 10%. Households with the highest budgets were: more likely to report needing care (highest vs lowest third of distribution of budgets: +1 to +31 percentage points (pp) across sites), to spend more on healthcare (2.0 to 6.4 times higher), have more inpatient and outpatient visits per year in five sites (1.0 to 3.0 times more frequently), spend more on drugs per visit (1.1 to 2.2 times higher) and were more likely to consult with a doctor (1.0 to 2.4 times higher odds). Better-off households were generally more likely to experience catastrophic health expenditure when calculated according to four methods (−1 to +12 pp), but much less likely using a normative method (−60 to −80 pp).

Conclusions

Slums have a very high degree of inequality of household budget that translates into inequities in the access to and use of healthcare. Evaluation of UHC and healthcare access interventions targeting these areas should consider distributional effects, although the standard measures may be unreliable.

A guide to systems-level, participatory, theory-informed implementation research in global health

Implementation research is a multidisciplinary field that addresses the complex phenomenon of how context influences our ability to deliver evidence-informed healthcare. There is increasing realisation of the importance of applying robust implementation research to scale-up life-saving interventions that meet health-related sustainable development goals. However, the lack of high-quality implementation research is impeding our ability to meet these targets, globally. Within implementation research, theory refers to the proposed hypothesis and/or explanation of how an intervention is expected to interact with the local context and actors to bring about change. Although there is increasing interest in applying theory to understand how and why implementation programmes work in real-world settings, global health actors still tend to favour impact evaluations conducted in controlled environments. This may, in part, be due to the relative novelty as well as methodological complexity of implementation research and the need to draw on divergent disciplines, including epidemiology, implementation science and social sciences. Because of this, implementation research is faced with a particular set of challenges about how to reconcile different ways of thinking and constructing knowledge about healthcare interventions. To help translate some of the ambiguity surrounding how divergent theoretical approaches and methods contribute to implementation research, we draw on our multidisciplinary expertise in the field, particularly in global health. We offer an overview of the different theoretical approaches and describe how they are applied to continuously select, monitor and evaluate implementation strategies throughout the different phases of implementation research. In doing so, we offer a relatively brief, user-focused guide to help global health actors implement and report on evaluation of evidence-based and scalable interventions, programmes and practices.

Long-term effects of payment for performance on maternal and child health outcomes: evidence from Tanzania

BACKGROUND

The success of payment for performance (P4P) schemes relies on their ability to generate sustainable changes in the behaviour of healthcare providers. This paper examines short-term and longer-term effects of P4P in Tanzania and the reasons for these changes.

METHODS

We conducted a controlled before and after study and an embedded process evaluation. Three rounds of facility, patient and household survey data (at baseline, after 13 months and at 36 months) measured programme effects in seven intervention districts and four comparison districts. We used linear difference-in-difference regression analysis to determine programme effects, and differential effects over time. Four rounds of qualitative data examined evolution in programme design, implementation and mechanisms of change.

RESULTS

Programme effects on the rate of institutional deliveries and antimalarial treatment during antenatal care reduced overtime, with stock out rates of antimalarials increasing over time to baseline levels. P4P led to sustained improvements in kindness during deliveries, with a wider set of improvements in patient experience of care in the longer term. A change in programme management and funding delayed incentive payments affecting performance on some indicators. The verification system became more integrated within routine systems over time, reducing the time burden on managers and health workers. Ongoing financial autonomy and supervision sustained motivational effects in those aspects of care giving not reliant on funding.

CONCLUSION

Our study adds to limited and mixed evidence documenting how P4P effects evolve over time. Our findings highlight the importance of undertaking ongoing assessment of effects over time.

The Improving Global Health Programme - leadership development in the NHS through overseas placement

The Improving Global Health (IGH) programme develops leadership capacity within the National Health Service (NHS) in a novel way. NHS employees collaboratively run quality improvement projects within organisations in low-income and middle-income countries with whom long-standing healthcare partnerships have been built. Leadership behaviours are developed through theoretical and experiential learning, alongside induction and mentorship. The health systems of overseas partners are strengthened through projects that align with local priorities. This article develops solutions to two main problems: how reciprocal global health programmes can be designed and how global health programmes based in leadership can attract women and black and minority ethnic groups into leadership. The outcomes of both sides of the IGH programme are described here. The overseas perspective is described using the reflections of two current partners, highlighting improvements in the local healthcare system and demonstrating growth in local team members. The UK perspective is evaluated using two surveys sent to different groups of returned IGH participants. Leadership, global health and quality improvement skills improve, having a significant and long-lasting impact on career trajectory. The IGH programme is attracting women and black and minority ethnic groups into leadership. Through collaboration and reciprocity, the IGH programme is developing a new cadre of NHS leader that is diverse and inclusive. The use of long-standing healthcare partnerships ensures that learning is shared and growth is mutual, creating development within the overseas and UK partner alike.

Association between ambulance prehospital time and maternal and perinatal outcomes in Sierra Leone: a countrywide study

INTRODUCTION

Sierra Leone, one of the countries with the highest maternal and perinatal mortality in the world, launched its first National Emergency Medical Service (NEMS) in 2018. We carried out a countrywide assessment to analyse NEMS operational times for obstetric emergencies in respect the access to timely essential surgery within 2 hours. Moreover, we evaluated the relationship between operational times and maternal and perinatal mortality.

METHODS

We collected prehospital data of 6387 obstetric emergencies referrals from primary health units to hospital facilities between June 2019 and May 2020 and we estimated the proportion of referrals with a prehospital time (PT) within 2 hours. The association between PT and mortality was investigated using Poisson regression models for binary data.

RESULTS

At the national level, the proportion of emergency obstetric referrals with a PT within 2 hours was 58.5% (95% CI 56.9% to 60.1%) during the rainy season and 61.4% (95% CI 59.5% to 63.2%) during the dry season. Results were substantially different between districts, with the capital city of Freetown reporting more than 90% of referrals within the benchmark and some rural districts less than 40%. Risk of maternal death at 60, 120 and 180 min of PT was 1.8%, 3.8% and 4.3%, respectively. Corresponding figures for perinatal mortality were 16%, 18% and 25%.

CONCLUSION

NEMS operational times for obstetric emergencies in Sierra Leone vary greatly and referral transports in rural areas struggle to reach essential surgery within 2 hours. Maternal and perinatal risk of death increased concurrently with operational times, even beyond the 2-hour target, therefore, any reduction of the time to reach the hospital, may translate into improved patient outcomes.

Assessing the quality of care for children attending health facilities: a systematic review of assessment tools

INTRODUCTION

Assessing quality of healthcare is integral in determining progress towards equitable health outcomes worldwide. Using the WHO 'Standards for improving quality of care for children and young adolescents in health facilities' as a reference standard, we aimed to evaluate existing tools that assess quality of care for children.

METHODS

We undertook a systematic literature review of publications/reports between 2008 and 2020 that reported use of quality of care assessment tools for children (<15 years) in health facilities. Identified tools were reviewed against the 40 quality statements and 510 quality measures from the WHO Standards to determine the extent each tool was consistent with the WHO Standards. The protocol was registered in PROSPERO ID: CRD42020175652.

RESULTS

Nine assessment tools met inclusion criteria. Two hospital care tools developed by WHO-Europe and WHO-South-East Asia Offices had the most consistency with the WHO Standards, assessing 291 (57·1%) and 208 (40·8%) of the 510 quality measures, respectively. Remaining tools included between 33 (6·5%) and 206 (40·4%) of the 510 quality measures. The WHO-Europe tool was the only tool to assess all 40 quality statements. The most common quality measures absent were related to experience of care, particularly provision of educational, emotional and psychosocial support to children and families, and fulfilment of children's rights during care.

CONCLUSION

Quality of care assessment tools for children in health facilities are missing some key elements highlighted by the WHO Standards. The WHO Standards are, however, extensive and applying all the quality measures in every setting may not be feasible. A consensus of key indicators to monitor the WHO Standards is required. Existing tools could be modified to include priority indicators to strengthen progress reporting towards delivering quality health services for children. In doing so, a balance between comprehensiveness and practical utility is needed.

PROSPERO REGISTRATION NUMBER

CRD42020175652.

Disruption in essential health services in Mexico during COVID-19: an interrupted time series analysis of health information system data

INTRODUCTION

The COVID-19 pandemic has disrupted health systems around the world. The objectives of this study are to estimate the overall effect of the pandemic on essential health service use and outcomes in Mexico, describe observed and predicted trends in services over 24 months, and to estimate the number of visits lost through December 2020.

METHODS

We used health information system data for January 2019 to December 2020 from the Mexican Institute of Social Security (IMSS), which provides health services for more than half of Mexico's population-65 million people. Our analysis includes nine indicators of service use and three outcome indicators for reproductive, maternal and child health and non-communicable disease services. We used an interrupted time series design and linear generalised estimating equation models to estimate the change in service use and outcomes from April to December 2020. Estimates were expressed using average marginal effects on the risk ratio scale.

RESULTS

The study found that across nine health services, an estimated 8.74 million patient visits were lost in Mexico. This included a decline of over two thirds for breast and cervical cancer screenings (79% and 68%, respectively), over half for sick child visits and female contraceptive services, approximately one-third for childhood vaccinations, diabetes, hypertension and antenatal care consultations, and a decline of 10% for deliveries performed at IMSS. In terms of patient outcomes, the proportion of patients with diabetes and hypertension with controlled conditions declined by 22% and 17%, respectively. Caesarean section rate did not change.

CONCLUSION

Significant disruptions in health services show that the pandemic has strained the resilience of the Mexican health system and calls for urgent efforts to resume essential services and plan for catching up on missed preventive care even as the COVID-19 crisis continues in Mexico.

Unlocking the health system barriers to maximise the uptake and utilisation of molecular diagnostics in low-income and middle-income country setting

BACKGROUND

Early access to diagnosis is crucial for effective management of any disease including tuberculosis (TB). We investigated the barriers and opportunities to maximise uptake and utilisation of molecular diagnostics in routine healthcare settings.

METHODS

Using the implementation of WHO approved TB diagnostics, Xpert Mycobacterium tuberculosis/rifampicin (MTB/RIF) and Line Probe Assay (LPA) as a benchmark, we evaluated the barriers and how they could be unlocked to maximise uptake and utilisation of molecular diagnostics.

RESULTS

Health officers representing 190 districts/counties participated in the survey across Kenya, Tanzania and Uganda. The survey findings were corroborated by 145 healthcare facility (HCF) audits and 11 policy-maker engagement workshops. Xpert MTB/RIF coverage was 66%, falling behind microscopy and clinical diagnosis by 33% and 1%, respectively. Stratified by HCF type, Xpert MTB/RIF implementation was 56%, 96% and 95% at district, regional and national referral hospital levels. LPA coverage was 4%, 3% below culture across the three countries. Out of 111 HCFs with Xpert MTB/RIF, 37 (33%) used it to full capacity, performing ≥8 tests per day of which 51% of these were level five (zonal consultant and national referral) HCFs. Likewise, 75% of LPA was available at level five HCFs. Underutilisation of Xpert MTB/RIF and LPA was mainly attributed to inadequate-utilities, 26% and human resource, 22%. Underfinancing was the main reason underlying failure to acquire molecular diagnostics. Second to underfinancing was lack of awareness with 33% healthcare administrators and 49% practitioners were unaware of LPA as TB diagnostic. Creation of a national health tax and decentralising its management was proposed by policy-makers as a booster of domestic financing needed to increase access to diagnostics.

CONCLUSION

Our findings suggest higher uptake and utilisation of molecular diagnostics at tertiary level HCFs contrary to the WHO recommendation. Country-led solutions are crucial for unlocking barriers to increase access to diagnostics.

Using health management information system data: case study and verification of institutional deliveries in Ethiopia

Health management information systems (HMIS) are a crucial source of timely health statistics and have the potential to improve reporting in low-income countries. However, concerns about data quality have hampered their widespread adoption in research and policy decisions. This article presents results from a data verification study undertaken to gain insights into the quality of HMIS data in Ethiopia. We also provide recommendations for working with HMIS data for research and policy translation. We linked the HMIS to the 2016 Emergency Obstetric and Newborn Care Assessment, a national census of all health facilities that provided maternal and newborn health services in Ethiopia. We compared the number of visits for deliveries and caesarean sections (C-sections) reported in the HMIS in 2015 (January–December) to those found in source documents (paper-based labour and delivery and operating theatre registers) in 2425 facilities across Ethiopia. We found that two-thirds of facilities had ‘good’ HMIS reporting for deliveries (defined as reporting within 10% of source documents) and half had ‘very good’ reporting (within 5% of source documents). Results were similar for reporting on C-section deliveries. We found that good reporting was more common in urban areas (OR: 1.30, 95% CI 1.06 to 1.59), public facilities (OR: 2.95, 95% CI 1.38 to 6.29) and in hospitals compared with health centres (OR: 1.71, 95% CI 1.13 to 2.61). Facilities in the Somali and Afar regions had the lowest odds of good reporting compared with Addis Ababa and were more likely to over-report deliveries in the HMIS. Further work remains to address remaining discrepancies in the Ethiopian HMIS. Nonetheless, our findings corroborate previous data verification exercises in Ethiopia and support greater use and uptake of HMIS data for research and policy decisions (particularly, greater use of HMIS data elements (eg, absolute number of services provided each month) rather than coverage indicators). Increased use of these data, combined with feedback mechanisms, is necessary to maintain data quality.

Ethical considerations of phone-based interviews from three studies of COVID-19 impact in Bihar, India

Phone-based interviews present a range of ethical challenges, including how to ensure informed consent and privacy and maintain confidentiality. Our paper presents conceptual and practical ethical considerations taken into account across three telephone studies on the impact of COVID-19 conducted following India’s nationwide lockdown imposed in March 2020. Two studies captured COVID-19 response impact on primary-level Reproductive Maternal Neonatal and Child Health (RMNCH) services and on provider wellness, respectively. The third study focused on how the gendered experience of COVID-19 and the state’s response to control transmission impacted women’s lives, focusing on health services, livelihood, entitlements and social change, by interviewing individual women. The ethical challenges as well as the advantages of digital data collection are presented with recommendations for low-resource settings. Ethical considerations included the above challenges as well as avoiding posing unreasonable time burden on the respondents, framing questions with a gendered lens, considering emotional states given contagion concerns and economic uncertainties, and redressing pandemic-induced distress. Using scripted Hindi was challenging in consent-taking, as was protecting household respondents’ privacy and confidentiality during lockdown. Unanticipated positive ethical implications of using a telephone approach included providing respondents privacy and catharsis, respondents choosing convenient interview times and affording health providers more privacy than institutional inperson interviews. Internalising empathy, respect and appreciative enquiry are key to establishing rapport in the absence of prior relationships. Institutional Review Board (IRB) time limits on call duration need to be flexible to allow for ‘active listening’ and empathetic enquiry in surveys on the impact of COVID-19.

Reflections on benefits and challenges of longitudinal organisational network analysis as a tool for health systems research and practice

As health systems practitioners and researchers increasingly turn towards systems thinking approaches and work on building interorganisational networks, they have demonstrated increasing interest in network analysis for investigating relationships and interactions between system actors, both at the individual and organisational levels. Despite the potential of network-based approaches to improve health system efficiency, effectiveness and responsiveness, both the theoretical and practical guidance on designing and evaluating network-building strategies is underdeveloped within the field. While there are multiple tools and resources to help users collect, manage and analyse network data, there is much less guidance on the practical applications of this information. One apparent gap is the limited application of longitudinal organisational network analysis, in which data are collected from the same organisational actors repeatedly over multiple time points. This yields insights into the dynamic nature of networks, including how the network structure and interactions change over time. Given that networks are rarely static, the addition of the time dimension has the potential to substantially enhance the analytical value of network analysis and contribute to more nuanced guidance for interested practitioners and policymakers. In this article, the authors draw on their experiences in conducting longitudinal network analysis of interorganisational relationships in the USA and India to comment on the opportunities and challenges of the methodology within the field of health systems research. We also provide suggestions as to how some of these challenges may be addressed or mitigated.

Why do strategies to strengthen primary health care succeed in some places and fail in others? Exploring local variation in the effectiveness of a community health worker managed digital health intervention in rural India

Introduction

Digital health interventions (DHIs) have huge potential as support modalities to identify and manage cardiovascular disease (CVD) risk in resource-constrained settings, but studies assessing them show modest effects. This study aims to identify variation in outcomes and implementation of SMARTHealth India, a cluster randomised trial of an ASHA-managed digitally enabled primary healthcare (PHC) service strengthening strategy for CVD risk management, and to explain how and in what contexts the intervention was effective.

Methods

We analysed trial outcome and implementation data for 18 PHC centres and collected qualitative data via focus groups with ASHAs (n=14) and interviews with ASHAs, PHC facility doctors and fieldteam mangers (n=12) Drawing on principles of realist evaluation and an explanatory mixed-methods design we developed mechanism-based explanations for observed outcomes.

Results

There was substantial between-cluster variation in the primary outcome (overall: I²=62.4%, p<=0.001). The observed heterogeneity in trial outcomes was not attributable to any single factor. Key mechanisms for intervention effectiveness were community trust and acceptability of doctors’ and ASHAs’ new roles, and risk awareness. Enabling local contexts were seen to evolve over time and in response to the intervention. These included obtaining legitimacy for ASHAs’ new roles from trusted providers of curative care; ASHAs’ connections to community and to qualified providers; their responsiveness to community needs; and the accessibility, quality and appropriateness of care provided by higher level medical providers, including those outside of the implementing (public) subsystem.

Conclusion

Local contextual factors were significant influences on the effectiveness of this DHI-enabled PHC service strategy intervention. Local adaptions need to be planned for, monitored and responded to over time. By identifying plausible explanations for variation in outcomes between clusters, we identify potential strategies to strengthen such interventions.

Prevalence and determinants of inappropriate antibiotic dispensing at private drug retail outlets in urban and rural areas of Indonesia: a mixed methods study

INTRODUCTION

The aim of this mixed-method study was to determine the extent and determinants of inappropriate dispensing of antibiotics by licensed private drug retail outlets in Indonesia.

METHODS

Standardised patients (SPs) made a total of 495 visits to 166 drug outlets (community pharmacies and drug stores) between July and August 2019. The SPs presented three clinical cases to drug outlet staff: parent of a child at home with diarrhoea; an adult with presumptive tuberculosis (TB); and an adult with upper respiratory tract infection (URTI). The primary outcome was the dispensing of an antibiotic without prescription, with or without the client requesting it. We used multivariable random effects logistic regression to assess factors associated with the primary outcome and conducted 31 interviews with drug outlet staff to explore these factors in greater depth.

RESULTS

Antibiotic dispensing without prescription occurred in 69% of SP visits. Dispensing antibiotics without a prescription was more likely in standalone pharmacies and pharmacies attached to clinics compared with drug stores, with an OR of 5.9 (95% CI 3.2 to 10.8) and OR of 2.2 (95% CI 1.2 to 3.9); and more likely for TB and URTI SP-performed cases compared with child diarrhoea cases, with an OR of 5.7 (95% CI 3.1 to 10.8) and OR of 5.2 (95% CI 2.7 to 9.8). Interviews revealed that inappropriate antibiotic dispensing was driven by strong patient demand for antibiotics, unqualified drug sellers dispensing medicines, competition between different types of drug outlets, drug outlet owners pushing their staff to sell medicines, and weak enforcement of regulations.

CONCLUSION

This study shows that inappropriate dispensing of antibiotics by private drug retail outlets is widespread. Interventions will need to address not only the role of drug sellers, but also the demand for antibiotics among clients and the push from drug outlet owners to compete with other outlets.

Examining the reach and exposure of a mobile phone-based training programme for frontline health workers (ASHAs) in 13 states across India

Mobile phones are increasingly used to facilitate in-service training for frontline health workers (FLHWs). Mobile learning (mLearning) programmes have the potential to provide FLHWs with high quality, inexpensive, standardised learning at scale, and at the time and location of their choosing. However, further research is needed into FLHW engagement with mLearning content at scale, a factor which could influence knowledge and service delivery. Mobile Academy is an interactive voice response training course for FLHWs in India, which aims to improve interpersonal communication skills and refresh knowledge of preventative reproductive, maternal, neonatal and child health. FLHWs dial in to an audio course consisting of 11 chapters, each with a 4-question true/false quiz, resulting in a cumulative pass/fail score. In this paper, we analyse call data records from the national version of Mobile Academy to explore coverage, user engagement and completion. Over 158 596 Accredited Social Health Activists (ASHAs) initiated the national version, while 111 994 initiated the course on state-based platforms. Together, this represents 41% of the estimated total number of ASHAs registered in the government database across 13 states. Of those who initiated the national version, 81% completed it; and of those, over 99% passed. The initiation and completion rates varied by state, with Rajasthan having the highest initiation rate. Many ASHAs made multiple calls in the afternoons and evenings but called in for longer durations earlier in the day. Findings from this analysis provide important insights into the differential reach and uptake of the programme across states.

Assessing exposure to Kilkari: a big data analysis of a large maternal mobile messaging service across 13 states in India

The Kilkari programme is being implemented by the Government of India in 13 states. Designed by BBC Media Action and scaled in collaboration with the Ministry of Health and Family Welfare from January 2016, Kilkari had provided mobile health information to over 10 million subscribers by the time BBC Media Action transitioned the service to the government in April 2019. Despite the reach of Kilkari in terms of the absolute number of subscribers, no longitudinal analysis of subscriber exposure to health information content over time has been conducted, which may underpin effectiveness and changes in health outcomes. In this analysis, we draw from call data records to explore exposure to the Kilkari programme in India for the 2018 cohort of subscribers. We start by assessing the timing of the first successful call answered by subscribers on entry to the programme during pregnancy or postpartum, and then assess call volume, delivery, answering and listening rates over time. Findings suggest that over half of subscribers answer their first call after childbirth, with the remaining starting in the pregnancy period. The system handles upwards of 1.2 million calls per day on average. On average, 50% of calls are picked up on the first call attempt, 76% by the third and 99.5% by the ninth call attempt. Among calls picked up, over 48% were listened to for at least 50% of the total content duration and 43% were listened to for at least 75%. This is the first analysis of its kind of a maternal mobile messaging programme at scale in India. Study analyses suggest that multiple call attempts may be required to reach subscribers. However, once answered, subscribers tend to listen the majority of the call-a figure consistent across states, over time, and by health content area.

'The nurse did not even greet me': how informed versus non-informed patients evaluate health systems responsiveness in South Africa

Introduction

Universal Health Coverage is not only about access to health services but also about access to high-quality care, since poor experiences may deter patients from accessing care. Evidence shows that quality of care drives health outcomes, yet little is known about non-clinical dimensions of care, and patients’ experience thereof relative to satisfaction with visits. This paper investigates the role of non-clinical dimensions of care in patient satisfaction.

Methods

Our study describes the interactions of informed and non-informed patients with primary healthcare workers at 39 public healthcare facilities in two metropolitan centres in two South African provinces. Our analysis included 1357 interactions using standardised patients (for informed patients) and patients’ exit interviews (for non-informed patients). The data were combined for three types of visits: contraception, hypertension and tuberculosis. We describe how satisfaction with care was related to patients’ experiences of non-clinical dimensions.

Results

We show that when real patients (RPs) reported being satisfied (vs dissatisfied) with a visit, it was associated with a 30% increase in the probability that a patient is greeted at the facilities. Likewise, when the RPs reported being satisfied (vs dissatisfied) with the visit, it was correlated with a 15% increase in the prospect that patients are pleased with healthcare workers’ explanations of health conditions.

Conclusion

Informed patients are better equipped to assess health-systems responsiveness in healthcare provision. Insights into responsiveness could guide broader efforts aimed at targeted education and empowerment of primary healthcare users to strengthen health systems and shape expectations for appropriate care and conduct.

Mismatched ambition, execution and outcomes: implementing maternal death surveillance and response system in Mtwara region, Tanzania

Background

Since 2015, Tanzania has been implementing the Maternal Death Surveillance and Response (MDSR) system. The system employs interactions of health providers and managers to identify, notify and review maternal deaths and recommend strategies for preventing further deaths. We aimed to analyse perceptions and experiences of health providers and managers in implementing the MDSR system.

Methods

An exploratory qualitative study was carried out with 30 purposively selected health providers and 30 health managers in four councils from the Mtwara region between June and July 2020. Key informant interviews and focus group discussions were used to collect data. Inductive thematic analysis was used to analyse data.

Results

Two main themes emerged from this study: ‘Accomplishing by ambitions’ and ‘A flawed system’. The themes suggest that health providers and managers have a strong desire to make the MDSR system work by making deliberate efforts to implement it. They reported working hard to timely notify, review death and implement action plans from meetings. Health providers and managers reported that MDSR has produced changes in care provision such as behavioural changes towards maternal care, increased accountability and policy changes. The system was however flawed by lack of training, organisational problems, poor coordination with other reporting and quality improvements systems, assigning blame and lack of motivation.

Conclusion

The implementation of the MDSR system in Tanzania faces systemic, contextual and individual challenges. However, our results indicate that health providers and managers are willing and committed to improve service delivery to avoid maternal deaths. Empowering health providers and managers by training and addressing the flaws will improve the system and quality of care.

The impact of a health facility construction campaign on health service utilisation and outcomes: analysis of spatially linked survey and facility location data in Ethiopia

Background

Access to health facilities in many low-income and middle-income countries remains low, with a strong association between individuals’ distance to facilities and health outcomes. Yet plausibly causal estimates of the effects of facility construction programmes are rare. Starting in 2004, more than 2800 government health facilities were built in Ethiopia. This study estimates the impact of this programme on maternal health service utilisation and birth outcomes.

Methods

We analyse the impact of Ethiopia’s health centre construction programme on health service utilisation and outcomes, using a difference-in-difference design. We match facility opening years to child birth years in four rounds of Demographic and Health Surveys (DHS) using georeferenced data. We also use event study models to test for pre-trends in the outcomes of interest.

Results

Opening of new health facilities within 5 km increases facility delivery by 7.2 percentage points (95% CI 5.2 to 9.1) and antenatal care by 0.38 visits (95% CI 0.24 to 0.52). It is not significantly associated with changes in caesarean section births or neonatal mortality. Opening of district hospitals increases facility delivery by 18.2 percentage points (95% CI 12.7 to 23.7), and caesarean section births by 6.8 percentage points (95% CI 2.5 to 11.2), but is not associated with reduction of neonatal mortality.

Conclusions

Ethiopia’s facility construction program improved access to antenatal and delivery care. However, there was no detectable association between facility construction and neonatal mortality. Increased access to care must be combined with health system quality improvements and broader social development initiatives to sustainably improve health outcomes.

Mixed-method estimation of population-level HIV viral suppression rate in the Western Cape, South Africa

INTRODUCTION

There are few population-wide data on viral suppression (VS) that can be used to monitor programmatic targets in sub-Saharan Africa. We describe how routinely collected viral load (VL) data from antiretroviral therapy (ART) programmes can be extrapolated to estimate population VS and validate this using a combination of empiric and model-based estimates.

METHODS

VL test results from were matched using a record linkage algorithm to obtain linked results for individuals. Test-level and individual-level VS rates were based on test VL values <1000 cps/mL, and individual VL <1000 cps/mL in a calendar year, respectively. We calculated population VS among people living with HIV (PLWH) in the province by combining census-derived midyear population estimates, HIV prevalence estimates and individual level VS estimates from routine VL data.

RESULTS

Approximately 1.9 million VL test results between 2008 and 2018 were analysed. Among individuals in care, VS increased from 85.5% in 2008 to 90% in 2018. Population VS among all PLWH in the province increased from 12.2% in 2008 to 51.0% in 2017. The estimates derived from this method are comparable to those from other published studies. Sensitivity analyses showed that the results are robust to variations in linkage method, but sensitive to the extreme combinations of assumed VL testing coverage and population HIV prevalence.

CONCLUSION

While validation of this method in other settings is required, this approach provides a simple, robust method for estimating population VS using routine data from ART services that can be employed by national programmes in high-burden settings.

Geospatial evaluation of trade-offs between equity in physical access to healthcare and health systems efficiency

Introduction

Decisions regarding the geographical placement of healthcare services require consideration of trade-offs between equity and efficiency, but few empirical assessments are available. We applied a novel geospatial framework to study these trade-offs in four African countries.

Methods

Geolocation data on population density (a surrogate for efficiency), health centres and cancer referral centres in Kenya, Malawi, Tanzania and Rwanda were obtained from online databases. Travel time to the closest facility (a surrogate for equity) was estimated with 1 km resolution using the Access Mod 5 least cost distance algorithm. We studied associations between district-level average population density and travel time to closest facility for each country using Pearson’s correlation, and spatial autocorrelation using the Global Moran’s I statistic. Geographical clusters of districts with inefficient resource allocation were identified using the bivariate local indicator of spatial autocorrelation.

Results

Population density was inversely associated with travel time for all countries and levels of the health system (Pearson’s correlation range, health centres: −0.89 to −0.71; cancer referral centres: −0.92 to −0.43), favouring efficiency. For health centres, negative spatial autocorrelation (geographical clustering of dissimilar values of population density and travel time) was weaker in Rwanda (−0.310) and Tanzania (−0.292), countries with explicit policies supporting equitable access to rural healthcare, relative to Kenya (−0.579) and Malawi (−0.543). Stronger spatial autocorrelation was observed for cancer referral centres (Rwanda: −0.341; Tanzania: −0.259; Kenya: −0.595; Malawi: −0.666). Significant geographical clusters of sparsely populated districts with long travel times to care were identified across countries.

Conclusion

Negative spatial correlations suggested that the geographical distribution of health services favoured efficiency over equity, but spatial autocorrelation measures revealed more equitable geographical distribution of facilities in certain countries. These findings suggest that even when prioritising efficiency, thoughtful decisions regarding geographical allocation could increase equitable physical access to services.

Using immunisation caregiver journey interviews to understand and optimise vaccination uptake: lessons from Sierra Leone

Quantitative and qualitative assessments have revealed diverse factors that influence the uptake of childhood immunisation services and shed light on reasons for vaccination delays and refusals. UNICEF and partner organisations developed the Immunisation Caregiver Journey Framework as a novel way to understand caregiver experiences in accessing and receiving immunisation services for children. This framework aims to help immunisation programmes identify vaccination barriers and opportunities to improve vaccination uptake by enhancing the overall caregiver journey in a systems-focused manner, using human-centred design principles. In this paper, we adapt the framework into a flexible qualitative inquiry approach with theoretical guidance from interpretative phenomenology. We draw from the implementation experiences in Sierra Leone to inform methodological guidance on how to design and implement the Immunisation Caregiver Journey Interviews (ICJI) to understand the lived experiences of caregivers as they navigate immunisation services for their children. Practical guidance is provided on sampling techniques, conducting interviews, data management, data analysis and the use of data to inform programmatic actions. When properly implemented, the ICJI approach generates a rich qualitative understanding of how caregivers navigate household and community dynamics, as well as primary healthcare delivery systems. We argue that understanding and improving the caregiver journey will enhance essential immunisation outcomes, such as the completion of the recommended vaccination schedule, timeliness of vaccination visits and reduction in dropouts between vaccine doses.

How do patient feedback systems work in low-income and middle-income countries? Insights from a realist evaluation in Bangladesh

Background

Well-functioning patient feedback systems can contribute to improved quality of healthcare and systems accountability. We used realist evaluation to examine patient feedback systems at health facilities in Bangladesh, informed by theories of citizenship and principal–agent relationships.

Methods

We collected and analysed data in two stages, using: document review; secondary analysis of data from publicly available web-portals; in-depth interviews with patients, health workers and managers; non-participant observations of feedback environments; and stakeholder workshops. Stage 1 focused on identifying and articulating the initial programme theory (PT) of patient feedback systems. In stage 2, we iteratively tested and refined this initial theory, through analysing data and grounding emerging findings within substantive theories and empirical literature, to arrive at a refined PT.

Results

Multiple patient feedback systems operate in Bangladesh, essentially comprising stages of collection, analysis and actions on feedback. Key contextual enablers include political commitment to accountability, whereas key constraints include limited patient awareness of feedback channels, lack of guidelines and documented processes, local political dynamics and priorities, institutional hierarchies and accountability relationships. Findings highlight that relational trust may be important for many people to exercise citizenship and providing feedback, and that appropriate policy and regulatory frameworks with clear lines of accountability are critical for ensuring effective patient feedback management within frontline healthcare facilities.

Conclusion

Theories of citizenship and principal–agent relationships can help understand how feedback systems work through spotlighting the citizenship identity and agency, shared or competing interests, and information asymmetries. We extend the understanding of these theories by highlighting how patients, health workers and managers act as both principals and agents, and how information asymmetry and possible agency loss can be addressed. We highlight the importance of awareness raising and non-threatening environment to provide feedback, adequate support to staff to document and analyse feedback and timely actions on the information.

Fostering global primary care research: a capacity-building approach

The Alma Ata and Astana Declarations reaffirm the importance of high-quality primary healthcare (PHC), yet the capacity to undertake PHC research—a core element of high-quality PHC—in low-income and middle-income countries (LMIC) is limited. Our aim is to explore the current risks or barriers to primary care research capacity building, identify the ongoing tensions that need to be resolved and offer some solutions, focusing on emerging contexts. This paper arose from a workshop held at the 2019 North American Primary Care Research Group Annual Meeting addressing research capacity building in LMICs. Five case studies (three from Africa, one from South-East Asia and one from South America) illustrate tensions and solutions to strengthening PHC research around the world. Research must be conducted in local contexts and be responsive to the needs of patients, populations and practitioners in the community. The case studies exemplify that research capacity can be strengthened at the micro (practice), meso (institutional) and macro (national policy and international collaboration) levels. Clinicians may lack coverage to enable research time; however, practice-based research is precisely the most relevant for PHC. Increasing research capacity requires local skills, training, investment in infrastructure, and support of local academics and PHC service providers to select, host and manage locally needed research, as well as to disseminate findings to impact local practice and policy. Reliance on funding from high-income countries may limit projects of higher priority in LMIC, and ‘brain drain’ may reduce available research support; however, we provide recommendations on how to deal with these tensions.

Patient pathways of tuberculosis care-seeking and treatment: an individual-level analysis of National Health Insurance data in Taiwan

Introduction

Patients with tuberculosis (TB) often experience difficulties in accessing diagnosis and treatment. Patient pathway analysis identifies mismatches between TB patient care-seeking patterns and service coverage, but to date, studies have only employed cross-sectional aggregate data.

Methods

We developed an algorithmic approach to analyse and interpret patient-level routine data on healthcare use and to construct patients’ pathways from initial care-seeking to treatment outcome. We applied this to patients with TB in a simple random sample of one million patients’ records in the Taiwan National Health Insurance database. We analysed heterogeneity in pathway patterns, delays, service coverage and patient flows between different health system levels.

Results

We constructed 7255 pathways for 6258 patients. Patients most commonly initially sought care at the primary clinic level, where the capacity for diagnosing TB patients was 12%, before eventually initiating treatment at higher levels. Patient pathways are extremely heterogeneous prior to diagnosis, with the 10% most complex pathways accounting for 48% of all clinical encounters, and 55% of those pathways yet to initiate treatment after a year. Extended consideration of alternative diagnoses was more common for patients aged 65 years or older and for patients with chronic lung disease.

Conclusion

Our study demonstrates that longitudinal analysis of routine individual-level healthcare data can be used to generate a detailed picture of TB care-seeking pathways. This allows an understanding of several temporal aspects of care pathways, including lead times to care and the variability in patient pathways.

The WHO Global Benchmarking Tool: a game changer for strengthening national regulatory capacity

Many low-income and middle-income countries lack the capacity to effectively and efficiently regulate medical products in their countries. To support countries in strengthening their capacity, WHO has developed the Global Benchmarking Tool (GBT) as the global standard for objectively assessing regulatory capacity for medicines and vaccines. The GBT is a game changer because it is the first globally accepted tool for assessing and strengthening national regulatory authorities. The inclusion of an institutional development plan in the GBT methodology provides context-specific actionable steps countries can take to advance their system’s functionality and maturity. The GBT facilitates coordination and improves the effectiveness of regulatory strengthening efforts. The tool also facilitates regulatory reliance and harmonisation, which helps to improve timely access to quality-assured medicines, and creates incentives for trade, particularly in countries and regions with a strong pharmaceutical manufacturing base. The GBT is a necessary tool for creating strong and effective regulatory systems, which are critical for ensuring the efficacy, safety and quality assurance of medicines and populations’ timely access to these medicines. In outlining the benefits of the GBT, this paper also offers some specific ideas for strengthening the GBT framework and process.

A systematic review of substandard, falsified, unlicensed and unregistered medicine sampling studies: a focus on context, prevalence, and quality

Substandard and falsified (SF) medicines are a global issue contributing to antimicrobial resistance and causing economic and humanitarian harm. To direct law enforcement efficiently, halt the spread of SF medicines and antimicrobial resistance, academics, NGOs and government organisations use medicine quality sampling studies to estimate the prevalence of the problem. A systematic review of medicine quality studies was conducted to estimate how the methodological quality of these studies and SF prevalence has changed between 2013 and 2018. We also aimed to critique medicine sampling study methodologies, and the systematic review process which generates prevalence estimates. Based on 33 studies, the overall estimated median (Q1-Q3) prevalence of SF medicines appears to have remained high at 25% (7.7%-34%) compared with 28.5% in 2013. Furthermore, the methodological quality of prevalence studies has improved over the last 25 years. Definitive conclusions regarding the prevalence of SF medicines cannot be drawn due to the variability in sample sizes, consistency of design methods, and a lack of information concerning contextual factors affecting medicine quality studies. We contend that studies which present cumulative average prevalence figures are useful in a broad sense but could be improved to create more reliable estimates. We propose that medicine quality studies record the context of the study environment to allow systematic reviewers to compare like with like. Although, the academic rigour of medicine quality studies is improving, medicine sampling study limitations still exist. These limitations inhibit the accurate estimation of SF medicine prevalence which is needed to support detailed policy changes.