Health system description and assessment: a scoping review of templates for systematic analyses

BACKGROUND

Understanding and comparing health systems is key for cross-country learning and health system strengthening. Templates help to develop standardised and coherent descriptions and assessments of health systems, which then allow meaningful analyses and comparisons. Our scoping review aims to provide an overview of existing templates, their content and the way data is presented.

MAIN BODY

Based on the WHO building blocks framework, we defined templates as having (1) an overall framework, (2) a list of indicators or topics, and (3) instructions for authors, while covering (4) the design of the health system, (5) an assessment of health system performance, and (6) should cover the entire health system. We conducted a scoping review of grey literature published between 2000 and 2023 to identify templates. The content of the identified templates was screened, analyzed and compared. We found 12 documents that met our inclusion criteria. The building block `health financing´ is covered in all 12 templates; and many templates cover ´service delivery´ and ´health workforce'. Health system performance is frequently assessed with regard to 'access and coverage', 'quality and safety', and 'financial protection'. Most templates do not cover 'responsiveness' and 'efficiency'. Seven templates combine quantitative and qualitative data, three are mostly quantitative, and two are primarily qualitative. Templates cover data and information that is mostly relevant for specific groups of countries, e.g. a particular geographical region, or for high or for low and middle-income countries (LMICs). Templates for LMICs rely more on survey-based indicators than administrative data.

CONCLUSIONS

This is the first scoping review of templates for standardized descriptions of health systems and assessments of their performance. The implications are that (1) templates can help analyze health systems across countries while accounting for context; (2) template-guided analyses of health systems could underpin national health policies, strategies, and plans; (3) organizations developing templates could learn from approaches of other templates; and (4) more research is needed on how to improve templates to better achieve their goals. Our findings provide an overview and help identify the most important aspects and topics to look at when comparing and analyzing health systems, and how data are commonly presented. The templates were created by organizations with different agendas and target audiences, and with different end products in mind. Comprehensive health systems analyses and comparisons require production of quantitative indicators and complementing them with qualitative information to build a holistic picture.

CLINICAL TRIAL REGISTRATION

  Not applicable.

Data for health system comparison and assessment in the African Region: A review of 63 indicators available in international databases

Background

Achieving universal health coverage in the African region requires health systems strengthening. Assessing and comparing health systems contributes to this process, but requires internationally comparable data. The European Observatory on Health Systems and Policies has produced Health Systems in Transition (HiT) reviews in Europe, Asia, North America and the Caribbean with a standardised template. This study explores data availability in international databases for the quantitative health and health system indicators in the HiT template for the WHO African region.

Methods

We identified ten databases which contained data for 40 of the 80 original HiT indicators and an additional 23 proxy indicators to fill some gaps. We then assessed data availability for the resulting 63 indicators by country and time, i.e. first/last year of data, years of data available overall and since 2000, and we explored for each indicator (1) against the country with the greatest availability overall and (2) against annual availability for all years since 2000.

Results

Overall data availability was greatest in South Africa (93.0% of possible total points) and least in South Sudan (59.5%). Since 2000, Uganda (60.4%) has had the highest data availability and South Sudan (37.2%) the lowest. By topic, data availability was the highest for health financing (91.4%; median start/end date 2000/2019) and background characteristics (88.5%; 1990/2020) and was considerably lower for health system performance (54.5%; 2000/2018) and physical and human resources (44.8%; 2004/2013). Data are available for different years in different countries, and at irregular intervals, complicating time series analysis. No data are available for service provision indicators.

Conclusions

Gaps in data in international databases across time, countries, and topics undermine systematic health systems comparisons and assessments, regional health systems strengthening, and efforts to achieve universal health coverage. More efforts are needed to strengthen national data collection and management and integrate national data into international databases to support cross-country assessments, peer learning, and planning. In tandem, more research is needed to understand the specific historical, cultural, administrative, and technological determinants influencing country data availability, as well as the facilitators and barriers of data sharing between countries and international databases, and the potential of new technologies to increase timeliness of data.

Nursing boundaries and work identity construction among nurses exercising an advanced role: A qualitative study

Research on the deployment of advanced practice nurses (APNs) in healthcare settings highlights significant challenges for APNs transitioning to a broader, less well-defined nursing role in negotiating professional boundaries and a new work identity with other health workers. However, theories of boundary-work and professional identity have been rarely applied to APNs relationships with general nurses and colleagues in lower professional position such as nursing-assistants. APNs relationships with these colleagues remain poorly understood. This article aims to contribute to addressing this gap. It is based on qualitative research on a pilot-project prefiguring the introduction of APN (pre-APN) in the French Health system entitled the Prefiguration of Clinical Nurse Specialists (PrefICS). Data were collected through field observations and interviews with pre-APNs, general nurses, nursing-assistants, doctors and nursing hierarchy, to assess the implementation of PrefICS project in four hospitals, one health centre and one cancer control centre. The analysis shows that facing the risk of their role being limited to collaborations with doctors, pre-APNs engaged in different forms of boundary-work with general nurses and nursing-assistants, to negotiate new professional relationships with these colleagues. Some pre-APNs presented themselves as resource persons and led activities aimed at developing and sharing nursing knowledges and competencies with general nurses and nursing-assistants. Other pre-APNs shaped their work identity around a reformist role in terms of both the nursing profession and work environments. Pre-APNs boundary work with general nurses and nursing-assistants produced work spaces in which pre-APNs interwove their work identity with these colleagues by negotiating new professional ties and brokering knowledges between different professional worlds. Changes in levels of pre-APN self-categorization reflected different views of the nursing and nursing-assistant professions, from which pre-APNs started building new alliances for a shared reflective work on their practice and about caring.

Indirect Effects of Ebola Virus Disease Epidemics on Health Systems in the Democratic Republic of the Congo, Guinea, Sierra Leone and Liberia: A Scoping Review Supplemented with Expert Interviews

Ebola Virus Disease (EVD) epidemics have been extensively documented and have received large scientific and public attention since 1976. Until July 2022, 16 countries worldwide had reported at least one case of EVD, resulting in 43 epidemics. Most of the epidemics occurred in the Democratic Republic of Congo (DRC) but the largest epidemic occurred from 2014-2016 in Guinea, Sierra Leone and Liberia in West Africa. The indirect effects of EVD epidemics on these countries' health systems, i.e., the consequences beyond infected patients and deaths immediately related to EVD, can be significant. The objective of this review was to map and measure the indirect effects of the EVD epidemics on the health systems of DRC, Guinea, Sierra Leone and Liberia and, from thereon, draw lessons for strengthening their resilience vis-à-vis future EVD outbreaks and other similar health emergencies. A scoping review of published articles from the PubMed database and gray literature was conducted. It was supplemented by interviews with experts. Eighty-six articles were included in this review. The results were structured based on WHO's six building blocks of a health system. During the EVD outbreaks, several healthcare services and activities were disrupted. A significant decline in indicators of curative care utilization, immunization levels and disease control activities was noticeable. Shortages of health personnel, poor health data management, insufficient funding and shortages of essential drugs characterized the epidemics that occurred in the above-mentioned countries. The public health authorities had virtually lost their leadership in the management of an EVD response. Governance was characterized by the development of a range of new initiatives to ensure adequate response. The results of this review highlight the need for countries to invest in and strengthen their health systems, through the continuous reinforcement of the building blocks, even if there is no imminent risk of an epidemic.

Economic evaluations of health system strengthening activities in low-income and middle-income country settings: a methodological systematic review

Objective

Health system strengthening (HSS) activities should accompany disease-targeting interventions in low/middle-income countries (LMICs). Economic evaluations provide information on how these types of investment might best be balanced but can be challenging. We conducted a systematic review to evaluate how researchers address these economic evaluation challenges.

Methods

We identified studies about economic evaluation of HSS activities in LMICs using a two-stage approach. First, we conducted a broad search to identify areas where economic evaluations of HSS activities were being conducted. Next, we selected specific interventions for more targeted literature review. We extracted study characteristics using the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) checklist. Finally, we summarised authors’ modelling decisions using a framework that examines how models are developed to emphasise generalisability, precision, or realism.

Findings

Our searches produced 1978 studies, out of which we included 36. Most studies used data from prospective trials and calculated cost-effectiveness directly from these trial inputs, rather than using simulation methods. As a group, these studies primarily emphasised precision and realism over generalisability, meaning that their results were best suited to specific settings.

Conclusions

The number of included studies was small. Our findings suggest that most economic evaluations of HSS do not leverage methods like sensitivity analyses or inputs from literature review that would produce more generalisable (but potentially less precise) results. More research into how decision-makers would use economic evaluations to define the expansion path to strengthening health systems would allow for conceptualising impactful work on the economic value of HSS.

How can we evaluate the cost-effectiveness of health system strengthening? A typology and illustrations

Health interventions often depend on a complex system of human and capital infrastructure that is shared with other interventions, in the form of service delivery platforms, such as healthcare facilities, hospitals, or community services. Most forms of health system strengthening seek to improve the efficiency or effectiveness of such delivery platforms. This paper presents a typology of ways in which health system strengthening can improve the economic efficiency of health services. Three types of health system strengthening are identified and modelled: (1) investment in the efficiency of an existing shared platform that generates positive benefits across a range of existing interventions; (2) relaxing a capacity constraint of an existing shared platform that inhibits the optimization of existing interventions; (3) providing an entirely new shared platform that supports a number of existing or new interventions. Theoretical models are illustrated with examples, and illustrate the importance of considering the portfolio of interventions using a platform, and not just piecemeal individual analysis of those interventions. They show how it is possible to extend principles of conventional cost-effectiveness analysis to identify an optimal balance between investing in health system strengthening and expenditure on specific interventions. The models developed in this paper provide a conceptual framework for evaluating the cost-effectiveness of investments in strengthening healthcare systems and, more broadly, shed light on the role that platforms play in promoting the cost-effectiveness of different interventions.

Asking different questions: A call to action for research to improve the quality of care for every woman, every child

Despite decades of considerable economic investment in improving the health of families and newborns world-wide, aspirations for maternal and newborn health have yet to be attained in many regions. The global turn toward recognizing the importance of positive experiences of pregnancy, intrapartum and postnatal care, and care in the first weeks of life, while continuing to work to minimize adverse outcomes, signals a critical change in the maternal and newborn health care conversation and research prioritization. This paper presents "different research questions" drawing on evidence presented in the 2014 Lancet Series on Midwifery and a research prioritization study conducted with the World Health Organization. The results indicated that future research investment in maternal and newborn health should be on "right care," which is quality care that is tailored to individuals, weighs benefits and harms, is person-centered, works across the whole continuum of care, advances equity, and is informed by evidence, including cost-effectiveness. Three inter-related research themes were identified: examination and implementation of models of care that enhance both well-being and safety; investigating and optimizing physiological, psychological, and social processes in pregnancy, childbirth, and the postnatal period; and development and validation of outcome measures that capture short and longer term well-being. New, transformative research approaches should account for the underlying social and political-economic mechanisms that enhance or constrain the well-being of women, newborns, families, and societies. Investment in research capacity and capability building across all settings is critical, but especially in those countries that bear the greatest burden of poor outcomes. We believe this call to action for investment in the three research priorities identified in this paper has the potential to achieve these benefits and to realize the ambitions of Sustainable Development Goal Three of good health and well-being for all.