Understanding the relationship between effectiveness and outcome indicators to improve quality in healthcare

Towards performance governance in healthcare: An analysis of Italian local health units

PURPOSE

Bouckaert and Halligan (2008) proposed four ideal types of performance management systems, ranging from a disconnected and input-led approach (performance administration) to a model in which performance management is fully integrated with both the internal and external context of an organisation (performance governance). This article empirically analyzes performance plans issued by Italian Local Health Units (LHUs) to provide a first nationwide snapshot of the different ideal-types of performance management that each (LHUs) have reached, in a 'performance governance'-oriented perspective.

DESIGN

This paper employs a qualitative methodology based on document analysis. The model orienting the analysis features six dimensions capturing the ideal-types characteristics and what the Italian performance regulations prescribe. Data was derived from the performance plans adopted by the Italian LHUs on the condition that they made the documentation necessary for the analysis public on their institutional website.

FINDINGS

For a 'performance governance' oriented approach, two elements are considered relevant: familiarity with the analysis of stakeholders and context. In our sample, consisting of 63 performance plans out of 99 Italian LHUs, it was challenging to identify specific territorial clusters, due to significant heterogeneity. The role of strategic objectives, integration between cycles, and context analysis seems to positively influence the orientation towards a 'performance governance' approach.

ORIGINALITY/VALUE

The application of Bouckaert and Halligan's ideal-types has only been episodically investigated in the healthcare sector, mainly at the individual health unit or Region level. This article's innovative contribution consists of conducting a qualitative analysis based on a replicable taxonomy that enables further national comparisons. Furthermore, it highlights the need for public healthcare systems to engage more with external stakeholders to improve the quality of their performance governance.

A Pragmatic Mapping of Perceptions and Use of Digital Information Systems in Primary Care in Sweden: Survey Study

BACKGROUND

Electronic health records and IT infrastructure in primary care allow for digital documentation and access to information, which can be used to guide evidence-based care and monitor patient safety and quality of care. Quality indicators specified by regulatory authorities can be automatically computed and presented to primary care staff. However, the implementation of digital information systems (DIS) in health care can be challenging, and understanding factors such as relative advantage, compatibility, complexity, trialability, and observability is needed to improve the success and rate of adoption and diffusion.

OBJECTIVE

This study aims to explore how DIS are used and perceived by health care professionals in primary care.

METHODS

This study used quantitative assessment to gather survey data on the use and potential of DIS in health care in Sweden from the perspectives of primary care personnel in various roles. The digital questionnaire was designed to be short and contained 3 sections covering respondent characteristics, current use of platforms, and perceptions of decision support tools. Data were analyzed using descriptive statistics, nonparametric hypothesis testing, ordinal coefficient α, and confirmatory factor analysis.

RESULTS

The study collected responses from participants across 10 regions of Sweden, comprising 31.9% (n=22) from private clinics and 68.1% (n=47) from public clinics. Participants included administrators (18/69, 26.1%), a medical strategist (1/69, 1.4%), and physicians (50/69, 72.5%). Usage frequency varied as follows: 11.6% (n=8) used DIS weekly, 24.6% (n=17) monthly, 27.5% (n=19) a few times a year, 26.1% (n=18) very rarely, and 10.1% (n=7) lacked access. Administrators used DIS more frequently than physicians (P=.005). DIS use centered on quality improvement and identifying high-risk patients, with differences by role. Physicians were more inclined to use DIS out of curiosity (P=.01). Participants desired DIS for patient follow-up, lifestyle guidance, treatment suggestions, reminders, and shared decision-making. Administrators favored predictive analysis (P<.001), while physicians resisted immediate patient identification (P=.03). The 5 innovation attributes showed high internal consistency (α>.7). These factors explained 78.5% of questionnaire variance, relating to complexity, competitive advantage, compatibility, trialability, and observability. Factors 2, 3, and 4 predicted intention to use DIS, with factor 2 alone achieving the best accuracy (root-mean-square=0.513).

CONCLUSIONS

Administrators and physicians exhibited role-based DIS use patterns highlighting the need for tailored approaches to promote DIS adoption. The study reveals a link between positive perceptions and intention to use DIS, emphasizing the significance of considering all factors for successful health care integration. The results suggest various directions for future studies. These include refining the trialability and observability questions for increased reliability and validity, investigating a larger sample with more specific target groups to improve generalization, and exploring the relevance of different groups' perspectives and needs in relation to decisions about and use of DIS.

Analysis of Medico-Legal Complaint Data: A Retrospective Study of Three Large Italian University Hospitals

(1) Background: Identifying hospital-related critical, and excellent, areas represents the main goal of this paper, in both a national and local setting. Information was collected and organized for an internal company's reports, regarding civil litigation that has been affecting the hospital, to relate the obtained results with the phenomenon of medical malpractice on a national scale. This is for the development of targeted improvement strategies, and for investing available resources in a proficient way. (2) Methods: In the present study, data from claims management in Umberto I General Hospital, Agostino Gemelli University Hospital Foundation and Campus Bio-Medico University Hospital Foundation, from 2013 to 2020 were collected. A total of 2098 files were examined, and a set of 13 outcome indicators in the assessment of "quality of care" was proposed. (3) Results: From the total number, only 779 records (37.1%) were attributable to the categories indexable for the present analysis. This data highlights how, following a correct and rigorous categorization of hospital events, it is possible to analyze these medico-legal aspects using a small number of indicators. Furthermore, it is important to consider how a consistent percentage of remaining events was difficult to index, and was also of poor scientific interest. (4) Conclusions: The proposed indicators do not require standards to be compared to, but provide a useful instrument for comparative purposes. In fact, in addition to comparative assessment between different business realities distributed throughout the territory, the use of outcome indicators allows for a longitudinal analysis evaluating the performance of an individual structure over time.

Regional well-being inequalities arising from healthcare expenditure public policies in Spain

Well-being inequalities arising from different healthcare expenditure public policies is currently a hot topic at a national scale, but especially so at a sub-national level because the inequalities in question are among citizens of the same country. Spain is an optimal study area to carry out research on this topic because it is considered to have one of the best health systems in the world, it is one of the top-ranking countries in terms of life expectancy rates (the indicators we use for well-being), and it has a decentralized public health system with significantly different regional healthcare expenditure public policies. Given that the factors involved in the complex direct, indirect, and second-order relationships between well-being and health spending are latent in nature, and that there are more hypotheses than certainties regarding these relationships, we propose a partial least squares structural equation modeling specification to test the research hypotheses and to estimate the corresponding impacts. These constructs are proxied by a set of 26 indicators, for which annual values at a regional scale were used for the period 2005-2018. From the estimation of this model, it can be concluded that mortality, expenditure and resources are the factors that have the greatest impact on well-being. In addition, a cluster analysis of the indicators for the constructs included in this research reveals the existence of three clearly differentiated groups of autonomous communities: the northern part of the country plus Extremadura (characterized by the lowest well-being and the highest mortality rates), Madrid (with the best results in well-being and mortality, the lowest public health expenditure per inhabitant and percentage of pharmaceutical spending, and the highest percentage in specialty care services and medical staff spending), and the rest of the country (south-eastern regions, with similar well-being values to those of the first group but with less health expenditure). Finally, a principal component analysis reveals that "healthiness" and "basic spending" are the optimal factors for mapping well-being and health spending in Spain.

Analyzing the key performance indicators of circular supply chains by hybrid fuzzy cognitive mapping and Fuzzy DEMATEL: evidence from healthcare sector

This study presents a multi-layer fuzzy-based decision-making approach to enhance the hospital Circular Supply Chain (CSC) performance by focusing on intensive care units (ICU) via key performance indicators analysis. In this regard, a Systematic Literature Review (SLR) and Institution Fuzzy Delphi (IFD) are employed to extract the relevant and prominent KPIs. After, a hybrid Fuzzy Cognitive Mapping (FCM) and Fuzzy Decision Making Trial and Evaluation Laboratory (FDEMATEL) have been applied to illustrate a conceptual framework for the CSC performance management of the healthcare sector in the emerging economy of Iran. As a result, eight critical indicators emanated from the SLR-IFD approach. Furthermore, sixteen relationships amongst the performance indicators were identified via hybrid FCM-FDEMATEL. Inventory availability, information availability, innovation, and technology were selected as the most influential indicators. Besides, changing the information technology category, including information availability and Innovation and technology, had the most impact on the performance of the entire CSC. This study attempts to evaluate hospitals' circular supply chain performance, by designing the circular evaluation framework. Hospital managers can use the results of this research to improve their internal circular supply chain performances in the intensive care units by understanding the different scenarios.

An integrative model of patients' perceived value of healthcare service quality in North Cyprus

Background

Improving healthcare quality has become an essential objective for all health institutions worldwide to address the need to improve services, manage costs and satisfy patient expectations about the quality of care. As health is one of the leading service sectors of the North Cyprus economy, analysing patients’ perceived value of healthcare service quality is crucial. In this research, a comparative analysis of existing models revealed affordability, acceptability and accessibility as the leading modern service quality indicators affecting patients’ perceived value of healthcare service quality. The quality of services is a leading factor impacting business competition and retention dictated by the current market. This study aimed to investigate the factors that influence patient perceptions of healthcare service quality in North Cyprus.

Methods

A self-administered questionnaire was carried out among 388 patients of public and private hospitals in North Cyprus, and the data were analysed using partial least squares-structural equation modelling.

Results

Empirical results highlight that the acceptability of healthcare services is a prerequisite for perceiving a high value of service quality. The affordability and accessibility of services, respectively, were less effective. Results concerning mediating effects confirm that acceptability could fully mediate the relationship between affordability and perceived value and could partially mediate the impact of accessibility on the perceived quality of healthcare services.

Conclusion

This study contributes to healthcare theory and practice by developing a conceptual framework to provide policymakers and managers with a practical understanding of factors that affect healthcare service quality.

Measuring Regional Performance in the Italian NHS: Are Disparities Decreasing?

Given the regional disparities that historically characterize the Italian context, in this paper we propose a framework to evaluate the regional health care systems' performance in order to contribute to the debate on the relationship between decentralisation of health care and equity. To investigate the regional health systems performance, we refer to the OECD Health Care Quality Indicators project to construct of a set of five composite indexes. The composite indexes are built on the basis of the non-compensatory Adjusted Mazziotta-Pareto Index, that allows comparability of the data across units and over time. We propose three indexes of health system performance, namely Quality Index, Accessibility Index and Cost-Expenditure Index, along with a Health Status Index and a Lifestyles Index. Our framework highlights that regional disparities still persist. Consistently with the evidence at the institutional level, there are regions, particularly in Southern Italy, which record lower levels of performance with high levels of expenditure. Continuous research is needed to provide policy makers with appropriate data and tools to build a cohesive health care system for the benefit of the whole population. Even if future research is needed to integrate our framework with new indicators for the calculation of the indexes and with the identification of new indexes, the study shows that a scientific reflection on decentralisation of health systems is necessary in order to reduce inequalities.

Using Higher-Order Constructs to Estimate Health-Disease Status: The Effect of Health System Performance and Sustainability

This article aims to provide information to public agencies and policymakers on the determinants of health systems and their relationships that influence citizens’ health–disease status. A total of 61 indicators for each of 17 Spanish autonomous communities were collected from the Spanish Ministry of Health, Social Services, and Equality between 2008 and 2017. The applied technique was partial least squares structural equation modeling (PLS-SEM). Concerning health–disease status, an influence of sustainability and performance on the health system was hypothesized. The findings revealed that health system sustainability had a negative effect on health–disease status, measured in terms of disease incidence. However, the relationship between health system performance and health–disease status is positive. Furthermore, health system performance mediates the relationship between sustainability and health–disease status. According to our study, if we consider the opposite poles that make up the definition of health–disease status (well-being and disease), this concept is defined more by the incidence of the negative aspect.

Health Investment Management and Healthcare Quality in the Public System: A Gender Perspective

The aim of this empirical research was to provide useful information for health system managers on the costs and investments involved in improving the quality of the National Health Service (NHS) based on patient assessments and from a gender perspective, i.e., without assuming that the perceived experience is identical for men and women. A cross-sectional study of 31 variables was applied using partial least squares structural equation modeling (PLS-SEM) as a research tool. The data were obtained from the Spanish Ministry of Health, Consumption, and Social Welfare for the entire Spanish territory between 2005 and 2018. The influence of expenditure, resource allocation, and mortality was hypothesized with regard to patient satisfaction according to disconfirmation theory. Patient satisfaction reflects clinical effectiveness, and therefore is a measure of health system quality. The results show that women are more sensitive to public investment in health than men, i.e., an increase in the level of spending and resources increases satisfaction more in women. In both sexes, the level of expenditure has a direct influence on patient satisfaction, and therefore on the quality of the healthcare system. It is important to increase spending on primary care, especially on specialized medical care and diagnostic equipment. However, reducing the use of drugs in favor of alternative treatments or therapies is considered to be positive. Likewise, spending has an impact on available resources, and these, in turn, have a positive influence on the level of use and a negative impact on mortality. Resources, especially healthcare staff, nuclear magnetic resonance equipment, and the number of posts in day hospitals, increase patients’ positive perception of the NHS.

Ranking the Healthcare Resource Factors for Public Satisfaction with Health System in China-Based on the Grey Relational Analysis Models

(1) Background: Public satisfaction with the health system is a very important comprehensive indicator. Given the limited healthcare resources in a society, it is always important for policymakers to have full information about the priority and the ranking order of the factors of healthcare resources for improving public satisfaction. (2) Methods: Grey Relational Analysis (GRA) is advantageous for satisfaction analysis because satisfaction is a “grey concept” of “having a clear boundary but vague connotation”. The data were from the CGSS and the China Health Statistics Yearbook (2013 and 2015), with a total of 15,969 samples (average satisfaction score = 68.5, age = 51.9, female = 49.4%). (3) Results: The government’s percentage of total expenditure on healthcare was ranked as the most important factor for public satisfaction with the health system in China in both 2013 and 2015. The second most important factor changed from “Out-of-pocket percentage of individuals” in 2013 to “Hospital beds per thousand populations” in 2015. Meanwhile, “Healthcare workforce per thousand populations” increased from the least important factor in 2013 to the 3rd in 2015. Disparities in the ranking orders of the factors among regions of China were identified too. (4) Conclusions: The analysis results suggest that during recent years the priority of Chinese residents’ healthcare satisfaction for healthcare resources has shifted on the national level from economic affordability to more intensive “people-centered” services, while the regional disparities and gaps need to receive more attention and be further improved in the healthcare reform of next round.

Going beyond health efficiency: What really matters?

Both citizens and policymakers demand the best possible results from a country's healthcare system. It is of utmost importance to accurately and objectively assess the efficiency of a healthcare system and to note the key indicators, where resources are lost, and possibilities for improvement. This paper evaluates the efficiency of health systems in 38 countries, mainly members of the Organization for Economic Co-operation and Development, using data envelopment analysis (DEA). In the first stage, bootstrapped Ivanovic distance is used to generate weights for the indicators, thus taking into consideration different country's goals, but not to the extent of reducing the possibility of comparison. The analysis shows that human resources are the most important health system resource and countries should pay special attention to developing and employing competent medical workers. The reorganization of human resources and the funds allocated to them could also increase efficiency. The second stage examines environmental indicators to find the causes of inefficiency. No proof is found that any one basic health system funding model produces better health outcomes than the others. Obesity is identified as a major issue.