Insights on the effectiveness of reward schemes from 10-year longitudinal case studies in 2 Italian regions

The contribution of benchmarking to quality improvement in healthcare. A systematic literature review

BACKGROUND

Benchmarking has been recognised as a valuable method to help identify strengths and weaknesses at all levels of the healthcare system. Despite a growing interest in the practice and study of benchmarking, its contribution to quality of care have not been well elucidated. As such, we conducted a systematic literature review with the aim of synthesizing the evidence regarding the relationship between benchmarking and quality improvement. We also sought to provide evidence on the associated strategies that can be used to further stimulate quality improvement.

METHODS

We searched three databases (PubMed, Web of Science and Scopus) for articles studying the impact of benchmarking on quality of care (processes and outcomes). Following assessment of the articles for inclusion, we conducted data analysis, quality assessment and critical synthesis according to the PRISMA guidelines for systematic literature review.

RESULTS

A total of 17 articles were identified. All studies reported a positive association between the use of benchmarking and quality improvement in terms of processes (N = 10), outcomes (N = 13) or both (N = 7). In the majority of studies (N = 12), at least one intervention, complementary to benchmarking, was undertaken to stimulate quality improvement. The interventions ranged from meetings between participants to quality improvement plans and financial incentives. A combination of multiple interventions was present in over half of the studies (N = 10).

CONCLUSIONS

The results generated from this review suggest that the practice of benchmarking in healthcare is a growing field, and more research is needed to better understand its effects on quality improvement. Furthermore, our findings indicate that benchmarking may stimulate quality improvement, and that interventions, complementary to benchmarking, seem to reinforce this improvement. Although this study points towards the benefit of combining performance measurement with interventions in terms of quality, future research should further analyse the impact of these interventions individually.

Waiting time information in the Italian NHS: A citizen perspective

Public involvement in the management and communication of waiting times is known to support initiatives to reduce waiting times, as well as increase fairness and promote transparency and accountability. In order to improve transparency and communication to citizens, Italy recently updated the National Regulatory Plan for Waiting Lists (2019-2021), which calls for the disclosure of waiting time information on healthcare provider webpages. This study analyses waiting time information for outpatient visits and digital services available on the institutional website pages of 144 public healthcare organisations in nine regions and two autonomous provinces of Italy. Web pages were analysed both in terms of the available information/services, using a grid, and in terms of the quality of the text using an advanced readability assessment tool (READ-IT). This information was complemented and validated by regional healthcare key informants during research-specific workshops. Waiting time information disclosure, digital services and text readability varied both within and between the regional healthcare systems and organisations. The types and characteristics of waiting time information and statistics vary considerably with a negative impact on their use for benchmarking and their readability and usability for booking purposes. Overall, communication weaknesses due to low harmonization and clarity of information can undermine efforts in effectively informing and involving the public through online waiting time data disclosure.

Using patient-reported measures to drive change in healthcare: the experience of the digital, continuous and systematic PREMs observatory in Italy

BACKGROUND

The use of Patient Reported Experience Measures (PREMs) has great potential in healthcare service improvement, but a limited use. This paper presents an empirical case of PREMs innovation in Italy, to foster patient data use up to the ward level, by keeping strengths and addressing weaknesses of previous PREMs survey experiences. The paper reports key lessons learned in this ongoing experience of action research, directly involving practitioners.

METHODS

The aim of this paper is to present the results of an ongoing action research, encompassing the innovation of PREMs collection, reporting and use, currently adopted by 21 hospitals of two Italian regions. The continuous and systematic PREMs collection has been implemented between 2017 and 2019 and includes: a continuous web-based administration, using web-services; an augmented and positive questionnaire matching standard closed-ended questions with narrative sections; the inclusion and benchmarking of patient data within a shared performance evaluation system; public disclosure of aggregated anonymized data; a multi-level and real-time web-platform for reporting PREMs to professionals. The action research was carried out with practitioners in a real-life and complex context. The authors used multiple data sources and methods: observations, feedback of practitioners, collected during several workshops and meetings, and analysis of preliminary data on the survey implementation.

RESULTS

A continuous and systematic PREMs observatory was developed and adopted in two Italian regions. PREMs participation and response rates tend to increase over time, reaching stable percentages after the first months. Narrative feedback provide a 'positive narration' of episodes and behaviours that made the difference to patients and can inform quality improvement actions. Real-time reporting of quantitative and qualitative data is enabling a gratifying process of service improvement and people management at all the hospitals' levels.

CONCLUSIONS

The PREMs presented in this paper has been recognized by healthcare professionals and managers as a strategic and positive tool for improving an actual use of PREMs at system and ward levels, by measuring and highlighting positive deviances, such as compassionate behaviours.

Implementing successful systematic Patient Reported Outcome and Experience Measures (PROMs and PREMs) in robotic oncological surgery-The role of physicians

Patient Reported Outcome and Experience Measures (PROMs and PREMs) play an increasingly important role in monitoring the quality of the oncological pathway. The aim of this study is to describe the case of five hospitals a year after the adoption of PROMs and PREMs for robotic oncological colorectal surgery in Tuscany and to investigate how the clinicians can impact the process of implementation and the efficacy of such measures. We used 14 months of data from the five robotic centers in Tuscany. Above all, the physician's personal motivation to improve the treatment of patients, the teamwork, and the possibility to use data for research purposes proved to be the essential factors for their engagement and the successful implementation of patient reported measures. Physicians play a key role in the adoption of systematic PROMs and PREMs. The higher their level of engagement, the higher the collection success, both in terms of number of patients enrolled and response rates. Moreover, the collection of patient reported measures may become part of physicians' daily practice and may lead to a change in their relationship and communication with patients, as clinicians accept to have their job reviewed and are not afraid to be evaluated by their patients.

Distribution of monetary incentives in health insurance scheme influences acupuncture treatment choices: An experimental study

BACKGROUND

Understanding how doctors respond to occupational and monetary incentives in health care payment systems is important for determining the effectiveness of such systems. This study examined changes in doctors' behaviors in response to monetary incentives within health care payment systems in a ceteris paribus setting.

METHODS

An online experiment was developed to analyze the effect of monetary incentives similar to fee-for-service (FFS) and capitation (CAP) on doctors' prescription patterns. In the first session, no monetary values were presented. In the second session conducted 1 week later, doctors were randomly assigned to one of two monetary incentive groups (FFS group: n = 25, CAP group: n = 25). In all sessions, doctors were presented with 10 cases and asked to determine the type and number of treatments.

RESULTS

In the first session with no monetary incentives, there was no significant difference between the FFS and CAP groups in the number of treatments. When monetary incentives were provided, doctors in the CAP group prescribed fewer treatments than the FFS group. The perceived severity of the cases did not change significantly between sessions and between groups. linear mixed-effects regression model indicated the treatment choices were influenced by monetary incentives, but not by the perceived severity of the patient's symptoms.

CONCLUSION

The monetary values incentivized the doctors' treatment choices, but not their professional evaluation of patients. Monetary values designed within health care systems influence the doctor's decisions in the form of external rewards, in addition to occupational values, and can thus be adjusted by more effective incentives.

Insights on the effectiveness of reward schemes from 10-year longitudinal case studies in 2 Italian regions

BACKGROUND

Pay for performance (P4P) programs have been widely analysed in literature, and the results regarding their impact on performance are mixed. Moreover, in the real-life setting, reward schemes are designed combining multiple elements altogether, yet, it is not clear what happens when they are applied using different combinations.

OBJECTIVES

To provide insights on how P4P programs are influenced by 5 key elements: whom, what, how, how many targets, and how much to reward.

METHODS

A qualitative longitudinal analysis of 10 years of P4P reward schemes adopted by the regional administrations of Tuscany and Lombardy (Italy) was conducted. The effects of the P4P features on performance are discussed considering both overall and specific indicators.

RESULTS

Both regions applied financial reward schemes for General Managers by linking the variable pay to performance. While Tuscany maintained a relatively stable financial incentive design and governance tools, Lombardy changed some elements of the design and introduced, in 2012, a P4P program aimed to reward the providers. The main differences between the 2 cases regard the number of targets (how many), the type (what), and the method applied to set targets (how).

CONCLUSION

Considering the overall performance obtained by the 2 regions, it seems that whom, how, and how much to reward are not relevant in the success of P4P programs; instead, the number (how many) and the type (what) of targets set may influence the performance improvement processes driven by financial reward schemes.