Depicting the interplay between organisational tiers in the use of a national quality registry to develop quality of care in Sweden

Quality and Performance Measurement in Primary Diabetes Care: A Qualitative Study in Urban China

BACKGROUND

Quality measurements in primary healthcare (PHC) have become an essential component for improving diabetes outcomes in many high-income countries. However, little is known about their implementation within the Chinese health-system context and how they are perceived by patients, physicians, and policy-makers. We examined stakeholders' perceptions of quality and performance measurements for primary diabetes care in Shanghai, China, and analyzed facilitators and barriers to implementation.

METHODS

In-depth interviews with 26 key stakeholders were conducted from 2018 to 2019. Participants were sampled from two hospitals, four community healthcare centers (CHCs), and four institutes involved in regulating CHCs. The Consolidated Framework for Implementation Research (CFIR) guided data analysis.

RESULTS

Existing quality measurements were uniformly implemented via a top-down process, with daily monitoring of family doctors' work and pay-for-performance incentives. Barriers included excluding frontline clinicians from indicator planning, a lack of transparent reporting, and a rigid organizational culture with limited bottom-up feedback. Findings under the CFIR construct "organizational incentives" suggested that current pay-for-performance incentives function as a "double-edged sword," increasing family doctors' motivation to excel while creating pressures to "game the system" among some physicians. When considering the CFIR construct "reflecting and evaluating," policy-makers perceived the online evaluation application - which provides daily reports on family doctors' work - to be an essential tool for improving quality; however, this information was not visible to patients. Findings included under the "network and communication" construct showed that specialists support the work of family doctors by providing training and patient consultations in CHCs.

CONCLUSION

The quality of healthcare could be considerably enhanced by involving patients and physicians in decisions on quality measurement. Strengthening hospital-community partnerships can improve the quality of primary care in hospital-centric systems. The case of Shanghai provides compelling policy lessons for other health systems faced with the challenge of improving PHC.

Maximising the value of clinical registry information through integration with a health service clinical governance framework: a case study

This initiative sought to identify unit participation in clinical registries within a large metropolitan health service and to develop approaches to integration of registry reporting within the organisational clinical governance framework to maximise potential quality improvement benefits. The initiative, led by the Medical Services Department at Alfred Health, initially involved identifying health service participation in clinical registries via a range of mechanisms, including one-on-one meetings with clinical registry investigators. In conjunction with the Clinical Governance Unit, tools to summarise and track clinical registry information at Alfred Health over time were developed and piloted. Alfred Health identified 69 clinical registries in which its units participated. These were heterogeneous in terms of clinical area and purpose, as well as the nature and frequency of reporting. Engagement with clinicians led to the establishment of a registry interest group, a calendar of clinical quality registry reports, and a guideline and reporting template and dashboard. Clinician engagement and medical leadership were critical to the development of this initiative. The reporting tool and dashboard have had initial success, with long-term success ultimately being measured by the routine incorporation of registry outcomes into clinical governance reporting over time.

Implementation of a national policy for improving health and social care: a comparative case study using the Consolidated Framework for Implementation Research

Background

Comprehensive policies are becoming common for addressing wicked problems in health and social care. Success of these policies often varies between target organizations. This variation can often be attributed to contextual factors. However, there is a lack of knowledge about the conditions for successful policy implementation and how context influences this process. The aim of this study was to investigate county-level actors’ perspectives on the implementation of a comprehensive national policy in three Swedish counties. The policy focused on developing quality of care for elderly based on the use of national quality registries (NQRs) and to improve coordination of care.

Methods

A comparative case study approach was used. Data was collected longitudinally through documents and interviews. The Consolidated Framework for Implementation Research (CFIR) guided the analysis.

Results

All three counties shared the view that the policy addressed important issues. Still, there was variation regarding how it was perceived and managed. Adaptable features—i.e., NQRs and improvement coaches—were perceived as relevant and useful. However, the counties differed in their perceptions of another policy component—i.e., senior management program—as an opportunity or a disturbance. This program, while tackling complex issues of collaboration, fell short in recognizing the counties’ pre-existing conditions and needs and also offered few opportunities for adaptations. Performance bonuses and peer pressure were strong incentives for all counties to implement the policy, despite the poor fit of policy content and local context.

Conclusions

Comprehensive health policies aiming to address wicked problems have better chances of succeeding if the implementation includes assessments of the target organizations’ implementation capacity as well as the implicit quid pro quos involved in policy development. Special attention is warranted regarding the use of financial incentives when dealing with wicked problems since the complexity makes it difficult to align incentives with the goals and to assess potential consequences. Other important aspects in the implementation of such policies are the use of collaborative approaches to engage stakeholders with differing perspectives, and the tailoring of policy communication to facilitate shared understanding and commitment.

The Educational Impact of Implementing National Quality Registries in Sweden-A National Collaboration Project

BACKGROUND AND OBJECTIVES

There is a need for improved clinical outcomes, and a useful tool in this endeavor is the use of National Quality Registries (NQRs). To learn more about the impact of NQRs, a National Collaboration Project was formed. This follow-up study had 2 aims: first, to describe the value and learning of a National Collaboration Project focusing on the use of NQRs in collaboration between universities, health care organizations, and the regional registry centers; and, second, to describe what activities are still ongoing.

METHOD

A qualitative design was used to obtain a detailed description of the extent to which project leaders perceived that the goals had been achieved after participation in the national project. A qualitative descriptive content analysis was performed.

RESULTS

Four main categories were found. The context proved to be crucial for how the local projects were formed and developed. Networking was highlighted as an important part of learning. Another mentioned part of learning was the change planned and implemented in the curriculum to promote the use of NQRs. Finally, the importance of anchoring and spreading the lessons learned was also stressed.

CONCLUSION

Using NQRs in multidisciplinary education is successful in many ways, but this study shows that certain factors need to be in place to make it work in practice.

Facilitators for using data from a quality registry in local quality improvement work: a cross-sectional survey of the Danish Cardiac Rehabilitation Database

OBJECTIVES

To investigate use of data from a clinical quality registry for cardiac rehabilitation in Denmark, considering the extent to which data are used for local quality improvement and what facilitates the use of these data, with a particular focus on whether there are differences between frontline staff and managers.

DESIGN

Cross-sectional nationwide survey study.

SETTING, METHODS AND PARTICIPANTS

A previously validated, Swedish questionnaire regarding use of data from clinical quality registries was translated and emailed to frontline staff, mid-level managers and heads of departments (n=175) in all 30 hospital departments participating in the Danish Cardiac Rehabilitation Database. Data were analysed descriptively and through multiple linear regression.

RESULTS

Survey response rate was 58% (101/175). Reports of registry use at department level (measured through an index comprising seven items; score min 0, max 7, where a low score indicates less use of data) varied significantly between groups of respondents: frontline staff mean score 1.3 (SD=2.0), mid-level management mean 2.4 (SD=2.3) and heads of departments mean 3.0 (SD=2.5), p=0.006. Overall, department level use of data was positively associated with higher perceived data quality and usefulness (regression coefficient=0.22, p=0.019), management request for data (regression coefficient=0.40, p=0.008) and personal motivation of the respondent (regression coefficient=1.63, p<0.001). Among managers, use of registry data was associated with data quality and usefulness (regression coefficient=0.43, p=0.027), and among frontline staff, reported data use was associated with management involvement in quality improvement work (regression coefficient=0.90, p=0.017) and personal motivation (regression coefficient=1.66, p<0.001).

CONCLUSIONS

The findings suggest relatively sparse use of data in local quality improvement work. A complex interplay of factors seem to be associated with data use with varying aspects being of importance for frontline staff and managers.

Clinical performance comparators in audit and feedback: a review of theory and evidence

BACKGROUND

Audit and feedback (A&F) is a common quality improvement strategy with highly variable effects on patient care. It is unclear how A&F effectiveness can be maximised. Since the core mechanism of action of A&F depends on drawing attention to a discrepancy between actual and desired performance, we aimed to understand current and best practices in the choice of performance comparator.

METHODS

We described current choices for performance comparators by conducting a secondary review of randomised trials of A&F interventions and identifying the associated mechanisms that might have implications for effective A&F by reviewing theories and empirical studies from a recent qualitative evidence synthesis.

RESULTS

We found across 146 trials that feedback recipients' performance was most frequently compared against the performance of others (benchmarks; 60.3%). Other comparators included recipients' own performance over time (trends; 9.6%) and target standards (explicit targets; 11.0%), and 13% of trials used a combination of these options. In studies featuring benchmarks, 42% compared against mean performance. Eight (5.5%) trials provided a rationale for using a specific comparator. We distilled mechanisms of each comparator from 12 behavioural theories, 5 randomised trials, and 42 qualitative A&F studies.

CONCLUSION

Clinical performance comparators in published literature were poorly informed by theory and did not explicitly account for mechanisms reported in qualitative studies. Based on our review, we argue that there is considerable opportunity to improve the design of performance comparators by (1) providing tailored comparisons rather than benchmarking everyone against the mean, (2) limiting the amount of comparators being displayed while providing more comparative information upon request to balance the feedback's credibility and actionability, (3) providing performance trends but not trends alone, and (4) encouraging feedback recipients to set personal, explicit targets guided by relevant information.

"Struggling with practices" - a qualitative study of factors influencing the implementation of clinical quality registries for cardiac rehabilitation in England and Denmark

Background

The use of clinical quality registries as means for data driven improvement in healthcare seem promising. However, their use has been shown to be challenged by a number of aspects, and we suggest some may be related to poor implementation. There is a paucity of literature regarding barriers and facilitators for registry implementation, in particular aspects related to data collection and entry. We aimed to illuminate this by exploring how staff perceive the implementation process related to the registries within the field of cardiac rehabilitation in England and Denmark.

Methods

A qualitative, interview-based study with staff involved in collecting and/or entering data into the two case registries (England N = 12, Denmark N = 12). Interviews were analysed using content analysis. The Consolidated Framework for Implementation Research was used to guide interviews and the interpretation of results.

Results

The analysis identified both similarities and differences within and between the studied registries, and resulted in clarification of staffs´ experiences in an overarching theme: ´Struggling with practices´ and five categories; the data entry process, registry quality, resources and management support, quality improvement and the wider healthcare context. Overall, implementation received little focused attention. There was a lack of active support from management, and staff may experience a struggle of fitting use of a registry into a busy and complex everyday practice.

Conclusion

The study highlights factors that may be important to consider when planning and implementing a new clinical quality registry within the field of cardiac rehabilitation, and is possibly transferrable to other fields. The results may thus be useful for policy makers, administrators and managers within the field and beyond. Targeting barriers and utilizing knowledge of facilitating factors is vital in order to improve the process of registry implementation, hence helping to achieve the intended improvement of care processes and outcomes.

Electronic supplementary material

The online version of this article (10.1186/s12913-019-3940-5) contains supplementary material, which is available to authorized users.

Enhancing policy implementation to improve healthcare practices: The role and strategies of hybrid national-local support structures

BACKGROUND

In this study, we followed a national initiative to enhance the use of quality indicators gathered in national quality registries (NQRs) for improvement of clinical practices in Swedish healthcare, more specifically by investigating the support strategies of regional support centers with national and local missions. The aim was to increase knowledge on the role, challenges, and strategies of support structures with mixed and complex missions in the healthcare system.

METHODS

Documents and 25 semistructured interviews with staff at 6 regional support centers, ie, quality registry centers, formed this multiple case study. Data were analyzed using conventional content analysis.

RESULTS

The centers' strategies varied from developing the NQRs to become more suitable for improvement to supporting healthcare's use of NQRs, from the use of task to process-oriented support strategies, and from taking on national responsibilities to responding to local initiatives. All quality registry centers engaged in initiatives inspired by the Breakthrough Series approach. Some used preexisting change concepts or collaborated with local development units. A main challenge was to overcome a lack of formal mandate to act in the healthcare organizations they served.

CONCLUSIONS

Support functions with mixed and complex missions have to use a variation of strategies to reach relevant actors and achieve changes. This study provides valuable input for policy and decision-makers on the support strategies used and challenges of support functions with complex missions situated in-between national and local levels of the healthcare system, here denoted hybrid national-local support structures.

Value-based healthcare as a trigger for improvement initiatives

Purpose This study explores four pilot teams' experiences of improvements resulting from the implementation of value-based healthcare (VBHC) at a Swedish University Hospital. The aim of this study is to gain a deeper understanding of VBHC when used as a management strategy to improve patients' health outcomes. Design/methodology/approach An exploratory design was used and qualitative interviews were undertaken with 20 team members three times each, during a period of two years. The content of the interviews was qualitatively analysed. Findings VBHC worked as a trigger for initiating improvements related to processes, measurements and patients' health outcomes. An example of improvements related to patients' health outcomes was solving the problem of patients' nausea. Improvement related to processes was developing care planning and increasing the number of contact nurses. Improvement related to measurements was increasing coverage ratio in the National Quality Registers used, and the development of a new coding system for measurements. VBHC contributed a structure for measurement and for identification of the need for improvements, but this structure on its own was not enough. To implement and sustain improvements, it is important to establish awareness of the need for improvements and to motivate changes not just among managers and clinical leaders directly involved in VBHC projects but also engage all other staff providing care. Originality/value This study shows that although the VBHC management strategy may serve as an initiator for improvements, it is not enough for the sustainable implementation of improvement initiatives. Regardless of strategy, managers and clinical leaders need to develop increased competence in change management.

Factors facilitating a national quality registry to aid clinical quality improvement: findings of a national survey

OBJECTIVES

While national quality registries (NQRs) are suggested to provide opportunities for systematic follow-up and learning opportunities, and thus clinical improvements, features in registries and contexts triggering such processes are not fully known. This study focuses on one of the world's largest stroke registries, the Swedish NQR Riksstroke, investigating what aspects of the registry and healthcare organisations facilitate or hinder the use of registry data in clinical quality improvement.

METHODS

Following particular qualitative studies, we performed a quantitative survey in an exploratory sequential design. The survey, including 50 items on context, processes and the registry, was sent to managers, physicians and nurses engaged in Riksstroke in all 72 Swedish stroke units. Altogether, 242 individuals were presented with the survey; 163 responded, representing all but two units. Data were analysed descriptively and through multiple linear regression.

RESULTS

A majority (88%) considered Riksstroke data to facilitate detection of stroke care improvement needs and acknowledged that their data motivated quality improvements (78%). The use of Riksstroke for quality improvement initiatives was associated (R²=0.76) with 'Colleagues' call for local results' (p=<0.001), 'Management Request of Registry data' (p=<0.001), and it was said to be 'Simple to explain the results to colleagues' (p=0.02). Using stepwise regression, 'Colleagues' call for local results' was identified as the most influential factor. Yet, while 73% reported that managers request registry data, only 39% reported that their colleagues call for the unit's Riksstroke results.

CONCLUSIONS

While an NQR like Riksstroke demonstrates improvement needs and motivates stakeholders to make progress, local stroke care staff and managers need to engage to keep the momentum going in terms of applying registry data when planning, performing and evaluating quality initiatives.