Development and Validation of the CPO Scale, a New Instrument for Evaluation of Health Care Improvement Efforts

Prioritising recommendations following analyses of adverse events in healthcare: a systematic review

Purpose

The purpose of this systematic review was to identify an appropriate method—a user-friendly and validated method—that prioritises recommendations following analyses of adverse events (AEs) based on objective features.

Data sources

The electronic databases PubMed/MEDLINE, Embase (Ovid), Cochrane Library, PsycINFO (Ovid) and ERIC (Ovid) were searched.

Study selection

Studies were considered eligible when reporting on methods to prioritise recommendations.

Data extraction

Two teams of reviewers performed the data extraction which was defined prior to this phase.

Results of data synthesis

Eleven methods were identified that are designed to prioritise recommendations. After completing the data extraction, none of the methods met all the predefined criteria. Nine methods were considered user-friendly. One study validated the developed method. Five methods prioritised recommendations based on objective features, not affected by personal opinion or knowledge and expected to be reproducible by different users.

Conclusion

There are several methods available to prioritise recommendations following analyses of AEs. All these methods can be used to discuss and select recommendations for implementation. None of the methods is a user-friendly and validated method that prioritises recommendations based on objective features. Although there are possibilities to further improve their features, the ‘Typology of safety functions’ by de Dianous and Fiévez, and the ‘Hierarchy of hazard controls’ by McCaughan have the most potential to select high-quality recommendations as they have only a few clearly defined categories in a well-arranged ordinal sequence.

Domains associated with successful quality improvement in healthcare - a nationwide case study

Background

There is a distinct difference between what we know and what we do in healthcare: a gap that is impairing the quality of the care and increasing the costs. Quality improvement efforts have been made worldwide by learning collaboratives, based on recognized continual improvement theory with limited scientific evidence. The present study of 132 quality improvement projects in Norway explores the conditions for improvement from the perspectives of the frontline healthcare professionals, and evaluates the effectiveness of the continual improvement method.

Methods

An instrument with 25 questions was developed on prior focus group interviews with improvement project members who identified features that may promote or inhibit improvement. The questionnaire was sent to 189 improvement projects initiated by the Norwegian Medical Association, and responded by 70% (132) of the improvement teams. A sub study of their final reports by a validated instrument, made us able to identify the successful projects and compare their assessments with the assessments of the other projects. A factor analysis with Varimax rotation of the 25 questions identified five domains. A multivariate regression analysis was used to evaluate the association with successful quality improvements.

Results

Two of the five domains were associated with success: Measurement and Guidance (p = 0.011), and Professional environment (p = 0.015). The organizational leadership domain was not associated with successful quality improvements (p = 0.26).

Conclusion

Our findings suggest that quality improvement projects with good guidance and focus on measurement for improvement have increased likelihood of success. The variables in these two domains are aligned with improvement theory and confirm the effectiveness of the continual improvement method provided by the learning collaborative. High performing professional environments successfully engaged in patient-centered quality improvement if they had access to: (a) knowledge of best practice provided by professional subject matter experts, (b) knowledge of current practice provided by simple measurement methods, assisted by (c) improvement knowledge experts who provided useful guidance on measurement, and made the team able to organize the improvement efforts well in spite of the difficult resource situation (time and personnel). Our findings may be used by healthcare organizations to develop effective infrastructure to support improvement and to create the conditions for making quality and safety improvement a part of everyone’s job.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-017-2454-2) contains supplementary material, which is available to authorized users.