Evaluation of a Quality Improvement Resource for Public Health Practitioners

OBJECTIVES

Quality improvement is a critical mechanism to manage public health agency performance and to strengthen accountability for public funds. The objective of this study was to evaluate a relatively new quality improvement resource, the Public Health Quality Improvement Exchange (PHQIX), a free online communication platform dedicated to making public health quality improvement information accessible to practitioners.

METHODS

We conducted an internet-based survey of registered PHQIX users (n = 536 respondents) in 2013 and key informant interviews with PHQIX frequent users (n = 21) in 2014, in the United States. We assessed use of the PHQIX website, user engagement and satisfaction, communication and knowledge exchange, use of information, and impact on quality improvement capacity and accreditation readiness.

RESULTS

Of 462 respondents, 369 (79.9%) browsed quality improvement initiatives, making it the most commonly used site feature, and respondents described PHQIX as a near-unique source for real-world quality improvement examples. Respondents were satisfied with the quality and breadth of topics and relevance to their settings (average satisfaction scores, 3.9-4.1 [where 5 was the most satisfied]). Of 407 respondents, 237 (58.2%) said that they had put into practice information learned on PHQIX, and 209 of 405 (51.6%) said that PHQIX had helped to improve quality improvement capacity. Fewer than half of respondents used the commenting function, the Community Forum, and the Ask an Expert feature.

CONCLUSIONS

Findings suggest that PHQIX, particularly descriptions of the quality improvement initiatives, is a valued resource for public health practitioners. Users reported sharing information with colleagues and applying what they learned to their own work. These findings may relate to other efforts to disseminate quality improvement knowledge.

Using health information exchanges to calculate clinical quality measures: A study of barriers and facilitators

BACKGROUND

A key motivation for the large national investment in electronic health record systems is to promote electronic reporting of quality measures that can be used as the basis for moving to value-based payment. Given the fragmented delivery system, robust quality reporting requires aggregating data across sites of care. Health information exchanges (HIEs) have emerged to facilitate exchange of clinical data across provider organizations and, therefore, should be well-positioned to support clinical quality measure reporting.

METHODS

By interviewing representatives from 36 HIEs across the United States, we aimed to determine whether HIEs are capable of computing National Quality Forum measures for 6 cardiovascular disease preventive services.

RESULTS

Eleven HIEs (30%) reported computing at least one CQM; six computed one or more of the measures, and no HIE computed a measure in each of the 6 areas. Barriers to computing CQMs included data quality, completeness, sharing, and transmission issues; organizational structure, maturity, and sustainability issues; and vendor issues.

CONCLUSIONS

The ability to compute CQMs at the HIE level is still yet to be developed; currently, very few HIEs are able to do so for a variety of reasons. As HIE services expand and HIEs mature organizationally, the viability and utility of CQM reporting at the HIE level will increase.

IMPLICATIONS

As the healthcare system migrates towards a value-based payment system these broad challenges will need to be addressed.

LEVEL OF EVIDENCE

Cross-sectional semi-structured qualitative interviews.

Beacon communities' public health initiatives: a case study analysis

INTRODUCTION

The Beacon Communities for Public Health (BCPH) project was launched in 2011 to gain a better understanding of the range of activities currently being conducted in population- and public health by the Beacon Communities. The project highlighted the successes and challenges of these efforts with the aim of sharing this information broadly among the public health community.

BACKGROUND

The Beacon Community Program, designed to showcase technology-enabled, community-based initiatives to improve outcomes, focused on: building and strengthening health information technology (IT) infrastructure and exchange capabilities; translating investments in health IT to measureable improvements in cost, quality, and population health; and, developing innovative approaches to performance measurement, technology, and care delivery.

METHODS

Four multimethod case studies were conducted based on a modified sociotechnical framework to learn more about public health initiative implementation and use in the Beacon Communities. Our methodological approach included using document review and semistructured key informant interviews. NACCHO Model Practice Program criteria were used to select the public health initiatives included in the case studies.

FINDINGS

Despite differences among the case studies, common barriers and facilitators were found to be present in all areas of the sociotechnical framework application including structure, people, technology, tasks, overarching considerations, and sustainability. Overall, there were many more facilitators (range = 7-14) present for each Beacon compared to barriers (range = 4-6).

DISCUSSION

Four influential promising practices were identified through the work: forging strong and sustainable partnerships; ensuring a good task-technology fit and a flexible and iterative design; fostering technology acceptance; and, providing education and demonstrating value.

CONCLUSIONS

A common weakness was the lack of a framework or model for the Beacon Communities evaluation work. Sharing a framework or approach to evaluation at the beginning of implementation made the work more effective. Supporting evaluation to inform future implementations is important.