U.S. hospital performance methodologies: a scoping review to identify opportunities for crossing the quality chasm

Hospital performance evaluation indicators: a scoping review

BACKGROUND

Hospitals are the biggest consumers of health system budgets and hence measuring hospital performance by quantitative or qualitative accessible and reliable indicators is crucial. This review aimed to categorize and present a set of indicators for evaluating overall hospital performance.

METHODS

We conducted a literature search across three databases, i.e., PubMed, Scopus, and Web of Science, using possible keyword combinations. We included studies that explored hospital performance evaluation indicators from different dimensions.

RESULTS

We included 91 English language studies published in the past 10 years. In total, 1161 indicators were extracted from the included studies. We classified the extracted indicators into 3 categories, 14 subcategories, 21 performance dimensions, and 110 main indicators. Finally, we presented a comprehensive set of indicators with regard to different performance dimensions and classified them based on what they indicate in the production process, i.e., input, process, output, outcome and impact.

CONCLUSION

The findings provide a comprehensive set of indicators at different levels that can be used for hospital performance evaluation. Future studies can be conducted to validate and apply these indicators in different contexts. It seems that, depending on the specific conditions of each country, an appropriate set of indicators can be selected from this comprehensive list of indicators for use in the performance evaluation of hospitals in different settings.

The PRIDx framework to engage payers in reducing diagnostic errors in healthcare

OBJECTIVES

No framework currently exists to guide how payers and providers can collaboratively develop and implement incentives to improve diagnostic safety. We conducted a literature review and interviews with subject matter experts to develop a multi-component 'Payer Relationships for Improving Diagnoses (PRIDx)' framework, that could be used to engage payers in diagnostic safety efforts.

CONTENT

The PRIDx framework, 1) conceptualizes diagnostic safety links to care provision, 2) illustrates ways to promote payer and provider engagement in the design and adoption of accountability mechanisms, and 3) explicates the use of data analytics. Certain approaches suggested by PRIDx were refined by subject matter expert interviewee perspectives.

SUMMARY

The PRIDx framework can catalyze public and private payers to take specific actions to improve diagnostic safety.

OUTLOOK

Implementation of the PRIDx framework requires new types of partnerships, including external support from public and private payer organizations, and requires creation of strong provider incentives without undermining providers' sense of professionalism and autonomy. PRIDx could help facilitate collaborative payer-provider approaches to improve diagnostic safety and generate research concepts, policy ideas, and potential innovations for engaging payers in diagnostic safety improvement activities.

Comprehensiveness, Accuracy, and Readability of Exercise Recommendations Provided by an AI-Based Chatbot: Mixed Methods Study

BACKGROUND

Regular physical activity is critical for health and disease prevention. Yet, health care providers and patients face barriers to implement evidence-based lifestyle recommendations. The potential to augment care with the increased availability of artificial intelligence (AI) technologies is limitless; however, the suitability of AI-generated exercise recommendations has yet to be explored.

OBJECTIVE

The purpose of this study was to assess the comprehensiveness, accuracy, and readability of individualized exercise recommendations generated by a novel AI chatbot.

METHODS

A coding scheme was developed to score AI-generated exercise recommendations across ten categories informed by gold-standard exercise recommendations, including (1) health condition-specific benefits of exercise, (2) exercise preparticipation health screening, (3) frequency, (4) intensity, (5) time, (6) type, (7) volume, (8) progression, (9) special considerations, and (10) references to the primary literature. The AI chatbot was prompted to provide individualized exercise recommendations for 26 clinical populations using an open-source application programming interface. Two independent reviewers coded AI-generated content for each category and calculated comprehensiveness (%) and factual accuracy (%) on a scale of 0%-100%. Readability was assessed using the Flesch-Kincaid formula. Qualitative analysis identified and categorized themes from AI-generated output.

RESULTS

AI-generated exercise recommendations were 41.2% (107/260) comprehensive and 90.7% (146/161) accurate, with the majority (8/15, 53%) of inaccuracy related to the need for exercise preparticipation medical clearance. Average readability level of AI-generated exercise recommendations was at the college level (mean 13.7, SD 1.7), with an average Flesch reading ease score of 31.1 (SD 7.7). Several recurring themes and observations of AI-generated output included concern for liability and safety, preference for aerobic exercise, and potential bias and direct discrimination against certain age-based populations and individuals with disabilities.

CONCLUSIONS

There were notable gaps in the comprehensiveness, accuracy, and readability of AI-generated exercise recommendations. Exercise and health care professionals should be aware of these limitations when using and endorsing AI-based technologies as a tool to support lifestyle change involving exercise.

Journey to STEEEP healthcare: A focus on systems through a patient's experience

Healthcare systems continue to struggle with providing safe, timely, effective, efficient, equitable and patient-centered (STEEEP) care. Upon audit by clinicians, treatment processes such as those completed following clinical pathways appear to manage care safely. However, when reviewing the treatment process through the patient and/or their family's lens, the experience is quite different. This article will use a vignette detailing care provided in a primary care physician's office along with the patient's outpatient testing experience to reveal opportunities for improvement, a glimpse into the patient's experience and share methods for achieving STEEEP healthcare.

The Search for an Outcome Variable That Measures Both Quality and Processes in Cardiac Surgery: Comparing the Quality Process Index and Mortality

BACKGROUND

The translation of a large quantity of data into valuable insights for daily clinical practice is underexplored. A considerable amount of information is overwhelming, making it difficult to distill and assess quality and processes at the hospital level. This study contributes to this necessary translation by developing a Quality Process Index that summarizes clinical data to measure quality and processes.

METHODS

The Quality Process Index was constructed to enable retrospective analyses of quality and process evolution from 2011 to 2021 for various surgery types in the Amsterdam Cardiosurgical Database (n = 5497). It is presented alongside mortality rates, which are the golden standard for quality measurement. The two outcome variables are compared as quality and process measurement options.

RESULTS

Results showed that the mean Quality Process Index appeared rather stable, even though analysis of variance found that the mean Quality Process Index differed significantly over the years (p < 0.001). The 30-day and 120-day mortality rates appeared to fluctuate more, but interestingly, we failed to reject the null hypothesis of equal means. The Quality Process Index and mortality rates were statistically negatively correlated, and the extent of correlation was more pronounced with the 120-day mortality rate, as computed using the Pearson correlation coefficient r (30-day rQPI,30 = -0.07, p < 0.001 and 120-day mortality rates rQPI,120 = -0.12, p < 0.001).

CONCLUSIONS

The Quality Process Index seeks to address the need to translate data for quality and process improvement in healthcare. While mortality remains the most impactful outcome measure, the Quality Process Index provides a more stable and comprehensive measurement of quality and process improvement or deterioration in healthcare. Therefore, the Quality Process Index as a quantification reinforces the understanding of the definition of quality and process improvement.

Quality and patient safety research in pediatric neurosurgery: a review

BACKGROUND

In 2001, the National Academy of Medicine, formerly known as the Institute of Medicine (IOM), published their seminal work, Crossing the Quality Chasm: A New Health System for the 21st Century. In this work, the authors called for improved safety, effectiveness, patient-centeredness, timeliness, efficiency, and equity in the United States' healthcare system. Two decades after the publication of this work, healthcare costs continue to rise, but outcomes lag other nations. The objective of this narrative review is to describe research efforts in pediatric neurosurgery with respect to the six quality aims proposed by the IOM, and highlight additional research opportunities.

METHODS

PubMed, Google Scholar, and EBSCOhost were queried to identify studies in pediatric neurosurgery that have addressed the aims proposed by the IOM. Studies were summarized and synthesized to develop a set of research opportunities to advance quality of care.

RESULTS

Twenty-three studies were reviewed which focused on the six quality aims proposed by the IOM. Out of these studies, five research opportunities emerged: (1) To examine performance of tools of care, (2) To understand processes surrounding care delivery, (3) To conduct cost-effectiveness analyses for a broader range of neurosurgical conditions, (4) To identify barriers driving healthcare disparities, and (5) To understand patients' and caregivers' experiences receiving care, and subsequently develop tools and programs to address their needs and preferences.

CONCLUSION

There is a growing body of literature examining quality in pediatric neurosurgical care across all aims proposed by the IOM. However, there remains important gaps in the literature that, if addressed, will advance the quality of pediatric neurosurgical care delivery.

Solutions for improved hospital-wide patient flows - a qualitative interview study of leading healthcare providers

BACKGROUND

Hospital productivity is of great importance for patients and public health to achieve better availability and health outcomes. Previous research demonstrates that improvements can be reached by directing more attention to the flow of patients. There is a significant body of literature on how to improve patient flows, but these research projects rarely encompass complete hospitals. Therefore, through interviews with senior managers at the world's leading hospitals, this study aims to identify effective solutions to enable swift patient flows across hospitals and develop a framework to guide improvements in hospital-wide patient flows.

METHODS

This study drew on qualitative data from interviews with 33 senior managers at 18 of the world's 25 leading hospitals, spread across nine countries. The interviews were conducted between June 2021 and November 2021 and transcribed verbatim. A thematic analysis followed, based on inductive reasoning to identify meaningful subjects and themes.

RESULTS

We have identified 50 solutions to efficient hospital-wide patient flows. They describe the importance for hospitals to align the organization; build a coordination and transfer structure; ensure physical capacity capabilities; develop standards, checklists, and routines; invest in digital and analytical tools; improve the management of operations; optimize capacity utilization and occupancy rates; and seek external solutions and policy changes. This study also presents a patient flow improvement framework to be used by healthcare managers, commissioners, and decision-makers when designing strategies to improve the delivery of healthcare services to meet the needs of patients.

CONCLUSIONS

Hospitals must invest in new capabilities and technologies, implement new working methods, and build a patient flow-focused culture. It is also important to strategically look at the patient's whole trajectory of care as one unified flow that must be aligned and integrated between and across all actors, internally and externally. Hospitals need to both proactively and reactively optimize their capacity use around the patient flow to provide care for as many patients as possible and to spread the burden evenly across the organization.

For better care we need better data: towards a national obstetrics registry

Unacceptably high rates of severe maternal morbidity and mortality in the United States and stark racial disparities in outcomes are generating efforts to improve both research capacity and quality improvement in obstetrical care. Comprehensive, high-quality datasets on which to build these efforts are crucial to the success of obstetrical quality improvement efforts. However, existing data sources in obstetrics have notable limitations. Other medical and surgical specialties have addressed similar challenges through the creation of national registries, and we argue that obstetrics must take the same approach to improve outcomes. In this article, we summarized the current availability and limitations of large-scale data in obstetrics research and compared the data with registries developed in other specialties. Moreover, we have outlined the guiding principles for the development of a national obstetrics registry and have proposed future directions.

Measuring Racial Inequities In The Quality Of Care Across Oncology Practices In The US

Racial inequities in clinical performance diminish overall health care system performance; however, quality assessments have rarely incorporated reliable measures of racial inequities. We studied care for more than one million Medicare fee-for-service beneficiaries with cancer to assess the feasibility of calculating reliable practice-level measures of racial inequities in chemotherapy-associated emergency department (ED) visits and hospitalizations. Specifically, we used hierarchical models to estimate adjusted practice-level Black-White differences in these events and described differences across practices. We calculated reliable inequity measures for 426 and 322 practices, depending on the measure. These practices reflected fewer than 10 percent of practices treating Medicare beneficiaries with chemotherapy, but they treated approximately half of all White and Black Medicare beneficiaries receiving chemotherapy and two-thirds of Black Medicare beneficiaries receiving chemotherapy. Black patients experienced chemotherapy-associated ED visits and hospitalizations at higher rates (54.2 percent and 35.8 percent, respectively) than White patients (45.7 percent and 31.9 percent, respectively). The median within-practice Black-White difference was 8.1 percentage points for chemotherapy-associated ED visits and 2.7 percentage points for chemotherapy-associated hospitalizations. Additional research is needed to identify other reliable measures of racial inequities in health care quality, measure care inequities in smaller practices, and assess whether providing practice-level feedback could improve equity.

When patients get stuck: A systematic literature review on throughput barriers in hospital-wide patient processes

Hospital productivity is of great importance to policymakers, and previous research demonstrates that improved hospital productivity can be achieved by directing more focus towards patient throughput at healthcare organizations. There is also a growing body of literature on patient throughput barriers hampering the flow of patients. These projects rarely, however, encompass complete hospitals. Therefore, this paper provides a systematic literature review on hospital-wide patient process throughput barriers by consolidating the substantial body of studies from single settings into a hospital-wide perspective. Our review yielded a total of 2207 articles, of which 92 were finally selected for analysis. The results reveal long lead times, inefficient capacity coordination and inefficient patient process transfer as the main barriers at hospitals. These are caused by inadequate staffing, lack of standards and routines, insufficient operational planning and a lack in IT functions. As such, this review provides new perspectives on whether the root causes of inefficient hospital patient throughput are related to resource insufficiency or inefficient work methods. Finally, this study develops a new hospital-wide framework to be used by policymakers and healthcare managers when deciding what improvement strategies to follow to increase patient throughput at hospitals.

Assessing the influence of patient language preference on 30 day hospital readmission risk from home health care: A retrospective analysis

BACKGROUND

In home health care, language barriers are understudied. Language barriers between patients and providers are known to affect a variety of patient outcomes. How a patient's language preference influences hospital readmission risk from home health care has yet to be determined.

OBJECTIVE

To determine if home care patients' language preference is associated with their risk for hospital readmission from home health care within 30 days of hospital discharge.

DESIGN

Retrospective cross-sectional study of hospital readmissions from an urban home health care agency's administrative records and the national electronic home health care record for the United States, captured between 2010 and 2015.

SETTING

New York City, New York, USA.

PARTICIPANTS

The dataset comprised 90,221 post-hospitalization patients and 6.5 million home health care visits.

METHODS

First, a Chi-square test was used to determine if there were significant differences in crude readmission rates based on language group. Inverse probability of treatment weighting was used to adjust for significant differences in known hospital readmission risk factors between to examine all-cause hospital readmission during a home health care stay. The final matched sample included 87,561 patients with a language preference of English, Spanish, Russian, Chinese, or Korean. English-speaking patients were considered the comparison group to the non-English speaking patients. A Marginal Structural Model was applied to estimate the impact of non-English language preference against English language preference on rehospitalization. The results of the marginal structural model were expressed as an odds ratio of likelihood of readmission to the hospital from home health care.

RESULTS

Home health patients with a non-English language preference had a higher hospital readmission risk than English-speaking patients. Crude readmission rate for the limited English proficiency patients was 20.4% (95% CI, 19.9-21.0%) overall compared to 18.5% (95% CI, 18.7-19.2%) for English speakers (p < 0.001). Being a non-English-speaking patient was associated with an odds ratio of 1.011 (95% CI, 1.004-1.018) in increased hospital readmission rates from home health care (p = 0.001). There were also statistically significant differences in readmission rate by language group (p < 0.001), with Korean speakers having the lowest rate and Spanish speakers having the highest, when compared to English speakers.

CONCLUSIONS

People with a non-English language preference have a higher readmission rate from home health care. Hospital and home healthcare agencies may need specialized care coordination services to reduce readmission risk for these patients. Tweetable abstract: A new US-based study finds that home care patients with language barriers are at higher risk for hospital readmission.

Need to Intervene: An Exploratory Study of Nurses' Experiences With Patienthood

Much has been written about the patient experience, but there is little information about experiences of providers as patients. Since lay patients and providers have differing perspectives and expectations, it is important to identify those elements shared by those in each group and those that diverge. This study identified experiences of nurses as being a patient or a family caregiver of a patient as well as identified assessments of the healthcare system by nurses. An exploratory study using a self-administered electronic questionnaire with a group of registered nurses was conducted. Assessments of the system by responders were positive when addressing quality of care, interactions among healthcare personnel, and interactions with patients. However, when discussing their experiences as patient, nurses reported they encountered problems with coordination of care, responses of medical personnel, attention to details of care, and responses to their attempts to become more involved. Results confirm issues raised by patients who are not medical experts in patient satisfaction studies. Adding a professional perspective highlights where problems with the healthcare system lie.