Daily review of AHRQ patient safety indicators has important impact on value-based purchasing, reimbursement, and performance scores

Factors Contributing to Patient Satisfaction Among VA Medical Center and Non-VA Medical Center Hospitals

INTRODUCTION

Veteran satisfaction of care within the Veterans Affairs is typically very high. Yet recommendation ratings of VA medical center (VA) hospitals as measured by Hospital Consumer Assessment of Healthcare Providers and Systems are generally lower than non-VA hospitals.Therefore, it was our objective to assess Veteran satisfaction and recommendation scores and then examine whether satisfaction correlates to recommendation.

METHODS

We identified all acute care VAs as our primary analytic cohort. As a comparator group, we also included all acute care academic hospitals (non-VAs), as designated by the Centers for Medicare Services. Using data from Hospital Consumer Assessment of Healthcare Providers and Systems and Strategic Analytics for Improvement and Learning (SAIL) Value Model, we collated patient satisfaction scores, as well as markers of surgical safety from Hospital Compare. We then analyzed the correlation within VAs and non-VAs, primarily focusing the relationship between the "would you recommend Hospital Rating" and subdomains of the "Overall Hospital Rating," as well as a composite score of patient safety.

RESULTS

A total of 133 VAs and 1116 non-VAs were identified. Among VAs, the "Would you Recommend" hospital rating was significantly and positively correlated with markers of patient satisfaction including care transitions (Pearson's r = 0.59, P = 0.03), Nursing communication (Pearson's R 0.79, P = 0.001), and percent of primary care provider wait times less than 30 min (Pearson's r = 0.25, P = 0.01). VA-recommended scores were negatively correlated with factors such as time to emergency department discharge, and the "leaving the emergency department before being evaluated." When looking at non-VAs, correlation directions were similar, albeit with stronger associations at almost every metric. While recommended scores correlated strongly to overall hospital ratings for both groups, VAs had no significant correlation between "would you recommend" and patient safety. However, there was a slight negative correlation between patient safety and "recommend" among non-VAs.

CONCLUSIONS

Although satisfiers and dissatisfiers of care appear similar between VAs and non-VAs, "would you recommend" is a far weaker marker of patient perceptions of safety and quality. These seemingly empathetic markers such as "would you recommend" should be used with caution as they may not address the fundamental question being asked.

Patient Safety Indicators at an Academic Veterans Affairs Hospital: Addressing Dual Goals of Clinical Care and Validity

BACKGROUND

Hospital-acquired complications add to patient morbidity and mortality, costs, length of stay, and negative patient experience. Patient Safety Indicators (PSIs) are a validated and widely used metric to evaluate hospital administrative data on preventing these events. Although many studies have addressed PSI validity, few have aimed to reduce PSI through clinical care. The authors aimed to reduce PSI events by addressing both validity and clinical care.

METHODS

Frontline clinicians used a deep dive template to provide input on all PSI cases, which were then reviewed by a PSI task force to identify performance gaps. After analyzing the frequency of gaps and cost-vs.-impact of potential solutions, five interventions were implemented to address the three most common, highly weighted PSIs: pressure ulcers, postoperative venous thromboembolism (VTE), and postoperative sepsis. Clinical care interventions included increasing patient mobility by creating a specialized mobility technician position, skin care audits to prevent pressure ulcers, and increasing use of pharmacologic VTE prophylaxis. Administrative interventions addressed improving clinician-coding concordance for sepsis and increasing documentation of comorbidities.

RESULTS

After interventions, the number of PSI events for composite PSI, VTE, and sepsis decreased by 41.3% (p = 0.039), 85.2% (p = 0.0091), and 51.5% (p = 0.063), respectively, relative to the preintervention period. Pressure ulcers increased by 33.3% (p = 0.0091).

CONCLUSION

Hospital complications cause substantial burden to hospitals, patients, and caregivers. Addressing administrative and clinical factors with targeted interventions led to reduction in composite PSI. Further efforts are needed locally to reduce the pressure ulcer PSI.

A Pragmatic Method for Measuring Inpatient Complications and Complication-Specific Mortality

OBJECTIVES

The primary objective of this study was to develop hospital-level metrics of major complications associated with mortality that allows for the identification of opportunities for improvement. The secondary objective is to improve upon current metrics for failure to rescue (i.e., death from serious but treatable complications.).

METHODS

Agency for Healthcare Research and Quality metrics served as the basis for identifying specific complications related to major organ system morbidity associated with death. Complication-specific occurrence rates, observed mortality, and risk-adjusted mortality indices were calculated for the study institution and 182 peer organizations using component International Classification of Disease, Tenth Revision codes. Data were included for adults over a 4-year period, with exclusion of hospice patients and complications present on admission. Temporal visualizations of each metric were used to compare past and recent performance at the study hospital and in comparison to peers.

RESULTS

The complication-specific method showed statistically significant differences in the study hospital occurrence rates and associated mortality rates compared with peer institutions. The monthly control-chart presentation of these metrics provides assessment of hospital-level interventions to prevent complications and/or reduce failure to rescue deaths.

CONCLUSIONS

The method described supplements existing metrics of serious complications that occur during the course of acute hospitalization allowing for enhanced visualization of opportunities to improve care delivery systems. This method leverages existing measure components to minimize reporting burden. Monthly time-series data allow interventions to prevent and/or rescue patients to be rapidly assessed for impact.

Patient safety indicators from a spine surgery perspective: the importance of a specialty specific clinician working with the documentation team and the impact to your hospital

BACKGROUND CONTEXT

The Hospital Acquired Conditions (HAC) Reduction Program supports the Centers for Medicare and Medicaid Services (CMS) effort to prevent harm to patients by providing a financial incentive to reduce HACs. HAC scores are impacted by Patient Safety Indicators (PSIs), potentially preventable hospital-related events associated with harmful patient outcomes. PSIs are identified using International Classification of Diseases (ICD) coding; however, ICD coding does not always reflect the patient's true medical course.

PURPOSE

To evaluate the efficacy of and costs savings associated with a clinical documentation review process in tandem with clinician collaboration in identifying incorrectly generated PSIs.

STUDY DESIGN

Retrospective chart review.

PATIENT SAMPLE

All patients undergoing spine surgery at a single multi-surgeon tertiary spine center.

OUTCOME MEASURES

Occurrence of PSI.

METHODS

Over two 11-month periods, all PSIs attributable to spine surgery were determined. The number and type of spine related PSIs were compared before (Control) and after the implementation of a specialty specific clinical review (Intervention) to identify incorrectly generated PSIs. The financial impact of this intervention was calculated in the form of an annual cost savings to our hospital system.

RESULTS

During the Control phase, 61 PSIs were reported in 3368 spine cases, representing a total of 3.6 PSIs/month. During Intervention phase, 26 PSIs in 4,482 spine cases, resulting in a statistically significant decrease of 1.5 PSIs per month. The percentage of PSIs across all surgical cases attributable to spine surgery had a statistically significant decrease during the Intervention period compared to the Control period (16% vs. 10%, p=.034), resulting in the avoidance of a 1% CMS cost reduction, an annual cost saving of approximately $3-4 million dollars per year.

CONCLUSIONS

The implementation of a clinical documentation review process with clinician collaboration to ensure ICD-10 coding accurately reflects the patient's medical course leads to more accurate PSI reporting, with the potential for substantial cost-savings for hospitals from CMS reimbursement.

Feasibility of Capturing Adverse Events From Insurance Claims Data Using International Classification of Diseases, Tenth Revision, Codes Coupled to Present on Admission Indicators

OBJECTIVE

The aim of the study was to investigate the feasibility of using administrative data to screen adverse events in Korea.

METHODS

We used a diagnosis-related groups claims data set and the information of the checklist of healthcare quality improvement (a part of the value incentive program) to verify adverse events in fiscal year 2018. Adverse events were identified using patient safety indicator (PSI) clusters and a present on admission indicator (POA). The PSIs consisted of 19 clusters representing subcategories of adverse events, such as hospital-acquired infection. Among the adverse events identified using PSI clusters, "POA = N," which means not present at the time of admission, was only deemed as the case in the final stage. We compared the agreement on the occurrence of adverse events from claims data with a reference standard data set (i.e., checklist of healthcare quality improvement) and presented them by PSI cluster and institution.

RESULTS

The cases of global PSI for any adverse event numbered 27,320 (2.32%) among all diagnostic codes in 2018. In terms of institutional distribution, considerable variation was observed throughout the clusters. For example, only 13.2% of institutions (n = 387) reported any global PSI for any adverse event throughout the whole year. The agreement between the reference standard and the claims data was poor, in the range of 2.2% to 10.8%, in 3 types of adverse events. The current claims data system (i.e., diagnostic codes coupled to POA indicators) failed to capture a large majority of adverse events identified using the reference standard.

CONCLUSIONS

Our results imply that the coding status of International Classification of Diseases, Tenth Revision, codes and POA indicators should be refined before using them as quality indicators.

Impact of Extent of Resection on Incidence of Postoperative Complications in Patients With Glioblastoma

BACKGROUND

Extent of resection (EOR) is well established as correlating with overall survival in patients with glioblastoma (GBM). The impact of EOR on reported quality metrics such as patient safety indicators (PSIs) and hospital-acquired conditions (HACs) is unknown.

OBJECTIVE

To perform a retrospective study to evaluate possible associations between EOR and the incidence of PSIs and HACs.

METHODS

We queried all patients diagnosed with GBM who underwent surgical resection at our institution between January 2011 and May 2017. Pre- and postoperative magnetic resonance images were analyzed for EOR. Each chart was reviewed to determine the incidence of PSIs and HACs.

RESULTS

A total of 284 patients met the inclusion criteria. EOR ranged from 39.00 to 100%, with a median of 99.84% and a mean of 95.7%. There were 16 PSI, and 13 HAC, events. There were no significant differences in the rates of PSIs or HACs when compared between patients stratified by gross total resection (EOR ≥ 95%) and subtotal resection (EOR < 95%). The odds of encountering a PSI or HAC were 2.5 times more likely in the subtotal resection group compared to the gross total resection group (P = .58). After adjusting for confounders, the odds of encountering a PSI or HAC in the subtotal resection group were 3.9 times greater than for the gross total resection group (P < .05).

CONCLUSION

Gross total resection of GBM is associated with a decreased incidence of PSIs and HACs, as compared to subtotal resection.

U.S. hospital performance methodologies: a scoping review to identify opportunities for crossing the quality chasm

Background

Hospital performance quality assessments inform patients, providers, payers, and purchasers in making healthcare decisions. These assessments have been developed by government, private and non-profit organizations, and academic institutions. Given the number and variability in available assessments, a knowledge gap exists regarding what assessments are available and how each assessment measures quality to identify top performing hospitals. This study aims to: (a) comprehensively identify current hospital performance assessments, (b) compare quality measures from each methodology in the context of the Institute of Medicine’s (IOM) six domains of STEEEP (safety, timeliness, effectiveness, efficiency, equitable, and patient-centeredness), and (c) formulate policy recommendations that improve value-based, patient-centered care to address identified gaps.

Methods

A scoping review was conducted using a systematic search of MEDLINE and the grey literature along with handsearching to identify studies that provide assessments of US-based hospital performance whereby the study cohort examined a minimum of 250 hospitals in the last two years (2017–2019).

Results

From 3058 unique records screened, 19 hospital performance assessments met inclusion criteria. Methodologies were analyzed across each assessment and measures were mapped to STEEEP. While safety and effectiveness were commonly identified measures across assessments, efficiency, and patient-centeredness were less frequently represented. Equity measures were also limited to risk- and severity-adjustment methods to balance patient characteristics across populations, rather than stand-alone indicators to evaluate health disparities that may contribute to community-level inequities.

Conclusions

To further improve health and healthcare value-based decision-making, there remains a need for methodological transparency across assessments and the standardization of consensus-based measures that reflect the IOM’s quality framework. Additionally, a large opportunity exists to improve the assessment of health equity in the communities that hospitals serve.

Patient Safety Indicators are an insufficient performance metric to track and grade outcomes of open aortic repair

OBJECTIVE

National rankings of hospitals rely on outcomes-based evaluation to assess the performance of surgical programs, particularly those performing high-risk elective surgical procedures such as open aortic repair. Various classification systems exist for tracking outcomes, but increasingly the International Classification of Diseases, Tenth Revision-based Agency for Healthcare Research and Quality Patient Safety Indicators (PSIs) are used as a publicly reported comparison measure of hospital quality performance. We sought to critically evaluate the accuracy of the existing vehicles to assess open aortic repair outcomes in an established program.

METHODS

This is a case-control study of patients who underwent open abdominal aortic aneurysm repair at the Johns Hopkins Medical Institutions from 2004 to 2018. Patients' characteristics and outcomes were collected as part of a prospectively maintained retrospective database. For each case, hemorrhagic, cardiac, respiratory, renal, wound, and thromboembolic complications were identified with the unique definitions used for open abdominal aortic aneurysm repair by the American College of Surgeons National Surgical Quality Improvement Program (NSQIP) database, the Society for Vascular Surgery Vascular Quality Initiative (VQI) database, and the Agency for Healthcare Research and Quality PSI initiative.

RESULTS

Of the 154 patients included in the study, 79 (51.0%) were identified as having a complication as defined by the VQI, 46 (29.7%) according to the NSQIP, and 15 (9.7%) according to the PSI system (P < .001). Patients most likely to incur a complication in the PSI system were those with a pararenal or more extensive aneurysm, with baseline congestive heart failure, requiring a supramesenteric clamp (all P < .01), or with an aneurysm >6.5 cm in diameter (P = .02). The NSQIP and VQI systems both identified more postoperative hemorrhagic, respiratory, renal, and wound complications than the PSI system did (P < .05). The VQI system identified the most renal complications (52; P < .001); factors unique to incurring a complication in the VQI include use of a suprarenal clamp and performance of an aortorenal bypass procedure as part of the repair (P < .01). Particularly weak correlation was noted between the PSI system and the VQI with respect to renal outcomes (ρ = 0.163).

CONCLUSIONS

The PSI system identified fewer important complications than either of the clinically focused databases, with the VQI capturing the most postoperative events, mostly because of its stringent definition of renal injury. We conclude that the PSI system should not form the basis of grading hospital performance in comparing clinically relevant complications of open aortic surgery programs.

Increased reporting but decreased mortality associated with adverse events in patients undergoing lung cancer surgery: Competing forces in an era of heightened focus on care quality?

INTRODUCTION

Advances in surgical techniques have improved clinical outcomes and decreased complications. At the same time, heightened attention to care quality has resulted in increased identification of hospital-acquired adverse events. We evaluated these divergent effects on the reported safety of lung cancer resection.

METHODS AND MATERIALS

We analyzed hospital-acquired adverse events in patients undergoing lung cancer resection using the National Hospital Discharge Survey (NHDS) database from 2001-2010. Demographics, diagnoses, and procedures data were abstracted using ICD-9 codes. We used the Agency for Healthcare Research and Quality (AHRQ) Patient Safety Indicators (PSI) to identify hospital-acquired adverse events. Weighted analyses were performed using t-tests and chi-square.

RESULTS

A total of 302,444 hospitalizations for lung cancer resection and were included in the analysis. Incidence of PSI increased over time (28% in 2001-2002 vs 34% in 2009-2010; P<0.001). Those with one or more PSI had increased in-hospital mortality (aOR = 11.1; 95% CI, 4.7-26.1; P<0.001) and prolonged hospitalization (12.5 vs 7.8 days; P<0.001). However, among those with PSI, in-hospital mortality decreased over time, from 17% in 2001-2002 to 2% in 2009-2010.

CONCLUSIONS

In a recent ten-year period, documented rates of adverse events associated with lung cancer resection increased. Despite this increase in safety events, we observed that mortality decreased. Because such metrics may be incorporated into hospital rankings and reimbursement considerations, adverse event coding consistency and content merit further evaluation.

Increasing Numbers and Reported Adverse Events in Patients with Lung Cancer Undergoing Inpatient Lung Biopsies: A Population-Based Analysis

INTRODUCTION

The use of molecular biomarkers to guide lung cancer management has led to increasing frequency and amounts of tissue required for repeat lung biopsies. While patient safety and reporting of adverse events has been increasingly emphasized in recent decades, the safety of lung biopsies in patients with lung cancer has only been studied in small cohorts. We therefore analyzed adverse events in patients with lung cancer undergoing lung biopsies in the National Hospital Discharge Survey (NHDS) database.

METHODS

Data were abstracted using ICD-9 lung cancer diagnosis (162.X) and lung biopsy procedure codes (33.20, 33.24, 33.25, 33.26, 33.27, 33.28) from 2001 to 2010. Agency for Healthcare Research and Quality (AHRQ) Patient-Safety Indicators (PSI) were used to identify hospital-acquired adverse events. Weighted analyses were performed using SAS version 9.4.

RESULTS

A total of 540,747 patients were included for analysis. The number of biopsies increased over time, from 51,221 in 2001, to 63,239 in 2010 (P < 0.001). Overall, 159,683 (30%) patients suffered ≥ 1-PSI event during their hospitalization. Incidence of PSI varied by biopsy type: bronchoscopic (26%), percutaneous (34%), surgical (39%). The proportion of patients with ≥ 1 PSI event increased from 24% in 2001 to 38% in 2010 (P < 0.001). Patients with ≥ 1 PSI had longer length of stay (mean, 11.6 vs 8.1 days; P < 0.001) and higher in-hospital mortality (adjusted odds ratio, 5.9, 95% CI 3.9-8.9; P < 0.001).

CONCLUSIONS

The frequency of lung biopsies performed and rate of documented adverse events in hospitalized lung cancer patients have increased. These findings have policy, funding, research, and practice implications.

Predictive Value Positive of MTM Eligibility Criteria under MMA and ACA in Identifying Individuals with Medication Utilization Issues

Objectives

To compare the predictive value positives (PVP) of medication therapy management eligibility criteria under the Medicare Modernization Act (MMA) and Affordable Care Act (ACA) in identifying individuals with medication utilization issues (MUI).

Methods

This is a retrospective analysis of Medicare database (2012-2013). MUI were determined based on medication utilization measures related to Medicare Part D Star Ratings. PVP or proportions of individuals with MUI were compared between individuals eligible for MTM under MMA and ACA. Need-based and demand-based logistic regression was used to adjust for patient characteristics. MTM eligibility thresholds in 2009 and 2013 and proposed 2015 MTM eligibility thresholds under MMA were examined. Main/sensitivity/disease-specific analyses were conducted to cover the range of eligibility thresholds and combinations.

Key Findings

MMA has higher PVP in identifying patients with MUI than ACA. Proportions of individuals with MUI were higher based on MMA than ACA (e.g., 74.96% for 2009 MMA, 73.51% for 2013 MMA, and 62.46% for proposed 2015 MMA vs. 52.17% for ACA in main analysis; P<0.05). Adjusted findings were similar. For example, based on the demand-based model in the main analysis, the odds ratios were 2.474 (95% CI: 2.454-2.494) for 2013 MMA in comparison to ACA. These numbers indicate that the MMA MTM eligibility criteria for 2013 had 147.4% higher PVP in identifying patients with MUI than ACA. Similar patterns were found in most sensitivity and disease-specific analyses.

Conclusions

MMA has higher PVP than ACA in identifying patients with MUI. This study may inform the government on future MTM policy.