Variation in academic medical centers' coding practices for postoperative respiratory complications: implications for the AHRQ postoperative respiratory failure Patient Safety Indicator

Inconsistent Surgical Implant Documentation: A Case Study in Total Knee and Hip Arthroplasty

Value-based care initiatives require accurate quantification of resource utilization. This study explores hospital resource documentation performance for total knee and hip arthroplasty (TKA, THA) implants and how this may differ between hospitals. This retrospective study utilized the Premier discharge database, years 2006 to 2020. TKA/THA cases were categorized into 5 tiers based upon the completeness of implant component documentation: Platinum, Gold, Silver, Bronze, Poor. Correlation between TKA and THA documentation performance (per-hospital percentage of Platinum cases) was assessed. Logistic regression analyses measured the association between hospital characteristics (region, teaching status, bed size, urban/rural) and satisfactory documentation. TKA/THA implant documentation performance was compared to documentation for endovascular stent procedures. Individual hospitals tended to have very complete (Platinum) or very incomplete (Poor) documentation for both TKA and THA. TKA and THA documentation performance were correlated (correlation coefficient = .70). Teaching hospitals were less likely to have satisfactory documentation for both TKA (P = .002) and THA (P = .029). Documentation for endovascular stent procedures was superior compared to TKA/THA. Hospitals' TKA and THA-related implant documentation performance is generally either very proficient or very poor, in contrast with often well-documented endovascular stent procedures. Hospital characteristics, other than teaching status, do not appear to impact TKA/THA documentation completeness.

Postoperative Respiratory Failure After Elective Abdominal Surgery: A Case-Control Study

INTRODUCTION

Postoperative respiratory failure (PRF) contributes significantly to morbidity and mortality. We sought to identify patient characteristics and perioperative risk factors associated with PRF in patients undergoing elective abdominal surgery to improve patient outcomes.

METHODS

We retrospectively reviewed patients undergoing elective abdominal surgery from 2011 to 2016 at our institution. An experimental group consisting of adult patients with the Patient Safety Indicator 11 diagnosis of PRF was compared with a time-matched control group.

RESULTS

Each group consisted of 233 patients. Comorbidities associated with PRF included ascites, coronary artery disease, chronic kidney disease, chronic obstructive pulmonary disease, diabetes mellitus type II, hypertension, and hypoalbuminemia (P < 0.05). American Society of Anesthesiologists score IV (20.2% versus 3.95%; P < 0.001), operative time (4.13 versus 2.55 h; P < 0.001), laparotomy with open operation (77.7% versus 45.5%; P < 0.001), and net intraoperative fluid balance (3635 versus 2410 mL; P < 0.001) were higher in patients with PRF. On multivariate analysis, age, American Society of Anesthesiologists score, chronic obstructive pulmonary disease, diabetes mellitus type II, laparotomy, and net intraoperative fluid balance maintained significance (P < 0.05).

CONCLUSIONS

We identified contributing pre- and intra-operative risk factors for PRF undergoing elective abdominal surgery. These findings may help identify those at increased risk for respiratory failure and mitigate complications.

A comparison of two structured taxonomic strategies in capturing adverse events in U.S. hospitals

OBJECTIVE

To compare the Agency for Healthcare Research and Quality's Quality and Safety Review System (QSRS) and the proposed triadic structure for the 11th version of the International Classification of Disease (ICD-11) in their ability to capture adverse events in U.S. hospitals.

DATA SOURCES/STUDY SETTING

One thousand patient admissions between 2014 and 2016 from three general, acute care hospitals located in Maryland and Washington D.C.

STUDY DESIGN

The admissions chosen for the study were a random sample from all three hospitals.

DATA COLLECTION/EXTRACTION METHODS

All 1000 admissions were abstracted through QSRS by one set of Certified Coding Specialists and a different set of coders assigned the draft ICD-11 codes. Previously assigned ICD-10-CM codes for 230 of the admissions were also used.

PRINCIPAL FINDINGS

We found less than 20 percent agreement between QSRS and ICD-11 in identifying the same adverse event. The likelihood of a mismatch between QSRS and ICD-11 was almost twice that of a match. The findings were similar to the agreement found between QSRS and ICD-10-CM in identifying the same adverse event. When coders were provided with a list of potential adverse events, the sensitivity and negative predictive value of ICD-11 improved.

CONCLUSIONS

While ICD-11 may offer an efficient way of identifying adverse events, our analysis found that in its draft form, it has a limited ability to capture the same types of events as QSRS. Coders may require additional training on identifying adverse events in the chart if ICD-11 is going to prove its maximum benefit.

Clinical and Health System Determinants of Venous Thromboembolism Event Rates After Hip Arthroplasty: An International Comparison

BACKGROUND

Routinely collected hospital data provide increasing opportunities to assess the performance of health care systems. Several factors may, however, influence performance measures and their interpretation between countries.

OBJECTIVE

We compared the occurrence of in-hospital venous thromboembolism (VTE) in patients undergoing hip replacement across 5 countries and explored factors that could explain differences across these countries.

METHODS

We performed cross-sectional studies independently in 5 countries: Canada; France; New Zealand; the state of California; and Switzerland. We first calculated the proportion of hospital inpatients with at least one deep vein thrombosis (DVT) or pulmonary embolism by using numerator codes from the corresponding Patient Safety Indicator. We then compared estimates from each country against a reference value (benchmark) that displayed the baseline risk of VTE in such patients. Finally, we explored length of stay, number of secondary diagnoses coded, and systematic use of ultrasound to detect DVT as potential factors that could explain between-country differences.

RESULTS

The rates of VTE were 0.16% in Canada, 1.41% in France, 0.84% in New Zealand, 0.66% in California, and 0.37% in Switzerland, while the benchmark was 0.58% (95% confidence interval, 0.35-0.81). Factors that could partially explain differences in VTE rates between countries were hospital length of stay, number of secondary diagnoses coded, and proportion of patients who received lower limb ultrasound to screen for DVT systematically before hospital discharge. An exploration of the French data showed that the systematic use of ultrasound may be associated with over detection of DVT but not pulmonary embolism.

CONCLUSIONS

In-hospital VTE rates after arthroplasty vary widely across countries, and a combination of clinical, data-related, and health system factors explain some of the variations in VTE rates across countries.

Sources of variability in hospital administrative data: Clinical coding of postoperative ileus

BACKGROUND

Multiple studies have questioned the validity of clinical codes in hospital administrative data. We examined variability in reporting a postoperative ileus (POI).

OBJECTIVE

We aimed to analyse sources of coding variations to understand how clinical coding professionals arrive at POI coding decisions and to verify existing knowledge that current clinical coding practices lack standardised applications of regulatory guidelines.

METHOD

Two medical records (cases 1 and 2) were provided to 15 clinical coders employed by a midsize nonprofit hospital in the northwest region of the United States. After coding these cases, the study participants completed a survey, reported on the application of guidelines, and participated in a focus group led by a health information management regulatory compliance expert.

RESULTS

Only 5 of the 15 clinical coders correctly indicated no POI complication in case 1 where the physician documentation did not establish a link between the POI as a complication of care and the surgery. In contrast, 13 of the 15 study participants correctly coded case 2, which included clear physician documentation and contained the clinical parameters for the coding of the POI as a complication of care. Clinical coder education, credentials, certifications, and experience did not relate to the coding performance. The clinical coders inconsistently prioritised coding rules and valued experience more than education.

CONCLUSION AND IMPLICATIONS

The application of International Classification of Diseases, Ninth Revision, Clinical Modification; coding conventions; Centers for Medicare and Medicaid Services coding guidelines; and American Hospital Association coding clinic advice was subject to the clinical coders' interpretation; they perceived them as conflicting guidance. Their reliance on subjective experience in dealing with this conflicting guidance may limit the accuracy of reporting outcomes of clinical performance.

The Use of Claims-Based Data in Inpatient Public Reporting and Pay-for-Performance Programs: Is There Opportunity for Improvement?

PURPOSE

This study examined whether self-reported, facility-based data validation practices for claims submissions of cases flagged as Patient Safety Indicators (PSIs) match professional and regulatory standards.

METHODS

The National Association of Healthcare Quality members who work in an inpatient setting were invited to complete an anonymous survey to self-report their practices around facility-based data validation of PSI cases.

RESULTS

The authors found widespread variation in how PSI administrative data are internally validated; inconsistency in the education and training required of staff who participate in this process; and relatively poor compliance with physician query guidelines and documentation amendment standards.

CONCLUSIONS

The self-described wide variation and nonadherence to professional and regulatory standards within the facility-based validation process for PSIs raise concerns about the use of these data to make meaningful judgments about quality and safety. The authors recommend a standardized approach to reporting and validation be implemented for use of PSIs in public reporting and pay-for-performance programs.

Incidence and Trends of Sepsis in US Hospitals Using Clinical vs Claims Data, 2009-2014

IMPORTANCE

Estimates from claims-based analyses suggest that the incidence of sepsis is increasing and mortality rates from sepsis are decreasing. However, estimates from claims data may lack clinical fidelity and can be affected by changing diagnosis and coding practices over time.

OBJECTIVE

To estimate the US national incidence of sepsis and trends using detailed clinical data from the electronic health record (EHR) systems of diverse hospitals.

DESIGN, SETTING, AND POPULATION

Retrospective cohort study of adult patients admitted to 409 academic, community, and federal hospitals from 2009-2014.

EXPOSURES

Sepsis was identified using clinical indicators of presumed infection and concurrent acute organ dysfunction, adapting Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3) criteria for objective and consistent EHR-based surveillance.

MAIN OUTCOMES AND MEASURES

Sepsis incidence, outcomes, and trends from 2009-2014 were calculated using regression models and compared with claims-based estimates using International Classification of Diseases, Ninth Revision, Clinical Modification codes for severe sepsis or septic shock. Case-finding criteria were validated against Sepsis-3 criteria using medical record reviews.

RESULTS

A total of 173 690 sepsis cases (mean age, 66.5 [SD, 15.5] y; 77 660 [42.4%] women) were identified using clinical criteria among 2 901 019 adults admitted to study hospitals in 2014 (6.0% incidence). Of these, 26 061 (15.0%) died in the hospital and 10 731 (6.2%) were discharged to hospice. From 2009-2014, sepsis incidence using clinical criteria was stable (+0.6% relative change/y [95% CI, -2.3% to 3.5%], P = .67) whereas incidence per claims increased (+10.3%/y [95% CI, 7.2% to 13.3%], P < .001). In-hospital mortality using clinical criteria declined (-3.3%/y [95% CI, -5.6% to -1.0%], P = .004), but there was no significant change in the combined outcome of death or discharge to hospice (-1.3%/y [95% CI, -3.2% to 0.6%], P = .19). In contrast, mortality using claims declined significantly (-7.0%/y [95% CI, -8.8% to -5.2%], P < .001), as did death or discharge to hospice (-4.5%/y [95% CI, -6.1% to -2.8%], P < .001). Clinical criteria were more sensitive in identifying sepsis than claims (69.7% [95% CI, 52.9% to 92.0%] vs 32.3% [95% CI, 24.4% to 43.0%], P < .001), with comparable positive predictive value (70.4% [95% CI, 64.0% to 76.8%] vs 75.2% [95% CI, 69.8% to 80.6%], P = .23).

CONCLUSIONS AND RELEVANCE

In clinical data from 409 hospitals, sepsis was present in 6% of adult hospitalizations, and in contrast to claims-based analyses, neither the incidence of sepsis nor the combined outcome of death or discharge to hospice changed significantly between 2009-2014. The findings also suggest that EHR-based clinical data provide more objective estimates than claims-based data for sepsis surveillance.

A multidisciplinary three-phase approach to improve the clinical utility of patient safety indicators

PURPOSE

The AHRQ Patient Safety Indicators (PSIs) are used for calculation of risk-adjusted postoperative rates for adverse events. The payers and quality consortiums are increasingly requiring public reporting of hospital performance on these metrics. We discuss processes designed to improve the accuracy and clinical utility of PSI reporting in practice.

METHODS

The study was conducted at a 793-bed tertiary care academic medical center where PSI processes have been aggressively implemented to track patient safety events at discharge. A three-phased approach to improving administrative data quality was implemented. The initiative consisted of clinical review of all PSIs, documentation improvement, and provider outreach including active querying for patient safety events.

RESULTS

This multidisciplinary effort to develop a streamlined process for PSI calculation reduced the reporting of miscoded PSIs and increased the clinical utility of PSI monitoring. Over 4 quarters, 4 of 41 (10%) PSI-11 and 9 of 138 (7%) PSI-15 errors were identified on review of clinical documentation and appropriate adjustments were made.

CONCLUSION

A multidisciplinary, phased approach leveraging existing billing infrastructure for robust metric coding, ongoing clinical review, and frontline provider outreach is a novel and effective way to reduce the reporting of false-positive outcomes and improve the clinical utility of PSIs.

A comparison of two quality measurement tools in pediatric surgery--the American College of Surgeons National Surgical Quality Improvement Program-Pediatric versus the Agency for Healthcare Research and Quality Pediatric Quality Indicators

BACKGROUND/PURPOSE

Identifying quality in pediatric surgery can be difficult given the low frequency of postoperative complications. We compared postoperative events following pediatric surgical procedures at a single institution identified by ACS-NSQIP Pediatric (ACS NSQIP-P) methodology and AHRQ Pediatric Quality Indicators (AHRQ PDIs), an administrative tool.

METHODS

AHRQ PDI algorithms were run on inpatient hospital discharge abstracts for 1257 children in the 2010 to 2013 ACS NSQIP-P at our institution. Four events-pulmonary complications, postoperative sepsis, wound dehiscence and bleeding-were matched between ACS NSQIP-P and AHRQ PDI.

RESULTS

Events were identified by ACS NSQIP-P in 7.9% of children and by AHRQ PDI in 8.0%. The four matched events were identified in 5.5% and 3.7%, respectively. Specificities of AHRQ PDI ranged from 97% to 100% and sensitivities from 0 to 2%. The largest discrepancy was in bleeding, where AHRQ PDI captured 1 of the 54 events identified by ACS NSQIP-P. None of the 41 pulmonary, sepsis, and wound dehiscence events identified by AHRQ PDI were clinically relevant according to ACS NSQIP-P.

CONCLUSIONS

Adverse events following pediatric surgery are infrequent; thus, additional measures of quality to supplement postoperative adverse events are needed. AHRQ PDIs are inadequate for assessing quality in pediatric surgery.

The TRANSFORM Patient Safety Project: a microsystem approach to improving outcomes on inpatient units

BACKGROUND

Improvements in hospital patient safety have been made, but innovative approaches are needed to accelerate progress. Evidence is emerging that microsystem approaches to quality and safety improvement in hospital care are effective.

OBJECTIVE

We aimed to evaluate the effects of a multifaceted, microsystem-level patient safety program on clinical outcomes and safety culture on inpatient units.

DESIGN

A 1-year prospective interventional study was conducted, followed by a 6-month sustainability phase.

SETTING AND PARTICIPANTS

Four medical and surgical inpatient units within an academic university medical center were included, with registered nurses and residents representing study participants.

INTERVENTIONS

In situ simulation training; debriefing of medical emergencies; monthly patient safety team meetings; patient safety champion role; interdisciplinary patient safety conferences; recognition program for exemplary teamwork.

OUTCOMES

Hospital-acquired severe sepsis/septic shock and acute respiratory failure; unplanned transfers to higher level of care (HLOC); weighted risk-adjusted mortality. Safety culture was measured using a widely accepted, validated survey.

RESULTS

Rates of hospital-acquired severe sepsis/septic shock and acute respiratory failure decreased on study units, from 1.78 to 0.64 (p = 0.04) and 2.44 to 0.43 per 1,000 unit discharges (p = 0.03), respectively. The mean number of days between cases of severe sepsis/septic shock increased from baseline to the intervention period (p = 0.03). Unplanned transfers to HLOC increased from 715 to 764 per 1,000 unit transfers (p = 0.08). The weighted risk-adjusted observed-to-expected mortality ratio on all study units decreased from 0.50 to 0.40 (p < 0.001). Overall scores of safety culture on study units improved after the 1-year intervention, significantly for nurses (p < 0.001), but not for residents (p = 0.06). Scores significantly improved in nine of twelve survey dimensions for nurses, compared to in four dimensions for residents.

CONCLUSION

A multifaceted patient safety program suggested an association with improved hospital-acquired complications and weighted, risk-adjusted mortality, and improved nurses' perceptions of safety culture on inpatient study units.