Measuring complications of serious pediatric emergencies using ICD-10

Improving Accuracy of Administrative Data for Perforated Appendicitis Classification

INTRODUCTION

Reliance on International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM) diagnosis codes may misclassify perforated appendicitis with resultant research, fiscal, and public health implications. We aimed to improve the accuracy of administrative data for perforated appendicitis classification relying on ICD-10-CM codes from 2015 to 2018.

METHODS

We conducted a retrospective study of randomly sampled patients aged ≤18 years diagnosed with acute appendicitis from eight children's hospitals. Patients were identified using the Pediatric Health Information System, and true perforation status was determined by medical record review. We developed two algorithms by leveraging Pediatric Health Information System data elements and data mining (DM) approaches. The two developed algorithm performance was compared against algorithms that exclusively relied on ICD-10-CM codes using area under the curve and other measures.

RESULTS

Of 1051 clinically validated encounters that were included, 383 (36.4%) patients were identified to have perforated appendicitis. The two algorithms developed using DM approaches primarily leveraged ICD-10-CM codes and length of stay. DM-developed algorithms had a significantly higher accuracy than algorithms relying exclusively on ICD-10-CM (P value < 0.01): sensitivity and specificity for DM-developed algorithms were 0.86-0.88 and 0.95-0.97, respectively, which were overall higher than algorithms that relied on only ICD-10-CM.

CONCLUSIONS

This study provides an algorithm that can improve the accuracy of perforated appendicitis classification using commonly available elements in administrative data. We recommend that this algorithm is used in future appendicitis classification to ensure valid reporting, hospital-level benchmarking, and fiscal or public health assessments.

Multicenter evaluation of a method to identify delayed diagnosis of diabetic ketoacidosis and sepsis in administrative data

OBJECTIVES

To derive a method of automated identification of delayed diagnosis of two serious pediatric conditions seen in the emergency department (ED): new-onset diabetic ketoacidosis (DKA) and sepsis.

METHODS

Patients under 21 years old from five pediatric EDs were included if they had two encounters within 7 days, the second resulting in a diagnosis of DKA or sepsis. The main outcome was delayed diagnosis based on detailed health record review using a validated rubric. Using logistic regression, we derived a decision rule evaluating the likelihood of delayed diagnosis using only characteristics available in administrative data. Test characteristics at a maximal accuracy threshold were determined.

RESULTS

Delayed diagnosis was present in 41/46 (89 %) of DKA patients seen twice within 7 days. Because of the high rate of delayed diagnosis, no characteristic we tested added predictive power beyond the presence of a revisit. For sepsis, 109/646 (17 %) of patients were deemed to have a delay in diagnosis. Fewer days between ED encounters was the most important characteristic associated with delayed diagnosis. In sepsis, our final model had a sensitivity for delayed diagnosis of 83.5 % (95 % confidence interval 75.2-89.9) and specificity of 61.3 % (95 % confidence interval 56.0-65.4).

CONCLUSIONS

Children with delayed diagnosis of DKA can be identified by having a revisit within 7 days. Many children with delayed diagnosis of sepsis may be identified using this approach with low specificity, indicating the need for manual case review.

Impact of COVID-19 on the associated complications of high-risk conditions in a statewide pediatric emergency network

Background

The COVID-19 pandemic affected the volume and epidemiology of pediatric emergency department (ED) visits. We aimed to determine the rate of associated complications for 16 high-risk conditions in a Michigan statewide network of academic and community EDs during the pandemic.

Methods

We conducted a cross-sectional study of pediatric ED visits among a network of 5 Michigan health systems during the pre-pandemic (March 1, 2019-March 10, 2020) and pandemic (March 11, 2020-March 31, 2021) periods. Data were collected from the medical record and included patient demographics, ED visit characteristics, procedure codes, and final International Classification of Diseases, 10th Revision, Clinical Modification diagnosis codes. Selection of codes for 16 high-risk conditions and diagnostic complications were identified using previously described methods. Characteristics of ED visits were compared before versus during the pandemic using χ2 and Fisher's exact tests. We used multilevel logistic regression to analyze covariates and potential confounders for being diagnosed with a high-risk condition or a complication of a high-risk condition.

Results

A total of 417,038 pediatric ED visits were analyzed. The proportion of patients presenting with 10 of 16 high-risk conditions (including appendicitis, sepsis, and stroke) was higher in the pandemic period compared with pre-pandemic (P < 0.01). Despite this, there was no significant increase in the frequency of complications for any of the 16 high-risk conditions during the pandemic. The adjusted odds of being diagnosed with appendicitis (pre-pandemic 0.23% vs pandemic 0.52%; odds ratio [OR], 1.19 [95% confidence interval, CI, 1.00-1.41]), diabetic ketoacidosis (pre-pandemic 0.16% vs pandemic 0.52%; OR, 2.40 [95% CI, 2.07-2.78]), intussusception (pre-pandemic 0.05% vs pandemic 0.07%; OR, 1.64 [95% CI, 1.22-2.21)], and testicular torsion (pre-pandemic 0.10% vs pandemic 0.14%; OR, 1.64 [95% CI, 1.18-2.28]) was higher during the pandemic.

Conclusions

Despite a higher proportion of ED visits attributed to high-risk conditions, there was no increase in complications, suggesting minimal impact of the pandemic on outcomes of pediatric ED visits.

Age-Period-Cohort Analysis of Ischemic Heart Disease Morbidity and Mortality in China, 1990-2019

BACKGROUND

The disease burden of ischemic heart disease (IHD) continues to increase. This study aimed to assess the age, period, and cohort effects on the long-term trends of IHD incidence and mortality in China from 1990 to 2019.

METHODS AND RESULTS

The data were obtained from the Global Burden of Disease Study (GBD) 2019, and the age-standardized incidence/mortality rate (ASIR/ASMR) was calculated. The age-period-cohort (APC) model, which is a generalized linear model revealing the correlation of disease rate and attained age, period, and cohort, was applied to estimate the net drift (estimated annual percentage change [EAPC]s), the local drifts (age-specific EAPCs), the age, period, and cohort effects. The analyses elucidated that the ASIR and ASMR of IHD declined after 2013. The net drift of incidence was 0.212% in females, and the net drift of mortality was 0.371% in males. The local drifts of mortality were above 0 in males aged 20-84 years and in females aged 65-84 years. The age effects showed elevated trends during the study period. The period effects declined after 2013. The cohort effects of mortality in males were higher than that in females.

CONCLUSIONS

The decrease of ASIR and ASMR indicated that measures to prevent IHD have been effective in China. However, the cardiovascular health of the elderly and males should be considered in future policy decisions.

Comparison of crosswalk methods for translating ICD-9 to ICD-10 diagnosis codes for child maltreatment

BACKGROUND

A validated source of International Classification of Disease (1CD) 10th revision diagnostic codes to identify child maltreatment has not been developed. Such a reference would be essential for the practical purposes of administrative data-based research and public health surveillance.

OBJECTIVE

To evaluate the validity of diagnosis code classifications for child maltreatment following conversion from ICD 9th edition, clinical modification (ICD-9-CM) to 10th revision.

PARTICIPANTS AND SETTING

Children receiving inpatient or emergency medical care in the United States with ICD-9-CM/ICD-10-CM diagnosis codes for child maltreatment, identified using two large multicenter hospital-based datasets.

METHODS

We evaluated the performance of general equivalence mappings (GEMs) and network-based mappings for previously-validated ICD-9-CM diagnosis codes for child maltreatment in the 2013-2014 PHIS and 2012 KID and resulting ICD-10-CM codes in the 2018-2019 PHIS and 2016 KID datasets.

RESULTS

Of 56 previously-validated ICD-9-CM diagnoses, GEMs identified 15 with a similar proportion of diagnosed children in the KID ICD-9-CM and ICD-10 eras and 14 diagnoses in PHIS. Network-based mapping identified 18 diagnoses with similar proportions in the KID datasets, and 13 diagnoses in PHIS. For six diagnoses, the proportion of children identified in the ICD-10 era using network-based mapping was more than ten times the proportion identified in the ICD-9-CM era.

CONCLUSION

Neither crosswalk method provided consistently reliable conversions, due to both crosswalk methodology and changes introduced by the ICD 10th revision. These findings highlight the need for independent construction and validation of ICD-10-based definitions of child maltreatment as a precursor to administrative data-based research and public health surveillance.

Practitioners Assess Achievements and Challenges of Nonfatal Injury Surveillance

OBJECTIVE

Injury surveillance relies on data coded for administrative rather than epidemiological accuracy. The Centers for Disease Control and Prevention (CDC) established the 5-year Surveillance Quality Improvement (SQI) initiative to advance consensus and methodology for injury epidemiology reporting and analysis. Evaluation of the positive predictive value of the CDC's injury surveillance definitions based on International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) and International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM) coding in designated injury categories comprised much of the SQI initiative's work. The goal of the current study is to identify achievements and challenges in SQI as articulated by experienced injury epidemiology practitioners who participated in the CDC-funded SQI initiative.

DESIGN, SETTING, AND PARTICIPANTS

We conducted semistructured interviews with 12 representatives of state and federal public health agencies who had participated extensively in the SQI initiative. The interviews were transcribed and coded using NVivo qualitative analysis software. Initial coding of the data involved both in vivo coding (using the words of participants) and coding of a priori themes.

MAIN OUTCOME MEASURES

Qualitative analysis identified 2 overarching themes, variability among states and observations on the science of injury surveillance.

RESULTS

Within the 2 broad themes, the respondents provided valuable insights regarding access to medical records, case definition validation, unique contributions of medical record abstracting, variations in the practice of medical coding, and the potential for use of data from medical record reviews in other injury-related areas.

CONCLUSIONS

The contributions of the SQI initiative have provided valuable insights into ICD-10-CM case definitions for national injury surveillance. Challenges remain with regard to data access and quality with ongoing reliance on administrative datasets for injury surveillance.

Trends in Pediatric Appendicitis and Imaging Strategies During Covid-19 in the United States

RATIONALE AND OBJECTIVES

To determine if, during the first wave of the COVID-19 pandemic, 1) the proportion of complicated appendicitis changed, and 2) if imaging strategies for appendicitis in children changed.

MATERIALS AND METHODS

Retrospective cross-sectional study using administrative data from the Pediatric Health Information System, inclusive of pediatric patients diagnosed with appendicitis from March to May in 2017, 2018, 2019 and 2020. We compared trends during COVID-19 pandemic (March-May 2020) with corresponding pre-COVID-19 periods in 2017-201.9 Study outcomes were the proportion of complicated appendicitis and trends in imaging for appendicitis explained by patient-level variables.

RESULTS

The proportion of complicated appendicitis cases increased by 4.4 percentage points, from 46.5% pre-COVID-19 (2017-2019) to 50.9% during COVID-19 (2020), p < 0.001. Mean count of uncomplicated acute appendicitis cases decreased from pre-COVID-19 to the 2020 COVID-19 period (2017: n = 2555; 2018: n = 2679; 2019: n = 2722; 2020: n = 2231). Mean count of complicated appendicitis was unchanged between study periods (2017: n = 2189; 2018: n = 2302, 2019: n = 2442; 2020: n = 2311). Imaging approaches were largely unchanged between study periods; ultrasound was the most utilized modality in both study periods (68.3%, 70.2%; p = 0.033).

CONCLUSION

During the first wave of the COVID-19 pandemic, the proportion of complicated appendicitis cases increased without an absolute increase in the number of complicated appendicitis cases, but instead a decrease in the number of uncomplicated acute appendicitis diagnoses.

Clinical Features and Preventability of Delayed Diagnosis of Pediatric Appendicitis

IMPORTANCE

Delayed diagnosis of appendicitis is associated with worse outcomes than timely diagnosis, but clinical features associated with diagnostic delay are uncertain, and the extent to which delays are preventable is unclear.

OBJECTIVE

To determine clinical features associated with delayed diagnosis of pediatric appendicitis, assess the frequency of preventable delay, and compare delay outcomes.

DESIGN, SETTING, AND PARTICIPANTS

This case-control study included 748 children treated at 5 pediatric emergency departments in the US between January 1, 2010, and December 31, 2019. Participants were younger than 21 years and had a diagnosis of appendicitis.

EXPOSURES

Individual features of appendicitis and pretest likelihood of appendicitis were measured by the Pediatric Appendicitis Risk Calculator (pARC).

MAIN OUTCOMES AND MEASURES

Case patients had a delayed diagnosis of appendicitis, defined as 2 emergency department visits leading to diagnosis and a case review showing the patient likely had appendicitis at the first visit. Control patients had a single emergency department visit yielding a diagnosis. Clinical features and pARC scores were compared by case-control status. Preventability of delay was assessed as unlikely, possible, or likely. The proportion of children with indicated imaging based on an evidence-based cost-effectiveness threshold was determined. Outcomes of delayed diagnosis were compared by case-control status, including hospital length of stay, perforation, and multiple surgical procedures.

RESULTS

A total of 748 children (mean [SD] age, 10.2 [4.3] years; 392 boys [52.4%]; 427 White children [57.1%]) were included in the study; 471 (63.0%) had a delayed diagnosis of appendicitis, and 277 (37.0%) had no delay in diagnosis. Children with a delayed diagnosis were less likely to have pain with walking (adjusted odds ratio [aOR], 0.16; 95% CI, 0.10-0.25), maximal pain in the right lower quadrant (aOR, 0.12; 95% CI, 0.07-0.19), and abdominal guarding (aOR, 0.33; 95% CI, 0.21-0.51), and were more likely to have a complex chronic condition (aOR, 2.34; 95% CI, 1.05-5.23). The pretest likelihood of appendicitis was 39% to 52% lower in children with a delayed vs timely diagnosis. Among children with a delayed diagnosis, 109 cases (23.1%) were likely to be preventable, and 247 (52.4%) were possibly preventable. Indicated imaging was performed in 104 (22.0%) to 289 (61.3%) children with delayed diagnosis, depending on the imputation method for missing data on white blood cell count. Patients with delayed diagnosis had longer hospital length of stay (mean difference between the groups, 2.8 days; 95% CI, 2.3-3.4 days) and higher perforation rates (OR, 7.8; 95% CI, 5.5-11.3) and were more likely to undergo 2 or more surgical procedures (OR, 8.0; 95% CI, 2.0-70.4).

CONCLUSIONS AND RELEVANCE

In this case-control study, delayed appendicitis was associated with initially milder symptoms but worse outcomes. These findings suggest that a majority of delayed diagnoses were at least possibly preventable and that many of these patients did not undergo indicated imaging, suggesting an opportunity to prevent delayed diagnosis of appendicitis in some children.

Validation of an Automated System for Identifying Complications of Serious Pediatric Emergencies

BACKGROUND

Illness complications are condition-specific adverse outcomes. Detecting complications of pediatric illness in administrative data would facilitate widespread quality measurement, however the accuracy of such detection is unclear.

METHODS

We conducted a cross-sectional study of patients visiting a large pediatric emergency department. We analyzed those <22 years old from 2012 to 2019 with 1 of 14 serious conditions: appendicitis, bacterial meningitis, diabetic ketoacidosis (DKA), empyema, encephalitis, intussusception, mastoiditis, myocarditis, orbital cellulitis, ovarian torsion, sepsis, septic arthritis, stroke, and testicular torsion. We applied a method using disposition, diagnosis codes, and procedure codes to identify complications. The automated determination was compared with the criterion standard of manual health record review by using positive predictive values (PPVs) and negative predictive values (NPVs). Interrater reliability of manual reviews used a κ.

RESULTS

We analyzed 1534 encounters. PPVs and NPVs for complications were >80% for 8 of 14 conditions: appendicitis, bacterial meningitis, intussusception, mastoiditis, myocarditis, orbital cellulitis, sepsis, and testicular torsion. Lower PPVs for complications were observed for DKA (57%), empyema (53%), encephalitis (78%), ovarian torsion (21%), and septic arthritis (64%). A lower NPV was observed in stroke (68%). The κ between reviewers was 0.88.

CONCLUSIONS

An automated method to measure complications by using administrative data can detect complications in appendicitis, bacterial meningitis, intussusception, mastoiditis, myocarditis, orbital cellulitis, sepsis, and testicular torsion. For DKA, empyema, encephalitis, ovarian torsion, septic arthritis, and stroke, the tool may be used to screen for complicated cases that may subsequently undergo manual review.

ICD-10 Transition Influences Trends in Perforated Appendix Admission Rate

BACKGROUND

This study sought to evaluate the influence of International Classification of Diseases, Tenth Revision (ICD-10) transition on Perforated Appendix Admission Rate (PAAR), which is a commonly used indicator representing access to care developed by Agency for Healthcare Research and Quality (AHRQ).

MATERIALS AND METHODS

In this interrupted time series study of Pediatric Health Information System database from 2013 to 2018, we employed three study phases (pre-implementation, washout, and initial implementation) to evaluate the influence of ICD-10 transition on trends in PAAR. ICD-10 diagnosis codes suggested by AHRQ's specifications were used to identify perforated and simple appendicitis, and PAAR was estimated accordingly. Generalized linear mixed models were used to examine the association of ICD-10 initial implementation and being documented as perforated appendicitis on encounter level.

RESULTS

We identified a total of 94,810 encounters diagnosed with appendicitis, and almost all patients' characteristics were similar over the three study phases, except for PAAR. The pre-implementation PAAR in October 2013 was 33.1%, and the immediate influence of ICD-10 transition on PAAR was 3.2% (P = 0.002), with a 0.38% per quarter increase over time (P = 0.02). After adjusting for age, gender, race/ethnicity, payer, and year, the likelihood of being documented as having perforated appendicitis in 2016 was 1.5 times higher than the estimated likelihood before the implementation (adjusted Odds Ratio: 1.51; 95% Confidence Interval: 1.40-1.63; P < 0.001).

CONCLUSIONS

The 2015-2018 ICD-10 transition may be erroneously associated with an increasing trend of PAAR. Care should be taken when interpreting the metric during this period.

Measuring complications of serious pediatric emergencies using ICD-10

OBJECTIVE

To create definitions for complications for 16 serious pediatric conditions using the International Classification of Diseases, 10th Revision, Clinical Modification or Procedure Coding System (ICD-10-CM/PCS), and to assess whether complication rates are similar to those measured with ICD-9-CM/PCS.

DATA SOURCES

The Healthcare Cost and Utilization Project State Emergency Department and Inpatient Databases from five states between 2014 and 2017 were used to identify cases and assess complication rates. Incidences were calculated using population counts from the 5-year American Community Survey.

DATA COLLECTION/EXTRACTION METHODS

Patients were identified by the presence of a diagnosis code for one of the 16 serious conditions. Only the first encounter for a given condition by a patient was included. Encounters resulting in transfer were excluded as the presence of complications was unknown.

STUDY DESIGN

We defined complications using data elements routinely available in administrative databases including ICD-10-CM/PCS codes. The definitions were adapted from ICD-9-CM/PCS using general equivalence mappings and refined using consensus opinion. We included 16 serious conditions: appendicitis, bacterial meningitis, compartment syndrome, new-onset diabetic ketoacidosis (DKA), ectopic pregnancy, empyema, encephalitis, intussusception, mastoiditis, myocarditis, orbital cellulitis, ovarian torsion, sepsis, septic arthritis, stroke, and testicular torsion. Using data from children under 18 years, we compared incidences and complication rates across the ICD-10-CM/PCS transition for each condition using interrupted time series.

PRINCIPAL FINDINGS

There were 61 314 ED visits for a serious condition; the most common was appendicitis (n = 37 493). Incidence rates for each condition were not significantly different across the ICD-10-CM/PCS transition for 13/16 conditions. Three differed: empyema (increased 42%), orbital cellulitis (increased 60%), and sepsis (increased 26%). Complication rates were not significantly different for each condition across the ICD-10-CM/PCS transition, except appendicitis (odds ratio 0.62, 95% CI 0.57-0.68), DKA (OR 3.79, 95% CI 1.92-7.50), and orbital cellulitis (OR 0.53, 95% CI 0.30-0.95).

CONCLUSIONS

For most conditions, incidences and complication rates were similar before and after the transition to ICD-10-CM/PCS codes, suggesting our system identifies complications of conditions in administrative data similarly using ICD-9-CM/PCS and ICD-10-CM/PCS codes. This system may be applied to screen for cases with complications and in health services research.