Surgical outcomes research: a progression from performance audits, to assessment of administrative databases, to prospective risk-adjusted analysis - how far have we come?

Cost analysis of tonsillectomy in children using medicaid data

OBJECTIVE

To evaluate the cost-effectiveness of adenotonsillectomy (T&A) for adenotonsillar hypertrophy and recurrent tonsillitis through the use of Missouri Medicaid data.

STUDY DESIGN

Children ages 2-16 years who had a diagnosis of adenotonsillar hypertrophy (based on medical claim codes) in 2006 (n = 4276) were included in this population-based study. The main outcome was direct total costs paid by Medicaid. Costs 2 years before and after T&A were compared in children who underwent surgical intervention with those who did not as well as costs comparison pre- and post-T&A. Wilcoxon rank-sum or Wilcoxon Signed-rank test was used for costs comparisons.

RESULTS

Children with adenotonsillar hypertrophy who underwent T&A were significantly less likely to be African American. They had more adenotonsillar infections before undergoing T&A and greater total costs (median costs $2313 vs. $1945; P = .009). The median costs were $1228 pre-T&A, compared with $823 post-T&A (P < .0001). This reduction in costs of $405 (33%) compares with a median cost of the procedure of $1088. The reduction in costs was mostly because of less antibiotic use and outpatient visits.

CONCLUSIONS

African American children have fewer T&A procedures for adenotonsillar hypertrophy than white children, which represents an unexplained racial disparity. Children with adenotonsillar hypertrophy who underwent T&A compared with those who did not had more adenotonsillar infections and greater health care costs. T&A leads to a reduction in costs that, after 2 years, is 37% of the costs of the procedure. Future studies should examine the effects of demographics, obesity, and disease severity on health care costs in children with adenotonsillar hypertrophy.

Frequency and variety of inpatient pediatric surgical procedures in the United States

OBJECTIVE

Pediatric surgical procedures are being performed in a variety of hospitals with large differences in surgical volume. We examined the frequency and variety of inpatient pediatric surgical procedures in the United States by hospital type and geographic region using a nationally representative sample.

METHODS

The 2009 Kids' Inpatient Database for patients <18 years old was used to calculate surgical frequencies by using International Classification of Diseases, Ninth Revision, Clinical Modification, (ICD-9-CM) codes. We performed stratified analysis by hospital type (free-standing children's hospital, children's unit within an adult hospital, and general hospital) and geographic region (South, West, Midwest, Northeast) to compare frequencies of surgical procedures.

RESULTS

A total of 216 081 procedures were projected for 2009 with the top 20 procedures accounting for >90% of cases. As many as 40% of all pediatric inpatient surgical procedures are being performed in adult general hospitals. Infrequent complex low-volume neonatal surgical procedures (pullthrough for Hirschsprung disease, surgery for malrotation, esophageal atresia repair, and diaphragmatic hernia repair) were 6.8 to 16 times more likely to occur in a children's hospital. Significant regional variation in procedure frequency rates occurred for appendectomy and cholecystectomy.

CONCLUSIONS

This report is the first to characterize pediatric surgical inpatient volume in the United States. Such data may influence the distribution of pediatric surgeons, number of trainees, and training curricula for pediatric surgeons, pediatricians, general surgeons and other surgical specialists who might operate on children. In addition, it raises the question of whether complex pediatric surgical procedures should preferably be performed at dedicated high volume children's hospitals.

Evaluation of the utility of hospital databases to provide data in assessing the quality of strabismus surgery

AIMS AND BACKGROUND

Rates of re-operation, which may be related to an unsatisfactory surgical outcome, can provide a long-term index of the quality of strabismus surgery. This study aims to evaluate the utility of the Scottish Morbidity Records (SMR1) in determining nature and rates of re-operation for strabismus at the Royal Hospital for Sick Children (RHSC), Glasgow.

METHODS

SMR1 data on strabismus surgery performed on children aged between 0 and 17 years at the RHSC, Glasgow, between January 2000 and March 2009 were analysed.

RESULTS

In total, 1376 strabismus procedures were carried out on 1274 individuals. The median time between first and subsequent procedures was 19 months; the commonest reasons being under-correction or recurrence. The Kaplan-Meier rate of undergoing re-operation was 7.4% after 9 years with a 95% confidence interval of 5.4-9.9%.

CONCLUSIONS

The SMR1 is a useful source of hospital-based and population data. With supplementation from parallel databases, routine administrative databases like the SMR1 can provide better quality data to inform practice.

American College of Surgeons National Surgical Quality Improvement Program Pediatric: a beta phase report

PURPOSE

The American College of Surgeons (ACS) National Surgical Quality Improvement Program Pediatric (NSQIP-P) expanded to beta phase testing with the enrollment of 29 institutions. Data collection and analysis were aimed at program refinement and development of risk-adjusted models for inter-institutional comparisons.

METHODS

Data from the first full year of beta-phase NSQIP-P were analyzed. Patient accrual used ACS-NSQIP methodology tailored to pediatric specialties. Preliminary risk adjusted modeling for all pediatric and neonatal operations and pediatric (excluding neonatal) abdominal operations was performed for all cause morbidity (other than death) and surgical site infections (SSI) using hierarchical logistic regression methodology and eight predictor variables. Results were expressed as odds ratios with 95% confidence intervals.

RESULTS

During calendar year 2010, 29 institutions enrolled 37,141 patients. 1644 total CPT codes were entered, of which 456 accounted for 90% of the cases. 450 codes were entered only once (1.2% of cases). For all cases, overall mortality was 0.25%, overall morbidity 7.9%, and the SSI rate 1.8%. For neonatal cases, mortality was 2.39%, morbidity 18.7%, and the SSI rate 3%. For the all operations model, risk-adjusted morbidity institutional odds ratios ranged 0.48-2.63, with 9/29 hospitals categorized as low outliers and 9/29 high outliers, while risk-adjusted SSI institutional odds ratios ranged 0.36-2.04, with 2/29 hospitals low outliers and 7/29 high outliers.

CONCLUSION

This report represents the first risk-adjusted hospital-level comparison of surgical outcomes in infants and children using NSQIP-P data. Programmatic and analytic modifications will improve the impact of this program as it moves into full implementation. These results indicate that NSQIP-P has the potential to serve as a model for determining risk-adjusted outcomes in the neonatal and pediatric population with the goal of developing quality improvement initiatives for the surgical care of children.

Quality indicators in pediatric orthopaedic surgery: a systematic review

BACKGROUND

The ability to measure health system quality has become a priority for governments, the private sector, and the public. Quality indicators (QIs) refer to clear, measurable items related to outcomes. The use of QIs can initiate local quality improvement and track changes in quality over time as interventions are implemented.

QUESTIONS/PURPOSES

We identified existing evidence-based indicators of quality pediatric orthopaedic care and evaluated published QIs that may be applicable to pediatric orthopaedic care.

SEARCH STRATEGY

Using five standard search engines we searched the literature using terms such as "quality indicators," "orthopaedic surgery," and "pediatric." Study selection was performed in a stepwise manner, first by title, then abstract, and then full-text review. Of the 604 citations identified, 13 articles were selected for inclusion. Eight papers included only pediatric patients.

RESULTS

The most commonly reported indicator was mortality followed by postoperative complications. Reoperation and readmission rates were also reported along with patient-centered QIs, although with less frequency.

CONCLUSION

Although mortality and postoperative complications were the most frequently reported QIs, concern for their applicability was raised because of their relative infrequency in pediatrics. Patient-centered QIs appear to be the most useful tools reported, although their use is somewhat limited in the published literature. Although there are benefits and drawbacks to all reported QIs, patient-centered and surgeon-defined outcomes along with cost-effectiveness have important roles in evaluating the quality of pediatric orthopaedic care.

Reoperation after colorectal surgery is an independent predictor of the 1-year mortality rate

BACKGROUND

Comparative evaluation of surgical quality among hospitals must improve outcome and efficiency, and reduce medical costs. Reoperation after colorectal surgery is a consequence of surgical complications and therefore considered a quality-of-care indicator. With respect to the mortality rate, the 1-year mortality may be a more meaningful figure than in-hospital mortality, because it also reflects the impact of surgical complications beyond discharge.

OBJECTIVE

The aim of our study was to evaluate the 1-year mortality after colorectal surgery and to identify predicting factors.

DESIGN

This study was a retrospective analysis from our colorectal surgery database.

PATIENTS

All patients who underwent elective colorectal surgery from 2005 to 2008 were included.

MAIN OUTCOME MEASURES

Both univariate and multivariate analysis were performed to identify predicting factors. The following variables were analyzed: age, operative risk according to the ASA class, Charlson-Age Comorbidity Index, indication for and type of resection, primary anastomosis, tumor staging, anastomotic leakage, and reoperation.

RESULTS

For 743 consecutive patients, the 1-year mortality rate was 6.9%. Patients were operated on mainly because of colorectal cancer (n = 537; 72%). The rate of reoperation and in-hospital mortality was 12.8% and 2.4%. Univariate survival analysis demonstrated that ASA class, age, Charlson-Age Comorbidity Index, reoperation, and stage of disease were independent predictors of 1-year mortality. Multivariate analysis showed that ASA class (P = .020; HR 1.69), age (P = .015; HR 2.08) and reoperation (P = .001; HR 2.72) are directly correlated with 1-year mortality.

LIMITATIONS

Both patients with benign diseases and colorectal cancer are included. Furthermore, no clear guidelines on whether to perform a reoperation were available.

CONCLUSION

One-year mortality after colorectal surgery is independently predicted by ASA class, age, and reoperation. Our results underline the value of the 1-year mortality rate and the reoperation rate as parameters for quality assessment in colorectal surgery.

Pediatric American College of Surgeons National Surgical Quality Improvement Program: feasibility of a novel, prospective assessment of surgical outcomes

PURPOSE

The American College of Surgeons (ACS) National Surgical Quality Improvement Program (NSQIP) provides validated assessment of surgical outcomes. This study reports initiation of an ACS NSQIP Pediatric at 4 children's hospitals.

METHODS

From October 2008 to June 2009, 121 data variables were prospectively collected for 3315 patients, including 30-day outcomes and tailoring the ACS NSQIP methodology to children's surgical specialties.

RESULTS

Three hundred seven postoperative complications/occurrences were detected in 231 patients representing 7.0% of the study population. Of the patients with complications, 175 (75.7%) had 1, 39 (16.9%) had 2, and 17 (7.4%) had 3 or more complications. There were 13 deaths (0.39%) and 14 intraoperative occurrences (0.42%) detected. The most common complications were infection, 105 (34%) (SSI, 54; sepsis, 31; pneumonia, 13; urinary tract infection, 7); airway/respiratory events, 27 (9%); wound disruption, 18 (6%); neurologic events, 8 (3%) (nerve injury, 4; stroke/vascular event, 2; hemorrhage, 2); deep vein thrombosis, 3 (<1%); renal failure, 3 (<1%); and cardiac events, 3 (<1%). Current sampling captures 17.5% of cases across institutions with unadjusted complication rates ranging from 6.8% to 10.2%. Completeness of data collection for all variables exceeded 95% with 98% interrater reliability and 87% of patients having full 30-day follow-up.

CONCLUSION

These data represent the first multiinstitutional prospective assessment of specialty-specific surgical outcomes in children. The ACS NSQIP Pediatric is poised for institutional expansion and future development of risk-adjusted models.

Effect of subjective preoperative variables on risk-adjusted assessment of hospital morbidity and mortality

OBJECTIVE

To examine the influence of American Society of Anesthesiologists Physical Status Classification (ASA) and preoperative Functional Health Status (FHS) variables on risk-adjusted estimates of surgical quality and to assess whether classifications are inflated at some hospitals.

BACKGROUND

ASA and FHS are influential in risk-adjusted comparisons of surgical quality. However, because ASA and FHS are subjective they can be inflated, making patients appear more ill than they actually are, and crediting hospitals for a sicker patient population.

METHODS

We identified 28,751 colorectal surgery patients at 170 hospitals participating in the American College of Surgeon's National Surgical Quality Improvement Program (ACS NSQIP) during 2006 to 2007. Logistic regression models were developed for morbidity and mortality with and without inclusion of ASA and FHS. Hospital quality rankings from the different models were compared.

RESULTS

Morbidity and mortality rates were 24.3% and 3.9%, respectively. Percents of patients in ASA classes I through V were 3.3%, 46.4%, 41.5%,8.3%, and 0.7% and that were independent or partially or totally dependent were 89.2%, 7.2%, and 3.6%, respectively. Models that included ASA and FHS exhibited slightly better fit (Hosmer-Lemshow statistic) and discrimination(c-statistic) than models without both these variables, though magnitudes of differences were consistent with chance. There was inconsistent evidence for improper assignment of ASA and FHS.

CONCLUSIONS

The small improvements in model quality when both ASA and FHS are present versus absent, suggest that they make a unique contribution to assessing severity of preoperative risk. With little indication that these subjective variables are subject to an important level of institutional bias, it is appropriate that they be used to assess risk-adjusted surgical quality. Periodic monitoring for inappropriate inflation of ASA status is warranted.