Proliferation and Contributions of National Database Studies in Otolaryngology Literature Published in the United States: 2005-2016

Quality and Impact of Manuscripts Using The Society of Thoracic Surgeons National Databases

BACKGROUND

The Society of Thoracic Surgeons (STS) National Databases contain the largest and most comprehensive cardiac, thoracic, and congenital surgery data available. In this analysis characteristics of manuscripts that used the STS National Databases were examined to evaluate the quality and impact of these publications.

METHODS

Manuscripts published from 2010 to 2020 that used the STS National Databases (Adult Cardiac, General Thoracic, and Congenital Heart Surgery) were examined. The number of times cited per published manuscript, journal of publication, and journal CiteScore were assessed. Author characteristics, including institutional association and h-index, were evaluated for first and last authors.

RESULTS

Of 539 published manuscripts, 179 (33.2%) used the Adult Cardiac Surgery, 128 (23.7%) the Congenital Heart Surgery, 85 (15.8%) the General Thoracic Surgery, and 136 (25.2%) used unspecified STS National Databases. Collectively the analyzed manuscripts were cited 18,943 times, with a mean of 35.1 (range, 0-528) citations per manuscript. Manuscripts were published in 97 journals with a mean year-adjusted CiteScore of 5.6 (range, 0.1-60.2). Authors associated with 361 institutions contributed to published manuscripts. The mean h-index of first authors was 24.6 (range, 0-100) and of last authors was 44.1 (range, 0-164). From 2010 to 2020 first authors wrote a mean of 1.6 (range, 1-31) and last authors wrote a mean of 1.9 (range, 1-29) STS National Databases publications.

CONCLUSIONS

The STS National Databases are some of the most robust data collection sources available to cardiothoracic surgeons. These data have enabled valuable research in respected journals from authors of varying experience levels.

Survival analysis of patients with advanced hypopharyngeal cancer comparing patients who received primary surgery to those who received chemoradiation: An analysis of the NCDB

INTRODUCTION

The objective of this study was to use the American College of Surgeons' National Cancer Database (NCDB) to examine the association between primary treatment and overall survival (OS) among patients with locoregionally advanced hypopharyngeal cancer.

METHODS

6,055 adult patients diagnosed between 2004 and 2015 with stage III or IV, M0, hypopharyngeal squamous cell carcinoma were identified within the NCDB. Patients who received primary chemoradiation (CRT) were compared to those that received surgery with adjuvant radiation or chemoradiation (S + Adj). OS was compared between treatment groups using Kaplan-Meier analyses, propensity score adjustment, and Cox regression analyses.

RESULTS

The median survival was 22.7 months (IQR 11.0-49.0). The S + Adj group had a significantly higher comorbidity score, higher grade disease, and more advanced stage disease than the CRT group. S + Adj was associated with significantly improved survival when compared to CRT (p < 0.0001). A propensity score adjusting for facility type, facility location, care at multiple facilities, histology, and T stage was developed. S + Adj was associated with longer survival (HR: 0.72, 95% CI: 0.64-0.80) when compared to CRT in a multivariable Cox regression analysis (adjusting for age, race and ethnicity, insurance status, a comorbidity index, diagnosis year, treatment delay, N stage, and the propensity score). S + Adj was associated with significantly improved survival among those with T2 disease (p = 0.02), T3 disease (p = 0.02), and T4 disease (p < 0.0001) in sensitivity analyses examining these subcohorts independently.

CONCLUSIONS

Among patients with advanced hypopharyngeal cancer reported in NCDB, treatment with S + Adj was associated with longer survival compared to those treated with primary CRT.

National Database Research in Head and Neck Reconstructive Surgery: A Call for Increased Transparency and Reproducibility

OBJECTIVE

To reproduce a published study comparing outcomes of patients who underwent microvascular reconstruction by plastic surgeons and otolaryngologists and to examine how case selection and methodology using the National Surgical Quality Improvement Program (NSQIP) data set can affect results and conclusions.

STUDY DESIGN

Cross-sectional analysis of US national database.

SETTING

American College of Surgeons National Surgical Quality Improvement Program (NSQIP) from 2005 to 2017.

SUBJECTS AND METHODS

A recently published study that used the NSQIP database to compare outcomes after head and neck free tissue transfer between plastic surgeons and otolaryngologists was reproduced. Different approaches to case selection and statistical analysis were evaluated and their effects on statistical significance and study conclusions were compared.

RESULTS

When all cases of free tissue transfer, captured in NSQIP between 2005 and 2017, were compared between plastic surgery and otolaryngology, plastic surgery patients appeared to have lower rates of complications and length of stay. However, a more in-depth analysis demonstrated that these results were confounded by older and sicker otolaryngology patients. A second analysis of the same NSQIP data, limited to only head and neck oncologic reconstructions, demonstrated that otolaryngology patients had fewer complications on univariate and multivariable analysis.

CONCLUSION

We demonstrated how case selection and analysis can significantly affect results. It is incumbent upon researchers who use NSQIP and other publicly available data sets to fully detail their methodology to allow other researchers to reproduce and evaluate their work and for the journal editorial process to carefully evaluate the methodology and conclusions of their contributing authors.

Machine Learning to Predict Delays in Adjuvant Radiation following Surgery for Head and Neck Cancer

OBJECTIVE

To apply a novel methodology with machine learning (ML) to a large national cancer registry to help identify patients who are high risk for delayed adjuvant radiation.

STUDY DESIGN

Observational cohort study.

SETTING

National Cancer Database (NCDB).

SUBJECTS AND METHODS

A total of 76,573 patients were identified from the NCDB who had invasive head and neck cancer and underwent surgery, followed by radiation. The model was constructed from 80% of the patient data and subsequently evaluated and scored with the remaining 20%. Permutation feature importance analysis was used to understand the weighted model construction.

RESULTS

A total of 76,573 patients met inclusion and exclusion criteria. Our ML model was able to predict whether patients would start adjuvant therapy beyond 50 days after surgery with an overall accuracy of 64.41% and a precision of 58.5%. The 2 most important variables used to build the model were treating facility and urban versus rural demographics.

CONCLUSION

Statistics can provide inferences within an overall system, while ML is a novel methodology that can make predictions. We can identify patients who are "high risk" for delayed radiation using information from >75,000 patient experiences, which has the potential for a direct impact on clinical care. Our inability to achieve greater accuracy is due to limitations of the data captured by the NCDB, and we need to continue to identify new variables that are correlated with delayed radiation therapy. ML will prove to be a valuable clinical tool in years to come, but its utility is limited by available data.