Levels of Evidence in Rhinology and Skull Base Surgery Research

The Quality of Otology and Neurotology Research in Otology Journals

OBJECTIVE

To establish the level of evidence and publishing trends in otology-specific journals over a 20-year period.

DESIGN

Retrospective analysis.

METHODS

The three O/N specific journals with the highest Eigenfactor scores were identified. All articles published in the years 1998, 2008, and 2018 were reviewed and level of evidence (LoE) based on standards set by the Oxford Centres for Evidence Based Medicine was assigned by two independent reviewers. One way analysis of variance and 95% bootstrap sensitivity analysis were performed.

RESULTS

A total of 1,062 studies were published over 20 years, of these 809 (76.2%) were eligible for inclusion in the present study. The average number of publications per year increased over time. The average LoE improved significantly over the total interval (-0.235, p = 0.027, [CI -0.45, -0.019]), however did not between 1998 and 2008 (p = 0.111) or between 2008 and 2018 (p = 1). When looking at just LoE 1 or 2, the number and percentage of higher quality papers improves over time-48/158 (30.4%) in 1998, rising to 94/250 (37.6%) in 2008, and 158/401 (39.4%) in 2008.

CONCLUSIONS

Over the past two decades there has been an overall increase in the quantity and quality (as measured by LoE) of publications in O/N-specific journals. In general, quality of O/N studies is slightly better in O/N-specific journals compared with general OHNS journals. However, there are still improvements to be had in the proportion of high-evidence publications, as they still number less than half of all total publications in the subspecialty.

Evaluating Strength of Evidence of Pediatric Otolaryngology Research Literature: A 20-Year Review

OBJECTIVES/HYPOTHESIS

Quantity and quality of Otolaryngology-Head and Neck Surgery (OTL-HNS) research are increasing, yet patterns within Pediatric OTL-HNS publications are unknown. This study examines trends in the level of evidence of pediatric OTL-HNS articles over a 20-year period to quantify the growth and characterize contributing factors.

STUDY DESIGN

Review article.

METHODS

A retrospective review was conducted on 12 peer-reviewed OTL-HNS journals at three time-points: 1996, 2006, and 2016. Pediatric-specific OTL-HNS journals were selected; all were among the top 10 highest impact factor journals, with one pediatric-specific and one Canadian journal. Publication details, author characteristics, and study focus were collected. Papers were classified based on the Oxford Centre for Evidence-Based Medicine Levels of Evidence by two independent reviewers.

RESULTS

Of the 1,733 articles reviewed, 727 met inclusion criteria. A greater absolute number of pediatric OTL-HNS articles were published over the years studied: from 95 in 1996 to 359 in 2016 (P < .001). As well, the absolute number of high-quality studies has increased over the study period, from 28 articles in 1996 to 100 articles in 2016. However, the relative percentage of high-quality papers remained stable between 27.9% and 32.2% with an average of 29.7% (P = .89). Higher impact factor journals did not tend to publish higher-quality pediatric OTL-HNS articles (P = .48).

CONCLUSIONS

Over the past 20 years, there is no appreciable improvement in the proportion of high-quality publications in pediatric OTL-HNS; however, there is an overall greater number of high-quality papers within OTL-HNS literature. These findings likely relate to challenges of research within pediatric surgical specialties.

LEVEL OF EVIDENCE

NA Laryngoscope, 2021.