Examining the correlation between Altmetric Attention Score and citation count in the gynecologic oncology literature: Does it have an impact?

The Top Ranked 101 Articles in Pediatric Surgical Journals from an Altmetric Perspective

INTRODUCTION

 In the era of scientific digitalization, online media platforms gain increasing popularity to accomplish research output awareness. The Altmetric Attention Score AAS weights these online mentions based on a privy algorithm. We aimed to characterize the top 100 articles with the highest (AAS) published in pediatric surgery journals.

MATERIALS AND METHODS

 Publications from six core pediatric surgery journals were retrieved from www.altmetric.com in January 2023 and ranked by their AAS. The top 101 publications were analyzed for their bibliometric measures, study design, and quality as well as online media mentions.

RESULTS

 The top 101 AAS articles were published between 1974 and 2022, preferentially from the United States (64%) and mainly in Journal of Pediatric Surgery (73%), followed by Journal of Pediatric Surgery Case Reports, Pediatric Surgery International, Seminars in Pediatric Surgery, and European Journal of Pediatric Surgery. Their AAS ranged between 21 and 389 (median: 33), with Twitter/X being mostly responsible for online mentions (n = 2,189; 75%). The number of citations in peer-reviewed journals ranged between 0 and 358 (median: 16) and did not correlate to AAS. Retrospective study design (33%) with low evidence level IV (43%) dominated.

CONCLUSION

 The Journal of Pediatric Surgery is the main source of high-profile AAS publications in pediatric surgery. The altmetric popularity of articles is predominantly achieved by their propagation via X, irrespective of the study quality and recognition in the scientific community. Thus, active "twitterism" may play the key role to reach high AAS scores.

Publication rates of podium presentations at the Society of Gynecologic Oncology (SGO) annual meetings

OBJECTIVES

Our study aimed to determine the publication rates of podium presentations from the 2017 and 2018 Society of Gynecologic Oncology (SGO) Annual Meetings; and to examine rates and predictors of oral presentations that resulted in publication.

METHODS

We reviewed podium presentations given at the 2017 and 2018 SGO Annual Meetings. Abstracts were evaluated for publication from January 1, 2017 to March 30, 2020 and January 1, 2018 to June 30, 2021, respectively, to allow for a 3 year period of publication.

RESULTS

In 2017 and 2018, 43 of 75 (57.3%) and 47 of 83 (56.6%) podium presentations were published within 3 years, respectively. No significant difference was found between the mean time to publication within 3 years (13.0 months vs 14.1 months for 2017 and 2018, respectively; p=0.96). Similarly, the mean difference of journal impact factors between both years did not reach significance (6.57 and 10.7 for 2017 and 2018, respectively; p=0.09). The median impact factor (IF) was 4.54 (range: 40.3) and 4.62 (range: 70.7) in 2017 and 2018, respectively. Of the presentations published, 53.4% (2017) and 38.3% (2018) appeared in the journal Gynecologic Oncology. Significant positive correlations for the likelihood of publication were determined among the following: funding status (r=0.93) including funding involving National Institutes for Health (r=0.91) or pharmaceutical (r=0.95), clinical trial study design (r=0.94), and pre-clinical research (r=0.95) (all p<0.005).

CONCLUSIONS

At the 2017 and 2018 SGO Annual Meetings 57% of podium presentations were published in a peer-reviewed journal within 3 years. Publication in peer-reviewed journals is crucial for timely distribution of clinical information to the medical community.

Modern Impact of Surgery Journals: Associations Between Impact Factor, H5-Index, and Altmetric Score

INTRODUCTION

While impact factor (IF) remains the "gold standard" metric for journal quality, newer metrics are gaining popularity. These include the H5-index and journal Altmetric Attention Score (AAS). We explored the relationship between the IF, H5-index, and AAS for core general surgery (GS) and subspecialty journals.

METHODS

For all GS and subspecialty journals with a Clarivate IF, H5-index (January 1, 2017, to December 31, 2021) and journal AAS were obtained. Journal Twitter presence and activity was sourced from Twitter and the Twitter application programming interface. Spearman's correlations were assessed for numeric variables.

RESULTS

A total of 105 journals were included, around half (49/105; 46.7%) of which were core GS journals. Median IF was 2.48 and median H5-index 19. Journal IF demonstrated a strong correlation with H5-index overall (r = 0.81), though this ranged from r = 0.95 (P < 0.01) for vascular surgery to r = 0.77 (P < 0.01) for plastic surgery journals. AAS was moderately correlated with the IF and H5-index (r = 0.59 and 0.62, respectively; both P < 0.01). R² values ranging indicated that 66% of the variation in the H5-index and 35% of the variation in AAS was explained by the IF. Just over half the journals had a Twitter account (54/105; 51.4%). Journals with a Twitter account also had a significantly higher IF, H5-index, and AAS than those without a Twitter account (all P < 0.01). AAS was moderately correlated with Twitter activity (r = 0.59) and Twitter followers (r = 0.69).

CONCLUSIONS

Across GS and subspecialty journals, journal IF correlates strongly with the H5-index and moderately with AAS. However, only 35% of variation in AAS and 66% of variation in the H5-index is explained by the IF, indicating that these metrics measure unique aspects of journal quality. The future growth of surgical journals should be geared towards improving across multiple metrics, including both the conventional and the contemporary, while leveraging social media to improve readership and eventual academic impact.

Impact of COVID-19 on Otolaryngology Literature

OBJECTIVES/HYPOTHESIS

To understand the effect of the COVID-19 pandemic on the volume, quality, and impact of otolaryngology publications.

STUDY DESIGN

Retrospective analysis.

METHODS

Fifteen of the top peer-reviewed otolaryngology journals were queried on PubMed for COVID and non-COVID-related articles from April 1, 2020 to March 31, 2021 (pandemic period) and pre-COVID articles from the year prior. Information on total number of submissions and rate of acceptance were collected from seven top-ranked journals.

RESULTS

Our PubMed query returned 759 COVID articles, 4,885 non-COVID articles, and 4,200 pre-COVID articles, corresponding to a 34% increase in otolaryngology publications during the pandemic period. Meta-analysis/reviews and miscellaneous publication types made up a larger portion of COVID publications than that of non-COVID and pre-COVID publications. Compared to pre-COVID articles, citations per article 120 days after publication and Altmetric Attention Score were higher in both COVID articles (citations/article: 2.75 ± 0.45, P < .001; Altmetric Attention Score: 2.05 ± 0.60, P = .001) and non-COVID articles (citations/article: 0.03 ± 0.01, P = .002; Altmetric Attention Score: 0.67 ± 0.28, P = .016). COVID manuscripts were associated with a 1.65 times higher acceptance rate compared to non-COVID articles (P < .001).

CONCLUSIONS

COVID-19 was associated with an increase in volume, citations, and attention for both COVID and non-COVID articles compared to pre-COVID articles. However, COVID articles were associated with lower evidence levels than non-COVID and pre-COVID articles.

LEVEL OF EVIDENCE

3 Laryngoscope, 132:1364-1373, 2022.