The Altmetric Attention Score Is Associated With Citation Rates and May Reflect Academic Impact in the Total Joint Arthroplasty Literature

A comparison of the top 500 papers in Clinical Nutrition ranked by citation and Altmetric Attention Scores

BACKGROUND AND AIMS

Citation scores (CS) have been traditionally used to measure the impact of scientific publications. Sourced from the Internet, Altmetric Attention Scores (AAS) are complementary metrics that assess how often publications are discussed and used globally. We compared by rank the top 500 papers by CS and AAS published in Clinical Nutrition with corresponding AAS and CS.

METHODS

A search for all publications in Clinical Nutrition was performed on Dimensions (https://app.dimensions.ai/discover/publication) on 3rd April 2024. Outputs were ranked according to CS and then by AAS with the top 500 in each category selected. Scores, year and type of publication were recorded. Correlation was expressed as the Spearman's rank coefficient (ϱ).

RESULTS

We identified 18,790 outputs. Within the top 500 publications ranked by CS, there was a significant weak positive correlation (ϱ = 0.235, P < 0.0001) between CS [median (IQR) 149 (116-223)] and AAS [7 (3-22)]. Ranked by AAS, there was a non-significant very weak positive correlation (ϱ = 0.072, P = 0.106) between AAS [55.5 (36-115)] and CS [42 (16.5-94.5)]. Trends remained similar when grouped by publication type. Guidelines, ranked by CS, had the highest CS and ranked by AAS, the highest CS and AAS. Publications per year, by year, ranked by CS, had a negatively skewed distribution peaking in 2012 and declined thereafter, but when ranked by AAS, had a moderately positive linear trend from 2001 to 2024 (ϱ = 0.513, P < 0.0001).

CONCLUSION

Correlation between CS and AAS was weak. Guidelines had the highest CS and AAS. CS are iterative taking years to mature while AAS are immediate.

Journal Metrics of Orthopaedic Journals between 2016 and 2021: Trends and Comparisons with Other Specialties

Bibliometric analysis plays a crucial role in elucidating publication trends and aids scholars in gauging the reach of prospective journals for their research dissemination. Concerns with impact factor (IF) have led us to examine the trends in IF, corrected IF (cIF), and Citescore in orthopaedic journals from 2016 to 2021 and compare them with internal medicine and general surgery journals. Journal IF and cIF were obtained from Journal Citation Reports and Citescore data from the Elsevier Scopus database for the years 2016 to 2021. Orthopaedic journals were categorized, and 10 medicine and surgery journals were selected for comparison. Mean values were analyzed to identify trends. The study included 52 orthopaedic journals, evenly split between the United States and the rest of the world, predominantly publishing in English. Mean IF in orthopaedic journals increased from 1.93 (2016) to 2.78 (2021), with similar rises in cIF and Citescore. These trends were consistent in specialty and general orthopaedic journals. No significant differences were found in mean IF between these categories. Medicine and surgery journals also experienced significant IF increases. Orthopaedic journals have experienced growing esteem and extent from 2016 to 2021. Specialty and general orthopaedic journals showed parallel growth. Researchers can utilize this analysis for informed publishing decisions, potentially expanding their readership.

The 100 Most Impactful Articles on Total Shoulder Arthroplasty: An Altmetric Analysis

Background

To use the top 100 articles pertaining to total shoulder arthroplasty (TSA) to understand the impact that social media platforms have on the dissemination of shoulder research while highlighting bibliometric factors associated with Altmetric Attention Score (AAS) to offer insight into the impact that social media platforms have on the dissemination, attention, and citation of shoulder research publications.

Methods

In June 2023, the Altmetric database was searched using the following PubMed MeSH terms: "total shoulder arthroplasty" or "TSA." Articles with the highest AAS were screened to exclude other topics unrelated to TSA. The top 100 articles that met inclusion criteria were used in the final analysis. Bibliometric factors pertaining to each study were collected for further analysis of article characteristics in accordance with prior studies.

Results

The Altmetric Database query yielded 1,283 studies. After applying our inclusion criteria, the top 118 articles with the highest AAS were identified. The mean AAS was 29.14 ± 42.35, with a range of 13 to 402. The included articles represented 27 journals, with 70 articles attributed to 2 journals: Journal of Shoulder and Elbow Surgery (JSES; 43%) and the Journal of Bone and Joint Surgery (JBJS; 16%). There was a significant increase in AAS for the presence of a conflict of interest (p = 0.042) and open access status (p < 0.01), but no association between the score and citation rate (p > 0.05).

Conclusions

Top articles on TSA, as defined by high AAS, mostly comprise original clinical research performed in the United States or Europe. The presence of a conflict of interest and open access status is associated with an increase in AAS, but there was no association between AAS score and citation rate.

The Most Impactful Articles on the Shoulder Labrum From the United States or Europe, and Decreased Level of Evidence Is Associated With Increased Altmetric Attention Score

Purpose

To use the top 100 articles pertaining to the shoulder labrum to understand the impact that social medial platforms have on the dissemination of shoulder research and to highlight bibliometric factors associated with Altmetric Attention Scores (AAS) to offer insight into the impact that social media platforms have on the dissemination, attention, and citation of shoulder research publications.

Methods

This was a cross-sectional study. In January 2023, the Altmetric database was searched using the PubMed Medical Subject Headings terms "shoulder labrum." Articles with the greatest AAS were screened to exclude other topics unrelated to the labrum of the shoulder. The top 100 articles that met inclusion criteria were used in the final analysis. Bibliometric factors pertaining to each study were collected for further analysis of article characteristics in accordance with previous studies.

Results

The Altmetric Database query yielded 619 studies. The top 100 articles with highest AAS were identified, mean Attestation Score was 24.85 ± 55.51, with a range of 7 to 460. The included articles represented 35 journals, with 57 articles attributed to 3 journals: American Journal of Sports Medicine (AJSM; 29%), Arthroscopy: The Journal of Arthroscopic & Related Surgery (Arthroscopy; 19%), and the Journal of Shoulder and Elbow Surgery (JSES; 9%). There was a significant increase in AAS for every decrease in the numerical Level of Evidence value for a study (P = .011) but no association between score and citation rate (P > 005).

Conclusions

Top articles on the shoulder labrum, as defined by high AAS score, are most commonly original clinical research published in 1 of 3 sports medicine journals and performed in the United States or Europe. A decreased numerical Level of Evidence is associated with an increase in AAS score, but there is no association between AAS score and citation rate.

Clinical Relevance

The increasing amount of science and health information shared freely through open-access journals, online servers, and numerous social media channels makes it difficult to measure the impact of research. Using measures such as the Altmetric Attention Score, in isolation or addition to measures of researcher or journal impact, has the potential to provide comprehensive information about the impact of research in the modern world.