Association Between Immediacy of Citations and Altmetrics in COVID-19 Research by Artificial Neural Networks

Impact of COVID-19 Pandemic on Biomedical Publications and Their Citation Frequency

BACKGROUND

The coronavirus disease 2019 (COVID-19) pandemic has resulted in enormous related publications. However, the citation frequency of these documents and their influence on the journal impact factor (JIF) are not well examined. We aimed to evaluate the impact of COVID-19 on biomedical research publications and their citation frequency.

METHODS

We searched publications on biomedical research in the Web of Science using the search terms "COVID-19," "SARS-Cov-2," "2019 corona*," "corona virus disease 2019," "coronavirus disease 2019," "novel coronavirus infection" and "2019-ncov." The top 200 journals were defined as those with a higher number of COVID-19 publications than other journals in 2020. The COVID-19 impact ratio was calculated as the ratio of the average number of citations per item in 2021 to the JIF for 2020.

RESULTS

The average number of citations for the top 200 journals in 2021, per item published in 2020, was 25.7 (range, 0-270). The average COVID-19 impact ratio was 3.84 (range, 0.26-16.58) for 197 journals that recorded the JIF for 2020. The average JIF ratio for the top 197 journals including the JIFs for 2020 and 2021 was 1.77 (range, 0.68-8.89). The COVID-19 impact ratio significantly correlated with the JIF ratio (r = 0.403, P = 0.010). Twenty-five Korean journals with a COVID-19 impact ratio > 1.5 demonstrated a higher JIF ratio (1.31 ± 0.39 vs. 1.01 ± 0.18, P < 0.001) than 33 Korean journals with a lower COVID-19 impact ratio.

CONCLUSION

COVID-19 pandemic infection has significantly impacted the trends in biomedical research and the citation of related publications.

Deep Impact: A Study on the Impact of Data Papers and Datasets in the Humanities and Social Sciences

The humanities and social sciences (HSS) have recently witnessed an exponential growth in data-driven research. In response, attention has been afforded to datasets and accompanying data papers as outputs of the research and dissemination ecosystem. In 2015, two data journals dedicated to HSS disciplines appeared in this landscape: Journal of Open Humanities Data (JOHD) and Research Data Journal for the Humanities and Social Sciences (RDJ). In this paper, we analyse the state of the art in the landscape of data journals in HSS using JOHD and RDJ as exemplars by measuring performance and the deep impact of data-driven projects, including metrics (citation count; Altmetrics, views, downloads, tweets) of data papers in relation to associated research papers and the reuse of associated datasets. Our findings indicate: that data papers are published following the deposit of datasets in a repository and usually following research articles; that data papers have a positive impact on both the metrics of research papers associated with them and on data reuse; and that Twitter hashtags targeted at specific research campaigns can lead to increases in data papers’ views and downloads. HSS data papers improve the visibility of datasets they describe, support accompanying research articles, and add to transparency and the open research agenda.

Predicting Citation Impact from Altmetric Attention in Clinical and Translational Research: Do Big Splashes Lead to Ripple Effects?

Publications are commonly used to evaluate the productivity and impact of research programs. Traditional metrics examine publication impact through slowly accumulating academic citations. “Altmetrics” are a new way to describe early publication influence in nonacademic media/community spheres (news, tweets, and blogs). Articles with significant altmetric attention make a big splash of immediate impact, whereas papers with high rates of academic citation reflect ripple effects of influence over time. Past research has found weak associations between altmetrics and academic citations. However, no previous research has focused on clinical/translational research, which aims to translate scientific discoveries to public use. Further, no previous research has assessed the relationship between altmetrics and modern citation impact factors like the National Institutes of Health (NIH)’s Relative Citation Ratio (RCR). It is also unclear whether publication in journals with higher journal impact factors (JIFs) may drive both public attention and academic impact. We investigated whether early altmetric indicators of splash predict citation ripples, beyond the effect of the JIF. For a portfolio of 2188 publications supported by the NIH’s Georgia Clinical and Translational Science Alliance from 2007–2020, we collected 2020 Altmetric Attention Scores (AAS), 2020 JIFs, and 2021 RCRs. All three were significantly correlated with one another. Regression analyses revealed that AAS significantly predicts later RCR, controlling for JIF and publication year. Findings indicate that in clinical/translational science, articles that make a big splash of altmetric attention have ripple effects through increased citation influence, which is not entirely due to publication in higher impact journals. Altmetric attention may be a useful early indicator of eventual influence and potential for translational advancement.