'Altmetrics'! Can you afford to ignore it?

A perspective on new dilemmas in scientific publishing in the time of a pandemic

BACKGROUND

The COVID-19 pandemic exerted manifold pressures on the public health framework globally, but it also in a way unified different genres and allowed for strategizing and implementing regulatory decisions as best as possible, especially in India. There is an unmet need for such a unified and integrative approach in the area of scientific publishing which has also been touched by various dilemmas, either emergent or propagated during this pandemic.

OBJECTIVES

This article intends to re-visit some of the dilemmas in scientific publishing, which have taken centre stage owing to a healthcare emergency, with the objective of highlighting an unmet need for developing unified criteria for research conduction and publishing from a futuristic view point, as one is not without the other.

CONTENT

While a fast track delivery of research data has been a priority for research journals, the due pressures in the process management of the same while skimming the ethical boundaries of responsible mediation through a Journal platform has remained a challenge globally for various reasons. Furthermore, the inevitability of a healthcare emergency inadvertently led to some cumulative off-target effects including accumulation of research waste, diminishing validity of academic metrics, short data set publications, hasty zombie clinical trials publishing merely an overview of the actual data, etc, which are major issues not only for journal Editors or the research community as a whole, but also for regulatory authorities and policy makers. As a step towards future pandemic preparedness, strategizing and streamlining research and publication processes ensuing responsible reporting should be treated as a topic of paramount significance. Hence, through debating on these dilemmas as well as potential integrative approaches, unified guiding criteria in the area of scientific publishing may be developed in lieu of preparedness for such future pandemic scenarios.

Over-optimization of academic publishing metrics: observing Goodhart's Law in action

BACKGROUND

The academic publishing world is changing significantly, with ever-growing numbers of publications each year and shifting publishing patterns. However, the metrics used to measure academic success, such as the number of publications, citation number, and impact factor, have not changed for decades. Moreover, recent studies indicate that these metrics have become targets and follow Goodhart's Law, according to which, "when a measure becomes a target, it ceases to be a good measure."

RESULTS

In this study, we analyzed >120 million papers to examine how the academic publishing world has evolved over the last century, with a deeper look into the specific field of biology. Our study shows that the validity of citation-based measures is being compromised and their usefulness is lessening. In particular, the number of publications has ceased to be a good metric as a result of longer author lists, shorter papers, and surging publication numbers. Citation-based metrics, such citation number and h-index, are likewise affected by the flood of papers, self-citations, and lengthy reference lists. Measures such as a journal's impact factor have also ceased to be good metrics due to the soaring numbers of papers that are published in top journals, particularly from the same pool of authors. Moreover, by analyzing properties of >2,600 research fields, we observed that citation-based metrics are not beneficial for comparing researchers in different fields, or even in the same department.

CONCLUSIONS

Academic publishing has changed considerably; now we need to reconsider how we measure success.