From Research Evaluation to Research Analytics. The digitization of academic performance measurement

One could think that bibliometric measurement of academic performance has always been digital since the computer-assisted invention of the Science Citation Index. Yet, since the 2000s, the digitization of bibliometric infrastructure has accelerated at a rapid pace. Citation databases are indexing an increasing variety of publication types. Altmetric data aggregators are producing data on the reception of research outcomes. Machine-readable persistent identifiers are created to unambiguously identify researchers, research organizations, and research objects; and evaluative software tools and current research information systems are constantly enlarging their functionalities to make use of these data and extract meaning from them. In this article, we analyse how these developments in evaluative bibliometrics have contributed to an extension of indicator-based research evaluation towards data-driven research analytics. Drawing on empirical material from blogs and websites as well as from research and policy papers, we discuss how interoperability, scalability, and flexibility as material specificities of digital infrastructures generate new ways of data production and their assessment, which affect the possibilities of how academic performance can be understood and (e)valuated.

Bibliometrics analysis on the research status and trends of adult-onset Still’s disease: 1921-2021

Objectives

The aim of this research is to discuss the research status, hotspots, frontiers and development trends in the field of adult-onset Still’s disease (AOSD) based on bibliometrics and visual analysis by CiteSpace software.

Methods

The relevant research articles on AOSD from 1921 to 2021 were retrieved from the Scopus database. CiteSpace software was used to form a visual knowledge map and conduct analysis for the countries/regions, journals, authors, keywords, clusters, research hotspots and frontiers of the included articles.

Results

There were 2,373 articles included, and the number of articles published during 1921-2021 is increasing. The country with the highest number of articles published was Japan (355, 14.96%), followed by the United States (329, 13.86%) and France (215, 9.06%). The author with the highest number of publications is Ansell, Barbara M. (30, 1.26%), and the author with the highest co-citation frequency is Yamaguchi, Masaya (703). Clinical Rheumatology is the journal with the highest publication frequency. The top five cluster groups were “joint”, “differential diagnosis”, “prednisolone”, “methotrexate” and “macrophage activation syndrome”. The diagnosis, treatment and pathogenesis of AOSD form the main research fields, and prognosis and complications are the research hotspots and trends.

Conclusions

The global research field in AOSD has expanded in the past 100 years. The complications and new pathogenesis of AOSD are hotspots in this field and need further study in the future.

How can citation impact in bibliometrics be normalized? A new approach combining citing-side normalization and citation percentiles

Since the 1980s, many different methods have been proposed to field-normalize citations. In this study, an approach is introduced that combines two previously introduced methods: citing-side normalization and citation percentiles. The advantage of combining two methods is that their advantages can be integrated in one solution. Based on citing-side normalization, each citation is field weighted and, therefore, contextualized in its field. The most important advantage of citing-side normalization is that it is not necessary to work with a specific field categorization scheme for the normalization procedure. The disadvantages of citing-side normalization—the calculation is complex and the numbers are elusive—can be compensated for by calculating percentiles based on weighted citations that result from citing-side normalization. On the one hand, percentiles are easy to understand: They are the percentage of papers published in the same year with a lower citation impact. On the other hand, weighted citation distributions are skewed distributions with outliers. Percentiles are well suited to assigning the position of a focal paper in such distributions of comparable papers. The new approach of calculating percentiles based on weighted citations is demonstrated in this study on the basis of a citation impact comparison between several countries.