The editor-manuscript game

Identifying the characteristics of excellent peer reviewers by using Publons

Purpose

This study aimed to identify the characteristics of excellent peer reviewers by using Publons.com (an open and free online peer review website).

Design/methodology/approach

Reviewers of the clinical medicine field on Publons were selected as the sample (n = 1,864). A logistic regression model was employed to examine the data.

Findings

The results revealed that reviewers' verified reviews, verified editor records, and whether they were the Publons mentors had significant and positive associations with excellent peer reviewers, while their research performance (including the number of articles indexed by Web of Science (WOS), citations, H-index and high-cited researcher), genders, words per review, number of current/past editorial boards, whether they had experiences of post-publication review on Publons and whether they were Publons academy graduates had no significant associations with excellent peer reviewers.

Originality/value

This study could help journals find excellent peer reviewers from free and open online platforms.

Peer review

The peer review history for this article is available at: https://publons.com/publon/10.1108/OIR-11-2021-0604.

Shared burden is always lighter - Peer-review performance in an ophthalmological journal 2010-2020

PURPOSE

There are concerns in the academic publishing community that it is becoming more difficult to secure reviews for scientific manuscripts. This study examines trends in editorial and peer review processes in an ophthalmological journal over the last decade.

METHODS

A retrospective analysis was performed of editorial data from the journal Acta Ophthalmologica containing all manuscript submissions between 2010 and 2020.

RESULTS

The number of yearly submissions grew between 2010 and 2019 from 1014 to 1623, and in 2020, the number of submissions increased to 2449. In total, the number of submissions increased by 142% between 2010 and 2020. Similarly, the proportion of desk-rejected manuscripts increased from 48% to 67% during the period 2010-2020. The number of invitations needed to obtain one review showed an increase from 1.9 to 2.6 between 2010 and 2019, but remained stable between 2019 and 2020. However, the number of reviewers per reviewed manuscript, reviewed manuscripts per reviewer and time from invitation to completed review assignment remained almost constant between 2010 and 2020. Researchers based in North American were disproportionally often invited to review (18%) compared to their share of published articles (7%), and they also declined review invitation more frequently compared to scholars in other parts of the world.

CONCLUSIONS

The study revealed an increase in submitted manuscripts to an ophthalmological journal over the last decade, with a further increase during the COVID-19 pandemic. The number of reviewer invitations needed to obtain one review grew during the study period but remained constant between 2019 and 2020, despite a vast increase in submitted manuscripts. Hence, the burden for unique reviewers did not increase. Instead, the proportion of desk-rejected manuscripts grew, and the reviewer pool expanded, which allowed the annual average number of reviews by individual reviewers to remain stable.