1
|
Antonoyiannakis M. Impact factor volatility due to a single paper: A comprehensive analysis. QUANTITATIVE SCIENCE STUDIES 2020. [DOI: 10.1162/qss_a_00037] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
Abstract
We study how a single paper affects the impact factor (IF) of a journal by analyzing data from 3,088,511 papers published in 11639 journals in the 2017 Journal Citation Reports of Clarivate Analytics. We find that IFs are highly volatile. For example, the top-cited paper of 381 journals caused their IF to increase by more than 0.5 points, while for 818 journals the relative increase exceeded 25%. One in 10 journals had their IF boosted by more than 50% by their top three cited papers. Because the single-paper effect on the IF is inversely proportional to journal size, small journals are rewarded much more strongly than large journals for a highly cited paper, while they are penalized more for a low-cited paper, especially if their IF is high. This skewed reward mechanism incentivizes high-IF journals to stay small to remain competitive in rankings. We discuss the implications for breakthrough papers appearing in prestigious journals. We question the reliability of IF rankings given the high IF sensitivity to a few papers that affects thousands of journals.
Collapse
Affiliation(s)
- Manolis Antonoyiannakis
- Department of Applied Physics & Applied Mathematics, Columbia University, 500 W. 120th St., Mudd 200, New York, NY 10027
- American Physical Society, Editorial Office, 1 Research Road, Ridge, NY 11961-2701
| |
Collapse
|
2
|
Scherngell T, Roche I, Horlesberger M, Besagni D, Zuger ME, Holste D. Initial comparative analysis of model and peer review process for ERC starting grant proposals. RESEARCH EVALUATION 2013. [DOI: 10.1093/reseval/rvt015] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
|
3
|
|