Preprints: What is their role in medical journals?

Making science public: a review of journalists' use of Open Access research

Science journalists are uniquely positioned to increase the societal impact of open research outputs by contextualizing and communicating findings in ways that highlight their relevance and implications for non-specialist audiences. Yet, it is unclear to what degree journalists use open research outputs, such as open access publications or preprints, in their reporting; what factors motivate or constrain this use; and how the recent surge in openly available research seen during the COVID-19 pandemic has affected this. This article examines these questions through a review of relevant literature published from 2018 onwards-particularly literature relating to the COVID-19 pandemic-as well as seminal articles outside the search dates. We find that research that explicitly examines journalists' engagement with open access publications or preprints is scarce, with existing literature mostly addressing the topic tangentially or as a secondary concern, rather than a primary focus. Still, the limited body of evidence points to several factors that may hamper journalists' use of these outputs and thus warrant further exploration. These include an overreliance on traditional criteria for evaluating scientific quality; concerns about the trustworthiness of open research outputs; and challenges using and verifying the findings. We also find that, while the COVID-19 pandemic encouraged journalists to explore open research outputs such as preprints, the extent to which these explorations will become established journalistic practices remains unclear. Furthermore, we note that current research is overwhelmingly authored and focused on the Global North, and the United States specifically. We conclude with recommendations for future research that attend to issues of equity and diversity, and more explicitly examine the intersections of open access and science journalism.

The experiences of COVID-19 preprint authors: a survey of researchers about publishing and receiving feedback on their work during the pandemic

The COVID-19 pandemic caused a rise in preprinting, triggered by the need for open and rapid dissemination of research outputs. We surveyed authors of COVID-19 preprints to learn about their experiences with preprinting their work and also with publishing their work in a peer-reviewed journal. Our research had the following objectives: 1. to learn about authors' experiences with preprinting, their motivations, and future intentions; 2. to consider preprints in terms of their effectiveness in enabling authors to receive feedback on their work; 3. to compare the impact of feedback on preprints with the impact of comments of editors and reviewers on papers submitted to journals. In our survey, 78% of the new adopters of preprinting reported the intention to also preprint their future work. The boost in preprinting may therefore have a structural effect that will last after the pandemic, although future developments will also depend on other factors, including the broader growth in the adoption of open science practices. A total of 53% of the respondents reported that they had received feedback on their preprints. However, more than half of the feedback was received through "closed" channels-privately to the authors. This means that preprinting was a useful way to receive feedback on research, but the value of feedback could be increased further by facilitating and promoting "open" channels for preprint feedback. Almost a quarter of the feedback received by respondents consisted of detailed comments, showing the potential of preprint feedback to provide valuable comments on research. Respondents also reported that, compared to preprint feedback, journal peer review was more likely to lead to major changes to their work, suggesting that journal peer review provides significant added value compared to feedback received on preprints.

Preprints in Health Professions Education: Raising Awareness and Shifting Culture

A preprint is a version of a research manuscript posted by its authors to a preprint server before peer review. Preprints are associated with a variety of benefits, including the ability to rapidly communicate research, the opportunity for researchers to receive feedback and raise awareness of their research, and broad and unrestricted access. For early-career researchers, preprints also provide a mechanism for demonstrating research progress and productivity without the lengthy timelines of traditional journal publishing. Despite these benefits, few health professions education (HPE) research articles are deposited as preprints, suggesting that preprinting is not currently integrated into HPE culture. In this article, the authors describe preprints, their benefits and related risks, and the potential barriers that hamper their widespread use within HPE. In particular, the authors propose the barriers of discordant messaging and the lack of formal and informal education on how to deposit, critically appraise, and use preprints. To mitigate these barriers, several recommendations are proposed to facilitate preprints in becoming an accepted and encouraged component of HPE culture, allowing the field to take full advantage of this evolving form of research dissemination.

PreprintMatch: A tool for preprint to publication detection shows global inequities in scientific publication

Preprints, versions of scientific manuscripts that precede peer review, are growing in popularity. They offer an opportunity to democratize and accelerate research, as they have no publication costs or a lengthy peer review process. Preprints are often later published in peer-reviewed venues, but these publications and the original preprints are frequently not linked in any way. To this end, we developed a tool, PreprintMatch, to find matches between preprints and their corresponding published papers, if they exist. This tool outperforms existing techniques to match preprints and papers, both on matching performance and speed. PreprintMatch was applied to search for matches between preprints (from bioRxiv and medRxiv), and PubMed. The preliminary nature of preprints offers a unique perspective into scientific projects at a relatively early stage, and with better matching between preprint and paper, we explored questions related to research inequity. We found that preprints from low income countries are published as peer-reviewed papers at a lower rate than high income countries (39.6% and 61.1%, respectively), and our data is consistent with previous work that cite a lack of resources, lack of stability, and policy choices to explain this discrepancy. Preprints from low income countries were also found to be published quicker (178 vs 203 days) and with less title, abstract, and author similarity to the published version compared to high income countries. Low income countries add more authors from the preprint to the published version than high income countries (0.42 authors vs 0.32, respectively), a practice that is significantly more frequent in China compared to similar countries. Finally, we find that some publishers publish work with authors from lower income countries more frequently than others.

Pharmaceutical industry-authored preprints: scientific and social media impact

AIM

Non-peer-reviewed manuscripts posted as preprints can be cited in peer-reviewed articles, which has both merits and demerits. International Committee of Medical Journal Editors guidelines mandate authors to declare preprints at the time of manuscript submission. We evaluated the trends in pharma-authored research published as preprints and their scientific and social media impact by analyzing citation rates and altmetrics.

RESEARCH DESIGN AND METHODS

We searched EuroPMC, PrePubMed bioRxiv and medRxiv for preprints submitted by authors affiliated with the top 50 pharmaceutical companies from inception until 15 June 2020. Data were extracted and analyzed from the search results. The number of citations for the preprint and peer-reviewed versions (if available) were compiled using the Publish or Perish software (version 1.7). Altmetric score was calculated using the "Altmetric it" online tool. Statistical significance was analyzed by Wilcoxon rank-sum test.

RESULTS

A total of 498 preprints were identified across bioRxiv (83%), PeerJ (5%), F1000Research (6%), Nature Precedings (3%), Preprint.org (3%), Wellcome Open Research preprint (0.2%) and medRxiv (0.2%) servers. Roche, Sanofi and Novartis contributed 56% of the retrieved preprints. The median number of citations for the included preprints was 0 (IQR = 1, Min-Max = 0-45). The median number of citations for the published preprints and unpublished preprints was 0 for both (IQR = 1, Min-Max = 0-25 and IQR = 1, Min-Max = 0-45, respectively; p = .091). The median Altmetric score of the preprints was 4 (IQR = 10.5, Min-Max = 0-160).

CONCLUSION

Pharma-authored research is being increasingly published as preprints and is also being cited in other peer-reviewed publications and discussed in social media.