1
|
Cole NL, Kormann E, Klebel T, Apartis S, Ross-Hellauer T. The societal impact of Open Science: a scoping review. ROYAL SOCIETY OPEN SCIENCE 2024; 11:240286. [PMID: 39100167 PMCID: PMC11296153 DOI: 10.1098/rsos.240286] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/19/2024] [Accepted: 05/20/2024] [Indexed: 08/06/2024]
Abstract
Open Science (OS) aims, in part, to drive greater societal impact of academic research. Government, funder and institutional policies state that it should further democratize research and increase learning and awareness, evidence-based policy-making, the relevance of research to society's problems, and public trust in research. Yet, measuring the societal impact of OS has proven challenging and synthesized evidence of it is lacking. This study fills this gap by systematically scoping the existing evidence of societal impact driven by OS and its various aspects, including Citizen Science (CS), Open Access (OA), Open/FAIR Data (OFD), Open Code/Software and others. Using the PRISMA Extension for Scoping Reviews and searches conducted in Web of Science, Scopus and relevant grey literature, we identified 196 studies that contain evidence of societal impact. The majority concern CS, with some focused on OA, and only a few addressing other aspects. Key areas of impact found are education and awareness, climate and environment, and social engagement. We found no literature documenting evidence of the societal impact of OFD and limited evidence of societal impact in terms of policy, health, and trust in academic research. Our findings demonstrate a critical need for additional evidence and suggest practical and policy implications.
Collapse
Affiliation(s)
- Nicki Lisa Cole
- Open and Reproducible Research Group, Sandgasse 36, 8010 Graz, Austria
| | - Eva Kormann
- Open and Reproducible Research Group, Sandgasse 36, 8010 Graz, Austria
| | - Thomas Klebel
- Open and Reproducible Research Group, Sandgasse 36, 8010 Graz, Austria
| | - Simon Apartis
- Open and Reproducible Research Group, Sandgasse 36, 8010 Graz, Austria
| | | |
Collapse
|
2
|
Delli K, Livas C, Nikitakis NG, Vissink A. Impact of COVID-19 Dentistry-Related Literature: An Altmetric Study. Int Dent J 2023; 73:770-776. [PMID: 36641342 PMCID: PMC9673089 DOI: 10.1016/j.identj.2022.11.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Revised: 11/09/2022] [Accepted: 11/09/2022] [Indexed: 11/18/2022] Open
Abstract
INTRODUCTION Scientific literature on COVID-19 has grown rapidly during the pandemic. The aim of this study was to provide a comprehensive overview of the popularity on the web of the available dental publications on COVID-19 and to examine associations amongst article characteristics, online mentions, and citations. MATERIALS AND METHODS An Altmetric Explorer search was conducted for COVID-19 articles published in dental journals using 3 keywords: COVID-19, SARS-CoV-2, and pandemic. The following Altmetric data were collected: Altmetric attention score (AAS), mentions by news outlets, tweets, Mendeley readers, and Web of Science citations. Additionally, article title, type, topic, origin and open access status, journal title, quartile of impact factor (IF) distribution, and time lapse between COVID-19 pandemic onset and publication date were analysed. RESULTS In all, 253 articles published in 48 dental journals were eligible for the study. AAS was significantly influenced by article topic, type, origin, and journal IF quartile. There was a negligible correlation between AAS and Web of Science citations. Mendeley was the only Altmetric source highly correlated with citations. CONCLUSIONS There was substantial online interest in COVID-19 dentistry-related literature, as depicted by the AAS of the reviewed articles and social media metrics. Mendeley reader counts were highly correlated with citations, and they may therefore be valuable in research impact evaluation.
Collapse
Affiliation(s)
- Konstantina Delli
- Department of Oral and Maxillofacial Surgery, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands.
| | - Christos Livas
- Division of Orthodontics, Dental Clinics Zwolle, Zwolle, The Netherlands
| | - Nikolaos G Nikitakis
- Department of Oral Medicine & Pathology and Hospital Dentistry, School of Dentistry, National and Kapodistrian University of Athens, Greece
| | - Arjan Vissink
- Department of Oral and Maxillofacial Surgery, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| |
Collapse
|
3
|
Rawashdeh B, Alryalat SA, Kim J, Eriksen C, Abu Assi M, Prasad R, Cooper M. The Leading Transplantation Journals: A Trend Analysis, 2011-2021. J Transplant 2023; 2023:8858320. [PMID: 37795130 PMCID: PMC10547570 DOI: 10.1155/2023/8858320] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Revised: 08/21/2023] [Accepted: 09/05/2023] [Indexed: 10/06/2023] Open
Abstract
Background As the field of transplantation has expanded, so have the quantity and variety of articles published on the topic. Evaluation of publications and journals is crucial to the expansion of transplant research. This study investigated the research output and journal metrics of the leading solid organ transplant journals published between 2011 and 2021 based on estimations of the trends in the category CiteScore from the Scopus database. Materials and Methods We obtained data on the listed journals from the Scopus Source List. We then filtered the list for "Transplantation" journals. Only the top quartiles or quartile 1 (Q1) journals were placed in this category. This study focused specifically on transplantation journals and did not include other journals related to diseases of transplanted organs such as the kidney, liver, heart, and lungs. Results The number of transplantation journals increased by 42.8% in the last ten years, from 28 in 2011 to 40 in 2021. Between 2011 and 2021, nine transplantation journals ranked in the highest quartile (Q1). The American Journal of Transplantation was the top journal in both years, with a 150% increase in citations and an 11.2% increase in articles published. Open access (OA) transplant journals rose from 3 in 2011 to 10 in 2021. In 2021, OA journals earned 8,555 citations, a 125% increase from 2011. Despite this increase, non-OA journals received more citations than OA in 2021 (p value 0.026). Conclusion Solid organ transplantation advances lead to more publications and citations. Regular journals and publications evaluation benefits academics and policymakers by promoting the growth of research. This study examined solid organ transplantation journals and gave a global perspective on transplant journal rankings and compared their status in 2011 and 2021.
Collapse
Affiliation(s)
- Badi Rawashdeh
- Division of Transplant Surgery, Medical College of Wisconsin, Milwaukee, WI, USA
| | | | - Joohyun Kim
- Division of Transplant Surgery, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Calvin Eriksen
- Division of Transplant Surgery, Medical College of Wisconsin, Milwaukee, WI, USA
| | | | - Raj Prasad
- Division of Transplant Surgery, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Matthew Cooper
- Division of Transplant Surgery, Medical College of Wisconsin, Milwaukee, WI, USA
| |
Collapse
|
4
|
Guo F, Zhao T, Zhai Q, Fang X, Yue H, Hua F, He H. 'Spin' among abstracts of randomised controlled trials in sleep medicine: A research-on-research study. Sleep 2023; 46:zsad041. [PMID: 36861330 DOI: 10.1093/sleep/zsad041] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Indexed: 03/03/2023] Open
Abstract
STUDY OBJECTIVES 'Spin', using reporting strategies to distort study results, can mislead readers of medical research. This study aimed to evaluate the prevalence and characteristics of 'spin' among randomised controlled trial (RCT) abstracts published in sleep medicine journals, and to identify factors associated with its presence and severity. METHODS The search for RCTs published between 2010 and 2020 were conducted in seven reputable journals of sleep medicine. Abstracts of RCTs with statistically nonsignificant primary outcomes were included and analysed for 'spin', according to pre-determined 'spin' strategies. Chi-square tests or logistic regression analyses were performed to detect the association between characteristics of included abstracts and the presence and severity of 'spin'. RESULTS A total of 114 RCT abstracts were included in this study, of which 89 (78.1%) were identified as having at least one type of 'spin' strategy. Sixty-six abstracts (57.9%) had 'spin' in the Results section, 82 (71.9%) abstracts presented with 'spin' in the Conclusions section. The presence of 'spin' varied significantly among RCTs based on the different categories of research area (P=0.047) and the statistician involvement (P=0.045). Furthermore, research area (P=0.019) and funding status (P=0.033) were significant factors associated with the severity of 'spin'. CONCLUSIONS The prevalence of 'spin' is high among RCT abstracts in sleep medicine. This raise the need for researchers, editors and other stakeholders to be aware of the issue of 'spin' and make joint efforts to eliminate it in future publications.
Collapse
Affiliation(s)
- Feiyang Guo
- Hubei-MOST KLOS and KLOBM, School and Hospital of Stomatology, Wuhan University, Wuhan, China
- Department of Orthodontics, School and Hospital of Stomatology, Wuhan University, Wuhan, China
| | - Tingting Zhao
- Hubei-MOST KLOS and KLOBM, School and Hospital of Stomatology, Wuhan University, Wuhan, China
- Department of Orthodontics, School and Hospital of Stomatology, Wuhan University, Wuhan, China
- Center for Dentofacial Development and Sleep Medicine, School and Hospital of Stomatology, Wuhan University, Wuhan, China
| | - Qianglan Zhai
- Hubei-MOST KLOS and KLOBM, School and Hospital of Stomatology, Wuhan University, Wuhan, China
| | - Xiaolin Fang
- Hubei-MOST KLOS and KLOBM, School and Hospital of Stomatology, Wuhan University, Wuhan, China
| | - Haoze Yue
- Department of Epidemiology and Public Health, University College London, London, UK
| | - Fang Hua
- Center for Dentofacial Development and Sleep Medicine, School and Hospital of Stomatology, Wuhan University, Wuhan, China
- Center for Evidence-Based Stomatology, School and Hospital of Stomatology, Wuhan University, Wuhan, China
- Center for Orthodontics and Pediatric Dentistry, Optics Valley Branch, School and Hospital of Stomatology, Wuhan University, Wuhan, China
- Division of Dentistry, School of Medical Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester, UK
| | - Hong He
- Hubei-MOST KLOS and KLOBM, School and Hospital of Stomatology, Wuhan University, Wuhan, China
- Department of Orthodontics, School and Hospital of Stomatology, Wuhan University, Wuhan, China
- Center for Dentofacial Development and Sleep Medicine, School and Hospital of Stomatology, Wuhan University, Wuhan, China
| |
Collapse
|
5
|
Raittio E, Sofi-Mahmudi A, Uribe SE. Research transparency in dental research: A programmatic analysis. Eur J Oral Sci 2023; 131:e12908. [PMID: 36482006 PMCID: PMC10108147 DOI: 10.1111/eos.12908] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Accepted: 11/14/2022] [Indexed: 12/13/2022]
Abstract
We assessed adherence to five transparency practices-data sharing, code sharing, conflict of interest disclosure, funding disclosure, and protocol registration-in articles in dental journals. We searched and exported the full text of all research articles from PubMed-indexed dental journals available in the Europe PubMed Central database until the end of 2021. We programmatically assessed their adherence to the five transparency practices using a validated and automated tool. Journal- and article-related information was retrieved from ScimagoJR and Journal Citation Reports. Of all 329,784 articles published in PubMed-indexed dental journals, 10,659 (3.2%) were available to download. Of those, 77% included a conflict of interest disclosure, and 62% included a funding disclosure. Seven percent of the articles had a registered protocol. Data sharing (2.0%) and code sharing (0.1%) were rarer. Sixteen percent of articles did not adhere to any of the five transparency practices, 29% adhered to one, 48% adhered to two, 7.0% adhered to three, 0.3% adhered to four, and no article adhered to all five practices. Adherence to transparency practices increased over time; however, data and code sharing especially remained rare. Coordinated efforts involving all stakeholders are needed to change current transparency practices in dental research.
Collapse
Affiliation(s)
- Eero Raittio
- Institute of Dentistry, University of Eastern Finland, Kuopio, Finland.,Department of Dentistry and Oral Health, Aarhus University, Aarhus, Denmark
| | - Ahmad Sofi-Mahmudi
- Seqiz Health Network, Kurdistan University of Medical Sciences, Seqiz, Kurdistan, Iran.,Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Sergio E Uribe
- Department of Conservative Dentistry and Oral Health, Riga Stradins University, Riga, Latvia.,School of Dentistry, Universidad Austral de Chile, Valdivia, Chile.,Baltic Biomaterials Centre of Excellence, Headquarters at Riga Technical University, Riga, Latvia
| |
Collapse
|
6
|
Crossley JR, Almasri M, Samaha N, Deklotz TR, Harley EH, Davidson BJ, Malekzadeh S, Kim HJ. Citations and Author Characteristics in Open-Access and Subscription-Based Otolaryngology Journals. Laryngoscope 2023; 133:79-82. [PMID: 35560994 DOI: 10.1002/lary.30167] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2022] [Revised: 03/17/2022] [Accepted: 04/16/2022] [Indexed: 02/02/2023]
Abstract
OBJECTIVE To describe the academic impact and author characteristics of open-access journals in otolaryngology. METHODS Original articles from three open-access (OTO Open, Laryngoscope Investigative Otolaryngology, and World Journal of Otorhinolaryngology) and three conventional subscription-based otolaryngology specific journals (Otolaryngology - Head & Neck Surgery, The Laryngoscope, JAMA Otolaryngology - Head & Neck Surgery) were assessed. Publication dates of articles from January 2017 to July 2020 were included. Google Scholar and Web of Science citation counts were recorded. H-indexes of first and last authors were included according to Google Scholar and Web of Science and analyzed. RESULTS This analysis included 3284 articles. Articles published in open-access otolaryngology-specific journals had significantly fewer citations on average (6.8) than articles published in subscription-based journals (12.4, p < 0.0001). The last authors of articles published in subscription-based journals had significantly higher h-indexes (23.50) compared with the last authors of articles published in open-access journals (19.53, p < 0.0001). The first authors of articles published in open-access journals had similar h-indexes (10.26) as the first authors of articles published in subscription-based journals (10.33). CONCLUSIONS Articles published in open-access journals in otolaryngology were cited significantly less than those published in subscription-based journals. The h-index of the last authors was significantly lower in open-access journals; however, the h-index of the first authors was similar between open-access and subscription-based journals. As measured by citations, open-access publications do not yet appear to have the impact of subscription-based publications. LEVEL OF EVIDENCE NA Laryngoscope, 133:79-82, 2023.
Collapse
Affiliation(s)
- Jason R Crossley
- Department of Otolaryngology - Head and Neck Surgery, MedStar Georgetown University Hospital, Washington, District of Columbia, USA
| | - Mohamad Almasri
- Georgetown University School of Medicine, Washington, District of Columbia, USA
| | - Nadia Samaha
- Georgetown University School of Medicine, Washington, District of Columbia, USA
| | - Timothy R Deklotz
- Department of Otolaryngology - Head and Neck Surgery, MedStar Georgetown University Hospital, Washington, District of Columbia, USA
| | - Earl H Harley
- Department of Otolaryngology - Head and Neck Surgery, MedStar Georgetown University Hospital, Washington, District of Columbia, USA
| | - Bruce J Davidson
- Department of Otolaryngology - Head and Neck Surgery, MedStar Georgetown University Hospital, Washington, District of Columbia, USA
| | - Sonya Malekzadeh
- Department of Otolaryngology - Head and Neck Surgery, MedStar Georgetown University Hospital, Washington, District of Columbia, USA
| | - H Jeffrey Kim
- Department of Otolaryngology - Head and Neck Surgery, MedStar Georgetown University Hospital, Washington, District of Columbia, USA
| |
Collapse
|
7
|
Altmetric Analysis of the Most Mentioned Articles Online in the Contemporary Craniofacial Surgery Literature. J Craniofac Surg 2023; 34:227-230. [PMID: 36608100 DOI: 10.1097/scs.0000000000009108] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2022] [Accepted: 09/06/2022] [Indexed: 12/31/2022] Open
Abstract
As online media acquires increased utilization as a means of disseminating scientific research, Altmetric analyses are useful to identify socially impactful publications and their characteristics. Accordingly, the objective of this investigation was to determine the most mentioned articles online regarding craniofacial surgery and compare these articles with their most cited counterparts. Using the Web of Science database, 7097 craniofacial surgery publications were identified. Altmetric Attention Score (AAS) and average citations per year (ACpY) were extracted, and articles were ranked by their social and scientific impact. Descriptive, comparative, and correlational analyses were performed to examine characteristics including AAS, ACpY, country of origin, journal, open access (OA) status, publication year, study design, and topic. The average AAS of the 50 most mentioned articles was 83.68 (SD±107.40), and the average citation count of the 50 most cited articles was 76.38 (SD±35.15). OA status was significantly more prevalent among the most mentioned articles (24.0%) relative to all articles (10.72%) and the most cited articles (4.0%). The most mentioned and the most cited articles primarily originated from the United States (64.0% and 38.0%, respectively), discussed topics related to the medical and surgical management of patients (48.0% and 58.0%, respectively), and were systematic reviews (16.0% and 28.0%, respectively). However, there was significantly more geographic diversity in the latter cohort. In summary, this comparative examination reveals important differences between the most mentioned and most cited articles, highlighting the distinct utility of AAS and citation count when evaluating research impact.
Collapse
|
8
|
Sotudeh H, Saber Z, Ghanbari Aloni F, Mirzabeigi M, Khunjush F. A longitudinal study of the evolution of opinions about open access and its main features: a twitter sentiment analysis. Scientometrics 2022. [DOI: 10.1007/s11192-022-04502-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|