1
|
Gupta S, Kumar N, Bhalla S. Citation metrics and evaluation of journals and conferences. J Inf Sci 2023. [DOI: 10.1177/01655515231151411] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
Citation analysis aims at evaluating the published scientific manuscripts, their authors and the publication venues (journals/conferences). There are several popular metrics for measuring the impact of the journals, the Impact Factor (IF) being the most popular. Similarly, the [Formula: see text]-index is a popular metric for evaluating and ranking conferences. We have presented a review of metrics for citation analysis, categorised according to their applicability for evaluating journals and conferences. The citation metrics may also be categorised as popularity measuring and prestige measuring. Prestige measuring indicators like SCImago Journal Rank (SJR) and Eigenfactor have already gained popularity for evaluating journals. We discuss their role in evaluating the conferences. Indeed, some conferences have already started mentioning their prestige score in terms of the SJR of their conference proceedings. We also propose a Normalised Immediacy Index ([Formula: see text]), a variant of the Immediacy Index ([Formula: see text]), to measure the immediate relevance of articles published in a journal/conference. It is shown that the proposed metric can be used for immediacy relevance comparison irrespective of the publication schedule of the articles. Spearman correlation was run to determine the relationship between the values of the proposed [Formula: see text] and traditional metrics ([Formula: see text]-index for conferences and IF for journals). A strong, positive monotonic correlation was observed between [Formula: see text] and H-index ([Formula: see text] = .67, [Formula: see text] = 17, [Formula: see text] < .01) for conferences and between [Formula: see text] and IF ([Formula: see text] = .65, [Formula: see text] = 20, [Formula: see text] < .01) for journals.
Collapse
Affiliation(s)
- Shikha Gupta
- SS College of Business Studies, University of Delhi, India
| | - Naveen Kumar
- Department of Computer Science, University of Delhi, India
| | | |
Collapse
|
2
|
Wei SX, Tong T, Rousseau R, Wang W, Ye FY. Relations among the h-, g-, ψ-, and p-index and offset-ability. J Informetr 2022. [DOI: 10.1016/j.joi.2022.101340] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
3
|
Wang HY, Chien TW, Kan WC, Wang CY, Chou W. Authors who contributed most to the fields of hemodialysis and peritoneal dialysis since 2011 using the hT-index: Bibliometric analysis. Medicine (Baltimore) 2022; 101:e30375. [PMID: 36197241 PMCID: PMC9509042 DOI: 10.1097/md.0000000000030375] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/26/2022] Open
Abstract
BACKGROUND The h-index does not take into account the full citation list of a researcher to evaluate individual research achievements (IRAs). As a generalization of the h-index, the hT-index takes all citations into account to evaluate IRAs. Compared to other bibliometric indices, it is unclear whether the hT-index is more closely associated with the h-index. We utilized articles published on hemodialysis and peritoneal dialysis (HD/PD) to validate the hT-index as a measure of the most significant contributions to HD/PD. METHODS Using keywords involving HD/PD in titles, subject areas, and abstracts since 2011, we obtained 7702 abstracts and their associated metadata (e.g., citations, authors, research institutes, countries of origin). In total, 4752 first or corresponding authors with hT-indices >0 were evaluated. To present the author's IRA, the following 4 visualizations were used: radar, Sankey, impact beam plot, and choropleth map to investigate whether the hT-index was more closely associated with the h-index than other indices (e.g., g-/x-indices and author impact factors), whether the United States still dominates the majority of publications concerning PD/HD, and whether there was any difference in research features between 2 prolific authors. RESULTS In HD/PD articles, we observed that (a) the hT-index was closer to and associated with the h-index; (b1) the United States (37.15), China (34.63), and Japan (28.09) had the highest hT-index; (b2) Sun Yat Sen University (Chian) earned the highest hT-index (=20.02) among research institutes; (c1) the authors with the highest hT-indices (=15.64 and 14.39, respectively) were David W Johnson (Australia) and Andrew Davenport (UK); and (c2) their research focuses on PD and HD, respectively. CONCLUSION The hT-index was demonstrated to be appropriate for assessing IRAs along with visualizations. The hT-index is recommended in future bibliometric analyses of IRAs as a complement to the h-index.
Collapse
Affiliation(s)
- Hsien-Yi Wang
- Department of Sport Management, College of Leisure and Recreation Management, Chia Nan University of Pharmacy and Science, Tainan, Taiwan
- Ncphrology Department, Chi-Mei Medical Center, Tainan, Taiwan
| | - Tsair-Wei Chien
- Department of Medical Research, Chi-Mei Medical Center, Tainan, Taiwan
| | - Wei-Chih Kan
- Department of Sport Management, College of Leisure and Recreation Management, Chia Nan University of Pharmacy and Science, Tainan, Taiwan
- Department of Biological Science and Technology, Chung Hwa University of Medical Technology, Tainan, Taiwan
| | | | - Willy Chou
- Department of Physical Medicine and Rehabilitation, Chiali Chi-Mei Hospital, Tainan, Taiwan
- Department of Physical Medicine and Rehabilitation, Chung San Medical University Hospital, Taichung, Taiwan
- *Correspondence: Willy Chou, Chi-Mei Medical Center, 901 Chung Hwa Road, Yung Kung Dist., Tainan 710, Taiwan (e-mail: )
| |
Collapse
|
4
|
Impact of h-index on author’s rankings: an improvement to the h-index for lower-ranked authors. Scientometrics 2022. [DOI: 10.1007/s11192-022-04464-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023]
|
5
|
Sweileh WM. Patient satisfaction with nursing care: A bibliometric and visualization analysis (1950-2021). Int J Nurs Pract 2022; 28:e13076. [PMID: 35822232 DOI: 10.1111/ijn.13076] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Revised: 05/28/2022] [Accepted: 06/12/2022] [Indexed: 12/01/2022]
Abstract
AIM The current study aimed to provide an overview of research publications on patient satisfaction with nursing care. BACKGROUND Research activity on patient satisfaction with nursing care is an indicator of the commitment of policymakers to improve the quality of health services. DESIGN This was a descriptive cross-sectional bibliometric study. METHODS The Scopus database was used to retrieve relevant documents for the period from 1950 to 31 December 2021. The keywords 'patient satisfaction' and 'nursing care' were used in the search strategy. Two volunteers validated the search strategy. RESULTS The search strategy found 387 documents authored by 1470 researchers and disseminated through 241 journals. Research on patient satisfaction with nursing care (a) has experienced a steep growth over the last decade; (b) was mainly published by scholars from a limited number of countries; (c) has limited cross-country collaboration and limited author collaboration; (d) has addressed research topics concerning the quality of care, instrument validation, emergency department and hospital care and (e) has shown the highest readability for topics related to nurses' burnout and patient satisfaction. CONCLUSION Researchers and educators, especially in low- and middle-income countries, need to focus on this field to support activities to upgrade health services and patient outcomes.
Collapse
Affiliation(s)
- Waleed M Sweileh
- Department of Physiology, Pharmacology/Toxicology, Division of Biomedical Sciences, College of Medicine and Health Sciences, An-Najah National University, Nablus, Palestine
| |
Collapse
|
6
|
Martynov I, Feng X, Duess JW, Gosemann JH, Lacher M, Mayer S. Global Development of Research on Anorectal Malformations over the Last Five Decades: A Bibliometric Analysis. CHILDREN 2022; 9:children9020253. [PMID: 35204973 PMCID: PMC8870452 DOI: 10.3390/children9020253] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Revised: 01/30/2022] [Accepted: 02/10/2022] [Indexed: 11/16/2022]
Abstract
Purpose: Anorectal malformations (ARM) are one of the most challenging congenital malformations in pediatric surgery. We aimed to assess the research activity on ARM over the last five decades. Methods: Data on original research publications were retrieved from the Web of Science Core Collection (1970–2020), and analyzed for countries, authors, scientific journals, and top-ten papers. Scientific quantity was assessed by the number of publications. Research quality was estimated from the number of citations, average citation rate per item (ACI), and h-index. Results: A total number of 1595 articles with 19,419 citations (ACI = 12.2; h-index = 54) were identified. The annual number of publications and citations significantly increased over time (p < 0.0001). The USA (n = 386; 24.2%), Japan (n = 153; 9.6%), and China (n = 137; 8.6%) were the most productive countries; and the USA (n = 7850; ACI = 20.3; h-index = 44), Japan (n = 1937; ACI = 12.6; h-index = 21), and the Netherlands (n = 1318; ACI = 17.3; h-index = 22) were the top cited countries. Articles were preferentially published in JPS (n = 391; 24.5%), PSI (n = 181; 11.3%), and EJPS (n = 56; 3.5%). Top-ten cited papers focused on classification (n = 1), surgical technique (n = 3), associated syndromes (n = 2), postoperative outcome (n = 3), and basic research (n = 1). Conclusion: This bibliometric study provides valuable insights into the global development of ARM research, and shows that clinical studies and international collaborations dominate in this field.
Collapse
|
7
|
Bornmann L, Ganser C, Tekles A. Simulation of the h index use at university departments within the bibliometrics-based heuristics framework: Can the indicator be used to compare individual researchers? J Informetr 2022. [DOI: 10.1016/j.joi.2021.101237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
8
|
Citations optimal growth path: A tool to analyze sensitivity to citations of h-like indexes. J Informetr 2021. [DOI: 10.1016/j.joi.2021.101215] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
9
|
Divecha CA, Tullu MS, Karande S. Published a research paper? What next?? J Postgrad Med 2021; 67:189-193. [PMID: 34806657 PMCID: PMC8706544 DOI: 10.4103/jpgm.jpgm_348_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2021] [Revised: 06/17/2021] [Accepted: 07/23/2021] [Indexed: 11/17/2022] Open
Affiliation(s)
- CA Divecha
- Assistant Professor of Pediatrics at College of Medicine and Health Sciences, National University of Science and Technology, Sohar, Sultanate of Oman
| | - MS Tullu
- Assistant Professor of Pediatrics at College of Medicine and Health Sciences, National University of Science and Technology, Sohar, Sultanate of Oman
| | - S Karande
- Assistant Professor of Pediatrics at College of Medicine and Health Sciences, National University of Science and Technology, Sohar, Sultanate of Oman
| |
Collapse
|
10
|
Bradshaw CJA, Chalker JM, Crabtree SA, Eijkelkamp BA, Long JA, Smith JR, Trinajstic K, Weisbecker V. A fairer way to compare researchers at any career stage and in any discipline using open-access citation data. PLoS One 2021; 16:e0257141. [PMID: 34506560 PMCID: PMC8432834 DOI: 10.1371/journal.pone.0257141] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2021] [Accepted: 08/24/2021] [Indexed: 11/18/2022] Open
Abstract
The pursuit of simple, yet fair, unbiased, and objective measures of researcher performance has occupied bibliometricians and the research community as a whole for decades. However, despite the diversity of available metrics, most are either complex to calculate or not readily applied in the most common assessment exercises (e.g., grant assessment, job applications). The ubiquity of metrics like the h-index (h papers with at least h citations) and its time-corrected variant, the m-quotient (h-index ÷ number of years publishing) therefore reflect the ease of use rather than their capacity to differentiate researchers fairly among disciplines, career stage, or gender. We address this problem here by defining an easily calculated index based on publicly available citation data (Google Scholar) that corrects for most biases and allows assessors to compare researchers at any stage of their career and from any discipline on the same scale. Our ε′-index violates fewer statistical assumptions relative to other metrics when comparing groups of researchers, and can be easily modified to remove inherent gender biases in citation data. We demonstrate the utility of the ε′-index using a sample of 480 researchers with Google Scholar profiles, stratified evenly into eight disciplines (archaeology, chemistry, ecology, evolution and development, geology, microbiology, ophthalmology, palaeontology), three career stages (early, mid-, late-career), and two genders. We advocate the use of the ε′-index whenever assessors must compare research performance among researchers of different backgrounds, but emphasize that no single index should be used exclusively to rank researcher capability.
Collapse
Affiliation(s)
- Corey J. A. Bradshaw
- Global Ecology, College of Science and Engineering, Flinders University, Adelaide, South Australia, Australia
- ARC Centre of Excellence for Australian Biodiversity and Heritage, EpicAustralia.org, Adelaide, Australia
- * E-mail:
| | - Justin M. Chalker
- Institute for Nanoscale Science and Technology, College of Science and Engineering, Flinders University, Adelaide, South Australia, Australia
| | - Stefani A. Crabtree
- Department of Environment and Society, Utah State University, Logan, Utah, United States of America
- The Santa Fe Institute, Santa Fe, New Mexico, United States of America
- The Centre for Research and Interdisciplinarity, Paris, France
| | - Bart A. Eijkelkamp
- College of Science and Engineering, Flinders University, Adelaide, South Australia, Australia
| | - John A. Long
- College of Science and Engineering, Flinders University, Adelaide, South Australia, Australia
| | - Justine R. Smith
- Eye and Vision Health, Flinders University College of Medicine and Public Health, Flinders University, Adelaide, South Australia, Australia
| | - Kate Trinajstic
- School of Molecular and Life Sciences, Curtin University, Bentley, Western Australia, Australia
| | - Vera Weisbecker
- ARC Centre of Excellence for Australian Biodiversity and Heritage, EpicAustralia.org, Adelaide, Australia
- College of Science and Engineering, Flinders University, Adelaide, South Australia, Australia
| |
Collapse
|
11
|
Fanourgiakis J, Panagiotakis C, Konstantourakis I. Exploring the research-based ranking and the university impact in Greece : A case of peripheral departments of management and economics. COLLNET JOURNAL OF SCIENTOMETRICS AND INFORMATION MANAGEMENT 2021. [DOI: 10.1080/09737766.2021.1978826] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- J. Fanourgiakis
- Department of Management Science and Technology, Hellenic Mediterranean University, Agios Nikolaos 72100, Greece
| | - C. Panagiotakis
- Department of Management Science and Technology, Hellenic Mediterranean University, Agios Nikolaos 72100, Greece
| | - I. Konstantourakis
- Department of Management Science and Technology, Hellenic Mediterranean University, Agios Nikolaos 72100, Greece
| |
Collapse
|
12
|
Bu Y, Waltman L, Huang Y. A multidimensional framework for characterizing the citation impact
of scientific publications. QUANTITATIVE SCIENCE STUDIES 2021. [DOI: 10.1162/qss_a_00109] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
Abstract
Abstract
The citation impact of a scientific publication is usually seen as a one-dimensional concept. We introduce a multidimensional framework for characterizing the citation impact of a publication. In addition to the level of citation impact, quantified by the number of citations received by a publication, we also conceptualize and operationalize the depth and breadth and the dependence and independence of the citation impact of a publication. The proposed framework distinguishes between publications that have a deep citation impact, typically in a relatively narrow research area, and publications that have a broad citation impact, probably covering a wider area of research. It also makes a distinction between publications that are strongly dependent on earlier work and publications that make a more independent scientific contribution. We use our multidimensional citation impact framework to report basic descriptive statistics on the citation impact of highly cited publications in all scientific disciplines. In addition, we present a detailed case study focusing on the field of scientometrics. The proposed citation impact framework provides a more in-depth understanding of the citation impact of a publication than a traditional one-dimensional perspective.
Collapse
Affiliation(s)
- Yi Bu
- Department of Information Management, Peking University, Beijing, China
- Center for Complex Networks and Systems Research, Luddy School of Informatics, Computing, and Engineering, Indiana University, Bloomington, IN, USA
| | - Ludo Waltman
- Centre for Science and Technology Studies, Leiden University, Leiden, The Netherlands
| | - Yong Huang
- School of Information Management, Wuhan University, Wuhan, Hubei, China
| |
Collapse
|
13
|
The Effect of Article Characteristics on Citation Number in a Diachronic Dataset of the Biomedical Literature on Chronic Inflammation: An Analysis by Ensemble Machines. PUBLICATIONS 2021. [DOI: 10.3390/publications9020015] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Citations are core metrics to gauge the relevance of scientific literature. Identifying features that can predict a high citation count is therefore of primary importance. For the present study, we generated a dataset of 121,640 publications on chronic inflammation from the Scopus database, containing data such as titles, authors, journal, publication date, type of document, type of access and citation count, ranging from 1951 to 2021. Hence we further computed title length, author count, title sentiment score, number of colons, semicolons and question marks in the title and we used these data as predictors in Gradient boosting, Bagging and Random Forest regressors and classifiers. Based on these data, we were able to train these machines, and Gradient Boosting achieved an F1 score of 0.552 on classification. These models agreed that document type, access type and number of authors were the best predicting factors, followed by title length.
Collapse
|
14
|
Dispersion measures for h-index: a study of the Brazilian researchers in the field of mathematics. Scientometrics 2021. [DOI: 10.1007/s11192-020-03848-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
15
|
Zanotto ED, Carvalho V. Article age- and field-normalized tools to evaluate scientific impact and momentum. Scientometrics 2021. [DOI: 10.1007/s11192-021-03877-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
16
|
Burghardt KJ, Howlett BH, Khoury AS, Fern SM, Burghardt PR. Bibliometric data based on the Pharm.D. and Ph.D. degree in United States research-intensive colleges of pharmacy. INTERNATIONAL JOURNAL OF PHARMACY PRACTICE 2021; 29:78-83. [PMID: 32813311 DOI: 10.1111/ijpp.12667] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2020] [Revised: 07/24/2020] [Accepted: 07/25/2020] [Indexed: 11/30/2022]
Abstract
OBJECTIVES The objective of this work was to compare bibliometrics based on doctoral degrees within United States colleges of pharmacy to understand productivity differences. Secondary objectives were to provide quantitative data based on degree that could be utilized by individual faculty, administration and other key stakeholders in academic pharmacy. METHODS Bibliometric indices were obtained from Scopus and Web of Science for faculty from research-intensive United States pharmacy schools. Scholarly metrics that included publication number, total citations, highest cited article and H-index were compared between degrees using multivariate regression adjusted for academic rank and years since first publication. A correction for multiple testing was applied. KEY FINDINGS All collected scholarly metrics were higher for Ph.D.-only and Pharm.D./Ph.D. faculty when compared to Pharm.D.-only faculty. Ph.D.-only faculty significantly differed compared to Pharm.D./Ph.D. faculty for Web of Science average citations per document. CONCLUSIONS Differences are apparent between the major doctoral degrees at research-intensive, federally funded colleges of pharmacy; however, these differences were primarily identified for Pharm.D.-only compared to the other doctoral degree types Future work should analyse the potential variables that explain the scholarly metrics differences between degrees and aim to analyse other areas of faculty impact beyond scholarly metrics.
Collapse
Affiliation(s)
- Kyle J Burghardt
- Eugene Applebaum College of Pharmacy and Health Sciences, Wayne State University, Detroit, MI, USA
| | - Bradley H Howlett
- Eugene Applebaum College of Pharmacy and Health Sciences, Wayne State University, Detroit, MI, USA
| | - Audrey S Khoury
- Eugene Applebaum College of Pharmacy and Health Sciences, Wayne State University, Detroit, MI, USA
| | - Stephanie M Fern
- Eugene Applebaum College of Pharmacy and Health Sciences, Wayne State University, Detroit, MI, USA
| | - Paul R Burghardt
- Wayne State University Nutrition and Food Sciences, Detroit, MI, USA
| |
Collapse
|
17
|
Mannon RB. Is It Time for Operation Warp Speed in Transplant Research? Transplant Direct 2020; 6:e619. [PMID: 33134495 PMCID: PMC7581020 DOI: 10.1097/txd.0000000000001073] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2020] [Revised: 09/16/2020] [Accepted: 09/17/2020] [Indexed: 11/26/2022] Open
Affiliation(s)
- Roslyn B. Mannon
- Division of Nephrology, Department of Medicine, University of Nebraska Medical Center, Nebraska-Western Iowa VA Medical Center, Omaha, NE
| |
Collapse
|
18
|
Johnson SD. Peer review versus the h-index for evaluation of individual researchers in the biological sciences. S AFR J SCI 2020. [DOI: 10.17159/sajs.2020/8700] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022] Open
Abstract
Past performance is a key consideration when rationalising the allocation of grants and other opportunities to individual researchers. The National Research Foundation of South Africa (NRF) has long used a highly structured system of ‘rating’ the past performance of individual researchers. This system relies heavily on peer review, and has seldom been benchmarked against bibliometric measures of research performance such as Hirsch’s h-index. Here I use data for about 600 rated researchers in the biological sciences to evaluate the extent to which outcomes of peer review correspond to bibliometric measures of research performance. The analysis revealed that values of the h-index based on the Scopus database are typically 5–20 for researchers placed in the NRF’s C rating category (‘established’), 20–40 for those in the B rating category (‘considerable international recognition’) and >40 for those in the A rating category (‘leading international scholars’). Despite concerns that citation patterns differ among disciplines, the mean h-index per rating category was remarkably consistent across five different disciplines in the biological sciences, namely animal sciences, plant sciences, ecology, microbiology and biochemistry/genetics. This observation suggests that the NRF rating system is equitable in the sense that the outcomes of peer review are generally consistent with bibliometric measures of research performance across different disciplines in the biological sciences. However, the study did reveal some notable discrepancies which could reflect either bias in the peer-review process or shortcomings in the bibliometric measures, or both.
Collapse
Affiliation(s)
- Steven D. Johnson
- Centre for Functional Biodiversity, School of Life Sciences, University of KwaZulu-Natal, Pietermaritzburg, South Africa
| |
Collapse
|
19
|
Baier-Fuentes H, González-Serrano MH, Alonso-Dos Santos M, Inzunza-Mendoza W, Pozo-Estrada V. Emotions and Sport Management: A Bibliometric Overview. Front Psychol 2020; 11:1512. [PMID: 32754088 PMCID: PMC7366861 DOI: 10.3389/fpsyg.2020.01512] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2020] [Accepted: 06/08/2020] [Indexed: 11/13/2022] Open
Abstract
Emotions are considered a fundamental aspect of sport scenarios, and within sports, consumer behavior is a very popular area of research in the sport management field. Thus, in recent years, there has been a growing interest for sport managers regarding the role that emotions play in sport consumer behavior. Thus, the aim of this paper is to provide an overview of the academic research on emotions in the sport management field using two techniques: a bibliometric performance analysis and a graphic mapping of the references in this field. This analysis focuses on authors, journals, papers, institutions and countries. Bibliometric indicators including the h-index measure, productivity and the number of citations were used to perform the performance analysis. Then, VOSviewer software was used to perform co-citation, bibliographic coupling and co-occurrence of keyword analysis (mapping analysis). The results of both types of analysis are consistent, with the United States being the most influential country in emotions in sport management research because the main authors and institutions in this research field belong to this country. The overall results indicate that the literature on this research topic has grown significantly in recent years in all scientific disciplines; however, the research topic is incipient, and therefore, the number of articles is still limited. Thus, this research presents the key aspects in the topic of emotions in sport management that could be helpful for researchers and policy makers in the field of sport management to make future decisions.
Collapse
Affiliation(s)
- Hugo Baier-Fuentes
- Department of Business Administration, Universidad Católica de la Santísima Concepción, Concepción, Chile
| | - María Huertas González-Serrano
- Department of Teaching and Learning of Physical Education, Plastic and Music Education, Universidad Católica de Valencia, Valencia, Spain
| | - Manuel Alonso-Dos Santos
- Department of Business Administration, Universidad Católica de la Santísima Concepción, Concepción, Chile.,Department of Marketing and Market Research, Facultad de Ciencias Económicas y Empresariales, University of Granada, Granada, Spain
| | - Williams Inzunza-Mendoza
- Department of Business Administration, Universidad Católica de la Santísima Concepción, Concepción, Chile
| | - Victor Pozo-Estrada
- Department of Business Administration, Universidad Católica de la Santísima Concepción, Concepción, Chile
| |
Collapse
|
20
|
Jappe A. Professional standards in bibliometric research evaluation? A meta-evaluation of European assessment practice 2005-2019. PLoS One 2020; 15:e0231735. [PMID: 32310984 PMCID: PMC7170233 DOI: 10.1371/journal.pone.0231735] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2019] [Accepted: 03/30/2020] [Indexed: 11/19/2022] Open
Abstract
Despite growing demand for practicable methods of research evaluation, the use of bibliometric indicators remains controversial. This paper examines performance assessment practice in Europe-first, identifying the most commonly used bibliometric methods and, second, identifying the actors who have defined wide-spread practices. The framework of this investigation is Abbott's theory of professions, and I argue that indicator-based research assessment constitutes a potential jurisdiction for both individual experts and expert organizations. This investigation was conducted using a search methodology that yielded 138 evaluation studies from 21 EU countries, covering the period 2005 to 2019. Structured content analysis revealed the following findings: (1) Bibliometric research assessment is most frequently performed in the Nordic countries, the Netherlands, Italy, and the United Kingdom. (2) The Web of Science (WoS) is the dominant database used for public research assessment in Europe. (3) Expert organizations invest in the improvement of WoS citation data, and set technical standards with regards to data quality. (4) Citation impact is most frequently assessed with reference to international scientific fields. (5) The WoS classification of science fields retained its function as a de facto reference standard for research performance assessment. A detailed comparison of assessment practices between five dedicated organizations and other individual bibliometric experts suggests that corporate ownership and limited access to the most widely used citation databases have had a restraining effect on the development and diffusion of professional bibliometric methods during this period.
Collapse
Affiliation(s)
- Arlette Jappe
- Interdisciplinary Centre of Science and Technology Studies (IZWT), University of Wuppertal, Wuppertal, Germany
| |
Collapse
|
21
|
Three Commonly Utilized Scholarly Databases and a Social Network Site Provide Different, But Related, Metrics of Pharmacy Faculty Publication. PUBLICATIONS 2020. [DOI: 10.3390/publications8020018] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Scholarly productivity is a critical component of pharmacy faculty effort and is used for promotion and tenure decisions. Several databases are available to measure scholarly productivity; however, comparisons amongst these databases are lacking for pharmacy faculty. The objective of this work was to compare scholarly metrics from three commonly utilized databases and a social networking site focused on data from research-intensive colleges of pharmacy and to identify factors associated with database differences. Scholarly metrics were obtained from Scopus, Web of Science, Google Scholar, and ResearchGate for faculty from research-intensive (Carnegie Rated R1, R2, or special focus) United States pharmacy schools with at least two million USD in funding from the National Institutes of Health. Metrics were compared and correlations were performed. Regression analyses were utilized to identify factors associated with database differences. Significant differences in scholarly metric values were observed between databases despite the high correlations, suggestive of systematic variation in database reporting. Time since first publication was the most common factor that was associated with database differences. Google Scholar tended to have higher metrics than all other databases, while Web of Science had lower metrics relative to other databases. Differences in reported metrics between databases are apparent, which may be attributable to the time since first publication and database coverage of pharmacy-specific journals. These differences should be considered by faculty, reviewers, and administrative staff when evaluating scholarly performance.
Collapse
|
22
|
Montazerian M, Zanotto ED, Eckert H. Prolificacy and visibility versus reputation in the hard sciences. Scientometrics 2020. [DOI: 10.1007/s11192-020-03369-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
23
|
Simoes N, Crespo N. Self-Citations and scientific evaluation: Leadership, influence, and performance. J Informetr 2020. [DOI: 10.1016/j.joi.2019.100990] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
24
|
|
25
|
Exploring the limitations of the h-index and h-type indexes in measuring the research performance of authors. Scientometrics 2020. [DOI: 10.1007/s11192-020-03364-1] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
26
|
Abstract
H-index is an accepted norm to rank scientists and makes them eligible for various professional benefits. However, taking into consideration the associated flaws of the h-index, a diversified set of parameters have been proposed by the scientific community to rank authors in a better way. Imaginary case studies and datasets are used to find out the practical and actual utility of the proposed indicators. To analyze the individual behaviour of each index, these indices are comprehensively evaluated on an extensive data set. This study emphasizes the scrutiny of the h-index, some of its variants, and extensions to rank authors. There appears to be a correlation between high citation rates for a published researcher and the award of prestigious accolades. Thus, the inclusion of a researcher in the list is based on high citation rates and the authority has claimed a direct connection between the citation rates and prestigious awards. In this context, the work initiated to find out the h-index and its variants for the selected researchers incorporated in the hall of citation laureates from the field of medicine. It is clear from the correlation analysis that there is a difference in the degree of correlation between the h-index and its variants. The A-index is weakly correlated, and M-Quotient is strongly correlated with h-index. Thus, most of the h-index variants are merely mathematically and arithmetically modified and does not add any new information as these are highly correlated and are based on the h-core. Thus, more useful and reasonable approaches could be developed for multidimensional and contextualized evaluations of scientific performance rather than cocooning them with mere numbers.
Collapse
Affiliation(s)
- Rosy Jan
- University of Kashmir, Srinagar, India
| | | |
Collapse
|
27
|
|
28
|
Interdisciplinary Comparison of Scientific Impact of Publications Using the Citation-Ratio. DATA SCIENCE JOURNAL 2019. [DOI: 10.5334/dsj-2019-019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
|
29
|
The h-index and multi-author hm-index for individual researchers in condensed matter physics. Scientometrics 2019. [DOI: 10.1007/s11192-019-03051-w] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
30
|
Montazerian M, Zanotto ED, Eckert H. A new parameter for (normalized) evaluation of H-index: countries as a case study. Scientometrics 2019. [DOI: 10.1007/s11192-018-2996-z] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
31
|
Fenner T, Harris M, Levene M, Bar-Ilan J. A novel bibliometric index with a simple geometric interpretation. PLoS One 2018; 13:e0200098. [PMID: 29990357 PMCID: PMC6039009 DOI: 10.1371/journal.pone.0200098] [Citation(s) in RCA: 48] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2018] [Accepted: 06/19/2018] [Indexed: 11/18/2022] Open
Abstract
We propose the χ-index as a bibliometric indicator that generalises the h-index. While the h-index is determined by the maximum square that fits under the citation curve of an author when plotting the number of citations in decreasing order, the χ-index is determined by the maximum area rectangle that fits under the curve. The height of the maximum rectangle is the number of citations ck to the kth most-cited publication, where k is the width of the rectangle. The χ-index is then defined as [Formula: see text], for convenience of comparison with the h-index and other similar indices. We present a comprehensive empirical comparison between the χ-index and other bibliometric indices, focusing on a comparison with the h-index, by analysing two datasets-a large set of Google Scholar profiles and a small set of Nobel prize winners. Our results show that, although the χ and h indices are strongly correlated, they do exhibit significant differences. In particular, we show that, for these data sets, there are a substantial number of profiles for which χ is significantly larger than h. Furthermore, restricting these profiles to the cases when ck > k or ck < k corresponds to, respectively, classifying researchers as either tending to influential, i.e. having many more than h citations, or tending to prolific, i.e. having many more than h publications.
Collapse
Affiliation(s)
- Trevor Fenner
- Department of Computer Science and Information Systems, University of London, London WC1E 7HX, United Kingdom
| | - Martyn Harris
- Department of Computer Science and Information Systems, University of London, London WC1E 7HX, United Kingdom
| | - Mark Levene
- Department of Computer Science and Information Systems, University of London, London WC1E 7HX, United Kingdom
| | - Judit Bar-Ilan
- Department of Information Science, Bar-Ilan University, Ramat Gan, Israel
- * E-mail:
| |
Collapse
|
32
|
Jappe A, Pithan D, Heinze T. Does bibliometric research confer legitimacy to research assessment practice? A sociological study of reputational control, 1972-2016. PLoS One 2018; 13:e0199031. [PMID: 29902239 PMCID: PMC6002049 DOI: 10.1371/journal.pone.0199031] [Citation(s) in RCA: 30] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2017] [Accepted: 05/30/2018] [Indexed: 12/24/2022] Open
Abstract
The use of bibliometric measures in the evaluation of research has increased considerably based on expertise from the growing research field of evaluative citation analysis (ECA). However, mounting criticism of such metrics suggests that the professionalization of bibliometric expertise remains contested. This paper investigates why impact metrics, such as the journal impact factor and the h-index, proliferate even though their legitimacy as a means of professional research assessment is questioned. Our analysis is informed by two relevant sociological theories: Andrew Abbott's theory of professions and Richard Whitley's theory of scientific work. These complementary concepts are connected in order to demonstrate that ECA has failed so far to provide scientific authority for professional research assessment. This argument is based on an empirical investigation of the extent of reputational control in the relevant research area. Using three measures of reputational control that are computed from longitudinal inter-organizational networks in ECA (1972-2016), we show that peripheral and isolated actors contribute the same number of novel bibliometric indicators as central actors. In addition, the share of newcomers to the academic sector has remained high. These findings demonstrate that recent methodological debates in ECA have not been accompanied by the formation of an intellectual field in the sociological sense of a reputational organization. Therefore, we conclude that a growing gap exists between an academic sector with little capacity for collective action and increasing demand for routine performance assessment by research organizations and funding agencies. This gap has been filled by database providers. By selecting and distributing research metrics, these commercial providers have gained a powerful role in defining de-facto standards of research excellence without being challenged by expert authority.
Collapse
Affiliation(s)
- Arlette Jappe
- Interdisciplinary Center of Science and Technology Studies (IZWT), University of Wuppertal, Wuppertal, Germany
| | - David Pithan
- Institute of Sociology, University of Wuppertal, Wuppertal, Germany
| | - Thomas Heinze
- Interdisciplinary Center of Science and Technology Studies (IZWT), University of Wuppertal, Wuppertal, Germany
- Institute of Sociology, University of Wuppertal, Wuppertal, Germany
- * E-mail:
| |
Collapse
|
33
|
Exploring the Hjif-Index, an Analogue to the H-Like Index for Journal Impact Factors. PUBLICATIONS 2018. [DOI: 10.3390/publications6020014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
|
34
|
Akbaritabar A, Casnici N, Squazzoni F. The conundrum of research productivity: a study on sociologists in Italy. Scientometrics 2017. [DOI: 10.1007/s11192-017-2606-5] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
35
|
|
36
|
Mingers J, O’Hanley JR, Okunola M. Using Google Scholar institutional level data to evaluate the quality of university research. Scientometrics 2017; 113:1627-1643. [PMID: 29200538 PMCID: PMC5691114 DOI: 10.1007/s11192-017-2532-6] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2017] [Indexed: 11/26/2022]
Abstract
In recent years, the extent of formal research evaluation, at all levels from the individual to the multiversity has increased dramatically. At the institutional level, there are world university rankings based on an ad hoc combination of different indicators. There are also national exercises, such as those in the UK and Australia that evaluate research outputs and environment through peer review panels. These are extremely costly and time consuming. This paper evaluates the possibility of using Google Scholar (GS) institutional level data to evaluate university research in a relatively automatic way. Several citation-based metrics are collected from GS for all 130 UK universities. These are used to evaluate performance and produce university rankings which are then compared with various rankings based on the 2014 UK Research Excellence Framework (REF). The rankings are shown to be credible and to avoid some of the obvious problems of the REF ranking, as well as being highly efficient and cost effective. We also investigate the possibility of normalizing the results for the university subject mix since science subjects generally produce significantly more citations than social science or humanities.
Collapse
Affiliation(s)
- John Mingers
- Kent Business School, University of Kent, Canterbury, CT2 7FS UK
| | | | | |
Collapse
|
37
|
Matthes J, Giesler M, Wagner-Menghin M, Himmelbauer M, Preusche I, Schüttpelz-Brauns K. Publication activity in medical education research: A descriptive analysis of submissions to the GMS Zeitschrift für Medizinische Ausbildung in 2007-2015. GMS JOURNAL FOR MEDICAL EDUCATION 2017; 34:Doc32. [PMID: 28890923 PMCID: PMC5569980 DOI: 10.3205/zma001109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Figures] [Subscribe] [Scholar Register] [Received: 10/11/2016] [Revised: 06/01/2017] [Accepted: 06/26/2017] [Indexed: 06/07/2023]
Abstract
Objectives: The significance of medical education research has increased internationally. In this context we investigated whether, and if so, how the quantity and quality of scientific papers reviewed and/or published by the GMS Zeitschrift für Medizinische Ausbildung (GMS Z Med Ausbild) changed. Methods: The quantity and ratio of original papers, project reports and reviews submitted to or published in the GMS Z Med Ausbild were analysed. Published scientific articles were investigated in regard to the quality features "study type" and "mode of data collection" as well as the background (university affiliation) of the last authors. The citation frequency within the first five years after PubMed listing was compared to the one of BMC Medical Education in the corresponding period. Results: The number of submitted scientific manuscripts increased steadily. Most of the submissions and publications are original papers. For publications explorative studies and prospective data collection are most common. A shift over time is not observed. 16% of the published works come from one and 36% from four of the in total 39 universities represented by the last authors. The development of the citation frequency of articles published in GMS Z Med Ausbild is similar to that of BMC Medical Education. Conclusion: The rising number of submissions indicates an increasing significance of medical education research in German-speaking countries. The development of the number of citations reflects the growing appreciation of GMS Z Med Ausbild also indicated by the increasing number of online accesses. Our findings that study type and mode of data collection did not change has to be interpreted with caution since among other things choice and correct application of adequate methods are crucial regarding a scientific work's quality, too. These aspects, however, were not investigated in this paper.
Collapse
Affiliation(s)
- Jan Matthes
- University of Cologne, Institute II, Center for Pharmacology, Cologne, Germany
| | - Marianne Giesler
- University of Freiburg, Medical Faculty, Office of Student Affairs, Centre for Evaluation of Teaching in Medicine Baden-Württemberg, Freiburg, Germany
| | | | | | - Ingrid Preusche
- University of Veterinary Medicine, Teaching Center, Vienna, Austria
| | - Katrin Schüttpelz-Brauns
- University Medicine Mannheim, Medical Faculty Mannheim at Heidelberg University, Department of Undergraduate Education and Educational Development, Mannheim, Germany
| |
Collapse
|
38
|
|
39
|
Littman MA, Sonne JW, Smith GV. Research productivity of doctor of physical therapy faculty promoted in the southeastern United States. MEDICAL EDUCATION ONLINE 2017; 22:1368849. [PMID: 28835200 PMCID: PMC5653937 DOI: 10.1080/10872981.2017.1368849] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/12/2017] [Accepted: 08/09/2017] [Indexed: 06/07/2023]
Abstract
BACKGROUND Little information exists on the research productivity of successfully promoted tenure-track Doctor of Physical Therapy (DPT) faculty. OBJECTIVE To determine the research productivity that typically results in successful promotion. DESIGN We collected publicly available curriculum vitae (CVs) from faculty currently in accredited DPT programs and who had been successfully promoted from an institution in the southeastern USA from 2000 through 2016. Total publication count, journal impact factor, funding, citations, and other metrics were analysed from 45 subjects of 22 of the 64 CAPTE-accredited DPT programs in the southeast. RESULTS None of the studied metrics were normally distributed with time to promotion as determined by a Shapiro-Wilk test. These faculty exhibited a median publication count of 4, range 0 to 43; median of average citation count of 12.4, range 0 to 87.25; median of average journal impact factor of 2.866, range 0 to 6.280; median external funding received of $9910, range $0.00 to $19 543 198; and median author h-index of 3, range 0 to 17. The median number of years before promotion was 6, ranging from 3 to 13 years. Linear regression analysis indicates a poor fit with no significant correlation between years before promotion and any of the studied metrics. No correlation between journal impact factor and number of citations was observed (m = -0.22, p = 0.728, R2 = 0.0003). Prior to promotion 31% (14 of 45) did not receive external funding and 24% (11 of 45) had a 0 h-index. The Carnegie Classification of the institution did not significantly correlate with research productivity metrics in this dataset (p = 0.213). CONCLUSION While faculty unsuccessful in promotion were not identifiable using this method, this research can be used by faculty and committees to evaluate research productivity against regional data and promote competitive standards with peer institutions. ABBREVIATIONS CAPTE: Commission on Accreditation in Physical Therapist Education; DPT: Doctor of Physical Therapy.
Collapse
Affiliation(s)
- Marissa A. Littman
- Physical Therapy Program, Department of Health Professions, University of Central Florida, Orlando, FL, USA
| | - James W. Sonne
- Physical Therapy Program, Department of Health Professions, University of Central Florida, Orlando, FL, USA
| | - Gerald V. Smith
- Physical Therapy Program, Department of Health Professions, University of Central Florida, Orlando, FL, USA
| |
Collapse
|
40
|
Hulac D, Johnson ND, Ushijima SC, Schneider MM. PUBLICATION OUTLETS FOR SCHOOL PSYCHOLOGY FACULTY: 2010 to 2015. PSYCHOLOGY IN THE SCHOOLS 2016. [DOI: 10.1002/pits.21977] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
41
|
Abramo G, D’Angelo CA. A comparison of university performance scores and ranks by MNCS and FSS. J Informetr 2016. [DOI: 10.1016/j.joi.2016.07.004] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|
42
|
Klavans R, Boyack KW. Which Type of Citation Analysis Generates the Most Accurate Taxonomy of Scientific and Technical Knowledge? J Assoc Inf Sci Technol 2016. [DOI: 10.1002/asi.23734] [Citation(s) in RCA: 155] [Impact Index Per Article: 19.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
43
|
Abstract
PurposeThe purpose of this paper is to show how bibliometrics would benefit from a stronger programme of construct validity.Design/methodology/approachThe value of the construct validity concept is demonstrated by applying this approach to the evaluation of theh-index, a widely used metric.FindingsThe paper demonstrates that theh-index comprehensively fails any test of construct validity. In simple terms, the metric does not measure what it purports to measure. This conclusion suggests that the current popularity of theh-index as a topic for bibliometric research represents wasted effort, which might have been avoided if researchers had adopted the approach suggested in this paper.Research limitations/implicationsThis study is based on the analysis of a single bibliometric concept.Practical implicationsThe conclusion that theh-index fails any test in terms of construct validity implies that the widespread use of this metric within the higher education sector as a management tool represents poor practice, and almost certainly results in the misallocation of resources.Social implicationsThis paper suggests that the current enthusiasm for theh-index within the higher education sector is misplaced. The implication is that universities, grant funding bodies and faculty administrators should abandon the use of theh-index as a management tool. Such a change would have a significant effect on current hiring, promotion and tenure practices within the sector, as well as current attitudes towards the measurement of academic performance.Originality/valueThe originality of the paper lies in the systematic application of the concept of construct validity to bibliometric enquiry.
Collapse
|
44
|
Medo M, Cimini G. Model-based evaluation of scientific impact indicators. Phys Rev E 2016; 94:032312. [PMID: 27739778 DOI: 10.1103/physreve.94.032312] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2016] [Indexed: 06/06/2023]
Abstract
Using bibliometric data artificially generated through a model of citation dynamics calibrated on empirical data, we compare several indicators for the scientific impact of individual researchers. The use of such a controlled setup has the advantage of avoiding the biases present in real databases, and it allows us to assess which aspects of the model dynamics and which traits of individual researchers a particular indicator actually reflects. We find that the simple average citation count of the authored papers performs well in capturing the intrinsic scientific ability of researchers, regardless of the length of their career. On the other hand, when productivity complements ability in the evaluation process, the notorious h and g indices reveal their potential, yet their normalized variants do not always yield a fair comparison between researchers at different career stages. Notably, the use of logarithmic units for citation counts allows us to build simple indicators with performance equal to that of h and g. Our analysis may provide useful hints for a proper use of bibliometric indicators. Additionally, our framework can be extended by including other aspects of the scientific production process and citation dynamics, with the potential to become a standard tool for the assessment of impact metrics.
Collapse
Affiliation(s)
- Matúš Medo
- Physics Department, University of Fribourg, CH-1700 Fribourg, Switzerland
| | - Giulio Cimini
- IMT School for Advanced Studies, 55100 Lucca, Italy
- Istituto dei Sistemi Complessi (ISC)-CNR, 00185 Rome, Italy
| |
Collapse
|
45
|
Ibáñez A, Armañanzas R, Bielza C, Larrañaga P. Genetic algorithms and Gaussian Bayesian networks to uncover the predictive core set of bibliometric indices. J Assoc Inf Sci Technol 2016. [DOI: 10.1002/asi.23467] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Affiliation(s)
- Alfonso Ibáñez
- Computational Intelligence Group; Departamento de Inteligencia Artificial; Universidad Politécnica de Madrid; Campus de Montegancedo s/n Boadilla del Monte 28660 Spain
| | - Rubén Armañanzas
- Krasnow Institute for Advanced Study; George Mason University; 4400 University Drive Fairfax VA 22030
| | - Concha Bielza
- Computational Intelligence Group; Departamento de Inteligencia Artificial; Universidad Politécnica de Madrid; Campus de Montegancedo s/n Boadilla del Monte 28660 Spain
| | - Pedro Larrañaga
- Computational Intelligence Group; Departamento de Inteligencia Artificial; Universidad Politécnica de Madrid; Campus de Montegancedo s/n Boadilla del Monte 28660 Spain
| |
Collapse
|
46
|
|
47
|
|
48
|
Vîiu GA. A theoretical evaluation of Hirsch-type bibliometric indicators confronted with extreme self-citation. J Informetr 2016. [DOI: 10.1016/j.joi.2016.04.010] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
49
|
|
50
|
Zyoud SH, Al-Jabi SW, Sweileh WM. Scientific publications from Arab world in leading journals of Integrative and Complementary Medicine: a bibliometric analysis. BMC COMPLEMENTARY AND ALTERNATIVE MEDICINE 2015; 15:308. [PMID: 26341635 PMCID: PMC4559877 DOI: 10.1186/s12906-015-0840-z] [Citation(s) in RCA: 40] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/09/2014] [Accepted: 09/01/2015] [Indexed: 02/07/2023]
Abstract
BACKGROUND Bibliometric analysis is increasingly employed as a useful tool to assess the quantity and quality of research performance. The specific goal of the current study was to evaluate the performance of research output originating from Arab world and published in international Integrative and Complementary Medicine (ICM) journals. METHODS Original scientific publications and reviews from the 22 Arab countries that were published in 22 international peer-reviewed ICM journals during all previous years up to December 31(st) 2013, were screened using the Web of Science databases. RESULTS Five hundred and ninety-one documents were retrieved from 19 ICM journals. The h-index of the set of papers under study was 47. The highest h-index was 27 for Morocco, 21 for Jordan, followed by 19 for each Kingdom of Saudi Arabia (KSA), and Egypt, and the lowest h-index was 1 for each of Comoros, Qatar, and Syrian Arab Republic. No data related to ICM were published from Djibouti, and Mauritania. After adjusting for economy and population power, Somalia (89), Morocco (32.5), Egypt (31.1), Yemen (21.4), and Palestine (21.2) had the highest research productivity. The total number of citations was 9,466, with an average citation of 16 per document. The study identified 262 (44.3 %) documents with 39 countries in Arab-foreign country collaborations. Arab authors collaborated most with countries in Europe (24.2 %), followed by countries in the Asia-Pacific region (9.8 %). CONCLUSION Scientific research output in the ICM field in the Arab world region is increasing. Most of publications from Arab world in ICM filed were driven by societal use of medicinal plants and herbs. Search for new therapies from available low cost medicinal plants in Arab world has motivated many researchers in academia and pharmaceutical industry. Further investigation is required to support these findings in a wider journal as well as to improve research output in the field of ICM from Arab world region by investing in more national and international collaborative research project.
Collapse
Affiliation(s)
- Sa'ed H Zyoud
- Poison Control and Drug Information Center (PCDIC), College of Medicine and Health Sciences, An-Najah National University, Nablus, Palestine.
- Department of Clinical and Community Pharmacy, College of Medicine and Health Sciences, An-Najah National University, Nablus, Palestine.
- WHO Collaborating Centre for Drug Information, National Poison Centre, Universiti Sains Malaysia (USM), Penang, Malaysia.
| | - Samah W Al-Jabi
- Department of Clinical and Community Pharmacy, College of Medicine and Health Sciences, An-Najah National University, Nablus, Palestine.
| | - Waleed M Sweileh
- Department of Pharmacology and Toxicology, College of Medicine and Health Sciences, An-Najah National University, Nablus, Palestine.
| |
Collapse
|