Normalization of Deviation: Quotation Error in Human Factors

Objective The objective of this paper is to examine quotation error in human factors. Background Science progresses through building on the work of previous research. This requires accurate quotation. Quotation error has a number of adverse consequences: loss of credibility, loss of confidence in the journal, and a flawed basis for academic debate and scientific progress. Quotation error has been observed in a number of domains, including marine biology and medicine, but there has been little or no previous study of this form of error in human factors, a domain that specializes in the causes and management of error. Methods A study was conducted examining quotation accuracy of 187 extracts from 118 published articles that cited a control article (Vaughan's 1996 book: The Challenger Launch Decision: Risky Technology, Culture, and Deviance at NASA). Results Of extracts studied, 12.8% ( n = 24) were classed as inaccurate, with 87.2% ( n = 163) being classed as accurate. A second dimension of agreement was examined with 96.3% ( n = 180) agreeing with the control article and only 3.7% ( n = 7) disagreeing. The categories of accuracy and agreement form a two by two matrix. Conclusion Rather than simply blaming individuals for quotation error, systemic factors should also be considered. Vaughan's theory, normalization of deviance, is one systemic theory that can account for quotation error. Application Quotation error is occurring in human factors and should receive more attention. According to Vaughan's theory, the normal everyday systems that promote scholarship may also allow mistakes, mishaps, and quotation error to occur.

History of Psychology Publish and Perish: Psychology's Most Prolific Authors Are Not Always the Ones We Remember

What is the relationship between being highly prolific in the realm of publication and being remembered as a great psychologist of the past? In this study, the PsycINFO database was used to identify the historical figures who wrote the most journal articles during the half-century from 1890 to 1939. Although a number of the 10 most prolific authors are widely remembered for their influence on the discipline today-E. L. Thorndike, Karl Pearson, E. B. Titchener, Henri Pi6ron-the majority are mostly forgotten. The data were also separated into the 5 distinct decades. Once again, a mixture of eminent and obscure individuals made appearances. Most striking, perhaps, was the great increase in articles published over the course of the half-century-approximately doubling each decade-and the enormous turnover in who was most prolific, decade over decade. In total, 100 distinct individuals appeared across just 5 lists of about 25 names each.

Applying an information literacy rubric to first-year health sciences student research posters

Objective

This article describes the collection and analysis of annotated bibliographies created by first-year health sciences students to support their final poster projects. The authors examined the students’ abilities to select relevant and authoritative sources, summarize the content of those sources, and correctly cite those sources.

Methods

We collected images of 1,253 posters, of which 120 were sampled for analysis, and scored the posters using a 4-point rubric to evaluate the students’ information literacy skills.

Results

We found that 52% of students were proficient at selecting relevant sources that directly contributed to the themes, topics, or debates presented in their final poster projects, and 64% of students did well with selecting authoritative peer-reviewed scholarly sources related to their topics. However, 45% of students showed difficulty in correctly applying American Psychological Association (APA) citation style.

Conclusion

Our findings demonstrate a need for instructors and librarians to provide strategies for reading and comprehending scholarly articles in addition to properly using APA citation style.

Accuracy of cited "facts" in medical research articles: A review of study methodology and recalculation of quotation error rate

Previous reviews estimated that approximately 20 to 25% of assertions cited from original research articles, or "facts," are inaccurately quoted in the medical literature. These reviews noted that the original studies were dissimilar and only began to compare the methods of the original studies. The aim of this review is to examine the methods of the original studies and provide a more specific rate of incorrectly cited assertions, or quotation errors, in original research articles published in medical journals. Additionally, the estimate of quotation errors calculated here is based on the ratio of quotation errors to quotations examined (a percent) rather than the more prevalent and weighted metric of quotation errors to the references selected. Overall, this resulted in a lower estimate of the quotation error rate in original medical research articles. A total of 15 studies met the criteria for inclusion in the primary quantitative analysis. Quotation errors were divided into two categories: content ("factual") or source (improper indirect citation) errors. Content errors were further subdivided into major and minor errors depending on the degree that the assertion differed from the original source. The rate of quotation errors recalculated here is 14.5% (10.5% to 18.6% at a 95% confidence interval). These content errors are predominantly, 64.8% (56.1% to 73.5% at a 95% confidence interval), major errors or cited assertions in which the referenced source either fails to substantiate, is unrelated to, or contradicts the assertion. Minor errors, which are an oversimplification, overgeneralization, or trivial inaccuracies, are 35.2% (26.5% to 43.9% at a 95% confidence interval). Additionally, improper secondary (or indirect) citations, which are distinguished from calculations of quotation accuracy, occur at a rate of 10.4% (3.4% to 17.5% at a 95% confidence interval).

Analysis of inter-country input-output table based on citation network: How to measure the competition and collaboration between industrial sectors on the global value chain

The input-output table is comprehensive and detailed in describing the national economic system with complex economic relationships, which embodies information of supply and demand among industrial sectors. This paper aims to scale the degree of competition/collaboration on the global value chain from the perspective of econophysics. Global Industrial Strongest Relevant Network models were established by extracting the strongest and most immediate industrial relevance in the global economic system with inter-country input-output tables and then transformed into Global Industrial Resource Competition Network/Global Industrial Production Collaboration Network models embodying the competitive/collaborative relationships based on bibliographic coupling/co-citation approach. Three indicators well suited for these two kinds of weighted and non-directed networks with self-loops were introduced, including unit weight for competitive/collaborative power, disparity in the weight for competitive/collaborative amplitude and weighted clustering coefficient for competitive/collaborative intensity. Finally, these models and indicators were further applied to empirically analyze the function of sectors in the latest World Input-Output Database, to reveal inter-sector competitive/collaborative status during the economic globalization.

A Categorical Content Analysis of Highly Cited Literature Related to Trends and Issues in Special Education

This investigation employs categorical content analysis processes as a mechanism to examine trends and issues in a sampling of highly cited (100+) literature in special education journals. The authors had two goals: (a) broadly identifying trends across publication type, content area, and methodology and (b) specifically identifying articles with disaggregated outcomes for students with learning disabilities (LD). Content analyses were conducted across highly cited (100+) articles published during a 20-year period (1992-2013) in a sample ( n = 3) of journals focused primarily on LD, and in one broad, cross-categorical journal recognized for its impact in the field. Results indicated trends in the article type (i.e., commentary and position papers), content (i.e., reading and behavior), and methodology (i.e., small proportions of experimental and quasi-experimental designs). Results also revealed stability in the proportion of intervention research studies when compared to previous analyses and a decline in the proportion of those that disaggregated data specifically for students with LD.

Nonpublication of trial results for new neurological drugs: A systematic review

OBJECTIVE

To evaluate nonpublication rates among trials of new successful and unsuccessful neurological drugs.

METHODS

"Licensed" drugs consisted of all novel agents receiving US Food and Drug Administration (FDA) licensure 2005-2012 inclusive in seven neurological disorders. "Stalled" drugs included all experimental agents tested in the same domains that had at least one completed phase III trial in the same time frame, but failed to receive FDA approval. Trials of these drugs were included in our sample if their primary outcome collection occurred before October 1, 2010. We determined the publication status of eligible trials using searches of clinicaltrials.gov, Google Scholar, PubMed, Embase, sponsor websites, and direct electronic query of trial contacts and sponsors. The primary outcome was time to journal publication (or results reporting in other media) after study completion.

RESULTS

The adjusted hazard ratio for publication was 1.79 (95% confidence interval, 1.20-2.67) in favor of licensed drugs. Based on the criteria for nonpublication in this report, 14,092 and 33,882 volunteers participated in unpublished trials of licensed and stalled neurological drugs, respectively. Result data were not publicly available in any form for 10% (16 of 163) and 46% (94 of 203) of trials of licensed and stalled drugs, respectively.

INTERPRETATION

Results of trials for stalled drugs are heavily under-reported. This deprives research and care communities of evidence about pathophysiology, drug class effects, and the value of surrogate endpoints in trials. Ann Neurol 2017;81:782-789.

Influence of autophagy on the genesis and development of atherosclerosis and its risk factors

Autophagy is a highly conservative process of degeneration during which intracellular components including soluble macromolecules (e. g., nucleic acids, proteins, carbohydrates and lipids) and dysfunctional organelles (e. g., mitochondria, peroxisomes, and the endoplasmatic reticulum) are degraded by a lysosome. Autophagy serves as a dynamic system of recycling proving cells with energy and building components. Because of it in cells of an organism new proteins and membranes can form contributing to survival of the individual under starvation conditions. Autophagy plays an important role in the genesis and development of multifactorial pathogenesis including atherosclerosis and its risk factors. The present article examines both a pathogenic and protective role of autophagy in such pathological processes. The article can be useful to molecular biologists and biochemists, as well as to professionals involved in the problems of atherosclerosis and cardiovascular diseases.

Leveraging Big Data for Exploring Occupational Diseases-Related Interest at the Level of Scientific Community, Media Coverage and Novel Data Streams: The Example of Silicosis as a Pilot Study

Objective

Silicosis is an untreatable but preventable occupational disease, caused by exposure to silica. It can progressively evolve to lung impairment, respiratory failure and death, even after exposure has ceased. However, little is known about occupational diseases-related interest at the level of scientific community, media coverage and web behavior. This article aims at filling in this gap of knowledge, taking the silicosis as a case study.

Methods

We investigated silicosis-related web-activities using Google Trends (GT) for capturing the Internet behavior worldwide in the years 2004–2015. GT-generated data were, then, compared with the silicosis-related scientific production (i.e., PubMed and Google Scholar), the media coverage (i.e., Google news), the Wikipedia traffic (i.e, Wikitrends) and the usage of new media (i.e., YouTube and Twitter).

Results

A peak in silicosis-related web searches was noticed in 2010–2011: interestingly, both scientific articles production and media coverage markedly increased after these years in a statistically significant way. The public interest and the level of the public engagement were witnessed by an increase in likes, comments, hashtags, and re-tweets. However, it was found that only a small fraction of the posted/uploaded material contained accurate scientific information.

Conclusions

GT could be useful to assess the reaction of the public and the level of public engagement both to novel risk-factors associated to occupational diseases, and possibly related changes in disease natural history, and to the effectiveness of preventive workplace practices and legislative measures adopted to improve occupational health. Further, occupational clinicians should become aware of the topics most frequently searched by patients and proactively address these concerns during the medical examination. Institutional bodies and organisms should be more present and active in digital tools and media to disseminate and communicate scientifically accurate information. This manuscript should be intended as preliminary, exploratory communication, paving the way for further studies.

Perception Bibliography: XVII. Psychological Index No. 13, 1906

74 items from this volume are relevant to perceptual problems.

Visual Apparent Movement Research: Review, 1935–1955, and Bibliography, 1955–1963

Publications from 1935 to 1955 on visual apparent movement are compiled, described and broadly classified by content to facilitate reference search. Since understanding of the basic processes in visual real movement is regarded as essential to the explanation of apparent movement, critical evaluation is minimal and studies of real movement are cited where pertinent. A supplementary appendix provides references covering the period of 1955 to 1963 organized to correspond with text sections that describe the earlier work.

Enhance the Value of a Research Paper: Choosing the Right References and Writing them Accurately

References help readers identify and locate sources used for justifying the need for conducting the research study, verify methods employed in the study and for discussing the interpretation of results and implications of the study. It is extremely essential that references are accurate and complete. This article provides suggestions regarding choosing references and writing reference list. References are a list of sources that are selected by authors to represent the best documents concerning the research study.1 They constitute the foundation of any research paper. Although generally written towards the end of the article-writing process, they are nevertheless extremely important. They provide the context for the hypothesis and help justify the need for conducting the research study. Authors use references to inform readers about the techniques used for conducting the study and convince them about the appropriateness of methodology used. References help provide appropriate perspective in which the research findings should be seen and interpreted. This communication will discuss the purpose of citations, how to select quality sources for citing and the importance of accuracy while writing the reference list.

Preserving the Integrity of Citations and References by All Stakeholders of Science Communication

Citations to scholarly items are building bricks for multidisciplinary science communication. Citation analyses are currently influencing individual career advancement and ranking of academic and research institutions worldwide. This article overviews the involvement of scientific authors, reviewers, editors, publishers, indexers, and learned associations in the citing and referencing to preserve the integrity of science communication. Authors are responsible for thorough bibliographic searches to select relevant references for their articles, comprehend main points, and cite them in an ethical way. Reviewers and editors may perform additional searches and recommend missing essential references. Publishers, in turn, are in a position to instruct their authors over the citations and references, provide tools for validation of references, and open access to bibliographies. Publicly available reference lists bear important information about the novelty and relatedness of the scholarly items with the published literature. Few editorial associations have dealt with the issue of citations and properly managed references. As a prime example, the International Committee of Medical Journal Editors (ICMJE) issued in December 2014 an updated set of recommendations on the need for citing primary literature and avoiding unethical references, which are applicable to the global scientific community. With the exponential growth of literature and related references, it is critically important to define functions of all stakeholders of science communication in curbing the issue of irrational and unethical citations and thereby improve the quality and indexability of scholarly journals.