1
|
Stunt JJ, Broekstra DC, de Boer MR. Statistics in publishing: the (mis)use of the p-value (Part 2). J Hand Surg Eur Vol 2022; 47:1092-1095. [PMID: 35949185 DOI: 10.1177/17531934221115968] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Affiliation(s)
- Jonáh J Stunt
- Department of Health Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Dieuwke C Broekstra
- Department of Plastic Surgery, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Michiel R de Boer
- Department of General Practice and Elderly Care Medicine, University Medical Center, Groningen, University of Groningen, Groningen, The Netherlands
| |
Collapse
|
2
|
Abstract
Null hypothesis significance testing is a commonly used tool for making statistical inferences in empirical studies, but its use has always been controversial. In this manuscript, I argue that even more problematic is that significance testing, and other abstract statistical benchmarks, often are used as tools for interpreting study data. This is problematic because interpreting data requires domain knowledge of the scientific topic and sensitivity to the study context, something that significance testing and other purely statistical approaches are not. By using simple examples, I demonstrate that researchers must first use their domain knowledge—professional expertise, clinical experience, practical insight—to interpret the data in their study and then use inferential statistics to provide some reasonable estimates about what can be generalized from the study data. Moving beyond the current focus on abstract statistical benchmarks will encourage researchers to measure their phenomena in more meaningful ways, transparently convey their data, and communicate their intellectual reasons for interpreting the data as they do, a shift that will better foster a scientific forum for cumulative science.
Collapse
|
3
|
Zhang W, Yan S, Tian B, Fei D. Statistical Assumptions and Reproducibility in Psychology: Data Mining Based on Open Science. Front Psychol 2022; 13:905977. [PMID: 35712145 PMCID: PMC9196269 DOI: 10.3389/fpsyg.2022.905977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Accepted: 04/27/2022] [Indexed: 11/25/2022] Open
Abstract
The failures of reproducibility in psychology (or other social sciences) can be investigated by tracing their logical chains, from statistical hypothesis to their conclusion. This research starts with the normality hypothesis, the homoscedasticity hypothesis, and the robust hypothesis and uses the R language to simulate and analyze the original data of 100 studies in Estimating the Reproducibility of Psychological Science to explore the influence of the premise hypothesis on statistical methods on the reproducibility of psychological research. The results indicated the following: (1) the answer to the question about psychological studies being repeatable or not relates to the fields to which the subjects belonged, (2) not all the psychological variables meet the normal distribution hypothesis, (3) the t-test is a more robust tool for psychological research than the Analysis of Variance (ANOVA), and (4) the robustness of ANOVA is independent of the normality and variance congruence of the analyzed data. This study made us realize that the repeatable study factors in psychology are more complex than we expected them to be.
Collapse
Affiliation(s)
- Wenqing Zhang
- Department of Psychology, Wuhan University, Wuhan, China
| | - Shu Yan
- Department of Psychology, Wuhan University, Wuhan, China
| | - Bo Tian
- Department of Psychology, Wuhan University, Wuhan, China
| | - Dingzhou Fei
- Department of Psychology, Wuhan University, Wuhan, China
| |
Collapse
|
4
|
Trafimow D, Osman M. Barriers to Converting Applied Social Psychology to Bettering the Human Condition. BASIC AND APPLIED SOCIAL PSYCHOLOGY 2022. [DOI: 10.1080/01973533.2022.2051327] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023]
|
5
|
Trafimow D. The power of directional predictions in psychology. JOURNAL FOR THE THEORY OF SOCIAL BEHAVIOUR 2022. [DOI: 10.1111/jtsb.12343] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Affiliation(s)
- David Trafimow
- Department of Psychology New Mexico State University Las Cruces New Mexico USA
| |
Collapse
|
6
|
Quatto P, Ripamonti E, Marasini D. Beyond p < .05: a critical review of new Bayesian proposals for assessing the p-value. J Biopharm Stat 2022; 32:308-329. [PMID: 35245154 DOI: 10.1080/10543406.2021.2009497] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
This paper reviews recent contributions from a Bayesian-oriented perspective, after the ASA statement on p-values (2016). We classify proposals that (i) supplement the p-value; (ii) modify the p-value itself. In the first group, we review the Bayes factor, the False Positive risk, the rejection odds and the analysis of credibility from both Matthews' and Held's point of view. We also put forth and discuss a new index of credibility, about which we conduct a delimited simulation study. In the second group, we discuss Gannon's modification of the p-value based on the Bayes factor and the second-generation p-value. The theory is illustrated with two case studies on pharmacotherapy in infectious diseases. Contemporary authors still refer to the p-value as a statistical indicator but have abandoned the perspective of evaluating p-values with fixed thresholds. Statistical societies worldwide should target new strategies to disseminate the debate on p-values in all applied fields of knowledge, as well as they may promote the use of different statistical procedures to supplement p-values.
Collapse
Affiliation(s)
- Piero Quatto
- Department of Economics, Management and Statistics, Statistical Section, University of Milan-Bicocca, Milan, Italy.,Milan Center of Neuroscience, University of Milan-Bicocca, Milan, Italy
| | - Enrico Ripamonti
- Milan Center of Neuroscience, University of Milan-Bicocca, Milan, Italy.,Department of Economics and Management, University of Brescia, Brescia, Italy
| | - Donata Marasini
- Department of Economics, Management and Statistics, Statistical Section, University of Milan-Bicocca, Milan, Italy
| |
Collapse
|
7
|
Fraune MR, Leite I, Karatas N, Amirova A, Legeleux A, Sandygulova A, Neerincx A, Dilip Tikas G, Gunes H, Mohan M, Abbasi NI, Shenoy S, Scassellati B, de Visser EJ, Komatsu T. Lessons Learned About Designing and Conducting Studies From HRI Experts. Front Robot AI 2022; 8:772141. [PMID: 35155588 PMCID: PMC8832512 DOI: 10.3389/frobt.2021.772141] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Accepted: 11/18/2021] [Indexed: 01/04/2023] Open
Abstract
The field of human-robot interaction (HRI) research is multidisciplinary and requires researchers to understand diverse fields including computer science, engineering, informatics, philosophy, psychology, and more disciplines. However, it is hard to be an expert in everything. To help HRI researchers develop methodological skills, especially in areas that are relatively new to them, we conducted a virtual workshop, Workshop Your Study Design (WYSD), at the 2021 International Conference on HRI. In this workshop, we grouped participants with mentors, who are experts in areas like real-world studies, empirical lab studies, questionnaire design, interview, participatory design, and statistics. During and after the workshop, participants discussed their proposed study methods, obtained feedback, and improved their work accordingly. In this paper, we present 1) Workshop attendees’ feedback about the workshop and 2) Lessons that the participants learned during their discussions with mentors. Participants’ responses about the workshop were positive, and future scholars who wish to run such a workshop can consider implementing their suggestions. The main contribution of this paper is the lessons learned section, where the workshop participants contributed to forming this section based on what participants discovered during the workshop. We organize lessons learned into themes of 1) Improving study design for HRI, 2) How to work with participants - especially children -, 3) Making the most of the study and robot’s limitations, and 4) How to collaborate well across fields as they were the areas of the papers submitted to the workshop. These themes include practical tips and guidelines to assist researchers to learn about fields of HRI research with which they have limited experience. We include specific examples, and researchers can adapt the tips and guidelines to their own areas to avoid some common mistakes and pitfalls in their research.
Collapse
Affiliation(s)
- Marlena R. Fraune
- Intergroup Human-Robot Interaction (iHRI) Lab, Department of Psychology, New Mexico State University, Las Cruces, NM, United States
- *Correspondence: Marlena R. Fraune,
| | - Iolanda Leite
- Division of Robotics, Perception, and Learning (RPL), School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, Stockholm, Sweden
| | - Nihan Karatas
- Human-Machine Interaction (HMI) and Human Characteristics Research Division, Institutes of Innovation for Future Society, Nagoya University, Nagoya, Japan
| | - Aida Amirova
- Department of Robotics and Mechatronics, School of Engineering and Digital Sciences, Nazarbayev University, Nur-Sultan, Kazakhstan
| | - Amélie Legeleux
- Lab-STICC, University of South Brittany, CNRS UMR 6285, Brest, France
| | - Anara Sandygulova
- Department of Robotics and Mechatronics, School of Engineering and Digital Sciences, Nazarbayev University, Nur-Sultan, Kazakhstan
| | - Anouk Neerincx
- Lab-STICC, University of South Brittany, CNRS UMR 6285, Brest, France
| | - Gaurav Dilip Tikas
- Strategy, Innovation and Entrepreneurship Area, Institute of Management Technology, Ghaziabad, India
| | - Hatice Gunes
- Affective Intelligence and Robotics Lab, Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom
| | - Mayumi Mohan
- Haptic Intelligence Department, Max Planck Institute for Intelligent Systems, Stuttgart, Germany
| | - Nida Itrat Abbasi
- Affective Intelligence and Robotics Lab, Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom
| | - Sudhir Shenoy
- Human-AI Technology Lab, Computer Engineering Program, University of Virginia, Charlottesville, VA, United States
| | - Brian Scassellati
- Social Robotics Lab, Department of Computer Science, Yale University, New Haven, CT, United States
| | - Ewart J. de Visser
- Warfighter Effectiveness Research Center, U.S. Air Force Academy, Colorado Springs, CO, United States
| | - Takanori Komatsu
- Department of Frontier Media Science, School of Interdisciplinary Mathematical Science, Meiji University, Tokyo, Japan
| |
Collapse
|
8
|
Friedel JE, Cox A, Galizio A, Swisher M, Small ML, Perez S. Monte Carlo Analyses for Single-Case Experimental Designs: An Untapped Resource for Applied Behavioral Researchers and Practitioners. Perspect Behav Sci 2021; 45:209-237. [DOI: 10.1007/s40614-021-00318-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/01/2021] [Indexed: 11/29/2022] Open
|
9
|
Moving to a world beyond p-value < 0.05: a guide for business researchers. REVIEW OF MANAGERIAL SCIENCE 2021. [DOI: 10.1007/s11846-021-00504-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
10
|
Technical Analysis of Tourism Price Process in the Eurozone. JOURNAL OF RISK AND FINANCIAL MANAGEMENT 2021. [DOI: 10.3390/jrfm14110517] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
This study is a specific contribution to investigating normalities in prices to a well-established cointegrated vector autoregressive model (VAR). While the role of prices in computational economics has been investigated, the real prices vis-à-vis nominal prices in the decision process has been neglected. The paper investigates the transition from nominal to real time-series of prices without losing information in the data set when deflating or de-seasonalizing. The likelihood approach is based on careful specifications of the (co)integration characteristics of tourism prices. The results confirm that the transmission of tourism prices in the Eurozone positively impacts Slovenian tourism prices when the spatial consolidated cointegrated VAR model is used. The theoretical-conceptual and empirical contribution is twofold: first, the study develops and empirically applies bona fide divisor of normality consolidation for time-series in levels instead of routinely utilised inflation integers, and second, the study introduces perfection of prices on a long-run time-series treatment.
Collapse
|
11
|
Stunt J, van Grootel L, Bouter L, Trafimow D, Hoekstra T, de Boer M. Why we habitually engage in null-hypothesis significance testing: A qualitative study. PLoS One 2021; 16:e0258330. [PMID: 34653185 PMCID: PMC8519469 DOI: 10.1371/journal.pone.0258330] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2020] [Accepted: 09/24/2021] [Indexed: 11/28/2022] Open
Abstract
Background Null Hypothesis Significance Testing (NHST) is the most familiar statistical procedure for making inferences about population effects. Important problems associated with this method have been addressed and various alternatives that overcome these problems have been developed. Despite its many well-documented drawbacks, NHST remains the prevailing method for drawing conclusions from data. Reasons for this have been insufficiently investigated. Therefore, the aim of our study was to explore the perceived barriers and facilitators related to the use of NHST and alternative statistical procedures among relevant stakeholders in the scientific system. Methods Individual semi-structured interviews and focus groups were conducted with junior and senior researchers, lecturers in statistics, editors of scientific journals and program leaders of funding agencies. During the focus groups, important themes that emerged from the interviews were discussed. Data analysis was performed using the constant comparison method, allowing emerging (sub)themes to be fully explored. A theory substantiating the prevailing use of NHST was developed based on the main themes and subthemes we identified. Results Twenty-nine interviews and six focus groups were conducted. Several interrelated facilitators and barriers associated with the use of NHST and alternative statistical procedures were identified. These factors were subsumed under three main themes: the scientific climate, scientific duty, and reactivity. As a result of the factors, most participants feel dependent in their actions upon others, have become reactive, and await action and initiatives from others. This may explain why NHST is still the standard and ubiquitously used by almost everyone involved. Conclusion Our findings demonstrate how perceived barriers to shift away from NHST set a high threshold for actual behavioral change and create a circle of interdependency between stakeholders. By taking small steps it should be possible to decrease the scientific community’s strong dependence on NHST and p-values.
Collapse
Affiliation(s)
- Jonah Stunt
- Department of Health Sciences, Section of Methodology and Applied Statistics, Vrije Universiteit, Amsterdam, The Netherlands
- Department of Radiation Oncology, Erasmus Medical Center, Rotterdam, The Netherlands
- * E-mail:
| | - Leonie van Grootel
- Department of Health Sciences, Section of Methodology and Applied Statistics, Vrije Universiteit, Amsterdam, The Netherlands
- Rathenau Institute, The Hague, The Netherlands
| | - Lex Bouter
- Department of Philosophy, Vrije Universiteit, Amsterdam, The Netherlands
- Department of Epidemiology and Data Science, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - David Trafimow
- Psychology Department, New Mexico State University, Las Cruces, New Mexico, United States of America
| | - Trynke Hoekstra
- Department of Health Sciences, Section of Methodology and Applied Statistics, Vrije Universiteit, Amsterdam, The Netherlands
| | - Michiel de Boer
- Department of Health Sciences, Section of Methodology and Applied Statistics, Vrije Universiteit, Amsterdam, The Netherlands
- Department of General Practice and Elderly Care, University Medical Center Groningen, Groningen, The Netherlands
| |
Collapse
|
12
|
Pearce L, Cooper J. Fostering COVID-19 Safe Behaviors Using Cognitive Dissonance. BASIC AND APPLIED SOCIAL PSYCHOLOGY 2021. [DOI: 10.1080/01973533.2021.1953497] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
13
|
Psychological Determinants of COVID-19 Vaccine Acceptance among Healthcare Workers in Kuwait: A Cross-Sectional Study Using the 5C and Vaccine Conspiracy Beliefs Scales. Vaccines (Basel) 2021; 9:vaccines9070701. [PMID: 34202298 PMCID: PMC8310287 DOI: 10.3390/vaccines9070701] [Citation(s) in RCA: 85] [Impact Index Per Article: 28.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Revised: 06/17/2021] [Accepted: 06/23/2021] [Indexed: 12/14/2022] Open
Abstract
Acceptance of coronavirus disease 2019 (COVID-19) vaccination appears as a decisive factor necessary to control the ongoing pandemic. Healthcare workers (HCWs) are among the highest risk groups for infection. The current study aimed to evaluate COVID-19 vaccine acceptance among HCWs in Kuwait, with identification of the psychological determinants of COVID-19 vaccine hesitancy. The study was conducted using an online anonymous survey distributed between 18 March 2021 and 29 March 2021. The sampling strategy was convenience-based depending on chain-referral sampling. Psychological determinants of COVID-19 vaccine acceptance were assessed using the 5C subscales and the Vaccine Conspiracy Beliefs Scale (VCBS). The total number of study participants was 1019, with the largest group being physicians (28.7%), pharmacists (20.2%), dentists (16.7%), and nurses (12.5%). The overall rate for COVID-19 vaccine acceptance was 83.3%, with 9.0% who were not willing to accept vaccination and 7.7% who were unsure. The highest rate for COVID-19 vaccine acceptance was seen among dentists (91.2%) and physicians (90.4%), while the lowest rate was seen among nurses (70.1%; p < 0.001). A higher level of COVID-19 vaccine hesitancy was found among females, participants with a lower educational level, and HCWs in the private sector. A preference for mRNA vaccine technology and Pfizer-BioNTech COVID-19 vaccine was found among the majority of participants (62.6% and 69.7%, respectively). COVID-19 vaccine hesitancy was significantly linked to the embrace of vaccine conspiracy beliefs. The highest 5C psychological predictors of COVID-19 vaccine acceptance were high levels of collective responsibility and confidence, and lower levels of constraints and calculation. The VCBS and 5C subscales (except the calculation subscale) showed acceptable levels of predicting COVID-19 vaccine acceptance based on receiver operating characteristic analyses. The participants who depended on social media platforms, TV programs, and news releases as their main sources of knowledge about COVID-19 vaccines showed higher rates of COVID-19 vaccine hesitancy. An overall satisfactory level of COVID-19 vaccine acceptance was seen among HCWs in Kuwait, which was among the highest rates reported globally. However; higher levels of vaccine hesitancy were observed among certain groups (females, nurses and laboratory workers, HCWs in the private sector), which should be targeted with more focused awareness programs. HCWs in Kuwait can play a central role in educating their patients and the general public about the benefits of COVID-19 vaccination to halt the spread of SARS-CoV-2, considering the high rates of vaccine hesitancy observed among the general public in Kuwait and the Middle East.
Collapse
|
14
|
Legate N, Weinstein N, Ryan RM. Ostracism in Real Life: Evidence That Ostracizing Others Has Costs, Even When It Feels Justified. BASIC AND APPLIED SOCIAL PSYCHOLOGY 2021. [DOI: 10.1080/01973533.2021.1927038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
15
|
Grice JW, Medellin E, Jones I, Horvath S, McDaniel H, O’lansen C, Baker M. Persons as Effect Sizes. ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE 2020. [DOI: 10.1177/2515245920922982] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Traditional indices of effect size are designed to answer questions about average group differences, associations between variables, and relative risk. For many researchers, an additional, important question is, “How many people in my study behaved or responded in a manner consistent with theoretical expectation?” We show how the answer to this question can be computed and reported as a straightforward percentage for a wide variety of study designs. This percentage essentially treats persons as an effect size, and it can easily be understood by scientists, professionals, and laypersons alike. For instance, imagine that in addition to d or η2, a researcher reports that 80% of participants matched theoretical expectation. No statistical training is required to understand the basic meaning of this percentage. By analyzing recently published studies, we show how computing this percentage can reveal novel patterns within data that provide insights for extending and developing the theory under investigation.
Collapse
Affiliation(s)
| | | | - Ian Jones
- Department of Psychology, Oklahoma State University
| | | | | | | | - Meggie Baker
- Department of Psychology, Oklahoma State University
| |
Collapse
|
16
|
Iso-Ahola SE. Replication and the Establishment of Scientific Truth. Front Psychol 2020; 11:2183. [PMID: 33041887 PMCID: PMC7525033 DOI: 10.3389/fpsyg.2020.02183] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2020] [Accepted: 08/04/2020] [Indexed: 11/13/2022] Open
Abstract
The idea of replication is based on the premise that there are empirical regularities or universal laws to be replicated and verified, and the scientific method is adequate for doing it. Scientific truth, however, is not absolute but relative to time, context, and the method used. Time and context are inextricably intertwined in that time (e.g., Christmas Day vs. New Year's Day) creates different contexts for behaviors and contexts create different experiences of time, rendering psychological phenomena inherently variable. This means that internal and external conditions fluctuate and are different in a replication study vs. the original. Thus, a replication experiment is just another empirical investigation in an ongoing effort to establish scientific truth. Neither the original nor a replication is the final arbiter of whether or not something exists. Discovered patterns need not be permanent laws of human behavior proven by the pinpoint statistical verification through replication. To move forward, phenomenon replications are needed to investigate phenomena in different ways, forms, contexts, and times. Such investigations look at phenomena not just in terms the magnitude of their effects but also by their frequency, duration, and intensity in labs and real life. They will also shed light on the extent to which lab manipulations may make many phenomena subjectively conscious events and effects (e.g., causal attributions) when they are nonconsciously experienced in real life, or vice versa. As scientific knowledge in physics is temporary and incomplete, should it be any surprise that science can only provide "temporary winners" for psychological knowledge of human behavior?
Collapse
Affiliation(s)
- Seppo E. Iso-Ahola
- Department of Kinesiology, School of Public Health, University of Maryland, College Park, College Park, MD, United States
| |
Collapse
|
17
|
Trafimow D, Uhalt J. The inaccuracy of sample-based confidence intervals to estimate a priori ones. METHODOLOGY-EUROPEAN JOURNAL OF RESEARCH METHODS FOR THE BEHAVIORAL AND SOCIAL SCIENCES 2020. [DOI: 10.5964/meth.2807] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
Confidence intervals (CIs) constitute the most popular alternative to widely criticized null hypothesis significance tests. CIs provide more information than significance tests and lend themselves well to visual displays. Although CIs are no better than significance tests when used solely as significance tests, researchers need not limit themselves to this use of CIs. Rather, CIs can be used to estimate the precision of the data, and it is the precision argument that may set CIs in a superior position to significance tests. We tested two versions of the precision argument by performing computer simulations to test how well sample-based CIs estimate a priori CIs. One version pertains to precision of width whereas the other version pertains to precision of location. Using both versions, sample-based CIs poorly estimate a priori CIs at typical sample sizes and perform better as sample sizes increase.
Collapse
|
18
|
Jones EO, Huey SJ. Affirmation and Majority Students: Does Affirmation Impair Academic Performance in White Males? BASIC AND APPLIED SOCIAL PSYCHOLOGY 2020. [DOI: 10.1080/01973533.2020.1732389] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
19
|
Bayesian Estimation with Informative Priors is Indistinguishable from Data Falsification. SPANISH JOURNAL OF PSYCHOLOGY 2019; 22:E45. [PMID: 31640834 DOI: 10.1017/sjp.2019.41] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Criticism of null hypothesis significance testing, confidence intervals, and frequentist statistics in general has evolved into advocacy of Bayesian analyses with informative priors for strong inference. This paper shows that Bayesian analysis with informative priors is formally equivalent to data falsification because the information carried by the prior can be expressed as the addition of fabricated observations whose statistical characteristics are determined by the parameters of the prior. This property of informative priors makes clear that only the use of non-informative, uniform priors in all types of Bayesian analyses is compatible with standards of research integrity. At the same time, though, Bayesian estimation with uniform priors yields point and interval estimates that are identical or nearly identical to those obtained with frequentist methods. At a qualitative level, frequentist and Bayesian outcomes have different interpretations but they are interchangeable when uniform priors are used. Yet, Bayesian interpretations require either the assumption that population parameters are random variables (which they are not) or an explicit acknowledgment that the posterior distribution (which is thus identical to the likelihood function except for a scale factor) only expresses the researcher's beliefs and not any information about the parameter of concern.
Collapse
|
20
|
Cornwell JFM, Jago CP, Higgins ET. When Group Influence Is More or Less Likely: The Case of Moral Judgments. BASIC AND APPLIED SOCIAL PSYCHOLOGY 2019. [DOI: 10.1080/01973533.2019.1666394] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|