1
|
Barnett SA, Griffiths TL, Hawkins RD. A Pragmatic Account of the Weak Evidence Effect. OPEN MIND 2022; 6:169-182. [DOI: 10.1162/opmi_a_00061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Accepted: 07/18/2022] [Indexed: 11/04/2022] Open
Abstract
Abstract
Language is not only used for neutral information; we often seek to persuade by arguing in favor of a particular view. Persuasion raises a number of challenges for classical accounts of belief updating, as information cannot be taken at face value. How should listeners account for a speaker’s “hidden agenda” when incorporating new information? Here, we extend recent probabilistic models of recursive social reasoning to allow for persuasive goals and show that our model provides a pragmatic account for why weakly favorable arguments may backfire, a phenomenon known as the weak evidence effect. Critically, this model predicts a systematic relationship between belief updates and expectations about the information source: weak evidence should only backfire when speakers are expected to act under persuasive goals and prefer the strongest evidence. We introduce a simple experimental paradigm called the Stick Contest to measure the extent to which the weak evidence effect depends on speaker expectations, and show that a pragmatic listener model accounts for the empirical data better than alternative models. Our findings suggest further avenues for rational models of social reasoning to illuminate classical decision-making phenomena.
Collapse
Affiliation(s)
- Samuel A. Barnett
- Department of Computer Science, Princeton University, Princeton, New Jersey
| | - Thomas L. Griffiths
- Department of Computer Science, Princeton University, Princeton, New Jersey
- Department of Psychology, Princeton University, Princeton, New Jersey
| | - Robert D. Hawkins
- Department of Psychology, Princeton University, Princeton, New Jersey
| |
Collapse
|
2
|
Meder B, Mayrhofer R, Ruggeri A. Developmental Trajectories in the Understanding of Everyday Uncertainty Terms. Top Cogn Sci 2022; 14:258-281. [PMID: 34291870 DOI: 10.1111/tops.12564] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Revised: 06/23/2021] [Accepted: 06/25/2021] [Indexed: 11/28/2022]
Abstract
Dealing with uncertainty and different degrees of frequency and probability is critical in many everyday activities. However, relevant information does not always come in the form of numerical estimates or direct experiences, but is instead obtained through qualitative, rather vague verbal terms (e.g., "the virus often causes coughing" or "the train is likely to be delayed"). Investigating how people interpret and utilize different natural language expressions of frequency and probability is therefore crucial to understand reasoning and behavior in real-world situations. While there is considerable work exploring how adults understand everyday uncertainty phrases, very little is known about how children interpret them and how their understanding develops with age. We take a developmental and computational perspective to address this issue and examine how 4- to 14-year-old children and adults interpret different terms. Each participant provided numerical estimates for 14 expressions, comprising both frequency and probability phrases. In total we obtained 2856 quantitative judgments, including 2240 judgments from children. Our findings demonstrate that adult-like intuitions about the interpretation of everyday uncertainty terms emerge fairly early in development, with the quantitative estimates of children converging to those of adults from around 9 years on. We also demonstrate how the vagueness of verbal terms can be represented through probability distributions, which provides additional leverage for tracking developmental shifts through cognitive modeling techniques. Taken together, our findings provide key insights into the developmental trajectories underlying the understanding of everyday uncertainty terms, and open up novel methodological pathways to formally model the vagueness of probability and frequency phrases, which are abundant in our everyday life and activities.
Collapse
Affiliation(s)
- Björn Meder
- Department of Health, Health and Medical University Potsdam
- MPRG iSearch, Max Planck Institute for Human Development
| | | | - Azzurra Ruggeri
- MPRG iSearch, Max Planck Institute for Human Development
- School of Education, Technical University Munich
| |
Collapse
|
3
|
Hahn U. Argument Quality in Real World Argumentation. Trends Cogn Sci 2020; 24:363-374. [PMID: 32298622 DOI: 10.1016/j.tics.2020.01.004] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2019] [Revised: 01/13/2020] [Accepted: 01/17/2020] [Indexed: 10/24/2022]
Abstract
The idea of resolving dispute through the exchange of arguments and reasons has been central to society for millennia. We exchange arguments as a way of getting at the truth in contexts as diverse as science, the court room, and our everyday lives. In democracies, political decisions should be negotiated through argument, not deception, or even worse, brute force. If argument is to lead to the truth or to good decisions, then some arguments must be better than others and 'argument strength' must have some meaningful connection with truth. Can argument strength be measured in a way that tracks an objective relationship with truth and not just mere persuasiveness? This article describes recent developments in providing such measures.
Collapse
Affiliation(s)
- Ulrike Hahn
- Department of Psychological Sciences, Birkbeck College, University of London, London, UK.
| |
Collapse
|
4
|
Gierth L, Bromme R. Beware of vested interests: Epistemic vigilance improves reasoning about scientific evidence (for some people). PLoS One 2020; 15:e0231387. [PMID: 32294109 PMCID: PMC7159212 DOI: 10.1371/journal.pone.0231387] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2019] [Accepted: 03/23/2020] [Indexed: 11/19/2022] Open
Abstract
In public disputes, stakeholders sometimes misrepresent statistics or other types of scientific evidence to support their claims. One of the reasons this is problematic is that citizens often do not have the motivation nor the cognitive skills to accurately judge the meaning of statistics and thus run the risk of being misinformed. This study reports an experiment investigating the conditions under which people become vigilant towards a source’s claim and thus reason more carefully about the supporting evidence. For this, participants were presented with a claim by a vested-interest or a neutral source and with statistical evidence which was cited by the source as being in support of the claim. However, this statistical evidence actually contradicted the source’s claim but was presented as a contingency table, which are typically difficult for people to interpret correctly. When the source was a lobbyist arguing for his company’s product people were better at interpreting the evidence compared to when the same source argued against the product. This was not the case for a different vested-interests source nor for the neutral source. Further, while all sources were rated as less trustworthy when participants realized that the source had misrepresented the evidence, only for the lobbyist source was this seen as a deliberate attempt at deception. Implications for research on epistemic trust, source credibility effects and science communication are discussed.
Collapse
Affiliation(s)
- Lukas Gierth
- Institute of Psychology, University of Münster, Münster, North Rhine-Westphalia, Germany
- * E-mail:
| | - Rainer Bromme
- Institute of Psychology, University of Münster, Münster, North Rhine-Westphalia, Germany
| |
Collapse
|
5
|
Abstract
The psychology of verbal reasoning initially compared performance with classical logic. In the last 25 years, a new paradigm has arisen, which focuses on knowledge-rich reasoning for communication and persuasion and is typically modeled using Bayesian probability theory rather than logic. This paradigm provides a new perspective on argumentation, explaining the rational persuasiveness of arguments that are logical fallacies. It also helps explain how and why people stray from logic when given deductive reasoning tasks. What appear to be erroneous responses, when compared against logic, often turn out to be rationally justified when seen in the richer rational framework of the new paradigm. Moreover, the same approach extends naturally to inductive reasoning tasks, in which people extrapolate beyond the data they are given and logic does not readily apply. We outline links between social and individual reasoning and set recent developments in the psychology of reasoning in the wider context of Bayesian cognitive science.
Collapse
Affiliation(s)
- Mike Oaksford
- Department of Psychological Sciences, Birkbeck, University of London, London WC1E 7HX, United Kingdom
| | - Nick Chater
- Nick Chater, Warwick Business School, University of Warwick, Coventry CV4 7AL, United Kingdom
| |
Collapse
|
6
|
Ecker UK, Lewandowsky S, Jayawardana K, Mladenovic A. Refutations of Equivocal Claims: No Evidence for an Ironic Effect of Counterargument Number. JOURNAL OF APPLIED RESEARCH IN MEMORY AND COGNITION 2019. [DOI: 10.1016/j.jarmac.2018.07.005] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
7
|
Collins PJ, Hahn U, von Gerber Y, Olsson EJ. The Bi-directional Relationship between Source Characteristics and Message Content. Front Psychol 2018; 9:18. [PMID: 29441029 PMCID: PMC5797680 DOI: 10.3389/fpsyg.2018.00018] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2017] [Accepted: 01/08/2018] [Indexed: 11/25/2022] Open
Abstract
Much of what we believe we know, we know through the testimony of others (Coady, 1992). While there has been long-standing evidence that people are sensitive to the characteristics of the sources of testimony, for example in the context of persuasion, researchers have only recently begun to explore the wider implications of source reliability considerations for the nature of our beliefs. Likewise, much remains to be established concerning what factors influence source reliability. In this paper, we examine, both theoretically and empirically, the implications of using message content as a cue to source reliability. We present a set of experiments examining the relationship between source information and message content in people's responses to simple communications. The results show that people spontaneously revise their beliefs in the reliability of the source on the basis of the expectedness of a source's claim and, conversely, adjust message impact by perceived reliability; hence source reliability and message content have a bi-directional relationship. The implications are discussed for a variety of psychological, philosophical and political issues such as belief polarization and dual-route models of persuasion.
Collapse
Affiliation(s)
- Peter J Collins
- Reasoning and Argumentation Lab, Department of Psychological Sciences, Birkbeck University of London, London, United Kingdom
| | - Ulrike Hahn
- Reasoning and Argumentation Lab, Department of Psychological Sciences, Birkbeck University of London, London, United Kingdom
| | | | - Erik J Olsson
- Department of Philosophy, Lund University, Lund, Sweden
| |
Collapse
|
8
|
|
9
|
Hsu AS, Horng A, Griffiths TL, Chater N. When Absence of Evidence Is Evidence of Absence: Rational Inferences From Absent Data. Cogn Sci 2016; 41 Suppl 5:1155-1167. [DOI: 10.1111/cogs.12356] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2015] [Revised: 10/30/2015] [Accepted: 12/07/2015] [Indexed: 11/26/2022]
Affiliation(s)
- Anne S. Hsu
- School of Electronic Engineering and Computer Science; Queen Mary; University of London
| | - Andy Horng
- Department of Psychology; University of California
| | | | - Nick Chater
- Warwick Business School; University of Warwick
| |
Collapse
|
10
|
An advantage of appearing mean or lazy: Amplified impressions of competence or warmth after mixed descriptions. JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY 2016. [DOI: 10.1016/j.jesp.2015.09.004] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
11
|
Harris AJL, Hahn U, Madsen JK, Hsu AS. The Appeal to Expert Opinion: Quantitative Support for a Bayesian Network Approach. Cogn Sci 2015; 40:1496-533. [DOI: 10.1111/cogs.12276] [Citation(s) in RCA: 42] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2014] [Revised: 04/01/2015] [Accepted: 04/13/2015] [Indexed: 11/30/2022]
Affiliation(s)
| | - Ulrike Hahn
- Department of Psychological Science; Birkbeck College; London
| | - Jens K. Madsen
- Department of Psychological Science; Birkbeck College; London
| | - Anne S. Hsu
- School of Electronic Engineering and Computer Science; Queen Mary University; London
| |
Collapse
|
12
|
On the interpretation of likelihood ratios in forensic science evidence: Presentation formats and the weak evidence effect. Forensic Sci Int 2014; 240:61-8. [DOI: 10.1016/j.forsciint.2014.04.005] [Citation(s) in RCA: 48] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2013] [Revised: 03/28/2014] [Accepted: 04/01/2014] [Indexed: 11/23/2022]
|