1
|
Le Denmat P, Verguts T, Desender K. A low-dimensional approximation of optimal confidence. PLoS Comput Biol 2024; 20:e1012273. [PMID: 39047032 PMCID: PMC11299811 DOI: 10.1371/journal.pcbi.1012273] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 08/05/2024] [Accepted: 06/24/2024] [Indexed: 07/27/2024] Open
Abstract
Human decision making is accompanied by a sense of confidence. According to Bayesian decision theory, confidence reflects the learned probability of making a correct response, given available data (e.g., accumulated stimulus evidence and response time). Although optimal, independently learning these probabilities for all possible data combinations is computationally intractable. Here, we describe a novel model of confidence implementing a low-dimensional approximation of this optimal yet intractable solution. This model allows efficient estimation of confidence, while at the same time accounting for idiosyncrasies, different kinds of biases and deviation from the optimal probability correct. Our model dissociates confidence biases resulting from the estimate of the reliability of evidence by individuals (captured by parameter α), from confidence biases resulting from general stimulus independent under and overconfidence (captured by parameter β). We provide empirical evidence that this model accurately fits both choice data (accuracy, response time) and trial-by-trial confidence ratings simultaneously. Finally, we test and empirically validate two novel predictions of the model, namely that 1) changes in confidence can be independent of performance and 2) selectively manipulating each parameter of our model leads to distinct patterns of confidence judgments. As a tractable and flexible account of the computation of confidence, our model offers a clear framework to interpret and further resolve different forms of confidence biases.
Collapse
Affiliation(s)
| | - Tom Verguts
- Department of Experimental Psychology, Ghent University, Ghent Belgium
| | | |
Collapse
|
2
|
Constant M, Pereira M, Faivre N, Filevich E. Prior information differentially affects discrimination decisions and subjective confidence reports. Nat Commun 2023; 14:5473. [PMID: 37673881 PMCID: PMC10482953 DOI: 10.1038/s41467-023-41112-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Accepted: 08/22/2023] [Indexed: 09/08/2023] Open
Abstract
According to Bayesian models, both decisions and confidence are based on the same precision-weighted integration of prior expectations ("priors") and incoming information ("likelihoods"). This assumes that priors are integrated optimally and equally in decisions and confidence, which has not been tested. In three experiments, we quantify how priors inform decisions and confidence. With a dual-decision task we create pairs of conditions that are matched in posterior information, but differ on whether the prior or likelihood is more informative. We find that priors are underweighted in discrimination decisions, but are less underweighted in confidence about those decisions, and this is not due to differences in processing time. The same patterns remain with exogenous probabilistic cues as priors. With a Bayesian model we quantify the weighting parameters for the prior at both levels, and find converging evidence that priors are more optimally used in explicit confidence, even when underused in decisions.
Collapse
Affiliation(s)
- Marika Constant
- Humboldt-Universität zu Berlin, Faculty of Life Sciences, Department of Psychology, Unter den Linden 6, 10099, Berlin, Germany.
- Bernstein Center for Computational Neuroscience Berlin, Philippstraße 13 Haus 6, 10115, Berlin, Germany.
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Luisenstraße 56, 10115, Berlin, Germany.
| | - Michael Pereira
- , Université Grenoble Alpes, Université Savoie Mont Blanc, CNRS, LPNC, 38000, Grenoble, France
| | - Nathan Faivre
- , Université Grenoble Alpes, Université Savoie Mont Blanc, CNRS, LPNC, 38000, Grenoble, France
| | - Elisa Filevich
- Humboldt-Universität zu Berlin, Faculty of Life Sciences, Department of Psychology, Unter den Linden 6, 10099, Berlin, Germany
- Bernstein Center for Computational Neuroscience Berlin, Philippstraße 13 Haus 6, 10115, Berlin, Germany
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Luisenstraße 56, 10115, Berlin, Germany
- Hector Institute for Education Sciences & Psychology, University of Tübingen, Europastraße 6, 72072, Tübingen, Germany
| |
Collapse
|
3
|
Samaha J, Denison R. The positive evidence bias in perceptual confidence is unlikely post-decisional. Neurosci Conscious 2022; 2022:niac010. [PMID: 35903409 PMCID: PMC9316228 DOI: 10.1093/nc/niac010] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2022] [Revised: 05/13/2022] [Accepted: 06/27/2022] [Indexed: 01/13/2023] Open
Abstract
Confidence in a perceptual decision is a subjective estimate of the accuracy of one’s choice. As such, confidence is thought to be an important computation for a variety of cognitive and perceptual processes, and it features heavily in theorizing about conscious access to perceptual states. Recent experiments have revealed a “positive evidence bias” (PEB) in the computations underlying confidence reports. A PEB occurs when confidence, unlike objective choice, overweights the evidence for the correct (or chosen) option, relative to evidence against the correct (or chosen) option. Accordingly, in a perceptual task, appropriate stimulus conditions can be arranged that produce selective changes in confidence reports but no changes in accuracy. Although the PEB is generally assumed to reflect the observer’s perceptual and/or decision processes, post-decisional accounts have not been ruled out. We therefore asked whether the PEB persisted under novel conditions that addressed two possible post-decisional accounts: (i) post-decision evidence accumulation that contributes to a confidence report solicited after the perceptual choice and (ii) a memory bias that emerges in the delay between the stimulus offset and the confidence report. We found that even when the stimulus remained on the screen until observers responded, and when observers reported their choice and confidence simultaneously, the PEB still emerged. Signal detection-based modeling showed that the PEB was not associated with changes to metacognitive efficiency, but rather to confidence criteria. The data show that memory biases cannot explain the PEB and provide evidence against a post-decision evidence accumulation account, bolstering the idea that the PEB is perceptual or decisional in nature.
Collapse
Affiliation(s)
- Jason Samaha
- Department of Psychology, University of California, 1156 High St, Santa Cruz, CA 95064, USA
| | - Rachel Denison
- Department of Psychological and Brain Sciences, Boston University, 64 Cummington Mall, Boston, MA 02215, USA
| |
Collapse
|
4
|
Constant M, Salomon R, Filevich E. Judgments of agency are affected by sensory noise without recruiting metacognitive processing. eLife 2022; 11:e72356. [PMID: 35049503 PMCID: PMC8820731 DOI: 10.7554/elife.72356] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Accepted: 01/19/2022] [Indexed: 11/16/2022] Open
Abstract
Acting in the world is accompanied by a sense of agency, or experience of control over our actions and their outcomes. As humans, we can report on this experience through judgments of agency. These judgments often occur under noisy conditions. We examined the computations underlying judgments of agency, in particular under the influence of sensory noise. Building on previous literature, we studied whether judgments of agency incorporate uncertainty in the same way that confidence judgments do, which would imply that the former share computational mechanisms with metacognitive judgments. In two tasks, participants rated agency, or confidence in a decision about their agency, over a virtual hand that tracked their movements, either synchronously or with a delay and either under high or low noise. We compared the predictions of two computational models to participants' ratings and found that agency ratings, unlike confidence, were best explained by a model involving no estimates of sensory noise. We propose that agency judgments reflect first-order measures of the internal signal, without involving metacognitive computations, challenging the assumed link between the two cognitive processes.
Collapse
Affiliation(s)
- Marika Constant
- Faculty of Life Sciences, Department of Psychology, Humboldt-Universität zu BerlinBerlinGermany
- Bernstein Center for Computational Neuroscience BerlinBerlinGermany
- Berlin School of Mind and Brain, Humboldt-Universität zu BerlinBerlinGermany
| | - Roy Salomon
- Gonda Multidisciplinary Brain Research Center, Bar-Ilan UniversityRamat-GanIsrael
| | - Elisa Filevich
- Faculty of Life Sciences, Department of Psychology, Humboldt-Universität zu BerlinBerlinGermany
- Bernstein Center for Computational Neuroscience BerlinBerlinGermany
- Berlin School of Mind and Brain, Humboldt-Universität zu BerlinBerlinGermany
| |
Collapse
|
5
|
Desender K, Donner TH, Verguts T. Dynamic expressions of confidence within an evidence accumulation framework. Cognition 2021; 207:104522. [DOI: 10.1016/j.cognition.2020.104522] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2020] [Revised: 11/09/2020] [Accepted: 11/17/2020] [Indexed: 10/22/2022]
|
6
|
Tsutsui-Kimura I, Matsumoto H, Akiti K, Yamada MM, Uchida N, Watabe-Uchida M. Distinct temporal difference error signals in dopamine axons in three regions of the striatum in a decision-making task. eLife 2020; 9:e62390. [PMID: 33345774 PMCID: PMC7771962 DOI: 10.7554/elife.62390] [Citation(s) in RCA: 52] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2020] [Accepted: 12/18/2020] [Indexed: 12/24/2022] Open
Abstract
Different regions of the striatum regulate different types of behavior. However, how dopamine signals differ across striatal regions and how dopamine regulates different behaviors remain unclear. Here, we compared dopamine axon activity in the ventral, dorsomedial, and dorsolateral striatum, while mice performed a perceptual and value-based decision task. Surprisingly, dopamine axon activity was similar across all three areas. At a glance, the activity multiplexed different variables such as stimulus-associated values, confidence, and reward feedback at different phases of the task. Our modeling demonstrates, however, that these modulations can be inclusively explained by moment-by-moment changes in the expected reward, that is the temporal difference error. A major difference between areas was the overall activity level of reward responses: reward responses in dorsolateral striatum were positively shifted, lacking inhibitory responses to negative prediction errors. The differences in dopamine signals put specific constraints on the properties of behaviors controlled by dopamine in these regions.
Collapse
Affiliation(s)
- Iku Tsutsui-Kimura
- Department of Molecular and Cellular Biology, Center for Brain Science, Harvard UniversityCambridgeUnited States
| | - Hideyuki Matsumoto
- Department of Molecular and Cellular Biology, Center for Brain Science, Harvard UniversityCambridgeUnited States
- Department of Physiology, Osaka City University Graduate School of MedicineOsakaJapan
| | - Korleki Akiti
- Department of Molecular and Cellular Biology, Center for Brain Science, Harvard UniversityCambridgeUnited States
| | - Melissa M Yamada
- Department of Molecular and Cellular Biology, Center for Brain Science, Harvard UniversityCambridgeUnited States
| | - Naoshige Uchida
- Department of Molecular and Cellular Biology, Center for Brain Science, Harvard UniversityCambridgeUnited States
| | - Mitsuko Watabe-Uchida
- Department of Molecular and Cellular Biology, Center for Brain Science, Harvard UniversityCambridgeUnited States
| |
Collapse
|
7
|
Rausch M, Zehetleitner M, Steinhauser M, Maier ME. Cognitive modelling reveals distinct electrophysiological markers of decision confidence and error monitoring. Neuroimage 2020; 218:116963. [DOI: 10.1016/j.neuroimage.2020.116963] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2020] [Revised: 05/05/2020] [Accepted: 05/14/2020] [Indexed: 12/29/2022] Open
|