1
|
Nguyen QN, Reinagel P. Different Forms of Variability Could Explain a Difference Between Human and Rat Decision Making. Front Neurosci 2022; 16:794681. [PMID: 35273473 PMCID: PMC8902138 DOI: 10.3389/fnins.2022.794681] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2021] [Accepted: 01/17/2022] [Indexed: 11/16/2022] Open
Abstract
When observers make rapid, difficult perceptual decisions, their response time is highly variable from trial to trial. In a visual motion discrimination task, it has been reported that human accuracy declines with increasing response time, whereas rat accuracy increases with response time. This is of interest because different mathematical theories of decision-making differ in their predictions regarding the correlation of accuracy with response time. On the premise that perceptual decision-making mechanisms are likely to be conserved among mammals, we seek to unify the rodent and primate results in a common theoretical framework. We show that a bounded drift diffusion model (DDM) can explain both effects with variable parameters: trial-to-trial variability in the starting point of the diffusion process produces the pattern typically observed in rats, whereas variability in the drift rate produces the pattern typically observed in humans. We further show that the same effects can be produced by deterministic biases, even in the absence of parameter stochasticity or parameter change within a trial.
Collapse
Affiliation(s)
| | - Pamela Reinagel
- Section of Neurobiology, Division of Biological Sciences, University of California, San Diego, San Diego, CA, United States
| |
Collapse
|
2
|
Seven steps toward more transparency in statistical practice. Nat Hum Behav 2021; 5:1473-1480. [PMID: 34764461 DOI: 10.1038/s41562-021-01211-8] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Accepted: 09/06/2021] [Indexed: 01/03/2023]
Abstract
We argue that statistical practice in the social and behavioural sciences benefits from transparency, a fair acknowledgement of uncertainty and openness to alternative interpretations. Here, to promote such a practice, we recommend seven concrete statistical procedures: (1) visualizing data; (2) quantifying inferential uncertainty; (3) assessing data preprocessing choices; (4) reporting multiple models; (5) involving multiple analysts; (6) interpreting results modestly; and (7) sharing data and code. We discuss their benefits and limitations, and provide guidelines for adoption. Each of the seven procedures finds inspiration in Merton's ethos of science as reflected in the norms of communalism, universalism, disinterestedness and organized scepticism. We believe that these ethical considerations-as well as their statistical consequences-establish common ground among data analysts, despite continuing disagreements about the foundations of statistical inference.
Collapse
|
3
|
Miletić S, Boag RJ, Trutti AC, Stevenson N, Forstmann BU, Heathcote A. A new model of decision processing in instrumental learning tasks. eLife 2021; 10:e63055. [PMID: 33501916 PMCID: PMC7880686 DOI: 10.7554/elife.63055] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2020] [Accepted: 01/26/2021] [Indexed: 01/12/2023] Open
Abstract
Learning and decision-making are interactive processes, yet cognitive modeling of error-driven learning and decision-making have largely evolved separately. Recently, evidence accumulation models (EAMs) of decision-making and reinforcement learning (RL) models of error-driven learning have been combined into joint RL-EAMs that can in principle address these interactions. However, we show that the most commonly used combination, based on the diffusion decision model (DDM) for binary choice, consistently fails to capture crucial aspects of response times observed during reinforcement learning. We propose a new RL-EAM based on an advantage racing diffusion (ARD) framework for choices among two or more options that not only addresses this problem but captures stimulus difficulty, speed-accuracy trade-off, and stimulus-response-mapping reversal effects. The RL-ARD avoids fundamental limitations imposed by the DDM on addressing effects of absolute values of choices, as well as extensions beyond binary choice, and provides a computationally tractable basis for wider applications.
Collapse
Affiliation(s)
- Steven Miletić
- University of Amsterdam, Department of PsychologyAmsterdamNetherlands
| | - Russell J Boag
- University of Amsterdam, Department of PsychologyAmsterdamNetherlands
| | - Anne C Trutti
- University of Amsterdam, Department of PsychologyAmsterdamNetherlands
- Leiden University, Department of PsychologyLeidenNetherlands
| | - Niek Stevenson
- University of Amsterdam, Department of PsychologyAmsterdamNetherlands
| | - Birte U Forstmann
- University of Amsterdam, Department of PsychologyAmsterdamNetherlands
| | - Andrew Heathcote
- University of Amsterdam, Department of PsychologyAmsterdamNetherlands
- University of Newcastle, School of PsychologyNewcastleAustralia
| |
Collapse
|
4
|
Kingma BRM, Roijendijk LMM, Van Maanen L, Van Rijn H, Van Beurden MHPH. Time perception and timed decision task performance during passive heat stress. Temperature (Austin) 2020; 8:53-63. [PMID: 33553505 PMCID: PMC7849768 DOI: 10.1080/23328940.2020.1776925] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
This study investigates the hypotheses that during passive heat stress, the change in perception of time and change in accuracy of a timed decision task relate to changes in thermophysiological variables gastrointestinal temperature and heart rate (HR), as well as subjective measures of cognitive load and thermal perception. Young adult males (N = 29) participated in two 60-min head-out water immersion conditions (36.5°C-neutral and 38.0°C-warm). Cognitive task measurements included accuracy (judgment task), response time (judgment ask), and time estimation (interval timing task). Physiological measurements included gastrointestinal temperature and heart rate. Subjective measurements included cognitive task load (NASA-TLX), rate of perceived exertion, thermal sensation, and thermal comfort. Gastrointestinal temperature and HR were significantly higher in warm versus neutral condition (gastrointestinal temperature: 38.4 ± 0.2°C vs. 37.2 ± 0.2°C, p < 0.01; HR: 105 ± 8 BPM vs. 83 ± 9 BPM, p < 0.01). The change in accuracy was significantly associated with the change in gastrointestinal temperature, and attenuated by change in thermal sensation and change in HR (r2=0.40, p< 0.01). Change in response time was significantly associated with the change in gastrointestinal temperature (r2=0.26, p< 0.002), and change in time estimation was best explained by a change in thermal discomfort (r2=0.18, p< 0.01). Changes in cognitive performance during passive thermal stress are significantly associated with changes in thermophysiological variables and thermal perception. Although explained variance is low (<50%), decreased accuracy is attributed to increased gastrointestinal temperature, yet is attenuated by increased arousal (expressed as increased HR and warmth thermal sensation).
Collapse
Affiliation(s)
- Boris R M Kingma
- Department of Training and Performance Innovations, TNO, Netherlands Organization for Applied Scientific Research, Unit Defense Safety and Security, Soesterberg, The Netherlands.,Department of Nutrition, Exercise and Sports, Section for Integrative Physiology, University of Copenhagen, Copenhagen N, Denmark.,Department of Energy Technology, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Linsey M M Roijendijk
- Department of Training and Performance Innovations, TNO, Netherlands Organization for Applied Scientific Research, Unit Defense Safety and Security, Soesterberg, The Netherlands
| | - Leendert Van Maanen
- Department of Experimental Psychology & Helmholtz Institute, Faculty of Social and Behavioral Sciences, Utrecht University, Utrecht, The Netherlands
| | - Hedderik Van Rijn
- Department of Psychology, University of Groningen, Groningen, The Netherlands
| | - Maurice H P H Van Beurden
- Department of Training and Performance Innovations, TNO, Netherlands Organization for Applied Scientific Research, Unit Defense Safety and Security, Soesterberg, The Netherlands
| |
Collapse
|
5
|
Decision urgency invigorates movement in humans. Behav Brain Res 2020; 382:112477. [DOI: 10.1016/j.bbr.2020.112477] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2019] [Revised: 01/08/2020] [Accepted: 01/08/2020] [Indexed: 11/18/2022]
|
6
|
Chandrasekaran C, Hawkins GE. ChaRTr: An R toolbox for modeling choices and response times in decision-making tasks. J Neurosci Methods 2019; 328:108432. [PMID: 31586868 PMCID: PMC6980795 DOI: 10.1016/j.jneumeth.2019.108432] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2019] [Revised: 08/01/2019] [Accepted: 09/07/2019] [Indexed: 11/25/2022]
Abstract
BACKGROUND Decision-making is the process of choosing and performing actions in response to sensory cues to achieve behavioral goals. Many mathematical models have been developed to describe the choice behavior and response time (RT) distributions of observers performing decision-making tasks. However, relatively few researchers use these models because it demands expertise in various numerical, statistical, and software techniques. NEW METHOD We present a toolbox - Choices and Response Times in R, or ChaRTr - that provides the user the ability to implement and test a wide variety of decision-making models ranging from classic through to modern versions of the diffusion decision model, to models with urgency signals, or collapsing boundaries. RESULTS In three different case studies, we demonstrate how ChaRTr can be used to effortlessly discriminate between multiple models of decision-making behavior. We also provide guidance on how to extend the toolbox to incorporate future developments in decision-making models. COMPARISON WITH EXISTING METHOD(S) Existing software packages surmounted some of the numerical issues but have often focused on the classical decision-making model, the diffusion decision model. Recent models that posit roles for urgency, time-varying decision thresholds, noise in various aspects of the decision-formation process or low pass filtering of sensory evidence have proven to be challenging to incorporate in a coherent software framework that permits quantitative evaluation among these competing classes of decision-making models. CONCLUSION ChaRTr can be used to make insightful statements about the cognitive processes underlying observed decision-making behavior and ultimately for deeper insights into decision mechanisms.
Collapse
Affiliation(s)
- Chandramouli Chandrasekaran
- Department of Psychological and Brain Sciences, Boston University, Boston, MA, USA; Department of Anatomy & Neurobiology, Boston University School of Medicine, Boston, MA, USA; Center for Systems Neuroscience, Boston University, Boston, MA, USA.
| | - Guy E Hawkins
- School of Psychology, University of Newcastle, Australia.
| |
Collapse
|
7
|
van Rijn H. Towards Ecologically Valid Interval Timing. Trends Cogn Sci 2019; 22:850-852. [PMID: 30266145 DOI: 10.1016/j.tics.2018.07.008] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2018] [Revised: 07/13/2018] [Accepted: 07/13/2018] [Indexed: 11/29/2022]
Abstract
Research on interval timing has provided significant insight into how intervals are perceived and produced in well-controlled laboratory settings. However, for timing theories to explain real-world performance, it is imperative that they provide better quantitative predictions and be applicable to timing tasks that are relevant in ecologically valid settings.
Collapse
Affiliation(s)
- Hedderik van Rijn
- Experimental Psychology, University of Groningen, Groningen, The Netherlands.
| |
Collapse
|
8
|
Abstract
A standard assumption of most sequential sampling models is that decision-makers rely on a decision criterion that remains constant throughout the decision process. However, several authors have recently suggested that, in order to maximize reward rates in dynamic environments, decision-makers need to rely on a decision criterion that changes over the course of the decision process. We used dynamic programming and simulation methods to quantify the reward rates obtained by constant and dynamic decision criteria in different environments. We further investigated what influence a decision-maker's uncertainty about the stochastic structure of the environment has on reward rates. Our results show that in most dynamic environments, both types of decision criteria yield similar reward rates, across different levels of uncertainty. This suggests that a static decision criterion might provide a robust default setting.
Collapse
|
9
|
van Maanen L, van der Mijn R, van Beurden MHPH, Roijendijk LMM, Kingma BRM, Miletić S, van Rijn H. Core body temperature speeds up temporal processing and choice behavior under deadlines. Sci Rep 2019; 9:10053. [PMID: 31296893 PMCID: PMC6624282 DOI: 10.1038/s41598-019-46073-3] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2019] [Accepted: 06/17/2019] [Indexed: 12/31/2022] Open
Abstract
Evidence suggests that human timing ability is compromised by heat. In particular, some studies suggest that increasing body temperature speeds up an internal clock, resulting in faster time perception. However, the consequences of this speed-up for other cognitive processes remain unknown. In the current study, we rigorously tested the speed-up hypothesis by inducing passive hyperthermia through immersion of participants in warm water. In addition, we tested how a change in time perception affects performance in decision making under deadline stress. We found that participants underestimate a prelearned temporal interval when body temperature increases, and that their performance in a two-alternative forced-choice task displays signatures of increased time pressure. These results show not only that timing plays an important role in decision-making, but also that this relationship is mediated by temperature. The consequences for decision-making in job environments that are demanding due to changes in body temperature may be considerable.
Collapse
Affiliation(s)
- Leendert van Maanen
- Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands.
| | | | - Maurice H P H van Beurden
- Netherlands Organization for Applied Scientific Research, Unit Defense Safety and Security, Department of Training and Performance Innovations, Soesterberg, The Netherlands
| | - Linsey M M Roijendijk
- Netherlands Organization for Applied Scientific Research, Unit Defense Safety and Security, Department of Training and Performance Innovations, Soesterberg, The Netherlands
| | - Boris R M Kingma
- Netherlands Organization for Applied Scientific Research, Unit Defense Safety and Security, Department of Training and Performance Innovations, Soesterberg, The Netherlands
| | - Steven Miletić
- Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands
| | - Hedderik van Rijn
- Department of Psychology, University of Groningen, Groningen, The Netherlands.
| |
Collapse
|
10
|
Miletić S, van Maanen L. Caution in decision-making under time pressure is mediated by timing ability. Cogn Psychol 2019; 110:16-29. [DOI: 10.1016/j.cogpsych.2019.01.002] [Citation(s) in RCA: 23] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2018] [Revised: 11/21/2018] [Accepted: 01/23/2019] [Indexed: 12/22/2022]
|
11
|
Affiliation(s)
- Joshua I. Gold
- Department of Neuroscience, University of Pennsylvania, Philadelphia, Pennsylvania 19104
| | - Alan A. Stocker
- Department of Psychology, University of Pennsylvania, Philadelphia, Pennsylvania 19104
| |
Collapse
|
12
|
|
13
|
Perceptual Decision Making in Rodents, Monkeys, and Humans. Neuron 2017; 93:15-31. [DOI: 10.1016/j.neuron.2016.12.003] [Citation(s) in RCA: 198] [Impact Index Per Article: 28.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2016] [Revised: 11/28/2016] [Accepted: 12/01/2016] [Indexed: 11/23/2022]
|
14
|
Murphy PR, Boonstra E, Nieuwenhuis S. Global gain modulation generates time-dependent urgency during perceptual choice in humans. Nat Commun 2016; 7:13526. [PMID: 27882927 PMCID: PMC5123079 DOI: 10.1038/ncomms13526] [Citation(s) in RCA: 93] [Impact Index Per Article: 11.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2016] [Accepted: 10/12/2016] [Indexed: 12/20/2022] Open
Abstract
Decision-makers must often balance the desire to accumulate information with the costs of protracted deliberation. Optimal, reward-maximizing decision-making can require dynamic adjustment of this speed/accuracy trade-off over the course of a single decision. However, it is unclear whether humans are capable of such time-dependent adjustments. Here, we identify several signatures of time-dependency in human perceptual decision-making and highlight their possible neural source. Behavioural and model-based analyses reveal that subjects respond to deadline-induced speed pressure by lowering their criterion on accumulated perceptual evidence as the deadline approaches. In the brain, this effect is reflected in evidence-independent urgency that pushes decision-related motor preparation signals closer to a fixed threshold. Moreover, we show that global modulation of neural gain, as indexed by task-related fluctuations in pupil diameter, is a plausible biophysical mechanism for the generation of this urgency. These findings establish context-sensitive time-dependency as a critical feature of human decision-making. Decision-making balances the benefits of additional information with the cost of time, but it is unclear whether humans adjust this balance within individual decisions. Here, authors show that we do make such adjustments to suit contextual demands and suggest that these are driven by modulation of neural gain.
Collapse
Affiliation(s)
- Peter R Murphy
- Institute of Psychology and Leiden Institute for Brain and Cognition, Leiden University, 2333 AK Leiden, The Netherlands.,Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, 20246 Hamburg, Germany
| | - Evert Boonstra
- Institute of Psychology and Leiden Institute for Brain and Cognition, Leiden University, 2333 AK Leiden, The Netherlands
| | - Sander Nieuwenhuis
- Institute of Psychology and Leiden Institute for Brain and Cognition, Leiden University, 2333 AK Leiden, The Netherlands
| |
Collapse
|