1
|
Hales CA, Clark L, Winstanley CA. Computational approaches to modeling gambling behaviour: Opportunities for understanding disordered gambling. Neurosci Biobehav Rev 2023; 147:105083. [PMID: 36758827 DOI: 10.1016/j.neubiorev.2023.105083] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2022] [Revised: 01/05/2023] [Accepted: 02/06/2023] [Indexed: 02/10/2023]
Abstract
Computational modeling has become an important tool in neuroscience and psychiatry research to provide insight into the cognitive processes underlying normal and pathological behavior. There are two modeling frameworks, reinforcement learning (RL) and drift diffusion modeling (DDM), that are well-developed in cognitive science, and have begun to be applied to Gambling Disorder. RL models focus on explaining how an agent uses reward to learn about the environment and make decisions based on outcomes. The DDM is a binary choice framework that breaks down decision making into psychologically meaningful components based on choice reaction time analyses. Both approaches have begun to yield insight into aspects of cognition that are important for, but not unique to, gambling, and thus relevant to the development of Gambling Disorder. However, these approaches also oversimplify or neglect various aspects of decision making seen in real-world gambling behavior. Gambling Disorder presents an opportunity for 'bespoke' modeling approaches to consider these neglected components. In this review, we discuss studies that have used RL and DDM frameworks to investigate some of the key cognitive components in gambling and Gambling Disorder. We also include an overview of Bayesian models, a methodology that could be useful for more tailored modeling approaches. We highlight areas in which computational modeling could enable progression in the investigation of the cognitive mechanisms relevant to gambling.
Collapse
Affiliation(s)
- C A Hales
- Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada; Department of Psychology, University of British Columbia, Vancouver, British Columbia, Canada.
| | - L Clark
- Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada; Department of Psychology, University of British Columbia, Vancouver, British Columbia, Canada
| | - C A Winstanley
- Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, British Columbia, Canada; Department of Psychology, University of British Columbia, Vancouver, British Columbia, Canada
| |
Collapse
|
2
|
Maps and territories, smoke, and mirrors. Behav Brain Sci 2022; 45:e195. [PMID: 36172761 DOI: 10.1017/s0140525x22000073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
It is a pleasure to comment on Bruineberg et al. - who raise some interesting questions of a philosophical and technical nature. I will try to answer three questions posed by the authors. Are Pearl and Friston blankets different things? Are Markov blankets used in an ontological sense? Is there a privileged Markov blanket?
Collapse
|
3
|
Shams L, Beierholm U. Bayesian causal inference: A unifying neuroscience theory. Neurosci Biobehav Rev 2022; 137:104619. [PMID: 35331819 DOI: 10.1016/j.neubiorev.2022.104619] [Citation(s) in RCA: 37] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Revised: 02/21/2022] [Accepted: 03/10/2022] [Indexed: 01/08/2023]
Abstract
Understanding of the brain and the principles governing neural processing requires theories that are parsimonious, can account for a diverse set of phenomena, and can make testable predictions. Here, we review the theory of Bayesian causal inference, which has been tested, refined, and extended in a variety of tasks in humans and other primates by several research groups. Bayesian causal inference is normative and has explained human behavior in a vast number of tasks including unisensory and multisensory perceptual tasks, sensorimotor, and motor tasks, and has accounted for counter-intuitive findings. The theory has made novel predictions that have been tested and confirmed empirically, and recent studies have started to map its algorithms and neural implementation in the human brain. The parsimony, the diversity of the phenomena that the theory has explained, and its illuminating brain function at all three of Marr's levels of analysis make Bayesian causal inference a strong neuroscience theory. This also highlights the importance of collaborative and multi-disciplinary research for the development of new theories in neuroscience.
Collapse
Affiliation(s)
- Ladan Shams
- Departments of Psychology, BioEngineering, and Neuroscience Interdepartmental Program, University of California, Los Angeles, USA.
| | | |
Collapse
|
4
|
Constant A, Ramstead MJD, Veissière SPL, Friston K. Regimes of Expectations: An Active Inference Model of Social Conformity and Human Decision Making. Front Psychol 2019; 10:679. [PMID: 30988668 PMCID: PMC6452780 DOI: 10.3389/fpsyg.2019.00679] [Citation(s) in RCA: 56] [Impact Index Per Article: 11.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2018] [Accepted: 03/11/2019] [Indexed: 01/06/2023] Open
Abstract
How do humans come to acquire shared expectations about how they ought to behave in distinct normalized social settings? This paper offers a normative framework to answer this question. We introduce the computational construct of 'deontic value' - based on active inference and Markov decision processes - to formalize conceptions of social conformity and human decision-making. Deontic value is an attribute of choices, behaviors, or action sequences that inherit directly from deontic cues in our econiche (e.g., red traffic lights); namely, cues that denote an obligatory social rule. Crucially, the prosocial aspect of deontic value rests upon a particular form of circular causality: deontic cues exist in the environment in virtue of the environment being modified by repeated actions, while action itself is contingent upon the deontic value of environmental cues. We argue that this construction of deontic cues enables the epistemic (i.e., information-seeking) and pragmatic (i.e., goal- seeking) values of any behavior to be 'cached' or 'outsourced' to the environment, where the environment effectively 'learns' about the behavior of its denizens. We describe the process whereby this particular aspect of value enables learning of habitual behavior over neurodevelopmental and transgenerational timescales.
Collapse
Affiliation(s)
- Axel Constant
- Charles Perkins Centre, The University of Sydney, Sydney, NSW, Australia
- Wellcome Trust Centre for Human Neuroimaging, University College London, London, United Kingdom
- Culture, Mind, and Brain Program, McGill University, Montreal, QC, Canada
| | - Maxwell J. D. Ramstead
- Wellcome Trust Centre for Human Neuroimaging, University College London, London, United Kingdom
- Culture, Mind, and Brain Program, McGill University, Montreal, QC, Canada
- Department of Philosophy, McGill University, Montreal, QC, Canada
- Division of Social and Transcultural Psychiatry, McGill University, Montreal, QC, Canada
| | - Samuel P. L. Veissière
- Culture, Mind, and Brain Program, McGill University, Montreal, QC, Canada
- Division of Social and Transcultural Psychiatry, McGill University, Montreal, QC, Canada
- Department of Anthropology, McGill University, Montreal, QC, Canada
| | - Karl Friston
- Wellcome Trust Centre for Human Neuroimaging, University College London, London, United Kingdom
| |
Collapse
|
5
|
Barnaud ML, Bessière P, Diard J, Schwartz JL. Reanalyzing neurocognitive data on the role of the motor system in speech perception within COSMO, a Bayesian perceptuo-motor model of speech communication. BRAIN AND LANGUAGE 2018; 187:19-32. [PMID: 29241588 PMCID: PMC6286382 DOI: 10.1016/j.bandl.2017.12.003] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/08/2017] [Revised: 07/17/2017] [Accepted: 12/02/2017] [Indexed: 06/07/2023]
Abstract
While neurocognitive data provide clear evidence for the involvement of the motor system in speech perception, its precise role and the way motor information is involved in perceptual decision remain unclear. In this paper, we discuss some recent experimental results in light of COSMO, a Bayesian perceptuo-motor model of speech communication. COSMO enables us to model both speech perception and speech production with probability distributions relating phonological units with sensory and motor variables. Speech perception is conceived as a sensory-motor architecture combining an auditory and a motor decoder thanks to a Bayesian fusion process. We propose the sketch of a neuroanatomical architecture for COSMO, and we capitalize on properties of the auditory vs. motor decoders to address three neurocognitive studies of the literature. Altogether, this computational study reinforces functional arguments supporting the role of a motor decoding branch in the speech perception process.
Collapse
Affiliation(s)
- Marie-Lou Barnaud
- Univ. Grenoble Alpes, Gipsa-lab, F-38000 Grenoble, France; CNRS, Gipsa-lab, F-38000 Grenoble, France; Univ. Grenoble Alpes, LPNC, F-38000 Grenoble, France; CNRS, LPNC, F-38000 Grenoble, France.
| | | | - Julien Diard
- Univ. Grenoble Alpes, LPNC, F-38000 Grenoble, France; CNRS, LPNC, F-38000 Grenoble, France
| | - Jean-Luc Schwartz
- Univ. Grenoble Alpes, Gipsa-lab, F-38000 Grenoble, France; CNRS, Gipsa-lab, F-38000 Grenoble, France.
| |
Collapse
|
6
|
Synnaeve G, Bessiere P. Multiscale Bayesian Modeling for RTS Games: An Application to StarCraft AI. IEEE TRANSACTIONS ON COMPUTATIONAL INTELLIGENCE AND AI IN GAMES 2016. [DOI: 10.1109/tciaig.2015.2487743] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
7
|
Patri JF, Diard J, Perrier P. Optimal speech motor control and token-to-token variability: a Bayesian modeling approach. BIOLOGICAL CYBERNETICS 2015; 109:611-626. [PMID: 26497359 DOI: 10.1007/s00422-015-0664-4] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/20/2015] [Accepted: 09/30/2015] [Indexed: 06/05/2023]
Abstract
The remarkable capacity of the speech motor system to adapt to various speech conditions is due to an excess of degrees of freedom, which enables producing similar acoustical properties with different sets of control strategies. To explain how the central nervous system selects one of the possible strategies, a common approach, in line with optimal motor control theories, is to model speech motor planning as the solution of an optimality problem based on cost functions. Despite the success of this approach, one of its drawbacks is the intrinsic contradiction between the concept of optimality and the observed experimental intra-speaker token-to-token variability. The present paper proposes an alternative approach by formulating feedforward optimal control in a probabilistic Bayesian modeling framework. This is illustrated by controlling a biomechanical model of the vocal tract for speech production and by comparing it with an existing optimal control model (GEPPETO). The essential elements of this optimal control model are presented first. From them the Bayesian model is constructed in a progressive way. Performance of the Bayesian model is evaluated based on computer simulations and compared to the optimal control model. This approach is shown to be appropriate for solving the speech planning problem while accounting for variability in a principled way.
Collapse
Affiliation(s)
- Jean-François Patri
- GIPSA-Lab, Université Grenoble Alpes, 11 Rue des Mathématiques, Saint-Martin-d'Hères, F-38000, Grenoble, France.
- GIPSA-Lab, CNRS, F-38000, Grenoble, France.
| | - Julien Diard
- LPNC, Université Grenoble Alpes, 1251 Avenue Centrale, Saint-Martin-d'Hères, F-38000, Grenoble, France
- LPNC, CNRS, F-38000, Grenoble, France
| | - Pascal Perrier
- GIPSA-Lab, Université Grenoble Alpes, 11 Rue des Mathématiques, Saint-Martin-d'Hères, F-38000, Grenoble, France
- GIPSA-Lab, CNRS, F-38000, Grenoble, France
| |
Collapse
|
8
|
Petzschner FH, Glasauer S, Stephan KE. A Bayesian perspective on magnitude estimation. Trends Cogn Sci 2015; 19:285-93. [DOI: 10.1016/j.tics.2015.03.002] [Citation(s) in RCA: 180] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2015] [Revised: 03/04/2015] [Accepted: 03/05/2015] [Indexed: 01/29/2023]
|
9
|
Diard J, Rynik V, Lorenceau J. A Bayesian computational model for online character recognition and disability assessment during cursive eye writing. Front Psychol 2013; 4:843. [PMID: 24273525 PMCID: PMC3822325 DOI: 10.3389/fpsyg.2013.00843] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2013] [Accepted: 10/22/2013] [Indexed: 12/13/2022] Open
Abstract
This research involves a novel apparatus, in which the user is presented with an illusion inducing visual stimulus. The user perceives illusory movement that can be followed by the eye, so that smooth pursuit eye movements can be sustained in arbitrary directions. Thus, free-flow trajectories of any shape can be traced. In other words, coupled with an eye-tracking device, this apparatus enables “eye writing,” which appears to be an original object of study. We adapt a previous model of reading and writing to this context. We describe a probabilistic model called the Bayesian Action-Perception for Eye On-Line model (BAP-EOL). It encodes probabilistic knowledge about isolated letter trajectories, their size, high-frequency components of the produced trajectory, and pupil diameter. We show how Bayesian inference, in this single model, can be used to solve several tasks, like letter recognition and novelty detection (i.e., recognizing when a presented character is not part of the learned database). We are interested in the potential use of the eye writing apparatus by motor impaired patients: the final task we solve by Bayesian inference is disability assessment (i.e., measuring and tracking the evolution of motor characteristics of produced trajectories). Preliminary experimental results are presented, which illustrate the method, showing the feasibility of character recognition in the context of eye writing. We then show experimentally how a model of the unknown character can be used to detect trajectories that are likely to be new symbols, and how disability assessment can be performed by opportunistically observing characteristics of fine motor control, as letter are being traced. Experimental analyses also help identify specificities of eye writing, as compared to handwriting, and the resulting technical challenges.
Collapse
Affiliation(s)
- Julien Diard
- Laboratoire de Psychologie et NeuroCognition, Université Grenoble Alpes-CNRS Grenoble, France
| | | | | |
Collapse
|
10
|
Integrate, yes, but what and how? A computational approach of sensorimotor fusion in speech. Behav Brain Sci 2013; 36:364-5. [DOI: 10.1017/s0140525x12002634] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
AbstractWe consider a computational model comparing the possible roles of “association” and “simulation” in phonetic decoding, demonstrating that these two routes can contain similar information in some “perfect” communication situations and highlighting situations where their decoding performance differs. We conclude that optimal decoding should involve some sort of fusion of association and simulation in the human brain.
Collapse
|
11
|
Ni J, Tatalovic M, Straumann D, Olasagasti I. Gaze direction affects linear self-motion heading discrimination in humans. Eur J Neurosci 2013; 38:3248-60. [DOI: 10.1111/ejn.12324] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2012] [Revised: 06/25/2013] [Accepted: 06/26/2013] [Indexed: 11/30/2022]
Affiliation(s)
- Jianguang Ni
- Department of Neurology; University Hospital Zürich; Zürich Switzerland
| | - Milos Tatalovic
- Department of Neurology; University Hospital Zürich; Zürich Switzerland
| | - Dominik Straumann
- Department of Neurology; University Hospital Zürich; Zürich Switzerland
| | - Itsaso Olasagasti
- Department of Neurology; University Hospital Zürich; Zürich Switzerland
| |
Collapse
|
12
|
Diard J, Bessière P, Berthoz A. Spatial Memory of Paths Using Circular Probability Distributions: Theoretical Properties, Navigation Strategies and Orientation Cue Combination. SPATIAL COGNITION AND COMPUTATION 2013. [DOI: 10.1080/13875868.2012.756490] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
13
|
Moulin-Frier C, Laurent R, Bessière P, Schwartz JL, Diard J. Adverse conditions improve distinguishability of auditory, motor, and perceptuo-motor theories of speech perception: An exploratory Bayesian modelling study. ACTA ACUST UNITED AC 2012. [DOI: 10.1080/01690965.2011.645313] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
|
14
|
Gilet E, Diard J, Bessière P. Bayesian action-perception computational model: interaction of production and recognition of cursive letters. PLoS One 2011; 6:e20387. [PMID: 21674043 PMCID: PMC3106017 DOI: 10.1371/journal.pone.0020387] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2011] [Accepted: 05/02/2011] [Indexed: 11/19/2022] Open
Abstract
In this paper, we study the collaboration of perception and action representations involved in cursive letter recognition and production. We propose a mathematical formulation for the whole perception-action loop, based on probabilistic modeling and bayesian inference, which we call the Bayesian Action-Perception (BAP) model. Being a model of both perception and action processes, the purpose of this model is to study the interaction of these processes. More precisely, the model includes a feedback loop from motor production, which implements an internal simulation of movement. Motor knowledge can therefore be involved during perception tasks. In this paper, we formally define the BAP model and show how it solves the following six varied cognitive tasks using bayesian inference: i) letter recognition (purely sensory), ii) writer recognition, iii) letter production (with different effectors), iv) copying of trajectories, v) copying of letters, and vi) letter recognition (with internal simulation of movements). We present computer simulations of each of these cognitive tasks, and discuss experimental predictions and theoretical developments.
Collapse
Affiliation(s)
- Estelle Gilet
- Estelle Gilet Laboratoire d'Informatique de Grenoble, INRIA Rhône-Alpes, CNRS, Montbonnot, France
| | - Julien Diard
- Julien Diard Laboratoire de Psychologie et NeuroCognition, CNRS, Université Pierre-Mendès-France, Grenoble, France
| | - Pierre Bessière
- Pierre Bessière Laboratoire d'Informatique de Grenoble, INRIA Rhône-Alpes, CNRS, Montbonnot, France
- Laboratoire de Physiologie de la Perception et de l'Action, Collège de France, CNRS, Paris, France
| |
Collapse
|