1
|
Nunez MD, Fernandez K, Srinivasan R, Vandekerckhove J. A tutorial on fitting joint models of M/EEG and behavior to understand cognition. Behav Res Methods 2024; 56:6020-6050. [PMID: 38409458 PMCID: PMC11335833 DOI: 10.3758/s13428-023-02331-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/21/2023] [Indexed: 02/28/2024]
Abstract
We present motivation and practical steps necessary to find parameter estimates of joint models of behavior and neural electrophysiological data. This tutorial is written for researchers wishing to build joint models of human behavior and scalp and intracranial electroencephalographic (EEG) or magnetoencephalographic (MEG) data, and more specifically those researchers who seek to understand human cognition. Although these techniques could easily be applied to animal models, the focus of this tutorial is on human participants. Joint modeling of M/EEG and behavior requires some knowledge of existing computational and cognitive theories, M/EEG artifact correction, M/EEG analysis techniques, cognitive modeling, and programming for statistical modeling implementation. This paper seeks to give an introduction to these techniques as they apply to estimating parameters from neurocognitive models of M/EEG and human behavior, and to evaluate model results and compare models. Due to our research and knowledge on the subject matter, our examples in this paper will focus on testing specific hypotheses in human decision-making theory. However, most of the motivation and discussion of this paper applies across many modeling procedures and applications. We provide Python (and linked R) code examples in the tutorial and appendix. Readers are encouraged to try the exercises at the end of the document.
Collapse
Affiliation(s)
- Michael D Nunez
- Psychological Methods, University of Amsterdam, Amsterdam, The Netherlands.
| | - Kianté Fernandez
- Department of Psychology, University of California, Los Angeles, CA, USA
| | - Ramesh Srinivasan
- Department of Cognitive Sciences, University of California, Irvine, CA, USA
- Department of Biomedical Engineering, University of California, Irvine, CA, USA
- Institute of Mathematical Behavioral Sciences, University of California, Irvine, CA, USA
| | - Joachim Vandekerckhove
- Department of Cognitive Sciences, University of California, Irvine, CA, USA
- Institute of Mathematical Behavioral Sciences, University of California, Irvine, CA, USA
- Department of Statistics, University of California, Irvine, CA, USA
| |
Collapse
|
2
|
Murrow M, Holmes WR. PyBEAM: A Bayesian approach to parameter inference for a wide class of binary evidence accumulation models. Behav Res Methods 2024; 56:2636-2656. [PMID: 37550470 DOI: 10.3758/s13428-023-02162-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/03/2023] [Indexed: 08/09/2023]
Abstract
Many decision-making theories are encoded in a class of processes known as evidence accumulation models (EAM). These assume that noisy evidence stochastically accumulates until a set threshold is reached, triggering a decision. One of the most successful and widely used of this class is the Diffusion Decision Model (DDM). The DDM however is limited in scope and does not account for processes such as evidence leakage, changes of evidence, or time varying caution. More complex EAMs can encode a wider array of hypotheses, but are currently limited by computational challenges. In this work, we develop the Python package PyBEAM (Bayesian Evidence Accumulation Models) to fill this gap. Toward this end, we develop a general probabilistic framework for predicting the choice and response time distributions for a general class of binary decision models. In addition, we have heavily computationally optimized this modeling process and integrated it with PyMC, a widely used Python package for Bayesian parameter estimation. This 1) substantially expands the class of EAM models to which Bayesian methods can be applied, 2) reduces the computational time to do so, and 3) lowers the entry fee for working with these models. Here we demonstrate the concepts behind this methodology, its application to parameter recovery for a variety of models, and apply it to a recently published data set to demonstrate its practical use.
Collapse
Affiliation(s)
- Matthew Murrow
- Department of Physics and Astronomy, Vanderbilt University, 6301 Stevenson Science Center, Nashville, 37212, TN, USA
| | - William R Holmes
- Cognitive Science Program and Department of Mathematics, Indiana University, 1001 E. 10th St., Bloomington, 47405, IN, USA.
| |
Collapse
|
3
|
Boelts J, Lueckmann JM, Gao R, Macke JH. Flexible and efficient simulation-based inference for models of decision-making. eLife 2022; 11:77220. [PMID: 35894305 PMCID: PMC9374439 DOI: 10.7554/elife.77220] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Accepted: 07/26/2022] [Indexed: 11/22/2022] Open
Abstract
Inferring parameters of computational models that capture experimental data is a central task in cognitive neuroscience. Bayesian statistical inference methods usually require the ability to evaluate the likelihood of the model—however, for many models of interest in cognitive neuroscience, the associated likelihoods cannot be computed efficiently. Simulation-based inference (SBI) offers a solution to this problem by only requiring access to simulations produced by the model. Previously, Fengler et al. introduced likelihood approximation networks (LANs, Fengler et al., 2021) which make it possible to apply SBI to models of decision-making but require billions of simulations for training. Here, we provide a new SBI method that is substantially more simulation efficient. Our approach, mixed neural likelihood estimation (MNLE), trains neural density estimators on model simulations to emulate the simulator and is designed to capture both the continuous (e.g., reaction times) and discrete (choices) data of decision-making models. The likelihoods of the emulator can then be used to perform Bayesian parameter inference on experimental data using standard approximate inference methods like Markov Chain Monte Carlo sampling. We demonstrate MNLE on two variants of the drift-diffusion model and show that it is substantially more efficient than LANs: MNLE achieves similar likelihood accuracy with six orders of magnitude fewer training simulations and is significantly more accurate than LANs when both are trained with the same budget. Our approach enables researchers to perform SBI on custom-tailored models of decision-making, leading to fast iteration of model design for scientific discovery.
Collapse
Affiliation(s)
- Jan Boelts
- University of Tübingen, Tübingen, Germany
| | | | | | | |
Collapse
|
4
|
Tusche A, Bas LM. Neurocomputational models of altruistic decision-making and social motives: Advances, pitfalls, and future directions. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2021; 12:e1571. [PMID: 34340256 PMCID: PMC9286344 DOI: 10.1002/wcs.1571] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/06/2021] [Revised: 06/23/2021] [Accepted: 07/01/2021] [Indexed: 01/09/2023]
Abstract
This article discusses insights from computational models and social neuroscience into motivations, precursors, and mechanisms of altruistic decision-making and other-regard. We introduce theoretical and methodological tools for researchers who wish to adopt a multilevel, computational approach to study behaviors that promote others' welfare. Using examples from recent studies, we outline multiple mental and neural processes relevant to altruism. To this end, we integrate evidence from neuroimaging, psychology, economics, and formalized mathematical models. We introduce basic mechanisms-pertinent to a broad range of value-based decisions-and social emotions and cognitions commonly recruited when our decisions involve other people. Regarding the latter, we discuss how decomposing distinct facets of social processes can advance altruistic models and the development of novel, targeted interventions. We propose that an accelerated synthesis of computational approaches and social neuroscience represents a critical step towards a more comprehensive understanding of altruistic decision-making. We discuss the utility of this approach to study lifespan differences in social preference in late adulthood, a crucial future direction in aging global populations. Finally, we review potential pitfalls and recommendations for researchers interested in applying a computational approach to their research. This article is categorized under: Economics > Interactive Decision-Making Psychology > Emotion and Motivation Neuroscience > Cognition Economics > Individual Decision-Making.
Collapse
Affiliation(s)
- Anita Tusche
- Department of Psychology, Queen's University, Ontario, Kingston, Canada.,Department of Economics, Queen's University, Ontario, Kingston, Canada.,Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, California, USA
| | - Lisa M Bas
- Department of Psychology, Queen's University, Ontario, Kingston, Canada
| |
Collapse
|
5
|
Jun EJ, Bautista AR, Nunez MD, Allen DC, Tak JH, Alvarez E, Basso MA. Causal role for the primate superior colliculus in the computation of evidence for perceptual decisions. Nat Neurosci 2021; 24:1121-1131. [PMID: 34183869 PMCID: PMC8338902 DOI: 10.1038/s41593-021-00878-6] [Citation(s) in RCA: 29] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2020] [Accepted: 05/21/2021] [Indexed: 02/05/2023]
Abstract
Trained monkeys performed a two-choice perceptual decision-making task in which they reported the perceived orientation of a dynamic Glass pattern, before and after unilateral, reversible, inactivation of a brainstem area-the superior colliculus (SC)-involved in preparing eye movements. We found that unilateral SC inactivation produced significant decision biases and changes in reaction times consistent with a causal role for the primate SC in perceptual decision-making. Fitting signal detection theory and sequential sampling models to the data showed that SC inactivation produced a decrease in the relative evidence for contralateral decisions, as if adding a constant offset to a time-varying evidence signal for the ipsilateral choice. The results provide causal evidence for an embodied cognition model of perceptual decision-making and provide compelling evidence that the SC of primates (a brainstem structure) plays a causal role in how evidence is computed for decisions-a process usually attributed to the forebrain.
Collapse
|
6
|
Shinn M, Lam NH, Murray JD. A flexible framework for simulating and fitting generalized drift-diffusion models. eLife 2020; 9:56938. [PMID: 32749218 PMCID: PMC7462609 DOI: 10.7554/elife.56938] [Citation(s) in RCA: 31] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2020] [Accepted: 08/03/2020] [Indexed: 01/10/2023] Open
Abstract
The drift-diffusion model (DDM) is an important decision-making model in cognitive neuroscience. However, innovations in model form have been limited by methodological challenges. Here, we introduce the generalized drift-diffusion model (GDDM) framework for building and fitting DDM extensions, and provide a software package which implements the framework. The GDDM framework augments traditional DDM parameters through arbitrary user-defined functions. Models are solved numerically by directly solving the Fokker-Planck equation using efficient numerical methods, yielding a 100-fold or greater speedup over standard methodology. This speed allows GDDMs to be fit to data using maximum likelihood on the full response time (RT) distribution. We demonstrate fitting of GDDMs within our framework to both animal and human datasets from perceptual decision-making tasks, with better accuracy and fewer parameters than several DDMs implemented using the latest methodology, to test hypothesized decision-making mechanisms. Overall, our framework will allow for decision-making model innovation and novel experimental designs.
Collapse
Affiliation(s)
- Maxwell Shinn
- Department of Psychiatry, Yale University, New Haven, United States.,Interdepartmental Neuroscience Program, Yale University, New Haven, United States
| | - Norman H Lam
- Department of Physics, Yale University, New Haven, United States
| | - John D Murray
- Department of Psychiatry, Yale University, New Haven, United States.,Interdepartmental Neuroscience Program, Yale University, New Haven, United States.,Department of Physics, Yale University, New Haven, United States
| |
Collapse
|
7
|
Manning C, Wagenmakers EJ, Norcia AM, Scerif G, Boehm U. Perceptual Decision-Making in Children: Age-Related Differences and EEG Correlates. COMPUTATIONAL BRAIN & BEHAVIOR 2020; 4:53-69. [PMID: 33604512 PMCID: PMC7870772 DOI: 10.1007/s42113-020-00087-7] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Children make faster and more accurate decisions about perceptual information as they get older, but it is unclear how different aspects of the decision-making process change with age. Here, we used hierarchical Bayesian diffusion models to decompose performance in a perceptual task into separate processing components, testing age-related differences in model parameters and links to neural data. We collected behavioural and EEG data from 96 6- to 12-year-old children and 20 adults completing a motion discrimination task. We used a component decomposition technique to identify two response-locked EEG components with ramping activity preceding the response in children and adults: one with activity that was maximal over centro-parietal electrodes and one that was maximal over occipital electrodes. Younger children had lower drift rates (reduced sensitivity), wider boundary separation (increased response caution) and longer non-decision times than older children and adults. Yet, model comparisons suggested that the best model of children's data included age effects only on drift rate and boundary separation (not non-decision time). Next, we extracted the slope of ramping activity in our EEG components and covaried these with drift rate. The slopes of both EEG components related positively to drift rate, but the best model with EEG covariates included only the centro-parietal component. By decomposing performance into distinct components and relating them to neural markers, diffusion models have the potential to identify the reasons why children with developmental conditions perform differently to typically developing children and to uncover processing differences inapparent in the response time and accuracy data alone.
Collapse
Affiliation(s)
- Catherine Manning
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| | | | | | - Gaia Scerif
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Udo Boehm
- University of Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|