Evidence Accumulation Models: Current Limitations and Future Directions

An extension of the shifted Wald model of human response times: Capturing the time dynamic properties of human cognition : Trial-varying Wald model

Despite the ubiquitous nature of evidence accumulation models in cognitive and experimental psychology, there has been a comparatively limited uptake of such techniques in the applied literature. While quantifying latent cognitive processing properties has significant potential for applied domains such as adaptive work systems, accumulator models often fall short in practical applications. Two primary reasons for these shortcomings are the complexities and time needed for the application of cognitive models, and the failure of current models to capture systematic trial-to-trial variability in parameters. In this manuscript, we develop a novel, trial-varying extension of the shifted Wald model to address these concerns. By leveraging conjugate properties of the Wald distribution, we derive computationally efficient solutions for threshold and drift parameters which can be updated instantaneously with new data. The resulting model allows the quantification of systematic variation in latent cognitive parameters across trials and we demonstrate the utility of such analyses through simulations and an exemplar application to an existing data set. The analytic nature of our solutions opens the door for real-world applications, significantly extending the reach of computational models of behavioral responses.

Does allowing for changes of mind influence initial responses?

Evidence accumulation models (EAMs) have become the dominant theoretical framework for rapid decision-making, and while many theoretically distinct variants exist, comparisons have proved challenging due to strong mimicry in their predictions about choice response time data. One solution to reduce mimicry is constraining these models with double responses, which are a second response that is made after the initial response. However, instructing participants that they are allowed to change their mind could influence their strategy for initial responding, meaning that explicit double responding paradigms may not generalise to standard paradigms. Here, we provide a validation of explicit double responding paradigms, by assessing whether participants' initial decisions - as measured by diffusion model parameters - differ based on whether or not they were instructed that they could change their response after their initial response. Across three experiments, our results consistently indicate that allowing for changes of mind does not influence initial responses, with Bayesian analyses providing at least moderate evidence in favour of the null in all cases. Our findings suggest that explicit double responding paradigms should generalise to standard paradigms, validating the use of explicit double responding in future rapid decision-making studies.

What can evidence accumulation modelling tell us about human social cognition?

Evidence accumulation models are a series of computational models that provide an account for speeded decision-making. These models have been used extensively within the cognitive psychology literature to great success, allowing inferences to be drawn about the psychological processes that underlie cognition that are sometimes not available in a traditional analysis of accuracy or reaction time (RT). Despite this, there have been only a few applications of these models within the domain of social cognition. In this article, we explore several ways in which the study of human social information processing would benefit from application of evidence accumulation modelling. We begin first with a brief overview of the evidence accumulation modelling framework and their past success within the domain of cognitive psychology. We then highlight five ways in which social cognitive research would benefit from an evidence accumulation approach. This includes (1) greater specification of assumptions, (2) unambiguous comparisons across blocked task conditions, (3) quantifying and comparing the magnitude of effects in standardised measures, (4) a novel approach for studying individual differences, and (5) improved reproducibility and accessibility. These points are illustrated using examples from the domain of social attention. Finally, we outline several methodological and practical considerations, which should help researchers use evidence accumulation models productively. Ultimately, it will be seen that evidence accumulation modelling offers a well-developed, accessible, and commonly understood framework that can reveal inferences about cognition that may otherwise be out of reach in a traditional analysis of accuracy and RT. This approach, therefore, has the potential to substantially revise our understanding of social cognition.

Brief mindfulness-based meditation enhances the speed of learning following positive prediction errors

Recent research has demonstrated that mindfulness-based meditation facilitates basic aspects of cognition, including memory and attention. Further developing this line of inquiry, here we considered the possibility that similar effects may extend to another core psychological process-instrumental learning. To explore this matter, in combination with a probabilistic selection task, computational modelling (i.e., reinforcement drift diffusion model analysis) was adopted to establish whether and how brief mindfulness-based meditation influences learning under conditions of uncertainty (i.e., choices based on the perceived likelihood of positive and negative outcomes). Three effects were observed. Compared with performance in the control condition (i.e., no meditation), mindfulness-based meditation (1) accelerated the rate of learning following positive prediction errors; (2) elicited a preference for the exploration (vs. exploitation) of choice selections; and (3) increased response caution. Collectively, these findings elucidate the pathways through which brief meditative experiences impact learning and decision-making, with implications for interventions designed to debias aspects of social-cognitive functioning using mindfulness-based meditation.

Prior beliefs and the interpretation of scientific results

How do prior beliefs affect the interpretation of scientific results? I discuss a hypothetical scenario where researchers publish results that could either support a theory they believe in, or refute that theory, and ask if the two instances carry the same weight. More colloquially, I ask if we should overweigh scientific results supporting a given theory and reported by a researcher, or a team, that initially did not support that theory. I illustrate the challenge using two examples from psychology: evidence accumulation models, and extra sensory perception.

Modelling decision-making biases

Biases are a fundamental aspect of everyday life decision-making. A variety of modelling approaches have been suggested to capture decision-making biases. Statistical models are a means to describe the data, but the results are usually interpreted according to a verbal theory. This can lead to an ambiguous interpretation of the data. Mathematical cognitive models of decision-making outline the structure of the decision process with formal assumptions, providing advantages in terms of prediction, simulation, and interpretability compared to statistical models. We compare studies that used both signal detection theory and evidence accumulation models as models of decision-making biases, concluding that the latter provides a more comprehensive account of the decision-making phenomena by including response time behavior. We conclude by reviewing recent studies investigating attention and expectation biases with evidence accumulation models. Previous findings, reporting an exclusive influence of attention on the speed of evidence accumulation and prior probability on starting point, are challenged by novel results suggesting an additional effect of attention on non-decision time and prior probability on drift rate.

Listening efficiency in adult cochlear-implant users compared with normally-hearing controls at ecologically relevant signal-to-noise ratios

Introduction

Due to having to work with an impoverished auditory signal, cochlear-implant (CI) users may experience reduced speech intelligibility and/or increased listening effort in real-world listening situations, compared to their normally-hearing (NH) peers. These two challenges to perception may be usefully integrated in a measure of listening efficiency: conceptually, the amount of accuracy achieved for a certain amount of effort expended.

Methods

We describe a novel approach to quantifying listening efficiency based on the rate of evidence accumulation toward a correct response in a linear ballistic accumulator (LBA) model of choice decision-making. Estimation of this objective measure within a hierarchical Bayesian framework confers further benefits, including full quantification of uncertainty in parameter estimates. We applied this approach to examine the speech-in-noise performance of a group of 24 CI users (M age: 60.3, range: 20-84 years) and a group of 25 approximately age-matched NH controls (M age: 55.8, range: 20-79 years). In a laboratory experiment, participants listened to reverberant target sentences in cafeteria noise at ecologically relevant signal-to-noise ratios (SNRs) of +20, +10, and +4 dB SNR. Individual differences in cognition and self-reported listening experiences were also characterised by means of cognitive tests and hearing questionnaires.

Results

At the group level, the CI group showed much lower listening efficiency than the NH group, even in favourable acoustic conditions. At the individual level, within the CI group (but not the NH group), higher listening efficiency was associated with better cognition (i.e., working-memory and linguistic-closure) and with more positive self-reported listening experiences, both in the laboratory and in daily life.

Discussion

We argue that listening efficiency, measured using the approach described here, is: (i) conceptually well-motivated, in that it is theoretically impervious to differences in how individuals approach the speed-accuracy trade-off that is inherent to all perceptual decision making; and (ii) of practical utility, in that it is sensitive to differences in task demand, and to differences between groups, even when speech intelligibility remains at or near ceiling level. Further research is needed to explore the sensitivity and practical utility of this metric across diverse listening situations.

The effect of memory load on object reconstruction: Insights from an online mouse-tracking task

Why can't we remember everything that we experience? Previous work in the domain of object memory has suggested that our ability to resolve interference between relevant and irrelevant object features may limit how much we can remember at any given moment. Here, we developed an online mouse-tracking task to study how memory load influences object reconstruction, testing participants synchronously over virtual conference calls. We first tested up to 18 participants concurrently, replicating memory findings from a condition where participants were tested individually. Next, we examined how memory load influenced mouse trajectories as participants reconstructed target objects. We found interference between the contents of working memory and what was perceived during object reconstruction, an effect that interacted with visual similarity and memory load. Furthermore, we found interference from previously studied but currently irrelevant objects, providing evidence of object-to-location binding errors. At the greatest memory load, participants were nearly three times more likely to move their mouse cursor over previously studied nontarget objects, an effect observed primarily during object reconstruction rather than in the period before the final response. As evidence of the dynamic interplay between working memory and perception, these results show that object reconstruction behavior may be altered by (i) interference between what is represented in mind and what is currently being viewed, and (ii) interference from previously studied but currently irrelevant information. Finally, we discuss how mouse tracking can provide a rich characterization of participant behavior at millisecond temporal resolution, enormously increasing power in cognitive psychology experiments.

Accounting for endogenous effects in decision-making with a non-linear diffusion decision model

The Drift-Diffusion Model (DDM) is widely accepted for two-alternative forced-choice decision paradigms thanks to its simple formalism and close fit to behavioral and neurophysiological data. However, this formalism presents strong limitations in capturing inter-trial dynamics at the single-trial level and endogenous influences. We propose a novel model, the non-linear Drift-Diffusion Model (nl-DDM), that addresses these issues by allowing the existence of several trajectories to the decision boundary. We show that the non-linear model performs better than the drift-diffusion model for an equivalent complexity. To give better intuition on the meaning of nl-DDM parameters, we compare the DDM and the nl-DDM through correlation analysis. This paper provides evidence of the functioning of our model as an extension of the DDM. Moreover, we show that the nl-DDM captures time effects better than the DDM. Our model paves the way toward more accurately analyzing across-trial variability for perceptual decisions and accounts for peri-stimulus influences.

Performance-contingent reward increases the use of congruent distracting information

In conflict tasks like the Simon task, participants are instructed to respond to a task-relevant target dimension while ignoring additional distracting information. In the Simon task the distracting spatial information can be congruent or incongruent with the task-relevant target information, causing a congruency effect. As seen in the proportion congruency effect and the congruency sequence effect, this congruency effect is larger in mostly congruent blocks and following congruent trials, respectively. Common theories suggest that when the proportion of incongruent trials is high or after an incongruent trial, focus on the task-relevant target information is increased and distracting information is inhibited. In two experiments, we investigated how reward modulates these phenomena. Specifically, performance-contingent reward - but not non-contingent reward - increased the usage of the distracting information in mostly congruent blocks or following congruent trials, while the adaptation to incongruency (i.e., mostly incongruent blocks or preceding incongruent trials) was the same in all conditions. Additional diffusion model analyses found that this effect of performance-contingent reward was captured by the drift rate parameter. These results suggest an increased focus on the target information by incongruent trials independent from reward, while the adaptation to (mostly) congruent trials characterized by increased usage of distracting information can be motivationally boosted. That is, performance-contingent reward increases the use of congruent distracting information beyond a mere relaxation of the increased target-focus following (mostly) congruent trials.

Response Durations: A Flexible, No-Cost Tool for Psychological Science

Response durations for simple key presses are an easily available but heavily underused measure. Whereas response times dominate the toolbox of experimental psychologists and cognitive modelers alike, any study with standard key-press responses also allows for the measurement of such durations as the time from response onset to response offset. Moreover, response times and durations are decidedly independent, so response durations hold great promise as a means to uncover unique perspectives on cognitive processing. We showcase recent observations and corresponding theoretical frameworks to highlight that this inconspicuous measure deserves much more attention than it has attracted so far. Given that it comes at no extra cost for common experimental setups, any researcher is well advised to consider adding the measure of response duration to their empirical toolbox.

Evidence accumulation modelling in the wild: understanding safety-critical decisions

Evidence accumulation models (EAMs) are a class of computational cognitive model used to understand the latent cognitive processes that underlie human decisions and response times (RTs). They have seen widespread application in cognitive psychology and neuroscience. However, historically, the application of these models was limited to simple decision tasks. Recently, researchers have applied these models to gain insight into the cognitive processes that underlie observed behaviour in applied domains, such as air-traffic control (ATC), driving, forensic and medical image discrimination, and maritime surveillance. Here, we discuss how this modelling approach helps researchers understand how the cognitive system adapts to task demands and interventions, such as task automation. We also discuss future directions and argue for wider adoption of cognitive modelling in Human Factors research.

Staggered Onsets of Processing Relevant and Irrelevant Stimulus Features Produce Different Dynamics of Congruency Effects

The dynamics of congruency effects in conflict tasks can be analyzed by means of delta plots which depict the reaction-time differences between incongruent and congruent conditions across the quantiles of the reaction-time distributions. Delta plots exhibit a variety of different shapes. Here we test the hypothesis that staggered onsets of processing task-relevant and task-irrelevant features for response selection (together with a declining influence of the irrelevant feature) produce such variety. For this purpose, staggered onsets were implemented in two extensions of the Leaky, Competing Accumulator model. We show the cardinal capability of these models to produce different shapes of delta plots with different assumptions about temporal offsets between processing relevant and irrelevant stimulus features. Applying the models to experimental data, we first show that they can reproduce the delta plots observed with a conflict task with stimulus size as the irrelevant feature. For this task congruency effects are delayed and appear only at longer reaction times. Second, we fit the models to the results of two new Simon-task experiments with an experimentally controlled temporal offset in addition to the internal one. The experimentally induced variations of the shape of delta plots for this task could be reasonably well fitted by one of the two models that assumed an early start of response selection as soon as either the relevant or the irrelevant stimulus feature becomes available. We conclude that delta plots are crucially shaped by staggered onsets of processing relevant and irrelevant features for response selection.

A practical introduction to using the drift diffusion model of decision-making in cognitive psychology, neuroscience, and health sciences

Recent years have seen a rapid increase in the number of studies using evidence-accumulation models (such as the drift diffusion model, DDM) in the fields of psychology and neuroscience. These models go beyond observed behavior to extract descriptions of latent cognitive processes that have been linked to different brain substrates. Accordingly, it is important for psychology and neuroscience researchers to be able to understand published findings based on these models. However, many articles using (and explaining) these models assume that the reader already has a fairly deep understanding of (and interest in) the computational and mathematical underpinnings, which may limit many readers' ability to understand the results and appreciate the implications. The goal of this article is therefore to provide a practical introduction to the DDM and its application to behavioral data - without requiring a deep background in mathematics or computational modeling. The article discusses the basic ideas underpinning the DDM, and explains the way that DDM results are normally presented and evaluated. It also provides a step-by-step example of how the DDM is implemented and used on an example dataset, and discusses methods for model validation and for presenting (and evaluating) model results. Supplementary material provides R code for all examples, along with the sample dataset described in the text, to allow interested readers to replicate the examples themselves. The article is primarily targeted at psychologists, neuroscientists, and health professionals with a background in experimental cognitive psychology and/or cognitive neuroscience, who are interested in understanding how DDMs are used in the literature, as well as some who may to go on to apply these approaches in their own work.

The role of parenting in the intergenerational transmission of executive functioning: A genetically informed approach

Deficits in executive functioning both run in families and serve as a transdiagnostic risk factor for psychopathology. The present study employed twin modeling to examine parenting as an environmental pathway underlying the intergenerational transmission of executive functioning in an at-risk community sample of children and adolescents (N = 354 pairs, 167 monozygotic). Using structural equation modeling of multi-informant reports of parenting and a multi-method measure of child executive functioning, we found that better parent executive functioning related to less harsh, warmer parenting, which in turn related to better child executive functioning. Second, we assessed the etiology of executive functioning via the nuclear twin family model, finding large non-shared environmental effects (E = .69) and low-to-moderate heritability (A = .22). We did not find evidence of shared environmental effects or passive genotype-environment correlation. Third, a bivariate twin model revealed significant shared environmental overlap between both warm and harsh parenting and child executive functioning (which may indicate either passive genotype-environment correlation or environmental mediation), and non-shared environmental overlap between only harsh parenting and child executive functioning (indicating an effect of harsh parenting separable from genetic confounds). In summary, genetics contribute to the intergenerational transmission of executive functioning, with environmental mechanisms, including harsh parenting, also making unique contributions.

Behavioural and neural indices of perceptual decision-making in autistic children during visual motion tasks

Many studies report atypical responses to sensory information in autistic individuals, yet it is not clear which stages of processing are affected, with little consideration given to decision-making processes. We combined diffusion modelling with high-density EEG to identify which processing stages differ between 50 autistic and 50 typically developing children aged 6-14 years during two visual motion tasks. Our pre-registered hypotheses were that autistic children would show task-dependent differences in sensory evidence accumulation, alongside a more cautious decision-making style and longer non-decision time across tasks. We tested these hypotheses using hierarchical Bayesian diffusion models with a rigorous blind modelling approach, finding no conclusive evidence for our hypotheses. Using a data-driven method, we identified a response-locked centro-parietal component previously linked to the decision-making process. The build-up in this component did not consistently relate to evidence accumulation in autistic children. This suggests that the relationship between the EEG measure and diffusion-modelling is not straightforward in autistic children. Compared to a related study of children with dyslexia, motion processing differences appear less pronounced in autistic children. Exploratory analyses also suggest weak evidence that ADHD symptoms moderate perceptual decision-making in autistic children.

Task-general efficiency of evidence accumulation as a computationally-defined neurocognitive trait: Implications for clinical neuroscience

Quantifying individual differences in higher-order cognitive functions is a foundational area of cognitive science that also has profound implications for research on psychopathology. For the last two decades, the dominant approach in these fields has been to attempt to fractionate higher-order functions into hypothesized components (e.g., "inhibition", "updating") through a combination of experimental manipulation and factor analysis. However, the putative constructs obtained through this paradigm have recently been met with substantial criticism on both theoretical and empirical grounds. Concurrently, an alternative approach has emerged focusing on parameters of formal computational models of cognition that have been developed in mathematical psychology. These models posit biologically plausible and experimentally validated explanations of the data-generating process for cognitive tasks, allowing them to be used to measure the latent mechanisms that underlie performance. One of the primary insights provided by recent applications of such models is that individual and clinical differences in performance on a wide variety of cognitive tasks, ranging from simple choice tasks to complex executive paradigms, are largely driven by efficiency of evidence accumulation (EEA), a computational mechanism defined by sequential sampling models. This review assembles evidence for the hypothesis that EEA is a central individual difference dimension that explains neurocognitive deficits in multiple clinical disorders and identifies ways in which in this insight can advance clinical neuroscience research. We propose that recognition of EEA as a major driver of neurocognitive differences will allow the field to make clearer inferences about cognitive abnormalities in psychopathology and their links to neurobiology.

Visual Motion and Decision-Making in Dyslexia: Reduced Accumulation of Sensory Evidence and Related Neural Dynamics

Children with and without dyslexia differ in their behavioral responses to visual information, particularly when required to pool dynamic signals over space and time. Importantly, multiple processes contribute to behavioral responses. Here we investigated which processing stages are affected in children with dyslexia when performing visual motion processing tasks, by combining two methods that are sensitive to the dynamic processes leading to responses. We used a diffusion model which decomposes response time and accuracy into distinct cognitive constructs, and high-density EEG. Fifty children with dyslexia (24 male) and 50 typically developing children (28 male) 6-14 years of age judged the direction of motion as quickly and accurately as possible in two global motion tasks (motion coherence and direction integration), which varied in their requirements for noise exclusion. Following our preregistered analyses, we fitted hierarchical Bayesian diffusion models to the data, blinded to group membership. Unblinding revealed reduced evidence accumulation in children with dyslexia compared with typical children for both tasks. Additionally, we identified a response-locked EEG component which was maximal over centro-parietal electrodes which indicated a neural correlate of reduced drift rate in dyslexia in the motion coherence task, thereby linking brain and behavior. We suggest that children with dyslexia tend to be slower to extract sensory evidence from global motion displays, regardless of whether noise exclusion is required, thus furthering our understanding of atypical perceptual decision-making processes in dyslexia.SIGNIFICANCE STATEMENT Reduced sensitivity to visual information has been reported in dyslexia, with a lively debate about whether these differences causally contribute to reading difficulties. In this large preregistered study with a blind modeling approach, we combine state-of-the art methods in both computational modeling and EEG analysis to pinpoint the stages of processing that are atypical in children with dyslexia in two visual motion tasks that vary in their requirement for noise exclusion. We find reduced evidence accumulation in children with dyslexia across both tasks, and identify a neural marker, allowing us to link brain and behavior. We show that children with dyslexia exhibit general difficulties with extracting sensory evidence from global motion displays, not just in tasks that require noise exclusion.

The time-course of distractor-based activation modulates effects of speed-accuracy tradeoffs in conflict tasks

The cognitive processes underlying the ability of human performers to trade speed for accuracy is often conceptualized within evidence accumulation models, but it is not yet clear whether and how these models can account for decision-making in the presence of various sources of conflicting information. In the present study, we provide evidence that speed-accuracy tradeoffs (SATs) can have opposing effects on performance across two different conflict tasks. Specifically, in a single preregistered experiment, the mean reaction time (RT) congruency effect in the Simon task increased, whereas the mean RT congruency effect in the Eriksen task decreased, when the focus was put on response speed versus accuracy. Critically, distributional RT analyses revealed distinct delta plot patterns across tasks, thus indicating that the unfolding of distractor-based response activation in time is sufficient to explain the opposing pattern of congruency effects. In addition, a recent evidence accumulation model with the notion of time-varying conflicting information was successfully fitted to the experimental data. These fits revealed task-specific time-courses of distractor-based activation and suggested that time pressure substantially decreases decision boundaries in addition to reducing the duration of non-decision processes and the rate of evidence accumulation. Overall, the present results suggest that time pressure can have multiple effects in decision-making under conflict, but that strategic adjustments of decision boundaries in conjunction with different time-courses of distractor-based activation can produce counteracting effects on task performance with different types of distracting sources of information.

Delta plots for conflict tasks: An activation-suppression race model

We describe a mathematically simple yet precise model of activation suppression that can explain the negative-going delta plots often observed in standard Simon tasks. The model postulates a race between the identification of the relevant stimulus attribute and the suppression of irrelevant location-based activation, with the irrelevant activation only having an effect if the irrelevant activation is still present at the moment when central processing of the relevant attribute starts. The model can be fitted by maximum likelihood to observed distributions of RTs in congruent and incongruent trials, and it provides good fits to two previously-reported data sets with plausible parameter values. R and MATLAB software for use with the model is provided.

Decision-Making and Multisensory Combination Under Time Stress

Using a video game platform, we examined how vision-based decision making was affected by a concurrent, potentially conflicting auditory stimulus. Electroencephalographic responses showed that by 150 milliseconds of stimulus onset, the brain had detected the conflict between visual and auditory stimuli. Systematically reducing the intertrial interval (ITI), which subjects described as stressful, undermined decision making. Subjects' arterial pulse variance decreased along with ITI, signaling increased parasympathetic influence on the heart. When successive trials required a shift in processing mode, short ITIs significantly boosted one trial's influence on the next, suggesting that stress reduces cognitive flexibility. Finally, our study demonstrates the heart's and the brain's important influence on decision making.

How do recall requirements affect decision-making in free recall initiation? A linear ballistic accumulator approach

Models of free recall describe free recall initiation as a decision-making process in which items compete to be retrieved. Recently, Osth and Farrell (Psychological Review, 126, 578–609, 2019) applied evidence accumulation models to complete RT distributions and serial positions of participants’ first recalls in free recall, which resulted in some novel conclusions about primacy and recency effects. Specifically, the results of the modeling favored an account in which primacy was due to reinstatement of the start-of-the-list, and recency was found to be exponential in shape. In this work, we examine what happens when participants are given alternative recall instructions. Prior work has demonstrated weaker primacy and greater recency when fewer items are required to report (Ward & Tan, Memory & Cognition, 2019), and a key question is whether this change in instructions qualitatively changes the nature of the recall process, or merely changes the parameters of the recall competition. We conducted an experiment where participants studied six- or 12-item lists and were post-cued as to whether to retrieve a single item, or as many items as possible. Subsequently, we applied LBA models with various assumptions about primacy and recency, implemented using hierarchical Bayesian techniques. While greater recency was observed when only one item was required for output, the model selection did not suggest that there were qualitative differences between the two conditions. Specifically, start-of-list reinstatement and exponential recency functions were favored in both conditions.

EEG-based Identification of Evidence Accumulation Stages in Decision-Making

Dating back to the 19th century, the discovery of processing stages has been of great interest to researchers in cognitive science. The goal of this paper is to demonstrate the validity of a recently developed method, hidden semi-Markov model multivariate pattern analysis (HsMM-MVPA), for discovering stages directly from EEG data, in contrast to classical reaction-time-based methods. To test the validity of stages discovered with the HsMM-MVPA method, we applied it to two relatively simple tasks where the interpretation of processing stages is straightforward. In these visual discrimination EEG data experiments, perceptual processing and decision difficulty were manipulated. The HsMM-MVPA revealed that participants progressed through five cognitive processing stages while performing these tasks. The brain activation of one of those stages was dependent on perceptual processing, whereas the brain activation and the duration of two other stages were dependent on decision difficulty. In addition, evidence accumulation models (EAMs) were used to assess to what extent the results of HsMM-MVPA are comparable to standard reaction-time-based methods. Consistent with the HsMM-MVPA results, EAMs showed that nondecision time varied with perceptual difficulty and drift rate varied with decision difficulty. Moreover, nondecision and decision time of the EAMs correlated highly with the first two and last three stages of the HsMM-MVPA, respectively, indicating that the HsMM-MVPA gives a more detailed description of stages discovered with this more classical method. The results demonstrate that cognitive stages can be robustly inferred with the HsMM-MVPA.