Testing the validity of conflict drift-diffusion models for use in estimating cognitive processes: A parameter-recovery study

Dynamics of attentional focusing in the Eriksen flanker task

Eriksen and Eriksen (Perception & Psychophysics, 16, 143-149, 1974) explained the flanker compatibility effect in terms of response competition. A simplified version of the original flanker task, featuring a 1-to-1 mapping of stimuli onto responses, has become prominent in the literature. Compatible flanker trials present identical items (HHHHH), whereas incompatible trials present different items (HHSHH). The 1-to-1 mapping is potentially problematic because it invites a strategy that people could use to perform the task. Subjects could first determine whether all the items are the same and focus attention on the central target only if they are not. Response times (RTs) would be longer for incompatible trials partly because they require the extra step of focusing attention. We tested this conditional focusing hypothesis by combining a 1-to-1 flanker task with a digit probe detection procedure. In half of the trials, the digit '7' appeared immediately after the response to the flanker display, at the target or a flanker location. Three experiments showed a V-shaped function of RTs to digits across locations that was not modulated by flanker compatibility. These results demonstrate that subjects focused attention on the central target regardless of the same/different configuration of the display, refuting the conditional focusing hypothesis. Our findings support Eriksen and Eriksen's original interpretation of the flanker task.

Reaching trajectories unravel modality-dependent temporal dynamics of the automatic process in the Simon task: a model-based approach

The Simon effect represents a phenomenon in which the location of the stimuli affects the speed and accuracy of the response, despite being irrelevant for the task demands. This is believed to be due to an automatic activation of a response corresponding to the location of the stimuli, which conflicts with the controlled decision process based on relevant stimuli features. Previously, differences in the nature of the Simon effect (i.e., the pattern of change of the effect across the distribution of response times) between visual and somatosensory stimuli were reported. We hypothesize that the temporal dynamics of visual and somatosensory automatic and controlled processes vary, thus driving the reported behavioral differences. While most studies have used response times to study the underlying mechanisms involved, in this study we had participants reach out to touch the targets and recorded their arm movements using a motion capture system. Importantly, the participants started their movements before a final decision was made. In this way, we could analyze the movements to gain insights into the competition between the automatic and controlled processes. We used this technique to describe the results in terms of a model assuming automatic activation due to location-based evidence, followed by inhibition. We found that for the somatosensory Simon effect, the decay of the automatic process is significantly slower than for the visual Simon effect, suggesting quantitative differences in this automatic process between the visual and somatosensory modalities.

Neurally constrained modeling of speed-accuracy tradeoff during visual search: gated accumulation of modulated evidence

Stochastic accumulator models account for response times and errors in perceptual decision making by assuming a noisy accumulation of perceptual evidence to a threshold. Previously, we explained saccade visual search decision making by macaque monkeys with a stochastic multiaccumulator model in which accumulation was driven by a gated feed-forward integration to threshold of spike trains from visually responsive neurons in frontal eye field that signal stimulus salience. This neurally constrained model quantitatively accounted for response times and errors in visual search for a target among varying numbers of distractors and replicated the dynamics of presaccadic movement neurons hypothesized to instantiate evidence accumulation. This modeling framework suggested strategic control over gate or over threshold as two potential mechanisms to accomplish speed-accuracy tradeoff (SAT). Here, we show that our gated accumulator model framework can account for visual search performance under SAT instructions observed in a milestone neurophysiological study of frontal eye field. This framework captured key elements of saccade search performance, through observed modulations of neural input, as well as flexible combinations of gate and threshold parameters necessary to explain differences in SAT strategy across monkeys. However, the trajectories of the model accumulators deviated from the dynamics of most presaccadic movement neurons. These findings demonstrate that traditional theoretical accounts of SAT are incomplete descriptions of the underlying neural adjustments that accomplish SAT, offer a novel mechanistic account of decision-making mechanisms during speed-accuracy tradeoff, and highlight questions regarding the identity of model and neural accumulators. NEW & NOTEWORTHY A gated accumulator model is used to elucidate neurocomputational mechanisms of speed-accuracy tradeoff. Whereas canonical stochastic accumulators adjust strategy only through variation of an accumulation threshold, we demonstrate that strategic adjustments are accomplished by flexible combinations of both modulation of the evidence representation and adaptation of accumulator gate and threshold. The results indicate how model-based cognitive neuroscience can translate between abstract cognitive models of performance and neural mechanisms of speed-accuracy tradeoff.

A parameter recovery assessment of time-variant models of decision-making

Evidence accumulation models have been one of the most dominant modeling frameworks used to study rapid decision-making over the past several decades. These models propose that evidence accumulates from the environment until the evidence for one alternative reaches some threshold, typically associated with caution, triggering a response. However, researchers have recently begun to reconsider the fundamental assumptions of how caution varies with time. In the past, it was typically assumed that levels of caution are independent of time. Recent investigations have however suggested the possibility that levels of caution decrease over time and that this strategy provides more efficient performance under certain conditions. Our study provides the first comprehensive assessment of this newer class of models accounting for time-varying caution to determine how robustly their parameters can be estimated. We assess five overall variants of collapsing threshold/urgency signal models based on the diffusion decision model, linear ballistic accumulator model, and urgency gating model frameworks. We find that estimation of parameters, particularly those associated with caution/urgency modulation are most robust for the linearly collapsing threshold diffusion model followed by an urgency-gating model with a leakage process. All other models considered, particularly those with ballistic accumulation or nonlinear thresholds, are unable to recover their own parameters adequately, making their usage in parameter estimation contexts questionable.

Conflict resolution in the Eriksen flanker task: Similarities and differences to the Simon task

In the Eriksen flanker task as well as in the Simon task irrelevant activation produces a response conflict that has to be resolved by mental control mechanisms. Despite these similarities, however, the tasks differ with respect to their delta functions, which express how the congruency effects develop with response time. The slope of the delta function is mostly positive for the flanker task, but negative for the Simon task. Much effort has been spent to explain this difference and to investigate whether it results from task-specific control. A prominent account is that the temporal overlap between irrelevant and relevant response activation is larger in the flanker task than in the Simon task. To test this hypothesis, we increased the temporal distance in a flanker task by presenting the flankers ahead of the target. This not only produced negatively sloped delta functions but also caused reversed congruency effects. We also conducted a Simon-task experiment in which we varied the proportion of congruent stimuli. As a result, the delta function was negatively sloped only if the proportion was low. These results demonstrate that a long temporal distance is necessary but not sufficient for observing negatively sloped delta functions. Finally, we modeled the data with drift-diffusion models. Together, our results show that differently sloped delta functions can be produced with both tasks. They further indicate that activation suppression is an important control mechanism that can be adapted rather flexibly to the control demands.

Errors in Action Timing and Inhibition Facilitate Learning by Tuning Distinct Mechanisms in the Underlying Decision Process

Goal-directed behavior requires integrating action selection processes with learning systems that adapt control using environmental feedback. These functions are known to intersect at a common neural substrate with multiple known targets of plasticity (the cortico-basal ganglia-thalamic network), suggesting that feedback signals have a multifaceted impact on future decisions. Using a hybrid of accumulation-to-bound decision models and reinforcement learning, we modeled the performance of humans in a stop signal task where participants (N 75: 37 males, 38 females) learned the prior distribution of the timing of a stop signal through trial-and-error feedback. Changes in the drift rate of the action execution process were driven by errors in action timing, whereas adaptation in the boundary height served to increase caution following failed stops. These findings highlight two interactive learning mechanisms for adapting the control of goal-directed actions based on dissociable dimensions of feedback error.SIGNIFICANCE STATEMENT Many complex behavioral goals rely on the ability to regulate the timing of action execution while also maintaining enough control to cancel actions in response to "Stop" cues in the environment. Here we examined how these fundamental components of behavior become tuned to the control demands of the environment by combining principles of reinforcement learning with accumulation-to-bound models. Model fits to behavioral data in an adaptive stop signal task revealed two adaptive mechanisms: (1) timing error-related changes in the rate of the execution signal; and (2) an increase in the execution boundary after failed stops. These findings demonstrate unique effects of timing and control errors on the underlying mechanisms of control, the rate and threshold of accumulating action signals.

The relative merit of empirical priors in non-identifiable and sloppy models: Applications to models of learning and decision-making : Empirical priors

Formal modeling approaches to cognition provide a principled characterization of observed responses in terms of a set of postulated processes, specifically in terms of parameters that modulate the latter. These model-based characterizations are useful to the extent that there is a clear, one-to-one mapping between parameters and model expectations (identifiability) and that parameters can be recovered from reasonably sized data using a typical experimental design (recoverability). These properties are sometimes not met for certain combinations of model classes and data. One suggestion to improve parameter identifiability and recoverability involves the use of "empirical priors", which constrain parameters according to a previously observed distribution of values. We assessed the efficacy of this proposal using a combination of real and artificial data. Our results showed that a point-estimate variant of the empirical-prior method could not improve parameter recovery systematically. We identified the source of poor parameter recovery in the low information content of the data. As a follow-up step, we developed a fully Bayesian variant of the empirical-prior method and assessed its performance. We find that even such a method that takes the covariance structure of the parameter distributions into account cannot reliably improve parameter recovery. We conclude that researchers should invest additional efforts in improving the informativeness of their experimental designs, as many of the problems associated to impoverished designs cannot be alleviated by modern statistical methods alone.

Multimodal Simon Effect: A Multimodal Extension of the Diffusion Model for Conflict Tasks

In conflict tasks, like the Simon task, it is usually investigated how task-irrelevant information affects the processing of task-relevant information. In the present experiments, we extended the Simon task to a multimodal setup, in which task-irrelevant information emerged from two sensory modalities. Specifically, in Experiment 1, participants responded to the identity of letters presented at a left, right, or central position with a left- or right-hand response. Additional tactile stimulation occurred on a left, right, or central position on the horizontal body plane. Response congruency of the visual and tactile stimulation was orthogonally varied. In Experiment 2, the tactile stimulation was replaced by auditory stimulation. In both experiments, the visual task-irrelevant information produced congruency effects such that responses were slower and less accurate in incongruent than incongruent conditions. Furthermore, in Experiment 1, such congruency effects, albeit smaller, were also observed for the tactile task-irrelevant stimulation. In Experiment 2, the auditory task-irrelevant stimulation produced the smallest effects. Specifically, the longest reaction times emerged in the neutral condition, while incongruent and congruent conditions differed only numerically. This suggests that in the co-presence of multiple task-irrelevant information sources, location processing is more strongly determined by visual and tactile spatial information than by auditory spatial information. An extended version of the Diffusion Model for Conflict Tasks (DMC) was fitted to the results of both experiments. This Multimodal Diffusion Model for Conflict Tasks (MDMC), and a model variant involving faster processing in the neutral visual condition (FN-MDMC), provided reasonable fits for the observed data. These model fits support the notion that multimodal task-irrelevant information superimposes across sensory modalities and automatically affects the controlled processing of task-relevant information.

Cognitive Models in Intelligence Research: Advantages and Recommendations for Their Application

Mathematical models of cognition measure individual differences in cognitive processes, such as processing speed, working memory capacity, and executive functions, that may underlie general intelligence. As such, cognitive models allow identifying associations between specific cognitive processes and tracking the effect of experimental interventions aimed at the enhancement of intelligence on mediating process parameters. Moreover, cognitive models provide an explicit theoretical formalization of theories regarding specific cognitive processes that may help in overcoming ambiguities in the interpretation of fuzzy verbal theories. In this paper, we give an overview of the advantages of cognitive modeling in intelligence research and present models in the domains of processing speed, working memory, and selective attention that may be of particular interest for intelligence research. Moreover, we provide guidelines for the application of cognitive models in intelligence research, including data collection, the evaluation of model fit, and statistical analyses.

The impact of anatomical and spatial distance between responses on response conflict

Different features of objects can be associated with different responses, so that their concurrent presence results in conflict. The Simon effect is a prominent example of this type of response conflict. In two experiments, we ask whether it is modulated by the anatomical or spatial relation between responses. Predictions were derived from an extended variant of the leaky, competing accumulator (LCA) model proposed by Usher and McClelland (Psychological Review, 108, 550-592, 2001). The relation between responses was represented by the lateral-inhibition parameter of the model. For the anatomical distance between responses the expectations were largely confirmed, but not for spatial distance. First, the Simon effect was stronger when responses were performed with two fingers of the same hand than with different hands. Second, the Simon effect was larger only for responses with different hands at short reaction times and disappeared at long ones, whereas for responses with fingers of the same hand, the Simon effect was essentially the same for shorter and longer reaction times. This difference resulted in smaller variability of reaction times in noncorresponding than in corresponding conditions. The dependence of decision processes, as modelled by the LCA model, on the anatomical relation between responses supports the broad hypothesis that the accumulation of evidence on the state of the world is intricately linked with the activation of response codes, that is, the selection of the appropriate actions.

Working memory mediates increased negative affect and suicidal ideation in childhood attention-deficit/hyperactivity disorder

Objective

Children with attention-deficit/hyperactivity disorder (ADHD) are at greater risk for suicidal ideation and suicide attempts compared to those without ADHD. Increased risk is at least partially attributable to a subset of children with ADHD and comorbid depression or disruptive behavior disorders; however, the early predictors and mechanisms driving increased risk are not well understood. Here, we investigate the contributions of two candidate mechanisms for increased suicidal ideation in children with ADHD: executive function and negative affect.

Methods

623 clinically well-characterized, community-recruited children classified by research criteria as ADHD (n=388) or typically-developing controls (n=253) participated. Parent-report on the Temperament in Middle Childhood Questionnaire provided a measure of negative affectivity. Children completed laboratory tasks to measure response inhibition and working memory. Suicidal ideation was evaluated by parent report during a semi-structured interview and child responses on the Children's Depression Inventory.

Results

Compared to typically developing controls, children with ADHD had higher rates of suicidal ideation, more negative affect, slower stop signal reaction times, and weaker working memory. Statistical path-model analyses confirmed the hypothesis that weaker working memory in ADHD statistically mediated increased negative affect. Weaker working memory also mediated and increased suicidal ideation in these cross sectional data. Findings were not attributable to comorbid disruptive behavioral disorders. Poor response inhibition did not reliably mediate negative affect or suicidal ideation.

Conclusion

Impairment in working memory is an important early risk factor for suicidal ideation in children with ADHD, and may help in identifying children for prevention and early intervention efforts.