Sensory-motor mechanisms in human parietal cortex underlie arbitrary visual decisions

The Attentional Drift Diffusion Model of Simple Perceptual Decision-Making

Perceptual decisions requiring the comparison of spatially distributed stimuli that are fixated sequentially might be influenced by fluctuations in visual attention. We used two psychophysical tasks with human subjects to investigate the extent to which visual attention influences simple perceptual choices, and to test the extent to which the attentional Drift Diffusion Model (aDDM) provides a good computational description of how attention affects the underlying decision processes. We find evidence for sizable attentional choice biases and that the aDDM provides a reasonable quantitative description of the relationship between fluctuations in visual attention, choices and reaction times. We also find that exogenous manipulations of attention induce choice biases consistent with the predictions of the model.

Self-evaluation of decision-making: A general Bayesian framework for metacognitive computation

People are often aware of their mistakes, and report levels of confidence in their choices that correlate with objective performance. These metacognitive assessments of decision quality are important for the guidance of behavior, particularly when external feedback is absent or sporadic. However, a computational framework that accounts for both confidence and error detection is lacking. In addition, accounts of dissociations between performance and metacognition have often relied on ad hoc assumptions, precluding a unified account of intact and impaired self-evaluation. Here we present a general Bayesian framework in which self-evaluation is cast as a "second-order" inference on a coupled but distinct decision system, computationally equivalent to inferring the performance of another actor. Second-order computation may ensue whenever there is a separation between internal states supporting decisions and confidence estimates over space and/or time. We contrast second-order computation against simpler first-order models in which the same internal state supports both decisions and confidence estimates. Through simulations we show that second-order computation provides a unified account of different types of self-evaluation often considered in separate literatures, such as confidence and error detection, and generates novel predictions about the contribution of one's own actions to metacognitive judgments. In addition, the model provides insight into why subjects' metacognition may sometimes be better or worse than task performance. We suggest that second-order computation may underpin self-evaluative judgments across a range of domains. (PsycINFO Database Record

Abstract and Effector-Selective Decision Signals Exhibit Qualitatively Distinct Dynamics before Delayed Perceptual Reports

Electrophysiological research has isolated neural signatures of decision formation in a variety of brain regions. Studies in rodents and monkeys have focused primarily on effector-selective signals that translate the emerging decision into a specific motor plan, but, more recently, research on the human brain has identified an abstract signature of evidence accumulation that does not appear to play any direct role in action preparation. The functional dissociations between these distinct signal types have only begun to be characterized, and their dynamics during decisions with deferred actions with or without foreknowledge of stimulus-effector mapping, a commonly studied task scenario in single-unit and functional imaging investigations, have not been established. Here we traced the dynamics of distinct abstract and effector-selective decision signals in the form of the broad-band centro-parietal positivity (CPP) and limb-selective β-band (8-16 and 18-30 Hz) EEG activity, respectively, during delayed-reported motion direction decisions with and without foreknowledge of direction-response mapping. With foreknowledge, the CPP and β-band signals exhibited a similar gradual build-up following evidence onset, but whereas choice-predictive β-band activity persisted up until the delayed response, the CPP dropped toward baseline after peaking. Without foreknowledge, the CPP exhibited identical dynamics, whereas choice-selective β-band activity was eliminated. These findings highlight qualitative functional distinctions between effector-selective and abstract decision signals and are of relevance to the assumptions founding functional neuroimaging investigations of decision-making.

SIGNIFICANCE STATEMENT

Neural signatures of evidence accumulation have been isolated in numerous brain regions. Although animal neurophysiology has largely concentrated on effector-selective decision signals that translate the emerging decision into a specific motor plan, recent research on the human brain has isolated abstract neural signatures of decision formation that are independent of specific sensory and motor requirements. Here, we examine the functional distinctions between the two distinct classes of decision variable signal during decisions with deferred actions with and without foreknowledge of stimulus-effector mapping. We find salient distinctions in the dynamics of abstract versus effector-selective decision signals in the human brain, in terms of sustainment through response delays and contingency on foreknowledge of stimulus-response mapping.

Neural correlates of evidence accumulation during value-based decisions revealed via simultaneous EEG-fMRI

Current computational accounts posit that, in simple binary choices, humans accumulate evidence in favour of the different alternatives before committing to a decision. Neural correlates of this accumulating activity have been found during perceptual decisions in parietal and prefrontal cortex; however the source of such activity in value-based choices remains unknown. Here we use simultaneous EEG–fMRI and computational modelling to identify EEG signals reflecting an accumulation process and demonstrate that the within- and across-trial variability in these signals explains fMRI responses in posterior-medial frontal cortex. Consistent with its role in integrating the evidence prior to reaching a decision, this region also exhibits task-dependent coupling with the ventromedial prefrontal cortex and the striatum, brain areas known to encode the subjective value of the decision alternatives. These results further endorse the proposition of an evidence accumulation process during value-based decisions in humans and implicate the posterior-medial frontal cortex in this process.

Parietal and prefrontal cortices gather information to make perceptual decisions, but it is not known if the same is true for value-based choices. Here, authors use simultaneous EEG-fMRI and modelling to show that during value- and reward-based decisions this evidence is accumulated in the posterior medial frontal cortex.

The contribution of the human posterior parietal cortex to episodic memory

The posterior parietal cortex (PPC) is traditionally associated with attention, perceptual decision making and sensorimotor transformations, but more recent human neuroimaging studies support an additional role in episodic memory retrieval. In this Opinion article, we present a functional-anatomical model of the involvement of the PPC in memory retrieval. Parietal regions involved in perceptual attention and episodic memory are largely segregated and often show a push-pull relationship, potentially mediated by prefrontal regions. Moreover, different PPC regions carry out specific functions during retrieval - for example, representing retrieved information, recoding this information based on task demands, or accumulating evidence for memory decisions.

Sequential sensory and decision processing in posterior parietal cortex

Decisions about the behavioral significance of sensory stimuli often require comparing sensory inference of what we are looking at to internal models of what we are looking for. Here, we test how neuronal selectivity for visual features is transformed into decision-related signals in posterior parietal cortex (area LIP). Monkeys performed a visual matching task that required them to detect target stimuli composed of conjunctions of color and motion-direction. Neuronal recordings from area LIP revealed two main findings. First, the sequential processing of visual features and the selection of target-stimuli suggest that LIP is involved in transforming sensory information into decision-related signals. Second, the patterns of color and motion selectivity and their impact on decision-related encoding suggest that LIP plays a role in detecting target stimuli by comparing bottom-up sensory inputs (what the monkeys were looking at) and top-down cognitive encoding inputs (what the monkeys were looking for).

DOI:http://dx.doi.org/10.7554/eLife.23743.001

Contributions of the parietal cortex to increased efficiency of planning-based action selection

Response selection is foundational to adaptive behavior, and considerable attention has been devoted to investigating this behavior under conditions in which the mapping between stimuli and responses is fixed. Results from prior studies implicate the left supramarginal gyrus (SMg), premotor and prefrontal cortices, as well as the cerebellum in this essential function. Yet, many goal-directed motor behaviors have multiple solutions with flexible mappings between stimuli and responses whose solutions are believed to involve prospective planning. Studies of selection under conditions of flexible mappings also reveal involvement of the left SMg, as well as bilateral premotor, superior parietal cortex (SPL) and pre-supplementary motor (pre-SMA) cortices, along with the cerebellum. This evidence is, however, limited by exclusive reliance on tasks that involve selection in the absence of overt action execution and without complete control of possible confounding effects related to differences in stimulus and response processing demands. Here, we address this limitation through use of a novel fMRI repetition suppression (FMRI-RS) paradigm. In our prime-probe design, participants select and overtly pantomime manual object rotation actions when the relationship between stimuli and responses is either flexible (experimental condition) or fixed (control condition). When trials were repeated in prime-probe pairs of the experimental condition, we detected improvements in performance accompanied by a significant suppression of blood oxygen-level dependent (BOLD) responses in: left SMg extending into and along the length of the intraparietal sulcus (IPS), right IPS, bilateral caudal superior parietal lobule (cSPL), dorsal premotor cortex (dPMC), pre-SMA, and in the lateral cerebellum. Further, region-of-interest analyses revealed interaction effects of fMRI-RS in the experimental versus control condition within left SMg and cerebellum, as well as in bilateral caudal SPL. These efficiency effects cannot be attributed to the repetition of stimulus or response processing, but instead are planning-specific and generally consistent with earlier findings from conventional fMRI investigations. We conclude that repetition-related increases in the efficiency of planning-based selection appears to be associated with parieto-cerebellar networks.

Perceptual and categorical decision making: goal-relevant representation of two domains at different levels of abstraction

To date it has been unclear whether perceptual decision making and rule-based categorization reflect activation of similar cognitive processes and brain regions. On one hand, both map potentially ambiguous stimuli to a smaller set of motor responses. On the other hand, decisions about perceptual salience typically concern concrete sensory representations derived from a noisy stimulus, while categorization is typically conceptualized as an abstract decision about membership in a potentially arbitrary set. Previous work has primarily examined these types of decisions in isolation. Here we independently varied salience in both the perceptual and categorical domains in a random dot-motion framework by manipulating dot-motion coherence and motion direction relative to a category boundary, respectively. Behavioral and modeling results suggest that categorical (more abstract) information, which is more relevant to subjects' decisions, is weighted more strongly than perceptual (more concrete) information, although they also have significant interactive effects on choice. Within the brain, BOLD activity within frontal regions strongly differentiated categorical salience and weakly differentiated perceptual salience; however, the interaction between these two factors activated similar frontoparietal brain networks. Notably, explicitly evaluating feature interactions revealed a frontal-parietal dissociation: parietal activity varied strongly with both features, but frontal activity varied with the combined strength of the information that defined the motor response. Together, these data demonstrate that frontal regions are driven by decision-relevant features and argue that perceptual decisions and rule-based categorization reflect similar cognitive processes and activate similar brain networks to the extent that they define decision-relevant stimulus-response mappings.NEW & NOTEWORTHY Here we study the behavioral and neural dynamics of perceptual categorization when decision information varies in multiple domains at different levels of abstraction. Behavioral and modeling results suggest that categorical (more abstract) information is weighted more strongly than perceptual (more concrete) information but that perceptual and categorical domains interact to influence decisions. Frontoparietal brain activity during categorization flexibly represents decision-relevant features and highlights significant dissociations in frontal and parietal activity during decision making.

Action observation: the less-explored part of higher-order vision

Little is presently known about action observation, an important perceptual component of high-level vision. To investigate this aspect of perception, we introduce a two-alternative forced-choice task for observed manipulative actions while varying duration or signal strength by noise injection. We show that accuracy and reaction time in this task can be modeled by a diffusion process for different pairs of action exemplars. Furthermore, discrimination of observed actions is largely viewpoint-independent, cannot be reduced to judgments about the basic components of action: shape and local motion, and requires a minimum duration of about 150–200 ms. These results confirm that action observation is a distinct high-level aspect of visual perception based on temporal integration of visual input generated by moving body parts. This temporal integration distinguishes it from object or scene perception, which require only very brief presentations and are viewpoint-dependent. The applicability of a diffusion model suggests that these aspects of high-level vision differ mainly at the level of the sensory neurons feeding the decision processes.

Doubt and the decision-making process in obsessive-compulsive disorder

The diagnosis of obsessive-compulsive disorder (OCD) is based on the presence of specific symptoms and their consequence in the lives of those that exhibit them. It is likely that these symptoms emerge from a neurocognitive vulnerability in the mental life of the individual which has a basis in neurophysiology. The prominence of doubt/uncertainty/lack of confidence (These terms are used interchangeably in this paper.), in the clinical presentation of many patients suffering from OCD leads to our consideration of the cognitive basis for this phenomenon. In this paper, we propose that OCD emerges from a perturbation in the decision-making process. Specifically, we hypothesize that there is diminished confidence, conviction, or certainty with regard to assimilating the information necessary to reach a decision. Recent advances in the neuroscience of decision-making provide an opportunity to further our understanding of the vulnerability underlying OCD.

Functional versus effector-specific organization of the human posterior parietal cortex: revisited

In the present study, we show that regions in posterior parietal regions process information independent of the currently used effector (hand, foot, or eye) during goal-directed actions. Functional MRI repetition suppression analysis suggests that generality across effectors holds also on the neuronal level and not just at the level of entire regions. More anterior parietal regions process information only for a specific effector or a subset of effectors.

It has been proposed that the posterior parietal cortex (PPC) is characterized by an effector-specific organization. However, strikingly similar functional MRI (fMRI) activation patterns have been found in the PPC for hand and foot movements. Because the fMRI signal is related to average neuronal activity, similar activation levels may result either from effector-unspecific neurons or from intermingled subsets of effector-specific neurons within a voxel. We distinguished between these possibilities using fMRI repetition suppression (RS). Participants made delayed, goal-directed eye, hand, and foot movements to visual targets. In each trial, the instructed effector was identical or different to that of the previous trial. RS effects indicated an attenuation of the fMRI signal in repeat trials. The caudal PPC was active during the delay but did not show RS, suggesting that its planning activity was effector independent. Hand and foot-specific RS effects were evident in the anterior superior parietal lobule (SPL), extending to the premotor cortex, with limb overlap in the anterior SPL. Connectivity analysis suggested information flow between the caudal PPC to limb-specific anterior SPL regions and between the limb-unspecific anterior SPL toward limb-specific motor regions. These results underline that both function and effector specificity should be integrated into a concept of PPC action representation not only on a regional but also on a fine-grained, subvoxel level.

The mirror illusion's effects on body state estimation

The mirror illusion uses a standard mirror to create a compelling illusion in which movements of one limb seem to be made by the other hidden limb. In this paper we adapt a motor control framework to examine which estimates of the body's configuration are affected by the illusion. We propose that the illusion primarily alters estimates related to upcoming states of the body (the desired state and the predicted state), with smaller effects on the estimate of the body state prior to movement initiation. Support for this proposal is provided both by behavioural effects of the illusion and by neuroimaging evidence from one neural region, V6A, that is critically involved in the mirror illusion and limb state estimation more generally.

The human cortical areas V6 and V6A

In macaque, it has long been known since the late nineties that the medial parieto-occipital sulcus (POS) contains two regions, V6 and V6A, important for visual motion and action. While V6 is a retinotopically organized extrastriate area, V6A is a broadly retinotopically organized visuomotor area constituted by a ventral and dorsal subdivision (V6Av and V6Ad), both containing arm movement-related cells active during spatially directed reaching movements. In humans, these areas have been mapped only in recent years thanks to neuroimaging methods. In a series of brain mapping studies, by using a combination of functional magnetic resonance imaging methods such as wide-field retinotopy and task-evoked activity, we mapped human areas V6 (Pitzalis et al., 2006) and V6Av (Pitzalis et al., 2013 d) retinotopically and defined human V6Ad functionally as a pointing-selective region situated anteriorly in the close proximity of V6Av (Tosoni et al., 2014). Like in macaque, human V6 is a motion area (e.g., Pitzalis et al., 2010, 2012, 2013 a, b , c ), while V6Av and V6Ad respond to pointing movements (Tosoni et al., 2014). The retinotopic organization (when present), anatomical position, neighbor relations, and functional properties of these three areas closely resemble those reported for macaque V6 (Galletti et al., 1996, 1999 a), V6Av, and V6Ad (Galletti et al., 1999 b; Gamberini et al., 2011). We suggest that information on objects in depth which are translating in space, because of the self-motion, is processed in V6 and conveyed to V6A for evaluating object distance in a dynamic condition such as that created by self-motion, so to orchestrate the eye and arm movements necessary to reach or avoid static and moving objects in the environment.

The activity in the anterior insulae is modulated by perceptual decision-making difficulty

Previous neuroimaging studies provide evidence for the involvement of the anterior insulae (INSs) in perceptual decision-making processes. However, how the insular cortex is involved in integration of degraded sensory information to create a conscious percept of environment and to drive our behaviors still remains a mystery. In this study, using functional magnetic resonance imaging (fMRI) and four different perceptual categorization tasks in visual and audio-visual domains, we measured blood oxygen level dependent (BOLD) signals and examined the roles of INSs in easy and difficult perceptual decision-making. We created a varying degree of degraded stimuli by manipulating the task-specific stimuli in these four experiments to examine the effects of task difficulty on insular cortex response. We hypothesized that significantly higher BOLD response would be associated with the ambiguity of the sensory information and decision-making difficulty. In all of our experimental tasks, we found the INS activity consistently increased with task difficulty and participants' behavioral performance changed with the ambiguity of the presented sensory information. These findings support the hypothesis that the anterior insulae are involved in sensory-guided, goal-directed behaviors and their activities can predict perceptual load and task difficulty.

Typicality sharpens category representations in object-selective cortex

The purpose of categorization is to identify generalizable classes of objects whose members can be treated equivalently. Within a category, however, some exemplars are more representative of that concept than others. Despite long-standing behavioral effects, little is known about how typicality influences the neural representation of real-world objects from the same category. Using fMRI, we showed participants 64 subordinate object categories (exemplars) grouped into 8 basic categories. Typicality for each exemplar was assessed behaviorally and we used several multi-voxel pattern analyses to characterize how typicality affects the pattern of responses elicited in early visual and object-selective areas: V1, V2, V3v, hV4, LOC. We found that in LOC, but not in early areas, typical exemplars elicited activity more similar to the central category tendency and created sharper category boundaries than less typical exemplars, suggesting that typicality enhances within-category similarity and between-category dissimilarity. Additionally, we uncovered a brain region (cIPL) where category boundaries favor less typical categories. Our results suggest that typicality may constitute a previously unexplored principle of organization for intra-category neural structure and, furthermore, that this representation is not directly reflected in image features describing natural input, but rather built by the visual system at an intermediate processing stage.

Space, time, and numbers in the right posterior parietal cortex: Differences between response code associations and congruency effects

The mental representations of space, time, and number magnitude are inherently linked. The right posterior parietal cortex (PPC) has been suggested to contain a general magnitude system that underlies the overlap between various perceptual dimensions. However, comparative studies including spatial, temporal, and numerical dimensions are missing. In a unified paradigm, we compared the impact of right PPC inhibition on associations with spatial response codes (i.e., Simon, SNARC, and STARC effects) and on congruency effects between space, time, and numbers. Prolonged cortical inhibition was induced by continuous theta-burst stimulation (cTBS), a protocol for transcranial magnetic stimulation (TMS), at the right intraparietal sulcus (IPS). Our results show that congruency effects, but not response code associations, are affected by right PPC inhibition, indicating different neuronal mechanisms underlying these effects. Furthermore, the results demonstrate that interactions between space and time perception are reflected in congruency effects, but not in an association between time and spatial response codes. Taken together, these results implicate that the congruency between purely perceptual dimensions is processed in PPC areas along the IPS, while the congruency between percepts and behavioral responses is independent of this region.

Sequential selection of economic good and action in medial frontal cortex of macaques during value-based decisions

Value-based decisions could rely either on the selection of desired economic goods or on the selection of the actions that will obtain the goods. We investigated this question by recording from the supplementary eye field (SEF) of monkeys during a gambling task that allowed us to distinguish chosen good from chosen action signals. Analysis of the individual neuron activity, as well as of the population state-space dynamic, showed that SEF encodes first the chosen gamble option (the desired economic good) and only ~100 ms later the saccade that will obtain it (the chosen action). The action selection is likely driven by inhibitory interactions between different SEF neurons. Our results suggest that during value-based decisions, the selection of economic goods precedes and guides the selection of actions. The two selection steps serve different functions and can therefore not compensate for each other, even when information guiding both processes is given simultaneously.

DOI:http://dx.doi.org/10.7554/eLife.09418.001

Much of our decision making seems to involve selecting the best option from among those currently available, and then working out how to attain that particular outcome. However, while this might sound straightforward in principle, exactly how this process is organized within the brain is not entirely clear.

One possibility is that the brain compares all the possible outcomes of a decision with each other before constructing a plan of action to achieve the most desirable of these. This is known as the 'goods-based' model of decision making. However, an alternative possibility is that the brain instead considers all the possible actions that could be performed at any given time. One specific action is then chosen based on a range of factors, including the potential outcomes that might result from each. This is an 'action-based' model of decision making.

Chen and Stuphorn have now distinguished between these possibilities by training two monkeys to perform a gambling task. The animals learned to make eye movements to one of two targets on a screen to earn a reward. The identity of the targets varied between trials, with some associated with larger rewards or a higher likelihood of receiving a reward than others. The location of the targets also changed in different trials, which meant that the choice of 'action' (moving the eyes to the left or right) could be distinguished from the choice of 'goods' (the reward).

By using electrodes to record from a region of the brain called the supplementary eye field, which helps to control eye movements, Chen and Stuphorn showed that the activity of neurons in this region predicted the monkeys’ decision-making behavior. Crucially, it did so in two stages: neurons first encoded the reward chosen by the monkey, before subsequently encoding the action that the monkey selected to obtain that outcome.

These data argue against an action-based model of decision making because outcomes are encoded before actions. However, they also argue against a purely goods-based model. This is because all possible actions are encoded by the brain (including those that are subsequently rejected), with the highest levels of activity seen for the action that is ultimately selected. The data instead support a new model of decision making, in which outcomes and actions are selected sequentially via two independent brain circuits.

DOI:http://dx.doi.org/10.7554/eLife.09418.002

Evidence Accumulation and Choice Maintenance Are Dissociated in Human Perceptual Decision Making

Perceptual decision making in monkeys relies on decision neurons, which accumulate evidence and maintain choices until a response is given. In humans, several brain regions have been proposed to accumulate evidence, but it is unknown if these regions also maintain choices. To test if accumulator regions in humans also maintain decisions we compared delayed and self-paced responses during a face/house discrimination decision making task. Computational modeling and fMRI results revealed dissociated processes of evidence accumulation and decision maintenance, with potential accumulator activations found in the dorsomedial prefrontal cortex, right inferior frontal gyrus and bilateral insula. Potential maintenance activation spanned the frontal pole, temporal gyri, precuneus and the lateral occipital and frontal orbital cortices. Results of a quantitative reverse inference meta-analysis performed to differentiate the functions associated with the identified regions did not narrow down potential accumulation regions, but suggested that response-maintenance might rely on a verbalization of the response.

Electrocorticography reveals the temporal dynamics of posterior parietal cortical activity during recognition memory decisions

Theories of the neurobiology of episodic memory predominantly focus on the contributions of medial temporal lobe structures, based on extensive lesion, electrophysiological, and imaging evidence. Against this backdrop, functional neuroimaging data have unexpectedly implicated left posterior parietal cortex (PPC) in episodic retrieval, revealing distinct activation patterns in PPC subregions as humans make memory-related decisions. To date, theorizing about the functional contributions of PPC has been hampered by the absence of information about the temporal dynamics of PPC activity as retrieval unfolds. Here, we leveraged electrocorticography to examine the temporal profile of high gamma power (HGP) in dorsal PPC subregions as participants made old/new recognition memory decisions. A double dissociation in memory-related HGP was observed, with activity in left intraparietal sulcus (IPS) and left superior parietal lobule (SPL) differing in time and sign for recognized old items (Hits) and correctly rejected novel items (CRs). Specifically, HGP in left IPS increased for Hits 300-700 ms poststimulus onset, and decayed to baseline ∼200 ms preresponse. By contrast, HGP in left SPL increased for CRs early after stimulus onset (200-300 ms) and late in the memory decision (from 700 ms to response). These memory-related effects were unique to left PPC, as they were not observed in right PPC. Finally, memory-related HGP in left IPS and SPL was sufficiently reliable to enable brain-based decoding of the participant's memory state at the single-trial level, using multivariate pattern classification. Collectively, these data provide insights into left PPC temporal dynamics as humans make recognition memory decisions.

Cortical alpha activity predicts the confidence in an impending action

When we make a decision, we experience a degree of confidence that our choice may lead to a desirable outcome. Recent studies in animals have probed the subjective aspects of the choice confidence using confidence-reporting tasks. These studies showed that estimates of the choice confidence substantially modulate neural activity in multiple regions of the brain. Building on these findings, we investigated the neural representation of the confidence in a choice in humans who explicitly reported the confidence in their choice. Subjects performed a perceptual decision task in which they decided between choosing a button press or a saccade while we recorded EEG activity. Following each choice, subjects indicated whether they were sure or unsure about the choice. We found that alpha activity strongly encodes a subject's confidence level in a forthcoming button press choice. The neural effect of the subjects' confidence was independent of the reaction time and independent of the sensory input modeled as a decision variable. Furthermore, the effect is not due to a general cognitive state, such as reward expectation, because the effect was specifically observed during button press choices and not during saccade choices. The neural effect of the confidence in the ensuing button press choice was strong enough that we could predict, from independent single trial neural signals, whether a subject was going to be sure or unsure of an ensuing button press choice. In sum, alpha activity in human cortex provides a window into the commitment to make a hand movement.

Evolution of posterior parietal cortex and parietal-frontal networks for specific actions in primates

Posterior parietal cortex (PPC) is an extensive region of the human brain that develops relatively late and is proportionally large compared with that of monkeys and prosimian primates. Our ongoing comparative studies have led to several conclusions about the evolution of this posterior parietal region. In early placental mammals, PPC likely was a small multisensory region much like PPC of extant rodents and tree shrews. In early primates, PPC likely resembled that of prosimian galagos, in which caudal PPC (PPCc) is visual and rostral PPC (PPCr) has eight or more multisensory domains where electrical stimulation evokes different complex motor behaviors, including reaching, hand-to-mouth, looking, protecting the face or body, and grasping. These evoked behaviors depend on connections with functionally matched domains in premotor cortex (PMC) and motor cortex (M1). Domains in each region compete with each other, and a serial arrangement of domains allows different factors to influence motor outcomes successively. Similar arrangements of domains have been retained in New and Old World monkeys, and humans appear to have at least some of these domains. The great expansion and prolonged development of PPC in humans suggest the addition of functionally distinct territories. We propose that, across primates, PMC and M1 domains are second and third levels in a number of parallel, interacting networks for mediating and selecting one type of action over others.

Visual Information Shapes the Dynamics of Corticobasal Ganglia Pathways during Response Selection and Inhibition

Action selection often requires the transformation of visual information into motor plans. Preventing premature responses may entail the suppression of visual input and/or of prepared muscle activity. This study examined how the quality of visual information affects frontobasal ganglia (BG) routes associated with response selection and inhibition. Human fMRI data were collected from a stop task with visually degraded or intact face stimuli. During go trials, degraded spatial frequency information reduced the speed of information accumulation and response cautiousness. Effective connectivity analysis of the fMRI data showed action selection to emerge through the classic direct and indirect BG pathways, with inputs deriving form both prefrontal and visual regions. When stimuli were degraded, visual and prefrontal regions processing the stimulus information increased connectivity strengths toward BG, whereas regions evaluating visual scene content or response strategies reduced connectivity toward BG. Response inhibition during stop trials recruited the indirect and hyperdirect BG pathways, with input from visual and prefrontal regions. Importantly, when stimuli were nondegraded and processed fast, the optimal stop model contained additional connections from prefrontal to visual cortex. Individual differences analysis revealed that stronger prefrontal-to-visual connectivity covaried with faster inhibition times. Therefore, prefrontal-to-visual cortex connections appear to suppress the fast flow of visual input for the go task, such that the inhibition process can finish before the selection process. These results indicate response selection and inhibition within the BG to emerge through the interplay of top–down adjustments from prefrontal and bottom–up input from sensory cortex.

Increased Reliance on Value-based Decision Processes Following Motor Cortex Disruption

BACKGROUND

During motor decision making, the neural activity in primary motor cortex (M1) encodes dynamically the competition occurring between potential action plans. A common view is that M1 represents the unfolding of the outcome of a decision process taking place upstream. Yet, M1 could also be directly involved in the decision process.

OBJECTIVE

Here we tested this hypothesis by assessing the effect of M1 disruption on a motor decision-making task.

METHODS

We applied continuous theta burst stimulation (cTBS) to inhibit either left or right M1 in different groups of subjects and included a third control group with no stimulation. Following cTBS, participants performed a task that required them to choose between two finger key-presses with the right hand according to both perceptual and value-based information. Effects were assessed by means of generalized linear mixed models and computational simulations.

RESULTS

In all three groups, subjects relied both on perceptual (P < 0.0001) and value-based information (P = 0.003) to reach a decision. Yet, left M1 disruption led to an increased reliance on value-based information (P = 0.03). This result was confirmed by a computational model showing an increased weight of the valued-based process on the right hand finger choices following left M1 cTBS (P < 0.01).

CONCLUSION

These results indicate that M1 is involved in motor decision making, possibly by weighting the final integration of multiple sources of evidence driving motor behaviors.

Content-specific evidence accumulation in inferior temporal cortex during perceptual decision-making

During a perceptual decision, neuronal activity can change as a function of time-integrated evidence. Such neurons may serve as decision variables, signaling a choice when activity reaches a boundary. Because the signals occur on a millisecond timescale, translating to human decision-making using functional neuroimaging has been challenging. Previous neuroimaging work in humans has identified patterns of neural activity consistent with an accumulation account. However, the degree to which the accumulating neuroimaging signals reflect specific sources of perceptual evidence is unknown. Using an extended face/house discrimination task in conjunction with cognitive modeling, we tested whether accumulation signals, as measured using functional magnetic resonance imaging (fMRI), are stimulus-specific. Accumulation signals were defined as a change in the slope of the rising edge of activation corresponding with response time (RT), with higher slopes associated with faster RTs. Consistent with an accumulation account, fMRI activity in face- and house-selective regions in the inferior temporal cortex increased at a rate proportional to decision time in favor of the preferred stimulus. This finding indicates that stimulus-specific regions perform an evidence integrative function during goal-directed behavior and that different sources of evidence accumulate separately. We also assessed the decision-related function of other regions throughout the brain and found that several regions were consistent with classifications from prior work, suggesting a degree of domain generality in decision processing. Taken together, these results provide support for an integration-to-boundary decision mechanism and highlight possible roles of both domain-specific and domain-general regions in decision evidence evaluation.

Human scalp potentials reflect a mixture of decision-related signals during perceptual choices

Single-unit animal studies have consistently reported decision-related activity mirroring a process of temporal accumulation of sensory evidence to a fixed internal decision boundary. To date, our understanding of how response patterns seen in single-unit data manifest themselves at the macroscopic level of brain activity obtained from human neuroimaging data remains limited. Here, we use single-trial analysis of human electroencephalography data to show that population responses on the scalp can capture choice-predictive activity that builds up gradually over time with a rate proportional to the amount of sensory evidence, consistent with the properties of a drift-diffusion-like process as characterized by computational modeling. Interestingly, at time of choice, scalp potentials continue to appear parametrically modulated by the amount of sensory evidence rather than converging to a fixed decision boundary as predicted by our model. We show that trial-to-trial fluctuations in these response-locked signals exert independent leverage on behavior compared with the rate of evidence accumulation earlier in the trial. These results suggest that in addition to accumulator signals, population responses on the scalp reflect the influence of other decision-related signals that continue to covary with the amount of evidence at time of choice.

Motor role of parietal cortex in a monkey model of hemispatial neglect

Parietal cortex is central to spatial cognition. Lesions of parietal cortex often lead to hemispatial neglect, an impairment of choices of targets in space. It has been unclear whether parietal cortex implements target choice at the general cognitive level, or whether parietal cortex subserves the choice of targets of particular actions. To address this question, monkeys engaged in choice tasks in two distinct action contexts--eye movements and arm movements. We placed focused reversible lesions into specific parietal circuits using the GABAA receptor agonist muscimol and validated the lesion placement using MRI. We found that lesions on the lateral bank of the intraparietal sulcus [lateral intraparietal area (LIP)] specifically biased choices made using eye movements, whereas lesions on the medial bank of the intraparietal sulcus [parietal reach region (PRR)] specifically biased choices made using arm movements. This double dissociation suggests that target choice is implemented in dedicated parietal circuits in the context of specific actions. This finding emphasizes a motor role of parietal cortex in spatial choice making and contributes to our understanding of hemispatial neglect.

Brain activity modulation during the production of imperative and declarative pointing

Pointing is a communicative gesture, commonly used for expressing two main intentions: imperative, to obtain a desired object/action from the other, or declarative, to share attention/interest about a referent with the other. Previous neuroimaging research on adults examined pointing almost exclusively as a reaching-like motor act rather than as a communicative gesture. Here, we used fMRI to record brain activity while 16 participants produced either imperative or declarative pointing gestures within a communicative context. A network of regions (the bilateral ventral premotor cortex, anterior midcingulate cortex, middle insula and the right preSMA) showed a preference for the production of declarative pointing as opposed to imperative pointing. The right preSMA also preferred declarative intention during pointing observation. Instead, independently from the intention, the right pMTG was more active during pointing observation than production. In the bilateral posterior parietal reach region we also observed a side (contra>ipsi) effect when the intention was imperative, regardless of the subject's role in the communication. Based on these results, we propose that pointing with declarative intention recruits a network of regions associated with will, motivation, emotional/affective expression and intersubjectivity, whereas pointing with imperative intention recruits regions associated with reaching. The proposal is consistent with the developmental hypothesis that declarative pointing reflects social cognitive abilities more than imperative pointing and establishes a stimulating link for future interdisciplinary research.

Precision and neuronal dynamics in the human posterior parietal cortex during evidence accumulation

Primate studies show slow ramping activity in posterior parietal cortex (PPC) neurons during perceptual decision-making. These findings have inspired a rich theoretical literature to account for this activity. These accounts are largely unrelated to Bayesian theories of perception and predictive coding, a related formulation of perceptual inference in the cortical hierarchy. Here, we tested a key prediction of such hierarchical inference, namely that the estimated precision (reliability) of information ascending the cortical hierarchy plays a key role in determining both the speed of decision-making and the rate of increase of PPC activity. Using dynamic causal modelling of magnetoencephalographic (MEG) evoked responses, recorded during a simple perceptual decision-making task, we recover ramping-activity from an anatomically and functionally plausible network of regions, including early visual cortex, the middle temporal area (MT) and PPC. Precision, as reflected by the gain on pyramidal cell activity, was strongly correlated with both the speed of decision making and the slope of PPC ramping activity. Our findings indicate that the dynamics of neuronal activity in the human PPC during perceptual decision-making recapitulate those observed in the macaque, and in so doing we link observations from primate electrophysiology and human choice behaviour. Moreover, the synaptic gain control modulating these dynamics is consistent with predictive coding formulations of evidence accumulation.

Neural representations of confidence emerge from the process of decision formation during perceptual choices

Choice confidence represents the degree of belief that one's actions are likely to be correct or rewarding and plays a critical role in optimizing our decisions. Despite progress in understanding the neurobiology of human perceptual decision-making, little is known about the representation of confidence. Importantly, it remains unclear whether confidence forms an integral part of the decision process itself or represents a purely post-decisional signal. To address this issue we employed a paradigm whereby on some trials, prior to indicating their decision, participants could opt-out of the task for a small but certain reward. This manipulation captured participants' confidence on individual trials and allowed us to discriminate between electroencephalographic signals associated with certain-vs.-uncertain trials. Discrimination increased gradually and peaked well before participants indicated their choice. These signals exhibited a temporal profile consistent with a process of evidence accumulation, culminating at time of peak discrimination. Moreover, trial-by-trial fluctuations in the accumulation rate of nominally identical stimuli were predictive of participants' likelihood to opt-out of the task, suggesting that confidence emerges from the decision process itself and is computed continuously as the process unfolds. Correspondingly, source reconstruction placed these signals in regions previously implicated in decision making, within the prefrontal and parietal cortices. Crucially, control analyses ensured that these results could not be explained by stimulus difficulty, lapses in attention or decision accuracy.

The strength of gradually accruing probabilistic evidence modulates brain activity during a categorical decision

The evolution of neural activity during a perceptual decision is well characterized by the evidence parameter in sequential sampling models. However, it is not known whether accumulating signals in human neuroimaging are related to the integration of evidence. Our aim was to determine whether activity accumulates in a nonperceptual task by identifying brain regions tracking the strength of probabilistic evidence. fMRI was used to measure whole-brain activity as choices were informed by integrating a series of learned prior probabilities. Participants first learned the predictive relationship between a set of shape stimuli and one of two choices. During scanned testing, they made binary choices informed by the sum of the predictive strengths of individual shapes. Sequences of shapes adhered to three distinct rates of evidence (RoEs): rapid, gradual, and switch. We predicted that activity in regions informing the decision would modulate as a function of RoE prior to the choice. Activity in some regions, including premotor areas, changed as a function of RoE and response hand, indicating a role in forming an intention to respond. Regions in occipital, temporal, and parietal lobes modulated as a function of RoE only, suggesting a preresponse stage of evidence processing. In all of these regions, activity was greatest on rapid trials and least on switch trials, which is consistent with an accumulation-to-boundary account. In contrast, activity in a set of frontal and parietal regions was greatest on switch and least on rapid trials, which is consistent with an effort or time-on-task account.

Decoupling motor plans from perceptual decisions to investigate whether and when decisions are embodied

Decision making is a crucial part of our life: we sense information from the environment and perform our motor response. However, "whether" and "when" decisions are embodied still needs to be fully elucidated. Neuroimaging data obtained by the disentanglement of perceptual decision from motor preparation revealed an increase in connectivity between inferior frontal cortex and sensory regions, and the important role played by intraparietal sulcus in motor decisions. The results obtained as well as the new research questions prompted by this work are carefully discussed herein.

Dissociating the influence of response selection and task anticipation on corticospinal suppression during response preparation

Motor behavior requires selecting between potential actions. The role of inhibition in response selection has frequently been examined in tasks in which participants are engaged in some advance preparation prior to the presentation of an imperative signal. Under such conditions, inhibition could be related to processes associated with response selection, or to more general inhibitory processes that are engaged in high states of anticipation. In Experiment 1, we manipulated the degree of anticipatory preparation. Participants performed a choice reaction time task that required choosing between a movement of the left or right index finger, and used transcranial magnetic stimulation (TMS) to elicit motor evoked potentials (MEPs) in the left hand agonist. In high anticipation blocks, a non-informative cue (e.g., fixation marker) preceded the imperative; in low anticipation blocks, there was no cue and participants were required to divide their attention between two tasks to further reduce anticipation. MEPs were substantially reduced before the imperative signal in high anticipation blocks. In contrast, in low anticipation blocks, MEPs remained unchanged before the imperative signal but showed a marked suppression right after the onset of the imperative. This effect occurred regardless of whether the imperative had signalled a left or right hand response. After this initial inhibition, left MEPs increased when the left hand was selected and remained suppressed when the right hand was selected. We obtained similar results in Experiment 2 except that the persistent left MEP suppression when the left hand was not selected was attenuated when the alternative response involved a non-homologous effector (right foot). These results indicate that, even in the absence of an anticipatory period, inhibitory mechanisms are engaged during response selection, possibly to prevent the occurrence of premature and inappropriate responses during a competitive selection process.

How active perception and attractor dynamics shape perceptual categorization: a computational model

We propose a computational model of perceptual categorization that fuses elements of grounded and sensorimotor theories of cognition with dynamic models of decision-making. We assume that category information consists in anticipated patterns of agent-environment interactions that can be elicited through overt or covert (simulated) eye movements, object manipulation, etc. This information is firstly encoded when category information is acquired, and then re-enacted during perceptual categorization. The perceptual categorization consists in a dynamic competition between attractors that encode the sensorimotor patterns typical of each category; action prediction success counts as "evidence" for a given category and contributes to falling into the corresponding attractor. The evidence accumulation process is guided by an active perception loop, and the active exploration of objects (e.g., visual exploration) aims at eliciting expected sensorimotor patterns that count as evidence for the object category. We present a computational model incorporating these elements and describing action prediction, active perception, and attractor dynamics as key elements of perceptual categorizations. We test the model in three simulated perceptual categorization tasks, and we discuss its relevance for grounded and sensorimotor theories of cognition.

Resting-state connectivity and functional specialization in human medial parieto-occipital cortex

According to recent models of visuo-spatial processing, the medial parieto-occipital cortex is a crucial node of the dorsal visual stream. Evidence from neurophysiological studies in monkeys has indicated that the parieto-occipital sulcus (POS) contains three functionally and cytoarchitectonically distinct areas: the visual area V6 in the fundus of the POS, and the visuo-motor areas V6Av and V6Ad in a progressively dorsal and anterior location with respect to V6. Besides different topographical organization, cytoarchitectonics, and functional properties, these three monkey areas can also be distinguished based on their patterns of cortico-cortical connections. Thanks to wide-field retinotopic mapping, areas V6 and V6Av have been also mapped in the human brain. Here, using a combined approach of resting-state functional connectivity and task-evoked activity by fMRI, we identified a new region in the anterior POS showing a pattern of functional properties and cortical connections that suggests a homology with the monkey area V6Ad. In addition, we observed distinct patterns of cortical connections associated with the human V6 and V6Av which are remarkably consistent with those showed by the anatomical tracing studies in the corresponding monkey areas. Consistent with recent models on visuo-spatial processing, our findings demonstrate a gradient of functional specialization and cortical connections within the human POS, with more posterior regions primarily dedicated to the analysis of visual attributes useful for spatial navigation and more anterior regions primarily dedicated to analyses of spatial information relevant for goal-directed action.

Successful remembering elicits event-specific activity patterns in lateral parietal cortex

Remembering a past event involves reactivation of content-specific patterns of neural activity in high-level perceptual regions (e.g., ventral temporal cortex, VTC). In contrast, the subjective experience of vivid remembering is typically associated with increased activity in lateral parietal cortex (LPC)--"retrieval success effects" that are thought to generalize across content types. However, the functional significance of LPC activation during memory retrieval remains a subject of active debate. In particular, theories are divided with respect to whether LPC actively represents retrieved content or if LPC activity only scales with content reactivation elsewhere (e.g., VTC). Here, we report a human fMRI study of visual memory recall (faces vs scenes) in which complementary forms of multivoxel pattern analysis were used to test for and compare content reactivation within LPC and VTC. During recall of visual images, we observed robust reactivation of broad category information (face vs scene) in both VTC and LPC. Moreover, recall-related activity patterns in LPC, but not VTC, differentiated between individual events. Importantly, these content effects were particularly evident in areas of LPC (namely, angular gyrus) in which activity scaled with subjective reports of recall vividness. These findings provide striking evidence that LPC not only signals that memories have been successfully recalled, but actively represents what is being remembered.

Memory accumulation mechanisms in human cortex are independent of motor intentions

Previous studies on perceptual decision-making have often emphasized a tight link between decisions and motor intentions. Human decisions, however, also depend on memories or experiences that are not closely tied to specific motor responses. Recent neuroimaging findings have suggested that, during episodic retrieval, parietal activity reflects the accumulation of evidence for memory decisions. It is currently unknown, however, whether these evidence accumulation signals are functionally linked to signals for motor intentions coded in frontoparietal regions and whether activity in the putative memory accumulator tracks the amount of evidence for only previous experience, as reflected in "old" reports, or for both old and new decisions, as reflected in the accuracy of memory judgments. Here, human participants used saccadic-eye and hand-pointing movements to report recognition judgments on pictures defined by different degrees of evidence for old or new decisions. A set of cortical regions, including the middle intraparietal sulcus, showed a monotonic variation of the fMRI BOLD signal that scaled with perceived memory strength (older > newer), compatible with an asymmetrical memory accumulator. Another set, including the hippocampus and the angular gyrus, showed a nonmonotonic response profile tracking memory accuracy (higher > lower evidence), compatible with a symmetrical accumulator. In contrast, eye and hand effector-specific regions in frontoparietal cortex tracked motor intentions but were not modulated by the amount of evidence for the effector outcome. We conclude that item recognition decisions are supported by a combination of symmetrical and asymmetrical accumulation signals largely segregated from motor intentions.

Brain networks of perceptual decision-making: an fMRI ALE meta-analysis

In the recent perceptual decision-making literature, a fronto-parietal network is typically reported to primarily represent the neural substrate of human perceptual decision-making. However, the view that only cortical areas are involved in perceptual decision-making has been challenged by several neurocomputational models which all argue that the basal ganglia play an essential role in perceptual decisions. To consolidate these different views, we conducted an Activation Likelihood Estimation (ALE) meta-analysis on the existing neuroimaging literature. The results argue in favor of the involvement of a frontal-parietal network in general perceptual decision-making that is possibly complemented by the basal ganglia, and modulated in substantial parts by task difficulty. In contrast, expectation of reward, an important aspect of many decision-making processes, shows almost no overlap with the general perceptual decision-making network.