From thought to action: the parietal cortex as a bridge between perception, action, and cognition

A shared, flexible neural map architecture reflects capacity limits in both visual short-term memory and enumeration

Human cognition is characterized by severe capacity limits: we can accurately track, enumerate, or hold in mind only a small number of items at a time. It remains debated whether capacity limitations across tasks are determined by a common system. Here we measure brain activation of adult subjects performing either a visual short-term memory (vSTM) task consisting of holding in mind precise information about the orientation and position of a variable number of items, or an enumeration task consisting of assessing the number of items in those sets. We show that task-specific capacity limits (three to four items in enumeration and two to three in vSTM) are neurally reflected in the activity of the posterior parietal cortex (PPC): an identical set of voxels in this region, commonly activated during the two tasks, changed its overall response profile reflecting task-specific capacity limitations. These results, replicated in a second experiment, were further supported by multivariate pattern analysis in which we could decode the number of items presented over a larger range during enumeration than during vSTM. Finally, we simulated our results with a computational model of PPC using a saliency map architecture in which the level of mutual inhibition between nodes gives rise to capacity limitations and reflects the task-dependent precision with which objects need to be encoded (high precision for vSTM, lower precision for enumeration). Together, our work supports the existence of a common, flexible system underlying capacity limits across tasks in PPC that may take the form of a saliency map.

Enhanced parietal cortex activation during location detection in children with autism

BACKGROUND

Visuospatial processing has been found to be mediated primarily by two cortical routes, one of which is unique to recognizing objects (occipital-temporal, ventral or "what" pathway) and the other to detecting the location of objects in space (parietal-occipital, dorsal or "where" pathway). Considering previous findings of relative advantage in people with autism in visuospatial processing, this functional MRI study examined the connectivity in the dorsal and ventral pathways in high-functioning children with autism.

METHODS

Seventeen high-functioning children and adolescents with autism spectrum disorders (ASD) and 19 age-and-IQ-matched typically developing (TD) participants took part in this study. A simple visual task involving object recognition and location detection was used. In the MRI scanner, participants were shown grey scale pictures of objects (e.g., toys, household items, etc.) and were asked to identify the objects presented or to specify the location of objects relative to a cross at the center of the screen.

RESULTS

Children with ASD, relative to TD children, displayed significantly greater activation in the left inferior parietal lobule (especially the angular gyrus) while detecting the location of objects. However, there were no group differences in brain activity during object recognition. There were also differences in functional connectivity, with the ASD participants showing decreased connectivity of the inferior temporal area with parietal and occipital areas during location detection.

CONCLUSIONS

The results of this study underscore previous findings of an increased reliance on visuospatial processing (increased parietal activation) for information processing in ASD individuals. In addition, such processing may be more local, focal, and detailed in ASD as evidenced from the weaker functional connectivity.

Attentional priority determines working memory precision

Visual working memory is a system used to hold information actively in mind for a limited time. The number of items and the precision with which we can store information has limits that define its capacity. How much control do we have over the precision with which we store information when faced with these severe capacity limitations? Here, we tested the hypothesis that rank-ordered attentional priority determines the precision of multiple working memory representations. We conducted two psychophysical experiments that manipulated the priority of multiple items in a two-alternative forced choice task (2AFC) with distance discrimination. In Experiment 1, we varied the probabilities with which memorized items were likely to be tested. To generalize the effects of priority beyond simple cueing, in Experiment 2, we manipulated priority by varying monetary incentives contingent upon successful memory for items tested. Moreover, we illustrate our hypothesis using a simple model that distributed attentional resources across items with rank-ordered priorities. Indeed, we found evidence in both experiments that priority affects the precision of working memory in a monotonic fashion. Our results demonstrate that representations of priority may provide a mechanism by which resources can be allocated to increase the precision with which we encode and briefly store information.

Eye movement preparation modulates neuronal responses in area V4 when dissociated from attentional demands

We examined whether the preparation of saccadic eye movements, when behaviorally dissociated from covert attention, modulates activity within visual cortex. We measured single-neuron and local field potential (LFP) responses to visual stimuli in area V4 while monkeys covertly attended a stimulus at one location and prepared saccades to a potential target at another. In spite of the irrelevance of visual information at the saccade target, visual activity at that location was modulated at least as much as, and often more than, activity at the covertly attended location. Modulations of activity at the attended and saccade target locations were qualitatively similar and included increased response magnitude, stimulus selectivity, and spiking reliability, as well as increased gamma and decreased low-frequency power of LFPs. These results demonstrate that saccade preparation is sufficient to modulate visual cortical representations and suggest that the interrelationship of oculomotor and attention-related mechanisms extends to posterior visual cortex.

An information theory account of cognitive control

Our ability to efficiently process information and generate appropriate responses depends on the processes collectively called cognitive control. Despite a considerable focus in the literature on the cognitive control of information processing, neural mechanisms underlying control are still unclear, and have not been characterized by considering the quantity of information to be processed. A novel and comprehensive account of cognitive control is proposed using concepts from information theory, which is concerned with communication system analysis and the quantification of information. This account treats the brain as an information-processing entity where cognitive control and its underlying brain networks play a pivotal role in dealing with conditions of uncertainty. This hypothesis and theory article justifies the validity and properties of such an account and relates experimental findings to the frontoparietal network under the framework of information theory.

Altering spatial priority maps via reward-based learning

Spatial priority maps are real-time representations of the behavioral salience of locations in the visual field, resulting from the combined influence of stimulus driven activity and top-down signals related to the current goals of the individual. They arbitrate which of a number of (potential) targets in the visual scene will win the competition for attentional resources. As a result, deployment of visual attention to a specific spatial location is determined by the current peak of activation (corresponding to the highest behavioral salience) across the map. Here we report a behavioral study performed on healthy human volunteers, where we demonstrate that spatial priority maps can be shaped via reward-based learning, reflecting long-lasting alterations (biases) in the behavioral salience of specific spatial locations. These biases exert an especially strong influence on performance under conditions where multiple potential targets compete for selection, conferring competitive advantage to targets presented in spatial locations associated with greater reward during learning relative to targets presented in locations associated with lesser reward. Such acquired biases of spatial attention are persistent, are nonstrategic in nature, and generalize across stimuli and task contexts. These results suggest that reward-based attentional learning can induce plastic changes in spatial priority maps, endowing these representations with the "intelligent" capacity to learn from experience.

Single trial prediction of self-paced reaching directions from EEG signals

Early detection of movement intention could possibly minimize the delays in the activation of neuroprosthetic devices. As yet, single trial analysis using non-invasive approaches for understanding such movement preparation remains a challenging task. We studied the feasibility of predicting movement directions in self-paced upper limb center-out reaching tasks, i.e., spontaneous movements executed without an external cue that can better reflect natural motor behavior in humans. We reported results of non-invasive electroencephalography (EEG) recorded from mild stroke patients and able-bodied participants. Previous studies have shown that low frequency EEG oscillations are modulated by the intent to move and therefore, can be decoded prior to the movement execution. Motivated by these results, we investigated whether slow cortical potentials (SCPs) preceding movement onset can be used to classify reaching directions and evaluated the performance using 5-fold cross-validation. For able-bodied subjects, we obtained an average decoding accuracy of 76% (chance level of 25%) at 62.5 ms before onset using the amplitude of on-going SCPs with above chance level performances between 875 to 437.5 ms prior to onset. The decoding accuracy for the stroke patients was on average 47% with their paretic arms. Comparison of the decoding accuracy across different frequency ranges (i.e., SCPs, delta, theta, alpha, and gamma) yielded the best accuracy using SCPs filtered between 0.1 to 1 Hz. Across all the subjects, including stroke subjects, the best selected features were obtained mostly from the fronto-parietal regions, hence consistent with previous neurophysiological studies on arm reaching tasks. In summary, we concluded that SCPs allow the possibility of single trial decoding of reaching directions at least 312.5 ms before onset of reach.

Three-dimensional reach trajectories as a probe of real-time decision-making between multiple competing targets

Though several features of cognitive processing can be inferred from the discrete measurement [e.g., reaction time (RT), accuracy, etc.] of participants' conscious reports (e.g., verbal or key-press responses), it is becoming increasingly clear that a much richer understanding of these features can be captured from continuous measures of rapid, largely non-conscious behaviors like hand or eye movements. Here, using new experimental data, we describe in detail both the approach and analyses implemented in some of our previous studies that have used rapid reaching movements under cases of target uncertainty in order to probe the features, constraints and dynamics of stimulus-related processing in the brain. This work, as well as that of others, shows that when individuals are simultaneously presented with multiple potential targets—only one of which will be cued after reach onset—they produce initial reach trajectories that are spatially biased in accordance with the probabilistic distribution of targets. Such “spatial averaging” effects are consistent with observations from neurophysiological studies showing that neuronal populations in sensorimotor brain structures represent multiple target choices in parallel and they compete for selection. These effects also confirm and help extend computational models aimed at understanding the underlying mechanisms that support action-target selection. We suggest that the use of this simple, yet powerful behavioral paradigm for providing a “real-time” visualization of ongoing cognitive processes occurring at the neural level offers great promise for studying processes related to a wide range of psychological phenomena, such as decision-making and the representation of objects.

Association between gait variability and brain ventricle attributes: a brain mapping study

BACKGROUND

It remains unknown which brain regions are involved in the maintenance of gait dynamic stability in older adults, as characterized by a low stride time variability. Expansion of lateral cerebral ventricles is an indirect marker of adjacent brain tissue volume. The purpose of this study was to examine the association between stride time variability and the volume of sub-regions of the lateral cerebral ventricles among older community-dwellers.

METHODS

One-hundred-fifteen participants free of hydrocephalus from the GAIT study (mean, 70.4±4.4years; 43.5% female) were included in this analysis. Stride time variability was measured at self-selected pace with a 10m electronic portable walkway (GAITRite). Participants were separated into 3 groups based on tertiles of stride time variability (i.e., <2.0%; 2.0-2.8%; >2.8%). Brain ventricle sub-volumes were quantified from three-dimensional T1-weighted MRI using semi-automated software. Age, gender, Cumulative Illness Rating Scale for Geriatrics, Mini-Mental State Examination, Go-NoGo, brain vascular burden, 4-item Geriatric Depression Scale, psychoactive drugs, vision, proprioception, body mass index, muscular strength and gait velocity were used as covariates.

RESULTS

Participants with the highest (i.e., worst) tertile of stride time variability exhibited larger temporal horns than those with the lowest (P=0.030) and intermediate tertiles (P=0.028). They also had larger middle portions of ventricular bodies than those with the intermediate tertile (P=0.018). Larger temporal horns were associated with increase in stride time variability (adjusted β=0.86, P=0.005), specifically with the highest tertile of stride time variability (adjusted OR=2.45, P=0.044).

CONCLUSIONS

Higher stride time variability was associated with larger temporal horns in older community-dwellers. Addressing focal neuronal losses in temporal lobes may represent an important strategy to prevent gait instability.

Differential activation patterns of FMRI in sleep-deprived brain: restoring effects of acupuncture

Previous studies suggested a remediation role of acupuncture in insomnia, and acupuncture also has been used in insomnia empirically and clinically. In this study, we employed fMRI to test the role of acupuncture in sleep deprivation (SD). Sixteen healthy volunteers (8 males) were recruited and scheduled for three fMRI scanning procedures, one following the individual's normal sleep and received acupuncture SP6 (NOR group) and the other two after 24 h of total SD with acupuncture on SP6 (SD group) or sham (Sham group). The sessions were counterbalanced approximately two weeks apart. Acupuncture stimuli elicited significantly different activation patterns of three groups. In NOR group, the right superior temporal lobe, left inferior parietal lobule, and left postcentral gyrus were activated; in SD group, the anterior cingulate cortex, bilateral insula, left basal ganglia, and thalamus were significantly activated while, in Sham group, the bilateral thalamus and left cerebellum were activated. Different activation patterns suggest a unique role of acupuncture on SP6 in remediation of SD. SP6 elicits greater and anatomically different activations than those of sham stimuli; that is, the salience network, a unique interoceptive autonomic circuit, may indicate the mechanism underlying acupuncture in restoring sleep deprivation.

What's special about task in dystonia? A voxel-based morphometry and diffusion weighted imaging study

Numerous brain imaging studies have demonstrated structural changes in the basal ganglia, thalamus, sensorimotor cortex, and cerebellum across different forms of primary dystonia. However, our understanding of brain abnormalities contributing to the clinically well-described phenomenon of task specificity in dystonia remained limited. We used high-resolution magnetic resonance imaging (MRI) with voxel-based morphometry and diffusion weighted imaging with tract-based spatial statistics of fractional anisotropy to examine gray and white matter organization in two task-specific dystonia forms, writer's cramp and laryngeal dystonia, and two non-task-specific dystonia forms, cervical dystonia and blepharospasm. A direct comparison between both dystonia forms indicated that characteristic gray matter volumetric changes in task-specific dystonia involve the brain regions responsible for sensorimotor control during writing and speaking, such as primary somatosensory cortex, middle frontal gyrus, superior/inferior temporal gyrus, middle/posterior cingulate cortex, and occipital cortex as well as the striatum and cerebellum (lobules VI-VIIa). These gray matter changes were accompanied by white matter abnormalities in the premotor cortex, middle/inferior frontal gyrus, genu of the corpus callosum, anterior limb/genu of the internal capsule, and putamen. Conversely, gray matter volumetric changes in the non-task-specific group were limited to the left cerebellum (lobule VIIa) only, whereas white matter alterations were found to underlie the primary sensorimotor cortex, inferior parietal lobule, and middle cingulate gyrus. Distinct microstructural patterns in task-specific and non-task-specific dystonias may represent neuroimaging markers and provide evidence that these two dystonia subclasses likely follow divergent pathophysiological mechanisms precipitated by different triggers.

Distinct neural specializations for learning to read words and name objects

Understanding the neural systems that underpin reading acquisition is key if neuroscientific findings are to inform educational practice. We provide a unique window into these systems by teaching 19 adults to read 24 novel words written in unfamiliar letters and to name 24 novel objects while in an MRI scanner. Behavioral performance on trained items was equivalent for the two stimulus types. However, componential letter-sound associations were extracted when learning to read, as shown by correct reading of untrained words, whereas object-name associations were holistic and arbitrary. Activity in bilateral anterior fusiform gyri was greater during object name learning than learning to read, and ROI analyses indicated that left mid-fusiform activity was predictive of success in object name learning but not in learning to read. In contrast, activity in bilateral parietal cortices was predictive of success for both stimulus types but was greater during learning and recall of written word pronunciations relative to object names. We argue that mid-to-anterior fusiform gyri preferentially process whole items and contribute to learning their spoken form associations, processes that are required for skilled reading. In contrast, parietal cortices preferentially process componential visual-verbal mappings, a process that is crucial for early reading development.

The effect of linguistic and visual salience in visual world studies

Research using the visual world paradigm has demonstrated that visual input has a rapid effect on language interpretation tasks such as reference resolution and, conversely, that linguistic material-including verbs, prepositions and adjectives-can influence fixations to potential referents. More recent research has started to explore how this effect of linguistic input on fixations is mediated by properties of the visual stimulus, in particular by visual salience. In the present study we further explored the role of salience in the visual world paradigm manipulating language-driven salience and visual salience. Specifically, we tested how linguistic salience (i.e., the greater accessibility of linguistically introduced entities) and visual salience (bottom-up attention grabbing visual aspects) interact. We recorded participants' eye-movements during a MapTask, asking them to look from landmark to landmark displayed upon a map while hearing direction-giving instructions. The landmarks were of comparable size and color, except in the Visual Salience condition, in which one landmark had been made more visually salient. In the Linguistic Salience conditions, the instructions included references to an object not on the map. Response times and fixations were recorded. Visual Salience influenced the time course of fixations at both the beginning and the end of the trial but did not show a significant effect on response times. Linguistic Salience reduced response times and increased fixations to landmarks when they were associated to a Linguistic Salient entity not present itself on the map. When the target landmark was both visually and linguistically salient, it was fixated longer, but fixations were quicker when the target item was linguistically salient only. Our results suggest that the two types of salience work in parallel and that linguistic salience affects fixations even when the entity is not visually present.

Endocannabinoid signaling in the etiology and treatment of major depressive illness

The purpose of this review is to examine human and preclinical data that are relevant to the following hypotheses. The first hypothesis is that deficient CB1R-mediated signaling results in symptoms that mimic those seen in depression. The second hypothesis is that activation of CB1R-mediated signaling results in behavioral, endocrine and other effects that are similar to those produced by currently used antidepressants. The third hypothesis is that conventional antidepressant therapies act through enhanced CB1R mediated signaling. Together the available data indicate that activators of CB1R signaling, particularly inhibitors of fatty acid amide hydrolase, should be considered for clinical trials for the treatment of depression.

Reward-based transfer from bottom-up to top-down search tasks

Recent evidence has suggested that reward modulates bottom-up and top-down attentional selection and that this effect persists within the same task even when reward is no longer offered. It remains unclear whether reward effects transfer across tasks, especially those engaging different modes of attention. We directly investigated whether reward-based contingency learned in a bottom-up search task was transferred to a subsequent top-down search task, and probed the nature of the transfer mechanism. Results showed that a reward-related benefit established in a pop-out-search task was transferred to a conjunction-search task, increasing participants' efficiency at searching for targets previously associated with a higher level of reward. Reward history influenced search efficiency by enhancing both target salience and distractor filtering, depending on whether the target and distractors shared a critical feature. These results provide evidence for reward-based transfer between different modes of attention and strongly suggest that an integrated priority map based on reward information guides both top-down and bottom-up attention.

Re-evaluating the role of TPJ in attentional control: contextual updating?

The right temporo-parietal junction (TPJ) is widely considered as part of a network that reorients attention to task-relevant, but currently unattended stimuli (Corbetta and Shulman, 2002). Despite the prevalence of this theory in cognitive neuroscience, there is little direct evidence for the principal hypothesis that TPJ sends an early reorientation signal that "circuit breaks" attentional processing in regions of the dorsal attentional network (e.g., the frontal eye fields) or is completely right lateralized during attentional processing. In this review, we examine both functional neuroimaging work on TPJ in the attentional literature as well as anatomical findings. We first critically evaluate the idea that TPJ reorients attention and is right lateralized; we then suggest that TPJ signals might rather reflect post-perceptual processes involved in contextual updating and adjustments of top-down expectations; and then finally discuss how these ideas relate to the electrophysiological (P300) literature, and to TPJ findings in other cognitive and social domains. We conclude that while much work is needed to define the computational functions of regions encapsulated as TPJ, there is now substantial evidence that it is not specialized for stimulus-driven attentional reorienting.

The background is remapped across saccades

Physiological studies have found that neurons prepare for impending eye movements, showing anticipatory responses to stimuli presented at the location of the post-saccadic receptive fields (RFs) (Wurtz in Vis Res 48:2070-2089, 2008). These studies proposed that visual neurons with shifting RFs prepared for the stimuli they would process after an impending saccade. Additionally, psychophysical studies have shown behavioral consequences of those anticipatory responses, including the transfer of aftereffects (Melcher in Nat Neurosci 10:903-907, 2007) and the remapping of attention (Rolfs et al. in Nat Neurosci 14:252-258, 2011). As the physiological studies proposed, the shifting RF mechanism explains the transfer of aftereffects. Recently, a new mechanism based on activation transfer via a saliency map was proposed, which accounted for the remapping of attention (Cavanagh et al. in Trends Cogn Sci 14:147-153, 2010). We hypothesized that there would be different aspects of the remapping corresponding to these different neural mechanisms. This study found that the information in the background was remapped to a similar extent as the figure, provided that the visual context remained stable. We manipulated the status of the figure and the ground in the saliency map and showed that the manipulation modulated the remapping of the figure and the ground in different ways. These results suggest that the visual system has an ability to remap the background as well as the figure, but lacks the ability to modulate the remapping of the background based on the visual context, and that different neural mechanisms might work together to maintain visual stability across saccades.

Emotion regulation, attention to emotion, and the ventral attentional network

Accounts of the effect of emotional information on behavioral response and current models of emotion regulation are based on two opposed but interacting processes: automatic bottom-up processes (triggered by emotionally arousing stimuli) and top-down control processes (mapped to prefrontal cortical areas). Data on the existence of a third attentional network operating without recourse to limited-capacity processes but influencing response raise the issue of how it is integrated in emotion regulation. We summarize here data from attention to emotion, voluntary emotion regulation, and on the origin of biases against negative content suggesting that the ventral network is modulated by exposure to emotional stimuli when the task does not constrain the handling of emotional content. In the parietal lobes, preferential activation of ventral areas associated with “bottom-up” attention by ventral network theorists is strongest in studies of cognitive reappraisal. In conditions when no explicit instruction is given to change one's response to emotional stimuli, control of emotionally arousing stimuli is observed without concomitant activation of the dorsal attentional network, replaced by a shift of activation toward ventral areas. In contrast, in studies where emotional stimuli are placed in the role of distracter, the observed deactivation of these ventral semantic association areas is consistent with the existence of proactive control on the role emotional representations are allowed to take in generating response. It is here argued that attentional orienting mechanisms located in the ventral network constitute an intermediate kind of process, with features only partially in common with effortful and automatic processes, which plays an important role in handling emotion by conveying the influence of semantic networks, with which the ventral network is co-localized. Current neuroimaging work in emotion regulation has neglected this system by focusing on a bottom-up/top-down dichotomy of attentional control.

Functional neuroanatomy of body checking in people with anorexia nervosa

OBJECTIVE

The neural correlates of body checking perceptions in eating disorders have not yet been identified. This functional Magnetic Resonance Imaging study examined the neuroanatomy involved in altered perception and identification with body checking in female with anorexia nervosa (AN).

METHOD

Brain activation while viewing images depicting normal weight individuals involved in either body checking behavior or a neutral (noneating disorder) body action, was compared between 20 females with AN and 15 matched healthy controls (HC).

RESULTS

Females with AN reported higher anxiety compared to HC during the body checking task. The level of anxiety positively correlated with body shape concern scores. People with AN had less activation in the medial prefrontal cortex (PFC) and right fusiform gyrus compared to HC in response to body checking compared to neutral action images. Body shape concern scores correlated negatively with medial PFC activation in AN group.

DISCUSSION

This preliminary study with modest power suggests that AN patients have reduced activation in cortical areas associated with self-reference, body action perception, and social cognition in females with AN.

Attention and predictions: control of spatial attention beyond the endogenous-exogenous dichotomy

The mechanisms of attention control have been extensively studied with a variety of methodologies in animals and in humans. Human studies using non-invasive imaging techniques highlighted a remarkable difference between the pattern of responses in dorsal fronto-parietal regions vs. ventral fronto-parietal (vFP) regions, primarily lateralized to the right hemisphere. Initially, this distinction at the neuro-physiological level has been related to the distinction between cognitive processes associated with strategic/endogenous vs. stimulus-driven/exogenous of attention control. Nonetheless, quite soon it has become evident that, in almost any situation, attention control entails a complex combination of factors related to both the current sensory input and endogenous aspects associated with the experimental context. Here, we review several of these aspects first discussing the joint contribution of endogenous and stimulus-driven factors during spatial orienting in complex environments and, then, turning to the role of expectations and predictions in spatial re-orienting. We emphasize that strategic factors play a pivotal role for the activation of the ventral system during stimulus-driven control, and that the dorsal system makes use of stimulus-driven signals for top-down control. We conclude that both the dorsal and the vFP networks integrate endogenous and exogenous signals during spatial attention control and that future investigations should manipulate both these factors concurrently, so as to reveal to full extent of these interactions.

A three-component model of the control error in manual tracking of continuous random signals

OBJECTIVE

The performance of human operators acting within closed-loop control systems is investigated in a classic tracking task. The dependence of the control error (tracking error) on the parameters display gain, k(display), and input signal frequency bandwidth, f(g), which alter task difficulty and presumably the control delay, is studied with the aim of functionally specifying it via a model.

BACKGROUND

The human operator as an element of a cascaded human-machine control system (e.g., car driving or piloting an airplane) codetermines the overall system performance. Control performance of humans in continuous tracking has been described in earlier studies.

METHOD

Using a handheld joystick, 10 participants tracked continuous random input signals. The parameters f(g) and k(display) were altered between experiments.

RESULTS

Increased task difficulty promoted lengthened control delay and, consequently, increased control error.Tracking performance degraded profoundly with target deflection components above 1 Hz, confirming earlier reports.

CONCLUSION

The control error is composed of a delay-induced component, a demand-based component, and a novel component: a human tracking limit. Accordingly, a new model that allows concepts of the observed control error to be split into these three components is suggested.

APPLICATION

To achieve optimal performance in control systems that include a human operator (e.g., vehicles, remote controlled rovers, crane control), (a) tasks should be kept as simple as possible to achieve shortest control delays, and (b) task components requiring higher-frequency (> 1 Hz) tracking actions should be avoided or automated by technical systems.

Reach preparation enhances visual performance and appearance

We investigated the impact of the preparation of reach movements on visual perception by simultaneously quantifying both an objective measure of visual sensitivity and the subjective experience of apparent contrast. Using a two-by-two alternative forced choice task, observers compared the orientation (clockwise or counterclockwise) and the contrast (higher or lower) of a Standard Gabor and a Test Gabor, the latter of which was presented during reach preparation, at the reach target location or the opposite location. Discrimination performance was better overall at the reach target than at the opposite location. Perceived contrast increased continuously at the target relative to the opposite location during reach preparation, that is, after the onset of the cue indicating the reach target. The finding that performance and appearance do not evolve in parallel during reach preparation points to a distinction with saccade preparation, for which we have shown previously there is a parallel temporal evolution of performance and appearance. Yet akin to saccade preparation, this study reveals that overall reach preparation enhances both visual performance and appearance.

Distractors less salient than targets capture attention rather than producing non-spatial filtering costs

Distractors that are less salient than the target evoke reaction time interference in the distractor search paradigm. Here, we investigated whether this interference indeed results from spatial attentional capture or merely from non-spatial filtering costs. Target and distractor salience was manipulated parametrically and the modulation of reaction time interference by the distance between both stimuli was taken as an indicator of attentional capture. For distractors that were less salient than the target, we found distance to be predictive of reaction time interference. Moreover, this relationship was modulated by the difference in relative salience of target and distractor: the less salient the distractor was compared to the target, the weaker was the influence of distance. These results are in accordance with the sequential sampling model of salience-based selection by Zehetleitner et al. (Zehetleitner, M., Koch, A.I., Goschy, H., Müller, H.J., 2013. Salience-based selection: Interference by distractors less salient than the target. PLoS ONE 8: e52595.). This model assumes the salience map to be computed by noisy accumulation of sensory evidence. As a result, the salience map output fluctuates around its true value and less salient locations can be denoted as most salient. A distractor less salient than the target can therefore capture attention with a certain probability. We conclude that reaction time interference by less salient distractors in the distractor search paradigm is a result of attentional capture in a proportion of trials, rather than a result of non-spatial filtering costs.

A low-frequency oscillatory neural signal in humans encodes a developing decision variable

We often make decisions based on sensory evidence that is accumulated over a period of time. How the evidence for such decisions is represented in the brain and how such a neural representation is used to guide a subsequent action are questions of considerable interest to decision sciences. The neural correlates of developing perceptual decisions have been thoroughly investigated in the oculomotor system of macaques who communicated their decisions using an eye movement. It has been found that the evidence informing a decision to make an eye movement is in part accumulated within the same oculomotor circuits that signal the upcoming eye movement. Recent evidence suggests that the somatomotor system may exhibit an analogous property for choices made using a hand movement. To investigate this possibility, we engaged humans in a decision task in which they integrated discrete quanta of sensory information over a period of time and signaled their decision using a hand movement or an eye movement. The discrete form of the sensory evidence allowed us to infer the decision variable on which subjects base their decision on each trial and to assess the neural processes related to each quantum of the incoming decision evidence. We found that a low-frequency electrophysiological signal recorded over centroparietal regions strongly encodes the decision variable inferred in this task, and that it does so specifically for hand movement choices. The signal ramps up with a rate that is proportional to the decision variable, remains graded by the decision variable throughout the delay period, reaches a common peak shortly before a hand movement, and falls off shortly after the hand movement. Furthermore, the signal encodes the polarity of each evidence quantum, with a short latency, and retains the response level over time. Thus, this neural signal shows properties of evidence accumulation. These findings suggest that the decision-related effects observed in the oculomotor system of the monkey during eye movement choices may share the same basic properties with the decision-related effects in the somatomotor system of humans during hand movement choices.

Dynamic excitatory and inhibitory gain modulation can produce flexible, robust and optimal decision-making

Behavioural and neurophysiological studies in primates have increasingly shown the involvement of urgency signals during the temporal integration of sensory evidence in perceptual decision-making. Neuronal correlates of such signals have been found in the parietal cortex, and in separate studies, demonstrated attention-induced gain modulation of both excitatory and inhibitory neurons. Although previous computational models of decision-making have incorporated gain modulation, their abstract forms do not permit an understanding of the contribution of inhibitory gain modulation. Thus, the effects of co-modulating both excitatory and inhibitory neuronal gains on decision-making dynamics and behavioural performance remain unclear. In this work, we incorporate time-dependent co-modulation of the gains of both excitatory and inhibitory neurons into our previous biologically based decision circuit model. We base our computational study in the context of two classic motion-discrimination tasks performed in animals. Our model shows that by simultaneously increasing the gains of both excitatory and inhibitory neurons, a variety of the observed dynamic neuronal firing activities can be replicated. In particular, the model can exhibit winner-take-all decision-making behaviour with higher firing rates and within a significantly more robust model parameter range. It also exhibits short-tailed reaction time distributions even when operating near a dynamical bifurcation point. The model further shows that neuronal gain modulation can compensate for weaker recurrent excitation in a decision neural circuit, and support decision formation and storage. Higher neuronal gain is also suggested in the more cognitively demanding reaction time than in the fixed delay version of the task. Using the exact temporal delays from the animal experiments, fast recruitment of gain co-modulation is shown to maximize reward rate, with a timescale that is surprisingly near the experimentally fitted value. Our work provides insights into the simultaneous and rapid modulation of excitatory and inhibitory neuronal gains, which enables flexible, robust, and optimal decision-making.

Perceptual decision-making involves not only simple transformation of sensory information to a motor decision, but can also be modulated by high-level cognition. For example, the latter may include strategic allocation of limited attentional resources over time in a decision task to improve performance. At the neurophysiological level, there is evidence supporting attention-induced neuronal gain modulation of both excitatory and inhibitory cortical neurons. In the context of perceptual discrimination tasks performed by animals, we make use of a biologically inspired computational model of decision-making to understand the computational capabilities of such co-modulation of neuronal gains. We find that dynamic co-modulation of both excitatory and inhibitory neurons is important for flexible, and cognitively demanding decision-making while also enhancing robustness in the decision circuit's functions. Our model captures the neuronal activity and behavioural data in the animal experiments remarkably well. Decision performance in a reaction time task can be optimized, maximizing the rate of receiving reward by using fast gain recruitment. Our experimentally fitted timescale is near the optimal one, suggesting that the animals performed almost optimally. By providing both computational simulations and theoretical analyses, our computational model sheds light into the multiple functions of rapid co-modulation of neuronal gains during decision-making.

Deciding where to look based on visual, auditory, and semantic information

Neurons in the dorsal frontal and parietal cortex are thought to transform incoming visual signals into the spatial goals of saccades, a process known as target selection. Here, we used functional magnetic resonance imaging (fMRI) to test how target selection may generalize beyond visual transformations when auditory and semantic information is used for selection. We compared activity in the frontal and parietal cortex when subjects made visually, aurally, and semantically guided saccades to one of four differently colored dots. Selection was based on a visual cue (i.e., one of the dots blinked), an auditory cue (i.e., a white noise burst was emitted at one of the dots' location), or a semantic cue (i.e., the color of one of the dots was spoken). Although neural responses in frontal and parietal cortex were robust, they were non-specific with regard to the type of information used for target selection. Decoders, however, trained on the patterns of activity in the intraparietal sulcus could classify both the type of cue used for target selection and the direction of the saccade. Therefore, we find evidence that the posterior parietal cortex is involved in transforming multimodal inputs into general spatial representations that can be used to guide saccades.

The parietal cortex and saccade planning: lessons from human lesion studies

The parietal cortex is a critical interface for attention and integration of multiple sensory signals that can be used for the implementation of motor plans. Many neurons in this region exhibit strong attention-, reach-, grasp- or saccade-related activity. Here, we review human lesion studies supporting the critical role of the parietal cortex in saccade planning. Studies of patients with unilateral parietal damage and spatial neglect reveal characteristic spatially lateralized deficits of saccade programming when multiple stimuli compete for attention. However, these patients also show bilateral impairments of saccade initiation and control that are difficult to explain in the context of their lateralized deficits of visual attention. These findings are reminiscent of the deficits of oculomotor control observed in patients with Bálint's syndrome consecutive to bilateral parietal damage. We propose that some oculomotor deficits following parietal damage are compatible with a decisive role of the parietal cortex in saccade planning under conditions of sensory competition, while other deficits reflect disinhibition of low-level structures of the oculomotor network in the absence of top-down parietal modulation.

Gearing up for action: attentive tracking dynamically tunes sensory and motor oscillations in the alpha and beta band

Allocation of attention during goal-directed behavior entails simultaneous processing of relevant and attenuation of irrelevant information. How the brain delegates such processes when confronted with dynamic (biological motion) stimuli and harnesses relevant sensory information for sculpting prospective responses remains unclear. We analyzed neuromagnetic signals that were recorded while participants attentively tracked an actor's pointing movement that ended at the location where subsequently the response-cue indicated the required response. We found the observers' spatial allocation of attention to be dynamically reflected in lateralized parieto-occipital alpha (8–12 Hz) activity and to have a lasting influence on motor preparation. Specifically, beta (16–25 Hz) power modulation reflected observers' tendency to selectively prepare for a spatially compatible response even before knowing the required one. We discuss the observed frequency-specific and temporally evolving neural activity within a framework of integrated visuomotor processing and point towards possible implications about the mechanisms involved in action observation.

•

Observing dynamic actions modulates on-going alpha and beta neural activity.

•

Alpha modulations reflect dynamic changes in the allocation of spatial attention.

•

Beta modulations relate to evolving, stimulus location-based response bias.

•

Alpha and beta activity jointly contribute to sensorimotor integration for action.

Visual salience improves spatial working memory via enhanced parieto-temporal functional connectivity

In everyday life, the brain is bombarded with a multitude of concurrent and competing stimuli. Only some of these enter consciousness and memory. Attention selects relevant signals for in-depth processing depending on current goals, but also on the intrinsic properties of stimuli. We combined behavior, computational modeling, and functional imaging to investigate mechanisms supporting access to memory based on intrinsic sensory properties. During fMRI scanning, human subjects were presented with pictures of naturalistic scenes that entailed high levels of competition between possible target objects. Following a retention interval of 8 s, participants judged the location (same/different) of a target object extracted from the initial scene. We found that memory performance at retrieval increased with increasing object salience at encoding, indicating a "prior entry" for salient information. fMRI analyses revealed encoding-related activation in the posterior parietal cortex, selectively for salient objects that were later remembered. Moreover, parietal cortex showed increased functional coupling with the medial-temporal lobe, for remembered objects only. These findings reveal a parietotemporal circuit that integrates available sensory cues (based on attention-grabbing saliency signals) and current memory requirements (storing objects' locations) to encode object-related spatial information in working memory.

The parietal cortex in sensemaking: the dissociation of multiple types of spatial information

According to the data-frame theory, sensemaking is a macrocognitive process in which people try to make sense of or explain their observations by processing a number of explanatory structures called frames until the observations and frames become congruent. During the sensemaking process, the parietal cortex has been implicated in various cognitive tasks for the functions related to spatial and temporal information processing, mathematical thinking, and spatial attention. In particular, the parietal cortex plays important roles by extracting multiple representations of magnitudes at the early stages of perceptual analysis. By a series of neural network simulations, we demonstrate that the dissociation of different types of spatial information can start early with a rather similar structure (i.e., sensitivity on a common metric), but accurate representations require specific goal-directed top-down controls due to the interference in selective attention. Our results suggest that the roles of the parietal cortex rely on the hierarchical organization of multiple spatial representations and their interactions. The dissociation and interference between different types of spatial information are essentially the result of the competition at different levels of abstraction.

Identifying the computational requirements of an integrated top-down-bottom-up model for overt visual attention within an active vision system

Computational visual attention systems have been constructed in order for robots and other devices to detect and locate regions of interest in their visual world. Such systems often attempt to take account of what is known of the human visual system and employ concepts, such as 'active vision', to gain various perceived advantages. However, despite the potential for gaining insights from such experiments, the computational requirements for visual attention processing are often not clearly presented from a biological perspective. This was the primary objective of this study, attained through two specific phases of investigation: 1) conceptual modeling of a top-down-bottom-up framework through critical analysis of the psychophysical and neurophysiological literature, 2) implementation and validation of the model into robotic hardware (as a representative of an active vision system). Seven computational requirements were identified: 1) transformation of retinotopic to egocentric mappings, 2) spatial memory for the purposes of medium-term inhibition of return, 3) synchronization of 'where' and 'what' information from the two visual streams, 4) convergence of top-down and bottom-up information to a centralized point of information processing, 5) a threshold function to elicit saccade action, 6) a function to represent task relevance as a ratio of excitation and inhibition, and 7) derivation of excitation and inhibition values from object-associated feature classes. The model provides further insight into the nature of data representation and transfer between brain regions associated with the vertebrate 'active' visual attention system. In particular, the model lends strong support to the functional role of the lateral intraparietal region of the brain as a primary area of information consolidation that directs putative action through the use of a 'priority map'.

Salience-based selection: attentional capture by distractors less salient than the target

Current accounts of attentional capture predict the most salient stimulus to be invariably selected first. However, existing salience and visual search models assume noise in the map computation or selection process. Consequently, they predict the first selection to be stochastically dependent on salience, implying that attention could even be captured first by the second most salient (instead of the most salient) stimulus in the field. Yet, capture by less salient distractors has not been reported and salience-based selection accounts claim that the distractor has to be more salient in order to capture attention. We tested this prediction using an empirical and modeling approach of the visual search distractor paradigm. For the empirical part, we manipulated salience of target and distractor parametrically and measured reaction time interference when a distractor was present compared to absent. Reaction time interference was strongly correlated with distractor salience relative to the target. Moreover, even distractors less salient than the target captured attention, as measured by reaction time interference and oculomotor capture. In the modeling part, we simulated first selection in the distractor paradigm using behavioral measures of salience and considering the time course of selection including noise. We were able to replicate the result pattern we obtained in the empirical part. We conclude that each salience value follows a specific selection time distribution and attentional capture occurs when the selection time distributions of target and distractor overlap. Hence, selection is stochastic in nature and attentional capture occurs with a certain probability depending on relative salience.

Thinking in spatial terms: decoupling spatial representation from sensorimotor control in monkey posterior parietal areas 7a and LIP

Perhaps the simplest and most complete description of the cerebral cortex is that it is a sensorimotor controller whose primary purpose is to represent stimuli and movements, and adaptively control the mapping between them. However, in order to think, the cerebral cortex has to generate patterns of neuronal activity that encode abstract, generalized information independently of ongoing sensorimotor events. A critical question confronting cognitive systems neuroscience at present therefore is how neural signals encoding abstract information emerge within the sensorimotor control networks of the brain. In this review, we approach that question in the context of the neural representation of space in posterior parietal cortex of non-human primates. We describe evidence indicating that parietal cortex generates a hierarchy of spatial representations with three basic levels: including (1) sensorimotor signals that are tightly coupled to stimuli or movements, (2) sensorimotor signals modified in strength or timing to mediate cognition (examples include attention, working memory, and decision-processing), as well as (3) signals that encode frankly abstract spatial information (such as spatial relationships or categories) generalizing across a wide diversity of specific stimulus conditions. Here we summarize the evidence for this hierarchy, and consider data showing that signals at higher levels derive from signals at lower levels. That in turn could help characterize neural mechanisms that derive a capacity for abstraction from sensorimotor experience.

Distinct neural mechanisms of distractor suppression in the frontal and parietal lobe

The posterior parietal cortex and the prefrontal cortex are associated with eye movements and visual attention, but their specific contributions are poorly understood. We compared the dorsolateral prefrontal cortex (dlPFC) and the lateral intraparietal area (LIP) in monkeys using a memory saccade task in which a salient distractor flashed at a variable timing and location during the memory delay. We found that the two areas had similar responses to target selection, but made distinct contributions to distractor suppression. Distractor responses were more strongly suppressed and more closely correlated with performance in the dlPFC relative to LIP. Moreover, reversible inactivation of the dlPFC produced much larger increases in distractibility than inactivation of LIP. These findings suggest that LIP and dlPFC mediate different aspects of selective attention. Although both areas can contribute to the perceptual selection of salient information, the dlPFC has a decisive influence on whether and how attended stimulus is linked with actions.

Slow gait in MCI is associated with ventricular enlargement: results from the Gait and Brain Study

Slow gait is ubiquitous among older adults and predicts cognitive decline and progression to dementia. Age-related structural brain changes could be responsible for abnormal gait. The purpose of this study was to determine whether brain lateral ventricle volume, a measure of brain atrophy, was associated with gait velocity among older adults with mild cognitive impairment (MCI), while considering the effects of age and brain vascular burden. Twenty community-dwellers with MCI, free of hydrocephalus, aged 76 years (69/80) [median (25th/75th percentile)] (35 % female) from the 'Gait and Brain Study' were included in this analysis. Quantitative gait performance was measured while steady-state walking at self-selected pace with a 6-m electronic portable walkway (GAITRite). Brain ventricle volume was quantified using semi-automated software from three-dimensional T1-weighted magnetic resonance imaging. Age, white matter hyperintensity burden and Mini-Mental State Examination score were used as potential confounders. Median gait velocity was 118.7 cm/s (104.4/131.3). Median brain ventricle volume was 39.9 mL (30.0/46.6) with the left ventricle being slightly larger than the right (P = 0.052). Brain ventricle volume was inversely associated with gait velocity (adjusted β = -0.63, P = 0.046). Volume of both the ventricular main bodies and the temporal horns correlated inversely with gait velocity (respectively, P = 0.009, P = 0.008). Left ventricle volume correlated with decreased gait velocity (P = 0.002) while right ventricle did not (P = 0.068). Slower gait velocity was associated with larger brain ventricle volume in our sample of people with MCI independent of age, cerebrovascular burden and cognitive worsening. This result may help elucidate the trajectories of cognitive and gait declines in people with MCI.

Sensory processing during viewing of cinematographic material: computational modeling and functional neuroimaging

The investigation of brain activity using naturalistic, ecologically-valid stimuli is becoming an important challenge for neuroscience research. Several approaches have been proposed, primarily relying on data-driven methods (e.g. independent component analysis, ICA). However, data-driven methods often require some post-hoc interpretation of the imaging results to draw inferences about the underlying sensory, motor or cognitive functions. Here, we propose using a biologically-plausible computational model to extract (multi-)sensory stimulus statistics that can be used for standard hypothesis-driven analyses (general linear model, GLM). We ran two separate fMRI experiments, which both involved subjects watching an episode of a TV-series. In Exp 1, we manipulated the presentation by switching on-and-off color, motion and/or sound at variable intervals, whereas in Exp 2, the video was played in the original version, with all the consequent continuous changes of the different sensory features intact. Both for vision and audition, we extracted stimulus statistics corresponding to spatial and temporal discontinuities of low-level features, as well as a combined measure related to the overall stimulus saliency. Results showed that activity in occipital visual cortex and the superior temporal auditory cortex co-varied with changes of low-level features. Visual saliency was found to further boost activity in extra-striate visual cortex plus posterior parietal cortex, while auditory saliency was found to enhance activity in the superior temporal cortex. Data-driven ICA analyses of the same datasets also identified "sensory" networks comprising visual and auditory areas, but without providing specific information about the possible underlying processes, e.g., these processes could relate to modality, stimulus features and/or saliency. We conclude that the combination of computational modeling and GLM enables the tracking of the impact of bottom-up signals on brain activity during viewing of complex and dynamic multisensory stimuli, beyond the capability of purely data-driven approaches.

Genetic and environmental influences on cortical thickness among 14-year-old twins

The overall volume of the brain has been found to be under relatively strong genetic control, but the relative strength of genetic and environmental factors on between-person variations in regional cortical thickness in adolescence is still not well understood. Here, we analyzed structural MRI data from 108 14-year-old healthy twins (54 females/54 males) to determine the relative contributions of genes and the environment toward regional variations in gray matter thickness across the cortex. After extracting cortical thickness values at a high spatial resolution, an A/C/E structural equation model that divides the variations into additive genetic (A), shared (C), and unique (E) environmental components was fitted. There was considerable regional variability in the magnitude of genetic influences on cortical thickness after controlling for sex. Regions with genetic contributions of greater than 80% were observed in the prefrontal cortex, predominantly in the bilateral dorsolateral and mesial superior frontal regions. No region showed prominent shared environmental influences, but unique environmental influences of over 80% were found in parietal association regions. The genetic variance for cortical thickness in adolescents in prefrontal regions overlapped with previous findings in adults. However, the unique environmental effects observed in multimodal parietal association cortices with converging inputs from visual, auditory, somatosensory regions, and neighboring secondary association cortices suggest that these regional variations are more shaped by experience and could form targets for early interventions in youth with behavioral disorders.

Asymmetric coding of categorical spatial relations in both language and vision

Describing certain types of spatial relationships between a pair of objects requires that the objects are assigned different “roles” in the relation, e.g., “A is above B” is different than “B is above A.” This asymmetric representation places one object in the “target” or “figure” role and the other in the “reference” or “ground” role. Here we provide evidence that this asymmetry may be present not just in spatial language, but also in perceptual representations. More specifically, we describe a model of visual spatial relationship judgment where the designation of the target object within such a spatial relationship is guided by the location of the “spotlight” of attention. To demonstrate the existence of this perceptual asymmetry, we cued attention to one object within a pair by briefly previewing it, and showed that participants were faster to verify the depicted relation when that object was the linguistic target. Experiment 1 demonstrated this effect for left-right relations, and Experiment 2 for above-below relations. These results join several other types of demonstrations in suggesting that perceptual representations of some spatial relations may be asymmetrically coded, and further suggest that the location of selective attention may serve as the mechanism that guides this asymmetry.

iMinerva: a mathematical model of distributional statistical learning

Statistical learning refers to the ability to identify structure in the input based on its statistical properties. For many linguistic structures, the relevant statistical features are distributional: They are related to the frequency and variability of exemplars in the input. These distributional regularities have been suggested to play a role in many different aspects of language learning, including phonetic categories, using phonemic distinctions in word learning, and discovering non-adjacent relations. On the surface, these different aspects share few commonalities. Despite this, we demonstrate that the same computational framework can account for learning in all of these tasks. These results support two conclusions. The first is that much, and perhaps all, of distributional statistical learning can be explained by the same underlying set of processes. The second is that some aspects of language can be learned due to domain-general characteristics of memory.