Separating distractor rejection and target detection in posterior parietal cortex--an event-related fMRI study of visual marking

Association between seated trunk control and cortical sensorimotor white matter brain changes in patients with chronic low back pain

Trunk control involves integration of sensorimotor information in the brain. Individuals with chronic low back pain (cLBP) have impaired trunk control and show differences in brain structure and function in sensorimotor areas compared with healthy controls (HC). However, the relationship between brain structure and trunk control in this group is not well understood. This cross-sectional study aimed to compare seated trunk control and sensorimotor white matter (WM) structure in people with cLBP and HC and explore relationships between WM properties and trunk control in each group. Thirty-two people with cLBP and 35 HC were tested sitting on an unstable chair to isolate trunk control; performance was measured using the 95% confidence ellipse area (CEA95) of center-of-pressure tracing. A WM network between cortical sensorimotor regions of interest was derived using probabilistic tractography. WM microstructure and anatomical connectivity between cortical sensorimotor regions were assessed. A mixed-model ANOVA showed that people with cLBP had worse trunk control than HC (F = 12.96; p < .001; ηp2 = .091). There were no differences in WM microstructure or anatomical connectivity between groups (p = 0.564 to 0.940). In the cLBP group, WM microstructure was moderately correlated (|r| = .456 to .565; p ≤ .009) with trunk control. Additionally, the cLBP group demonstrated stronger relationships between anatomical connectivity and trunk control (|r| = .377 to .618 p < .034) compared to the HC group. Unique to the cLBP group, WM connectivity between right somatosensory and left motor areas highlights the importance of interhemispheric information exchange for trunk control. Parietal areas associated with attention and spatial reference frames were also relevant to trunk control. These findings suggest that people with cLBP adopt a more cortically driven sensorimotor integration strategy for trunk control. Future research should replicate these findings and identify interventions to effectively modulate this strategy.

Object Recognition and Dorsal Stream Vulnerabilities in Children With Early Brain Damage

Aim

Visual functions of the dorsal stream are considered vulnerable in children with early brain damage. Considering the recognition of objects in suboptimal representations a dorsal stream dysfunction, we examined whether children with early brain damage and impaired object recognition had either general or selective dorsal stream dysfunctions.

Method

In a group of children with early brain damage (n = 48) we evaluated the dorsal stream functioning. To determine whether these patients had an increased risk of a dorsal stream dysfunction we compared the percentage of patients with impaired object recognition, assessed with the L94, with the estimated base rate. Then we evaluated the performance levels on motion perception, visual attention and visuomotor tasks in patients with (n = 18) and without (n = 11) object recognition abnormalities. A general dorsal stream dysfunction was considered present if a patient showed at least one abnormally low score in two out of three additional dorsal stream functions.

Results

Six of the eighteen (33.3%) patients with object recognition problems scored abnormally low on at least two additional dorsal stream functions. This was significantly higher than the base rate (p = 0.01). The difference of 24.1% between the patients with and without object recognition problems was not significant. Of the patients with object recognition problems 72.2% had at least 1 dorsal weakness, whereas this was only the case in 27.3% of patients without object recognition problems. Compared to patients with normal object recognition, patients with object recognition problems scored significantly more abnormally low on motion perception and visual attention (ps = 0.03) but did not differ on visuomotor skills.

Conclusion

Children with object recognition problems seem at risk for other dorsal stream dysfunctions, but dysfunctions might be rather specific than general. Multiple functions/aspects should be evaluated in neuropsychological assessment of children at risk.

Involvement of the dorsal and ventral attention networks in visual attention span

Visual attention span (VAS), which refers to the window size of multielement parallel processing in a short time, plays an important role in higher‐level cognition (e.g., reading) as required by encoding large amounts of information input. However, it is still a matter of debate about the underlying neural mechanism of VAS. In the present study, a modified visual 1‐back task was designed by using nonverbal stimuli and nonverbal responses, in which possible influences of target presence and position were considered to identify more pure VAS processing. A task‐driven functional magnetic resonance imaging (fMRI) experiment was then performed, and 30 healthy adults participated in this study. Results of confirmatory and exploratory analyses consistently revealed that both dorsal attention network (DAN) and ventral attention network (VAN) were significantly activated during this visual simultaneous processing. In particular, more significant activation in the left superior parietal lobule (LSPL), as compared to that in the bilateral inferior frontal gyrus (IFGs), suggested a greater involvement of DAN in VAS‐related processing in contrast to VAN. In addition, it was also found that the activation in temporoparietal junctions (TPJs) were suppressed during multielement processing only in the target‐absent condition. The current results suggested the recruitment of LSPL in covert attentional shifts and top‐down control of VAS resources distribution during the rapid visual simultaneous processing, as well as the involvement of bilateral IFGs (especially RIFG) in both VAS processing and inhibitory control. The present findings might bring some enlightenments for diagnosis of the atypicality of attentional disorders and reading difficulties.

Clinical Assessment of Visual Motion Perception in Children With Brain Damage: A Comparison With Base Rates and Control Sample

Aim: In this study, we examined (1) the presence of abnormally low scores (below 10^th percentile) in various visual motion perception aspects in children with brain damage, while controlling for their cognitive developmental delay; (2) whether the risk is increased in comparison with the observation and expectation in a healthy control group and healthy population. Methods: Performance levels of 46 children with indications of brain damage (M_age = 7y4m, SD = 2y4m) on three visual motion perception aspects (global motion, motion speed, motion-defined form) were evaluated. We used developmental age as entry of a preliminary reference table to classify the patient's performance levels. Then we compared the percentages of abnormally low scores with percentages expected in the healthy population using estimated base rates and the observed percentages in the control sample (n = 119). Results: When using developmental age as reference level, the percentage of low scores on at least one of the three tasks was significantly higher than expected in the healthy population [19/46, 41% (95%CI: 28-56%), p = 0.03]. In 15/19 (79% [95%CI: 61-97%] patients only one aspect of motion perception was affected. Four patients performed abnormally low on two out of three tasks, which is also higher than expected (4/46, 8.7%, 95%CI: 2.4-20.8% vs. 2.1%; z = 2.61, p < 0.01). The observed percentages in the patient group were also higher than found in the control group. Interpretation: There is some evidence that children with early brain damage have an increased risk of isolated and combined motion perception problems, independent of their performance IQ.

Changes in visual cortical processing attenuate singleton distraction during visual search

The ability to suppress distractions is essential to successful completion of goal-directed behaviors. Several behavioral studies have recently provided strong evidence that learned suppression may be particularly efficient in reducing distractor interference. Expectations about a distractor's repeated location, color, or even presence are rapidly learned and used to attenuate interference. In this study, we use a visual search paradigm in which a color singleton, which is known to capture attention, occurs within blocks with high or low frequency. The behavioral results show reduced singleton interference during the high compared to the low frequency block (Won et al., 2019). The fMRI results provide evidence that the attenuation of distractor interference is supported by changes in singleton, target, and non-salient distractor representations within retinotopic visual cortex. These changes in visual cortex are accompanied by findings that singleton-present trials compared to non-singleton trials produce greater activation in bilateral parietal cortex, indicative of attentional capture, in low frequency, but not high frequency blocks. Together, these results suggest that the readout of saliency signals associated with an expected color singleton from visual cortex is suppressed, resulting in less competition for attentional priority in frontoparietal attentional control regions.

Processing of Targets and Non-targets in Verbal Working Memory

In this study we used functional MRI (fMRI) to examine whether defining a stimulus as a target affects brain activation associated with a verbal working memory (WM) task. Seventeen healthy right-handed volunteers performed a Sternberg task with three consonants as memory set. We performed a region of interest based fMRI analysis to examine differences in brain activity patterns between targets and non-targets. Non-target brain activity was subtracted from target activity and hemispheric and fronto-parietal differences were tested by conducting a MANOVA. Participants responded correctly to 97.5% of the stimuli. The fMRI results showed a hemisphere by fronto-parietal location interaction, where targets evoked increased activity in the right frontal regions compared to non-targets, whereas the left frontal task activation did not differ between targets and non-targets. In the parietal regions, targets evoked increased activity compared to non-targets in the lateral anterior, but not the medial posterior part. Our study revealed that defining a stimulus as a target within a verbal WM task evokes an increase in brain activity in right frontal brain regions, compared to non-targets. Our results suggest an important hemispheric differentiation in target processing, in which the right frontal cortex is predominantly involved in processes associated with target stimuli. The left frontal cortex does not differentiate between processing target and non-target stimuli, suggesting involvement in WM processes that are independent of stimulus type. Parietal, the lateral anterior part is predominantly involved in target processing, while the medial posterior part does not differentiate between target and non-target processing.

Shared neural underpinnings of multisensory integration and trial-by-trial perceptual recalibration in humans

Perception adapts to mismatching multisensory information, both when different cues appear simultaneously and when they appear sequentially. While both multisensory integration and adaptive trial-by-trial recalibration are central for behavior, it remains unknown whether they are mechanistically linked and arise from a common neural substrate. To relate the neural underpinnings of sensory integration and recalibration, we measured whole-brain magnetoencephalography while human participants performed an audio-visual ventriloquist task. Using single-trial multivariate analysis, we localized the perceptually-relevant encoding of multisensory information within and between trials. While we found neural signatures of multisensory integration within temporal and parietal regions, only medial superior parietal activity encoded past and current sensory information and mediated the perceptual recalibration within and between trials. These results highlight a common neural substrate of sensory integration and perceptual recalibration, and reveal a role of medial parietal regions in linking present and previous multisensory evidence to guide adaptive behavior.

A good ventriloquist will make their audience experience an illusion. The speech the spectators hear appears to come from the mouth of the puppet and not from the puppeteer. Moviegoers experience the same illusion: they perceive dialogue as coming from the mouths of the actors on screen, rather than from the loudspeakers mounted on the walls. Known as the ventriloquist effect, this ‘trick’ exists because the brain assumes that sights and sounds which occur at the same time have the same origin, and it therefore combines the two sets of sensory stimuli.

A version of the ventriloquist effect can be induced in the laboratory. Participants hear a sound while watching a simple visual stimulus (for instance, a circle) appear on a screen. When asked to pinpoint the origin of the noise, volunteers choose a location shifted towards the circle, even if this was not where the sound came from. In addition, this error persists when the visual stimulus is no longer present: if a standard trial is followed by a trial that features a sound but no circle, participants perceive the sound in the second test as ‘drawn’ towards the direction of the former shift. This is known as the ventriloquist aftereffect.

By scanning the brains of healthy volunteers performing this task, Park and Kayser show that a number of brain areas contribute to the ventriloquist effect. All of these regions help to combine what we see with what we hear, but only one maintains representations of the combined sensory inputs over time. Called the medial superior parietal cortex, this area is unique in contributing to both the ventriloquist effect and its aftereffect.

We must constantly use past and current sensory information to adapt our behavior to the environment. The results by Park and Kayser shed light on the brain structures that underpin our capacity to combine information from several senses, as well as our ability to encode memories. Such knowledge should be useful to explore how we can make flexible decisions.

Preview benefit survives a three-dimensional rotation of the rigid configuration of search items

When some distractors (old items) are presented prior to others (new items) during an inefficient visual search task, search becomes easier, as though observers were able to exclude the old items from the search. This phenomenon, called preview benefit, occurs when the locations of the old items are deprioritized relative to the locations of the new items, through a process of visual marking. It has been demonstrated that preview benefit persists when the old items move on the display, if the spatial relationships among the old items remain unchanged, suggesting that the memory template for visual marking represents the spatial configuration of the old items. One remaining question is whether the configuration is coded in two- or three-dimensional coordinates. In the present study, we examined whether preview benefit was preserved when all items were graphically rendered in three-dimensional coordinates and rigidly rotated around the vertical axis at a constant angular velocity. Preview benefit occurred in this situation, suggesting that the memory template for visual marking represents the spatial configuration in three-dimensional coordinates.

Gradual acquisition of visuospatial associative memory representations via the dorsal precuneus

Activation of parietal cortex structures like the precuneus is commonly observed during explicit memory retrieval, but the role of parietal cortices in encoding has only recently been appreciated and is still poorly understood. Considering the importance of the precuneus in human visual attention and imagery, we aimed to assess a potential role for the precuneus in the encoding of visuospatial representations into long-term memory. We therefore investigated the acquisition of constant versus repeatedly shuffled configurations of icons on background images over five subsequent days in 32 young, healthy volunteers. Functional magnetic resonance imaging was conducted on Days 1, 2, and 5, and persistent memory traces were assessed by a delayed memory test after another 5 days. Constant compared to shuffled configurations were associated with significant improvement of position recognition from Day 1 to 5 and better delayed memory performance. Bilateral dorsal precuneus activations separated constant from shuffled configurations from Day 2 onward, and coactivation of the precuneus and hippocampus dissociated recognized and forgotten configurations, irrespective of condition. Furthermore, learning of constant configurations elicited increased functional coupling of the precuneus with dorsal and ventral visual stream structures. Our results identify the precuneus as a key brain structure in the acquisition of detailed visuospatial information by orchestrating a parieto-occipito-temporal network.

Neural Mechanisms for the Benefits of Stimulus-Driven Attention

Stimulus-driven attention can improve working memory (WM) when drawn to behaviorally relevant information, but the neural mechanisms underlying this effect are unclear. The present study used functional magnetic resonance imaging (fMRI) to test competing hypotheses regarding the nature of the benefits of stimulus-driven attention to WM: that stimulus-driven attention benefits WM directly via salience detection, that stimulus-driven attention benefits WM incidentally via cognitive control mechanisms recruited to reduce interference from salient features, or that both mechanisms are co-involved in enhancing WM for salient information. To test these hypotheses, we observed activation in brain regions associated with cognitive control and salience detection. We found 2 cognitive control regions that were associated with enhanced memory for salient stimuli: a region in the right superior parietal lobule and a region in the right inferior frontal junction. No regions associated with salience detection were found to show this effect. These fMRI results support the hypothesis that benefits to WM from stimulus-driven attention occur primarily as a result of cognitive control and top-down factors rather than pure bottom-up aspects of stimulus-driven attention.

Parieto–Occipital Areas Involved in Efficient Filtering in Search: A Time Course Analysis of Visual Marking using Behavioural and Functional Imaging Procedures

Search for a colour–form conjunction target can be facilitated by presenting one set of distractors prior to the second set of distractors and the target: the preview benefit (Watson & Humphreys, 1997). The early presentation of one set of distractors enables them to be efficiently filtered from search. We report two studies investigating the time course of the preview benefit. In Experiment 1 we use a standard reaction time analysis to show that the benefit has a relatively slow time course; old items need to precede the new set by 600 ms or more in order to be fully filtered from search. Furthermore, the reductions in reaction time across time in the preview condition varied nonlinearly with the display size, suggesting that old items were discounted from search in parallel. In Experiment 2 we examined the neural locus of this filtering effect over time, using positron emission tomography (PET). We show that regions of parieto–occipital cortex are selectively activated in a preview search condition relative to a detection baseline. These regions also increase in activation as the preview interval increases (and search then becomes easier), consistent with them modulating the parallel filtering of distractors from targets in spatial search. Interestingly, the same areas as those activated in preview search were also active in conjunction search relative to its own detection baseline. Thus these regions either modulate parallel filtering in conjunction search too, or they modulate different behavioural functions according to task constraints.

Weaker Functional Connectivity Strength in Patients with Type 2 Diabetes Mellitus

Type 2 diabetes mellitus (T2DM) is related to cognitive impairments and increased risk for dementia. Neuroimaging studies have demonstrated T2DM-related brain structural and functional changes which are partly associated to the cognitive decline. However, few studies focused on the early neuroimaging findingsin T2DM patients. In this study, a data-driven whole-brain resting state functional connectivity strength (rsFCS) methodwas used to evaluate resting functional changes in 53 T2DM patients compared with 55 matched healthy controls (HCs), and to detect the associations between the rsFCSchanges and cognitive functions in T2DM patients. The T2DM patients exhibited weaker long-range rsFCS in the right insula and weaker short-range rsFCS in the right supramarginalgyrus (SG) compared with the HCs. Additionally, seed-based functional connectivity (FC) analysis revealed weaker FC between the right insula and the bilateral superior parietal lobule (SPL), and between the right SG and the bilateral supplementary motor area (SMA)/right SPL in T2DM patientscompared with the HCs. In T2DM patients, negative correlation was found between the long-range rsFCS in the right insula and HbA1c levels; and the FC between the right SG and the bilateral SMA negatively correlated with TMT-A scores. Our results indicated that the rsFCS alteration occurredbefore obvious cognitive deficits in T2DM patients, which might be helpful for understanding the neuromechanism of cognitive declines in T2DM patients.

Schizophrenia affects speech-induced functional connectivity of the superior temporal gyrus under cocktail-party listening conditions

The superior temporal gyrus (STG) is involved in speech recognition against informational masking under cocktail-party-listening conditions. Compared to healthy listeners, people with schizophrenia perform worse in speech recognition under informational speech-on-speech masking conditions. It is not clear whether the schizophrenia-related vulnerability to informational masking is associated with certain changes in FC of the STG with some critical brain regions. Using sparse-sampling fMRI design, this study investigated the differences between people with schizophrenia and healthy controls in FC of the STG for target-speech listening against informational speech-on-speech masking, when a listening condition with either perceived spatial separation (PSS, with a spatial release of informational masking) or perceived spatial co-location (PSC, without the spatial release) between target speech and masking speech was introduced. The results showed that in healthy participants, but not participants with schizophrenia, the contrast of either the PSS or PSC condition against the masker-only condition induced an enhancement of functional connectivity (FC) of the STG with the left superior parietal lobule and the right precuneus. Compared to healthy participants, participants with schizophrenia showed declined FC of the STG with the bilateral precuneus, right SPL, and right supplementary motor area. Thus, FC of the STG with the parietal areas is normally involved in speech listening against informational masking under either the PSS or PSC conditions, and declined FC of the STG in people with schizophrenia with the parietal areas may be associated with the increased vulnerability to informational masking.

The Role of Top-Down Focused Spatial Attention in Preattentive Salience Coding and Salience-based Attentional Capture

Selective visual attention requires an efficient coordination between top-down and bottom-up attention control mechanisms. This study investigated the behavioral and neural effects of top-down focused spatial attention on the coding of highly salient distractors and their tendency to capture attention. Combining spatial cueing with an irrelevant distractor paradigm revealed bottom-up based attentional capture only when attention was distributed across the whole search display, including the distractor location. Top-down focusing spatial attention on the target location abolished attentional capture of a salient distractor outside the current attentional focus. Functional data indicated that the missing capture effect was not based on diminished bottom-up salience signals at unattended distractor locations. Irrespectively of whether salient distractors occurred at attended or unattended locations, their presence enhanced BOLD signals at their respective spatial representation in early visual areas as well as in inferior frontal, superior parietal, and medial parietal cortex. Importantly, activity in these regions reflected the presence of a salient distractor rather than attentional capture per se. Moreover, successfully inhibiting attentional capture of a salient distractor at an unattended location further increased neural responses in medial parietal regions known to be involved in controlling spatial attentional shifts. Consequently, data provide evidence that top-down focused spatial attention prevents automatic attentional capture by supporting attentional control processes counteracting a spatial bias toward a salient distractor.

Brain substrates of perceived spatial separation between speech sources under simulated reverberant listening conditions in schizophrenia

BACKGROUND

People with schizophrenia recognize speech poorly under multiple-people-talking (informational masking) conditions. In reverberant environments, direct-wave signals from a speech source are perceptually integrated with the source reflections (the precedence effect), forming perceived spatial separation (PSS) between different sources and consequently improving target-speech recognition against informational masking. However, the brain substrates underlying the schizophrenia-related vulnerability to informational masking and whether schizophrenia affects the unmasking effect of PSS are largely unknown.

METHOD

Using psychoacoustic testing and functional magnetic resonance imaging, respectively, the speech recognition under either the PSS or perceived spatial co-location (PSC) condition and the underlying brain substrates were examined in 20 patients with schizophrenia and 16 healthy controls.

RESULTS

Speech recognition was worse in patients than controls. Under the PSS (but not PSC) condition, speech recognition was correlated with activation of the superior parietal lobule (SPL), and target speech-induced activation of the SPL, precuneus, middle cingulate cortex and caudate significantly declined in patients. Moreover, the separation (PSS)-against-co-location (PSC) contrast revealed (1) activation of the SPL, precuneus and anterior cingulate cortex in controls, (2) suppression of the SPL and precuneus in patients, (3) activation of the pars triangularis of the inferior frontal gyrus and middle frontal gyrus in both controls and patients, (4) activation of the medial superior frontal gyrus in patients, and (5) impaired functional connectivity of the SPL in patients.

CONCLUSIONS

Introducing the PSS listening condition efficiently reveals both the brain substrates underlying schizophrenia-related speech-recognition deficits against informational masking and the schizophrenia-related neural compensatory strategy for impaired SPL functions.

Age mediation of frontoparietal activation during visual feature search

Activation of frontal and parietal brain regions is associated with attentional control during visual search. We used fMRI to characterize age-related differences in frontoparietal activation in a highly efficient feature search task, detection of a shape singleton. On half of the trials, a salient distractor (a color singleton) was present in the display. The hypothesis was that frontoparietal activation mediated the relation between age and attentional capture by the salient distractor. Participants were healthy, community-dwelling individuals, 21 younger adults (19-29 years of age) and 21 older adults (60-87 years of age). Top-down attention, in the form of target predictability, was associated with an improvement in search performance that was comparable for younger and older adults. The increase in search reaction time (RT) associated with the salient distractor (attentional capture), standardized to correct for generalized age-related slowing, was greater for older adults than for younger adults. On trials with a color singleton distractor, search RT increased as a function of increasing activation in frontal regions, for both age groups combined, suggesting increased task difficulty. Mediational analyses disconfirmed the hypothesized model, in which frontal activation mediated the age-related increase in attentional capture, but supported an alternative model in which age was a mediator of the relation between frontal activation and capture.

Brain connectivity and visual attention

Emerging hypotheses suggest that efficient cognitive functioning requires the integration of separate, but interconnected cortical networks in the brain. Although task-related measures of brain activity suggest that a frontoparietal network is associated with the control of attention, little is known regarding how components within this distributed network act together or with other networks to achieve various attentional functions. This review considers both functional and structural studies of brain connectivity, as complemented by behavioral and task-related neuroimaging data. These studies show converging results: The frontal and parietal cortical regions are active together, over time, and identifiable frontoparietal networks are active in relation to specific task demands. However, the spontaneous, low-frequency fluctuations of brain activity that occur in the resting state, without specific task demands, also exhibit patterns of connectivity that closely resemble the task-related, frontoparietal attention networks. Both task-related and resting-state networks exhibit consistent relations to behavioral measures of attention. Further, anatomical structure, particularly white matter pathways as defined by diffusion tensor imaging, places constraints on intrinsic functional connectivity. Lastly, connectivity analyses applied to investigate cognitive differences across individuals in both healthy and diseased states suggest that disconnection of attentional networks is linked to deficits in cognitive functioning, and in extreme cases, to disorders of attention. Thus, comprehensive theories of visual attention and their clinical translation depend on the continued integration of behavioral, task-related neuroimaging, and brain connectivity measures.

A parieto-medial temporal pathway for the strategic control over working memory biases in human visual attention

The contents of working memory (WM) can both aid and disrupt the goal-directed allocation of visual attention. WM benefits attention when its contents overlap with goal-relevant stimulus features, but WM leads attention astray when its contents match features of currently irrelevant stimuli. Recent behavioral data have documented that WM biases of attention may be subject to strategic cognitive control processes whereby subjects are able to either enhance or inhibit the influence of WM contents on attention. However, the neural mechanisms supporting cognitive control over WM biases on attention are presently unknown. Here, we characterize these mechanisms by combining human functional magnetic resonance imaging with a task that independently manipulates the relationship between WM cues and attention targets during visual search (with WM contents matching either search targets or distracters), as well as the predictability of this relationship (100 vs 50% predictability) to assess participants' ability to strategically enhance or inhibit WM biases on attention when WM contents reliably matched targets or distracter stimuli, respectively. We show that cues signaling predictable (> unpredictable) WM-attention relations reliably enhanced search performance, and that this strategic modulation of the interplay between WM contents and visual attention was mediated by a neuroanatomical network involving the posterior parietal cortex, the posterior cingulate, and medial temporal lobe structures, with responses in the hippocampus proper correlating with behavioral measures of strategic control of WM biases. Thus, we delineate a novel parieto-medial temporal pathway implementing cognitive control over WM biases to optimize goal-directed selection.

Effects of number magnitude and notation at 7T: separating the neural response to small and large, symbolic and nonsymbolic number

We examined the effects of number magnitude (within vs. outside the subitizable range) and notation (symbolic vs. nonsymbolic number) on neural responses to visual displays in the human brain using fMRI at 7T. We found that the right temporoparietal junction (rTPJ) responded more strongly to small than to larger numbers (2, 4 > 6, 8), while there was greater activity bilaterally within and around the intraparietal sulcus (IPS) as number magnitude increased (6, 8 > 2, 4). The effects of number magnitude were greatest for nonsymbolic stimuli. In addition, there was striking overlap between rTPJ regions responding to small numbers and those most strongly activated by symbolic stimuli, and between IPS regions responding to large numbers and those most activated by nonsymbolic stimuli. The results are consistent with distinct neural processes recruited for the processing of small- and large-number magnitudes. Contributions due to differences in representing exact number (small nonsymbolic arrays and all symbolic numbers, in rTPJ) and overall magnitude (particularly with large nonsymbolic arrays, in IPS), and the associated theoretical implications of the findings, are discussed.

I can see what you are doing: Action familiarity and affordance promote recovery from extinction

We assessed the effects of three factors on recovery from extinction in patients with lesions including the posterior parietal lobe: (a) whether objects were frequently used together in action versus whether they could be used in action together; (b) whether there was an effect of positioning objects for action; and (c) whether the surface properties of objects mediated performance. There was greater recovery from extinction for objects used frequently together, along with effects produced by objects that could be used together. There were also positive effects of correctly positioning objects for action. There were no effects of surface information on the benefit of reporting both members of a pair, though there were some effects on error trials. The results provide positive evidence for an effect on attention of affordances based on objects falling in plausible co-locations for action. Such affordances may also be influenced by the frequency with which objects are used together and can be generated from edge-based representations of objects (surface colour and depth are not necessary). However, surface-based representations may influence the speed with which action-related properties of objects engage attention.

Brain connectivity and postural control in young traumatic brain injury patients: A diffusion MRI based network analysis

Our previous research on traumatic brain injury (TBI) patients has shown a strong relationship between specific white matter (WM) diffusion properties and motor deficits. The potential impact of TBI-related changes in network organization of the associated WM structural network on motor performance, however, remains largely unknown. Here, we used diffusion tensor imaging (DTI) based fiber tractography to reconstruct the human brain WM networks of 12 TBI and 17 control participants, followed by a graph theoretical analysis. A force platform was used to measure changes in body posture under conditions of compromised proprioceptive and/or visual feedback. Findings revealed that compared with controls, TBI patients showed higher betweenness centrality and normalized path length, and lower values of local efficiency, implying altered network organization. These results were not merely a consequence of differences in number of connections. In particular, TBI patients displayed reduced structural connectivity in frontal, parieto-premotor, visual, subcortical, and temporal areas. In addition, the decreased connectivity degree was significantly associated with poorer balance performance. We conclude that analyzing the structural brain networks with a graph theoretical approach provides new insights into motor control deficits following brain injury.

Prioritization by transients in visual search

There is an ongoing debate as to whether prioritizing new objects over old objects (the so-called preview benefit) is the result of top-down inhibition of old objects (i.e., visual marking; Watson & Humphreys, 1997) or attentional allocation to new objects, presented with a luminance transient (Donk & Theeuwes, 2001). In the two experiments reported here, we tested whether prioritization by luminance transients alone can produce a subset-selective search similar to the preview effect. Subjects viewed multiobject displays while a subset of objects was briefly flashed. The subjects prioritized up to 14 flashed objects over at least 14 nonflashed objects. Since prioritization by luminance transients can produce a subset-selective search on its own, it may well play an important role in the preview benefit.

Spatial attention deficits in humans: the critical role of superior compared to inferior parietal lesions

According to a longstanding view, inferior as opposed to superior parietal cortex critically contributes to the spatial attentional deficits encountered following unilateral parietal ischemic lesions. We review the evidence on which this view is based and contrast it with more recent structural lesion evidence concerning the critical role of the intraparietal sulcus in spatial attention deficits. In a classical spatial cueing paradigm, focal lesions of the posterior and of the middle segment of the intraparietal sulcus give rise to a pathological invalidity effect that is indistinguishable from that seen after classical inferior parietal lesions. When a competing distracter is added to a target stimulus, the deleterious consequences of focal IPS lesions are again very similar to those classically observed following inferior parietal lesions. The deficit could not be accounted for by functional effects at a distance affecting inferior parietal cortex. These single-case lesion data establish the critical role of the posterior and the middle IPS segment in spatially selective attention and are in line with a vast amount of functional imaging evidence in the intact brain pointing to the prominent role of the intraparietal sulcus in spatial attention, along with inferior parietal cortex under specific circumstances. Functional imaging has also provided hints about the differences in functional contribution between inferior and superior parietal cortex. These hypotheses await further confirmation based on lesion evidence.

Active ignoring in early visual cortex

Selective attention is critical for controlling the input to mental processes. Attentional mechanisms act not only to select relevant stimuli but also to exclude irrelevant stimuli. There is evidence that we can actively ignore irrelevant information. We measured neural activity relating to successfully ignoring distracters (using preview search) and found increases in both the precuneus and primary visual cortex during preparation to ignore distracters. We also found reductions in activity in fronto-parietal regions while previewing distracters and a reduction in activity in early visual cortex during search when a subset of items was successfully excluded from search, both associated with precuneus activity. These results are consistent with the proposal that actively excluding distractions has two components: an initial stage where distracters are encoded, and a subsequent stage where further processing of these items is inhibited. Our findings suggest that it is the precuneus that controls this process and can modulate activity in visual cortex as early as V1.

Deficits in subprocesses of visual feature search after frontal, parietal, and temporal brain lesions--a modeling approach

Deficits in visuospatial attention are commonly observed after different kinds of brain lesions. However, the structure-function relationships are not well understood. We investigated whether our response time (RT) model, strategies of visual search (STRAVIS), combined with a linear model of brain lesions, enables us to relate specific impairments in cognitive processes to specific sites of focal brain lesions. In STRAVIS, RTs in overt visual feature search with graded target-distractor similarity are decomposed into the durations of successive search steps. Fitting the model to an observer's RTs yields individual estimates of the parameters "attentional focus size," "attentional dwell time," and "movement time of attention or the eyes." In 28 patients with various focal lesions to the frontal, parietal, and/or temporal cortex and 28 matched controls, we determined with the help of linear models which lesions were most predictive for each parameter. Predictions were validated with a second sample of 12 patients and 12 controls. Critical lesion areas for the STRAVIS focus size were the dorsolateral prefrontal cortex and the temporal lobe, with dorsolateral prefrontal cortex lesions reducing the focus and temporal lesions enlarging it. The STRAVIS dwell time was reduced in patients with lesions to the anterior insula and the superior parietal lobe. Lesions to the frontal eye fields, the superior parietal lobe, and the parieto-occipital cortex were most detrimental to the STRAVIS movement time. Applying linear models to a patient sample with heterogeneous lesions may be a promising new method for investigating how different brain areas interplay in a complex task.

Deficits in visual search for conjunctions of motion and form after parietal damage but with spared hMT+/V5

It has been argued that area hMT+/V5 in humans acts as a motion filter, enabling targets defined by a conjunction of motion and form to be efficiently selected. We present data indicating that (a) damage to parietal cortex leads to a selective problem in processing motion-form conjunctions, and (b) that the presence of a structurally and functional intact hMT+/V5 is not sufficient for efficient search for motion-form conjunctions. We suggest that, in addition to motion-processing areas (e.g., hMT+/V5), the posterior parietal cortex is necessary for efficient search with motion-form conjunctions, so that damage to either brain region may bring about deficits in search. We discuss the results in terms of the involvement of the posterior parietal cortex in the top-down guidance of search or in the binding of motion and form information.

Comparing segmentation by time and by motion in visual search: an FMRI investigation

Brain activity was recorded while participants engaged in a difficult visual search task for a target defined by the spatial configuration of its component elements. The search displays were segmented by time (a preview then a search display), by motion, or were unsegmented. A preparatory network showed activity to the preview display, in the time but not in the motion segmentation condition. A region of the precuneus showed (i) higher activation when displays were segmented by time or by motion, and (ii) correlated activity with larger segmentation benefits behaviorally, regardless of the cue. Additionally, the results revealed that success in temporal segmentation was correlated with reduced activation in early visual areas, including V1. The results depict partially overlapping brain networks for segmentation in search by time and motion, with both cue-independent and cue-specific mechanisms.

The neural mechanisms of visual selection: the view from neuropsychology

In this review, we discuss how neuropsychological impairments in visual selection can inform us about how selection normally operates. Using neuroanatomical and behavioral evidence on the disorders of neglect, extinction, and simultanagnosia, we propose functional and anatomical links between different aspects of visual selection and distinct sites in the posterior parietal cortex (PPC). This includes linking: (i) bottom-up attentional capture and the right temporo-parietal junction (TPJ); (ii) top-down segmentation of displays and the medial PPC; (iii) grouping, individuation and identification, and the inferior intra-parietal sulcus (IPS) bilaterally; and (iv) the suppression of saliency and the left IPS. In addition, when neuropsychological studies are combined with fMRI, there is evidence that these regions of the PPC interact with striate and extra-striate cortical areas, which respond to specific properties of stimuli. Selection should be viewed as an emergent property of a network of areas involving both ventral and dorsal cortex.

Repeated Contextual Search Cues Lead to Reduced BOLD-Onset Times in Early Visual and Left Inferior Frontal Cortex

Repetition of context can facilitate search for targets in distractor-filled displays. This contextual cueing goes along with enhanced event-related brain potentials in visual cortex, as previously demonstrated with depth electrodes in the human brain. However, modulation of the BOLD-response in striate and peristriate cortices has, to our knowledge, not yet been reported as a consequence of contextual cueing. Here, we report a selective reduction of the BOLD onset latency for repeated distractor configurations in these areas. In addition, the same onset latency reduction was observed in posterior inferior frontal cortex, a potential source area for feedback signals to early visual areas.

The role of right and left parietal lobes in the conceptual processing of numbers

Neuropsychological and functional imaging studies have associated the conceptual processing of numbers with bilateral parietal regions (including intraparietal sulcus). However, the processes driving these effects remain unclear because both left and right posterior parietal regions are activated by many other conceptual, perceptual, attention, and response-selection processes. To dissociate parietal activation that is number-selective from parietal activation related to other stimulus or response-selection processes, we used fMRI to compare numbers and object names during exactly the same conceptual and perceptual tasks while factoring out activations correlating with response times. We found that right parietal activation was higher for conceptual decisions on numbers relative to the same tasks on object names, even when response time effects were fully factored out. In contrast, left parietal activation for numbers was equally involved in conceptual processing of object names. We suggest that left parietal activation for numbers reflects a range of processes, including the retrieval of learnt facts that are also involved in conceptual decisions on object names. In contrast, number selectivity in right parietal cortex reflects processes that are more involved in conceptual decisions on numbers than object names. Our results generate a new set of hypotheses that have implications for the design of future behavioral and functional imaging studies of patients with left and right parietal damage.

Using biologically plausible neural models to specify the functional and neural mechanisms of visual search

We review research from our laboratory that attempts to pull apart the functional and neural mechanisms of visual search using converging, inter-disciplinary evidence from experimental studies with normal participants, neuropsychological studies with brain lesioned patients, functional brain imaging and computational modelling. The work suggests that search is determined by excitatory mechanisms that support the selection of target stimuli, and inhibitory mechanisms that suppress irrelevant distractors. These mechanisms operate through separable though overlapping neural circuits which can be functionally decomposed by imposing model-based analyses on brain imaging data. The chapter highlights the need for inter-disciplinary research for understanding complex cognitive processes at several levels.

Simultaneous preparation of multiple potential movements: opposing effects of spatial proximity mediated by premotor and parietal cortex

Neurophysiological studies in monkey have suggested that premotor and motor cortex may prepare for multiple movements simultaneously, sustained by cooperative and competitive interactions within and between the neural populations encoding different actions. Here, we investigate whether competition between alternative movement directions, manipulated in terms of number and spatial angle, is reflected in electroencephalographic (EEG) measures of (pre)motor cortical activity in humans. EEG was recorded during performance of a center-out pointing task in which response signals were preceded by cues providing prior information in the form of arrows pointing to one or more possible movement targets. Delay-period activity in (pre)motor cortex was modulated in the predicted manner by the number of possible movement directions and by the angle separating them. Response latencies, however, were determined not only by the amplitude of movement-preparatory activity, but also by differences in the duration of stimulus evaluation against the visuospatial memory of the cue, reflected in EEG potentials originating from posterior parietal cortex (PPC). Specifically, the spatial proximity of possible movement targets was processed differently by (pre)motor and posterior parietal cortex. Spatial proximity enhanced the amplitude of (pre)motor cortex preparatory activity during the delay period but delayed evaluation of the response signal in the PPC, thus producing opposite effects on response latency. The latter finding supports distributed control of movement decisions in the frontoparietal network, revealing a feature of distributed control that is of potential significance for the understanding of distracter effects in reaching and pointing.

Quantity without numbers and numbers without quantity in the parietal cortex

A dominant view in numerical cognition is that processing the quantity indicated by numbers (e.g. deciding the larger between two numbers such as '12.07' or '15.02') relies on the intraparietal regions (IPS) of the cerebral cortex. However, it remains unclear whether the IPS could play a more general role in numerical cognition, for example in (1) quantity processing even with non-numerical stimuli (e.g. choosing the larger of 'bikini' and 'coat'); and/or (2) conceptual tasks involving numbers beyond those requiring quantity processing (e.g. attributing a summer date to either '12.07' or '15.02'). In this study we applied fMRI-guided TMS to the left and right IPS, while independently manipulating stimulus and task. Our results showed that IPS involvement in numerical cognition is neither stimulus-specific nor specific for conceptual tasks. Thus, quantity judgments with numerical and non-numerical stimuli were equally affected by IPS-TMS, as well as a number conceptual task not requiring quantity comparisons. However, IPS-TMS showed no impairment for perceptual decisions on numbers without any conceptual processing (i.e. colour judgment), nor for conceptual decisions that did not involve quantity or number stimuli (e.g. summer object: 'bikini' or 'coat'?). These results are consistent with proposals that the parietal areas are engaged in the conceptual representation of numbers but they challenge the most common view that number processing is so automatic that the simple presentation of numbers activates the IPS and a sense of magnitude. Rather, our results show that the IPS is only necessary when conceptual operations need to be explicitly oriented to numerical concepts.

Recollection- and familiarity-based decisions reflect memory strength

We used event-related fMRI to investigate whether recollection- and familiarity-based memory judgments are modulated by the degree of visual similarity between old and new art paintings. Subjects performed a flower detection task, followed by a Remember/Know/New surprise memory test. The old paintings were randomly presented with new paintings, which were either visually similar or visually different. Consistent with our prediction, subjects were significantly faster and more accurate to reject new, visually different paintings than new, visually similar ones. The proportion of false alarms, namely remember and know responses to new paintings, was significantly reduced with decreased visual similarity. The retrieval task evoked activation in multiple visual, parietal and prefrontal regions, within which remember judgments elicited stronger activation than know judgments. New, visually different paintings evoked weaker activation than new, visually similar items in the intraparietal sulcus. Contrasting recollection with familiarity revealed activation predominantly within the precuneus, where the BOLD response elicited by recollection peaked significantly earlier than the BOLD response evoked by familiarity judgments. These findings suggest that successful memory retrieval of pictures is mediated by activation in a distributed cortical network, where memory strength is manifested by differential hemodynamic profiles. Recollection- and familiarity-based memory decisions may therefore reflect strong memories and weak memories, respectively.

Convergence between lesion-symptom mapping and functional magnetic resonance imaging of spatially selective attention in the intact brain

The parietal regions implicated in spatially selective attention differ between patient lesion studies and functional imaging of the intact brain. We aimed to resolve this discordance. In a voxel-based lesion-symptom mapping study in 20 ischemic stroke patients, we applied the same cognitive subtraction approach as in 23 healthy volunteers who underwent functional magnetic resonance imaging (fMRI) using identical tasks and stimuli. An instructive central cue directed attention to one visual quadrant. After a brief delay, a grating appeared in that quadrant together with an irrelevant grating in an uncued quadrant. Subjects had to discriminate the orientation of the grating in the cued quadrant. Patients with a right inferior parietal lesion were significantly more impaired during contralesional versus ipsilesional orienting when stimuli were bilateral and symmetrical than when stimuli occupied diagonally opposite quadrants or two quadrants within the same hemifield. In one area, the lesion-volume map overlapped with the activity map obtained in healthy volunteers: the lower bank of the middle third of the right intraparietal sulcus (IPS). In an additional 37 healthy fMRI subjects, we disentangled the effects of symmetry, bilaterality, and spatial configuration between stimuli on activity in the volume of overlap. Only the axis of configuration between stimuli had a significant effect, with highest activity when the configuration axis was horizontal. This constitutes converging evidence from patients and cognitively intact subjects that the lower bank of the middle third of the right IPS critically contributes to attentive selection between competing stimuli in a spatially anisotropic manner.

An fMRI investigation into the neural mechanisms of spatial attentional selection in a location-based negative priming task

Selective attention enables us to respond to objects and events that are relevant to our goals for adaptive interactions with the environment. Despite evidence from research addressing the selection of a target location, little is known about the neural mechanisms of attentional selection in situations in which the selection is biased in favor of the information in the irrelevant location. In this study, we combined event-related fMRI and a location-based negative priming paradigm with a prime-probe-trial design to investigate the neural mechanisms of spatial attentional selection. Participants were instructed to respond to the location of a pre-specified target while ignoring a distractor at an irrelevant location. The goal of this study was twofold. First, we identified brain regions that are linked to conflict resolution situations, in which the selection bias puts the irrelevant information in the probe trial on a selection advantage over the target. Second, we determined the mechanism of conflict resolution when the encoding conditions of stimuli are manipulated by presenting stimuli either abruptly (onset) or masked (no-onset). The results showed that the bottom-up-induced competition among stimuli in the target selection is stronger for onset than no-onset stimuli. The superior parietal lobule was sensitive to those changes in bottom-up-induced competition. Furthermore, the dorsolateral prefrontal cortex and inferior parietal lobe were activated to resolve the additional processing effort necessary to select the negatively biased target. In conclusion, the present study identified dissociable neural components needed to resolve the negative selection bias, which attentional modulation can be addressed in future studies by examining changes in the functional connectivity.

Previewing distracters reduces their effective contrast

In a visual search task, when half the distracters are presented earlier than the remainder ('previewed'), observers find the target item more efficiently than when all the items are presented together -- the preview benefit. We measured psychometric functions for contrast increments on Gabors that were presented as a valid preview for subsequent search, and when they were a non-predictive (dummy) preview. Sensitivity to contrast increments was lower (rightwards shift of the psychometric function) on valid, compared to dummy previews. This is consistent with an account of the preview benefit in terms of active inhibition, equivalent to lowering the contrast of previewed items that are being actively ignored.

Visual marking and change detection

The preview benefit from prior exposure of response-irrelevant (distracter) objects in visual search has been accounted for in terms of top-down inhibition (i.e. visual marking), bottom-up abrupt onset capture, or asynchrony-dependent perceptual segregation. We assess the relative contribution of abrupt onset and visual marking in a paradigm combining visual search with a visual working memory task. We investigated time-based selection of multiple objects for storage in visual working memory, using a change detection paradigm (Luck and Vogel in Nature 390:279-281, 1997) with distracter preview. We varied preview exposure (short vs. long), in a series of three experiments. The contribution of asynchrony-related perceptual segregation was assessed across experiments by varying the complexity of the stimuli (colored squares, oriented bars and oriented T-shapes) and the type of change detection (color or orientation), resulting in different levels of perceptual segregation between visual elements. The results suggest that bottom-up abrupt onset, visual marking and perceptual segregation factors co-operate in time-based selection for storage in visual working memory.

A psychophysical investigation into the preview benefit in visual search

In preview search, half of the distracters are presented ahead of the remaining distracters and the target. Search under these conditions is more efficient than when all the items appear together (Watson & Humphreys, 1997). We investigated the mechanisms contributing to this preview benefit using an orientation discrimination task. In a display of vertical Gabors (all equidistant from fixation) one Gabor (chosen at random) was tilted (left or right). When half the non-tilted Gabors were previewed, thresholds increased less with the number of Gabors, relative to when all the Gabors appeared together (a preview benefit). In a further experiment, orientation noise was added to some of the Gabors. When all Gabors were presented simultaneously, orientation thresholds for the target increased. The effects of noise on thresholds was reduced, however, when the noisy Gabors were presented as a preview. Furthermore, there was less effect of noise in the preview condition than when observers were cued to a subset of Gabors (with a cue presented prior to the Gabors, adjacent to their positions). Visual information can be effectively excluded from the previewed locations to a greater degree than when attention is directed to a subset of display items. The implications for understanding the mechanisms involved in preview search are discussed.

Remapping attentional priorities: differential contribution of superior parietal lobule and intraparietal sulcus

Seeking and selectively attending to significant extrapersonal stimuli in a dynamic environment requires the updating of an attentional priority map. Using functional magnetic resonance imaging, we investigated the role of posterior parietal cortex in such remappings of attentional priorities where the configuration, location, and significance of stimuli were systematically varied. Our data revealed a functional dissociation between 2 juxtaposed posterior parietal regions: one in the superior parietal lobule (SPL) and another in the intraparietal sulcus (IPS). SPL was preferentially activated in all conditions where a spatial displacement occurred in the location of the target, the location of the distracter, or the focus of attention (exogenous and endogenous shifts of spatial attention). Shifts of the attentional focus also activated the IPS but principally if they were guided endogenously by internal rules of relevance rather than stimulus displacement per se (endogenous attention shifts). Only the IPS region was activated by transient resetting of target significance when the stimulus configuration changed but the attentional focus remained spatially fixed (feature attention shifts). These 2 components of the large-scale frontoparietal spatial attention network therefore have common and distinctive functions. In specific, the IPS component is more closely related to the compilation of an attentional priority map, including the endogenous recalibration of attentional weights. The SPL component, on the other hand, is more closely related to the modification of spatial coordinates linked to attentional priorities (spatial shifting). Collectively, these 2 areas allow posterior parietal cortex to dynamically encode extrapersonal events according to their spatial coordinates and valence.

Recognition memory of newly learned faces

We used event-related fMRI to study recognition memory of newly learned faces. Caucasian subjects memorized unfamiliar, neutral and happy South Korean faces and 4 days later performed a memory retrieval task in the MR scanner. We predicted that previously seen faces would be recognized faster and more accurately and would elicit stronger neural activation than novel faces. Consistent with our hypothesis, novel faces were recognized more slowly and less accurately than previously seen faces. We found activation in a distributed cortical network that included face-responsive regions in the visual cortex, parietal and prefrontal regions, and the hippocampus. Within all regions, correctly recognized, previously seen faces evoked stronger activation than novel faces. Additionally, in parietal and prefrontal cortices, stronger activation was observed during correct than incorrect trials. Finally, in the hippocampus, false alarms to happy faces elicited stronger responses than false alarms to neutral faces. Our findings suggest that face recognition memory is mediated by stimulus-specific representations stored in extrastriate regions; parietal and prefrontal regions where old and new items are classified; and the hippocampus where veridical memory traces are recovered.

A computational model of visual marking using an inter-connected network of spiking neurons: the spiking search over time & space model (sSoTS)

In the real world, visual information is selected over time as well as space, when we prioritise new stimuli for attention. Watson and Humphreys [Watson, D., Humphreys, G.W., 1997. Visual marking: prioritizing selection for new objects by top-down attentional inhibition of old objects. Psychological Review 104, 90-122] presented evidence that new information in search tasks is prioritised by (amongst other processes) active ignoring of old items - a process they termed visual marking. In this paper we present, for the first time, an explicit computational model of visual marking using biologically plausible activation functions. The "spiking search over time and space" model (sSoTS) incorporates different synaptic components (NMDA, AMPA, GABA) and a frequency adaptation mechanism based on [Ca(2+)] sensitive K(+) current. This frequency adaptation current can act as a mechanism that suppresses the previously attended items. We show that, when coupled with a process of active inhibition applied to old items, frequency adaptation leads to old items being de-prioritised (and new items prioritised) across time in search. Furthermore, the time course of these processes mimics the time course of the preview effect in human search. The results indicate that the sSoTS model can provide a biologically plausible account of human search over time as well as space.