Brain electrical correlates of dimensional weighting: An ERP study

Sensorimotor brain dynamics reflect architectural affordances

Anticipating meaningful actions in the environment is an essential function of the brain. Such predictive mechanisms originate from the motor system and allow for inferring actions from environmental affordances, and the potential to act within a specific environment. Using architecture, we provide a unique perspective on the ongoing debate in cognitive neuroscience and philosophy on whether cognition depends on movement or is decoupled from our physical structure. To investigate cognitive processes associated with architectural affordances, we used a mobile brain/body imaging approach recording brain activity synchronized to head-mounted displays. Participants perceived and acted on virtual transitions ranging from nonpassable to easily passable. We found that early sensory brain activity, on revealing the environment and before actual movement, differed as a function of affordances. In addition, movement through transitions was preceded by a motor-related negative component that also depended on affordances. Our results suggest that potential actions afforded by an environment influence perception.

Learned feature variance is encoded in the target template and drives visual search

Real world visual search targets are frequently imperfect perceptual matches to our internal target templates. For example, the same friend on different occasions is likely to wear different clothes, hairstyles, and accessories, but some of these may be more likely to vary than others. The ability to deal with template-to-target variability is important to visual search in natural environments, but we know relatively little about how feature variability is handled by the attentional system. In these studies, we test the hypothesis that top-down attentional biases are sensitive to the variance of target feature dimensions over time and prioritize information from less-variable dimensions. On each trial, subjects were shown a target cue composed of colored dots moving in a specific direction followed by a working memory probe (30%) or visual search display (70%). Critically, the target features in the visual search display differed from the cue, with one feature drawn from a distribution narrowly centered over the cued feature (low-variance dimension), and the other sampled from a broader distribution (high-variance dimension). The results demonstrate that subjects used knowledge of the likely cue-to-target variance to set template precision and bias attentional selection. Moreover, an individual's working memory precision for each feature predicted search performance. Our results suggest that observers are sensitive to the variance of feature dimensions within a target and use this information to weight mechanisms of attentional selection.

Attending to multiple objects relies on both feature- and dimension-based control mechanisms: Evidence from human electrophysiology

Numerous everyday search tasks require humans to attentionally select and temporally store more than one object present in the visual environment. Recently, several enumeration studies sought to isolate the mechanisms underlying multiple object processing by means of electrophysiological measures, which led to a more fine-grained picture as to which processing stages are modulated by object numerosity. One critical limitation that most of these studies share is that they used stimulus designs in which multiple targets were exclusively defined by the same feature value. Accordingly, it remains an open issue whether these findings generalize to search scenarios in which multiple targets are physically not identical. To systematically address this issue, we introduced three target context conditions in which multiple targets were defined randomly by (1) the same feature (sF), (2) different features within the same dimension (dFsD), or (3) different features across dimensions (dD). Our findings revealed that participants' ability to enumerate multiple targets was remarkably influenced by inter-target relationships, with fastest responses for sF trials, slowest responses for dD trials, and responses of intermediate speed for dFsD trials. Our electrophysiological analyses disclosed that one source of this response slowing was feature-based and originated from the stage of attentional selection (as indexed by PCN waves), whereas another source was dimension-based and associated with working memory processes (as indexed by P3b waves). Overall, our results point to a significant role of physical inter-target relationships in multiple object processing-a factor that has been largely neglected in most studies on enumeration.

Task-specific, dimension-based attentional shaping of motion processing in monkey area MT

Nonspatially selective attention is based on the notion that specific features or objects in the visual environment are effectively prioritized in cortical visual processing. Feature-based attention (FBA), in particular, is a well-studied process that dynamically and selectively addresses neurons preferentially processing the attended feature attribute (e.g., leftward motion). In everyday life, however, behavior may require high sensitivity for an entire feature dimension (e.g., motion), but experimental evidence for a feature dimension-specific attentional modulation on a cellular level is lacking. Therefore, we investigated neuronal activity in macaque motion-selective mediotemporal area (MT) in an experimental setting requiring the monkeys to detect either a motion change or a color change. We hypothesized that neural activity in MT is enhanced when the task requires perceptual sensitivity to motion. In line with this, we found that mean firing rates were higher in the motion task and that response variability and latency were lower compared with values in the color task, despite identical visual stimulation. This task-specific, dimension-based modulation of motion processing emerged already in the absence of visual input, was independent of the relation between the attended and stimulating motion direction, and was accompanied by a spatially global reduction of neuronal variability. The results provide single-cell support for the hypothesis of a feature dimension-specific top-down signal emphasizing the processing of an entire feature class.NEW & NOTEWORTHY Cortical processing serving visual perception prioritizes information according to current task requirements. We provide evidence in favor of a dimension-based attentional mechanism addressing all neurons that process visual information in the task-relevant feature domain. Behavioral tasks required monkeys to attend either color or motion, causing modulations of response strength, variability, latency, and baseline activity of motion-selective monkey area MT neurons irrespective of the attended motion direction but specific to the attended feature dimension.

Electrophysiological evidence for an attentional bias in processing body stimuli in bulimia nervosa

Empirical evidence suggests abnormalities in the processing of body stimuli in bulimia nervosa (BN). This study investigated central markers of processing body stimuli by means of event-related potentials in BN. EEG was recorded from 20 women with BN and 20 matched healthy controls while watching and evaluating underweight, normal and overweight female body pictures. Bulimics evaluated underweight bodies as less unpleasant and overweight bodies as bigger and more arousing. A higher P2 to overweight stimuli occurred in BN only. In contrast to controls, no N2 increase to underweight bodies was observed in BN. P3 was modulated by stimulus category only in healthy controls; late slow waves to underweight bodies were more pronounced in both groups. P2 amplitudes to overweight stimuli were correlated with drive for thinness and body dissatisfaction. We present novel support for altered perceptual and cognitive-affective processing of body images in BN on the subjective and electrophysiological level.

Attentional spreading to task-irrelevant object features: experimental support and a 3-step model of attention for object-based selection and feature-based processing modulation

Directing attention to a specific feature of an object has been linked to different forms of attentional modulation. Object-based attention theory founds on the finding that even task-irrelevant features at the selected object are subject to attentional modulation, while feature-based attention theory proposes a global processing benefit for the selected feature even at other objects. Most studies investigated either the one or the other form of attention, leaving open the possibility that both object- and feature-specific attentional effects do occur at the same time and may just represent two sides of a single attention system. We here investigate this issue by testing attentional spreading within and across objects, using reaction time (RT) measurements to changes of attended and unattended features on both attended and unattended objects. We asked subjects to report color and speed changes occurring on one of two overlapping random dot patterns (RDPs), presented at the center of gaze. The key property of the stimulation was that only one of the features (e.g., motion direction) was unique for each object, whereas the other feature (e.g., color) was shared by both. The results of two experiments show that co-selection of unattended features even occurs when those features have no means for selecting the object. At the same time, they demonstrate that this processing benefit is not restricted to the selected object but spreads to the task-irrelevant one. We conceptualize these findings by a 3-step model of attention that assumes a task-dependent top-down gain, object-specific feature selection based on task- and binding characteristics, and a global feature-specific processing enhancement. The model allows for the unification of a vast amount of experimental results into a single model, and makes various experimentally testable predictions for the interaction of object- and feature-specific processes.

Parietal substrates for dimensional effects in visual search: evidence from lesion-symptom mapping

In visual search, the detection of pop-out targets is facilitated when the target-defining dimension remains the same compared with when it changes across trials. We tested the brain regions necessary for these dimensional carry-over effects using a voxel-based morphometry study with brain-lesioned patients. Participants had to search for targets defined by either their colour (red or blue) or orientation (right- or left-tilted), and the target dimension either stayed the same or changed on consecutive trials. Twenty-five patients were categorized according to whether they showed an effect of dimensional change on search or not. The two groups did not differ with regard to their performance on several working memory tasks, and the dimensional carry-over effects were not correlated with working memory performance. With spatial, sustained attention and working memory deficits as well as lesion volume controlled, damage within the right inferior parietal lobule (the angular and supramarginal gyri) extending into the intraparietal sulcus was associated with an absence of dimensional carry-over (P < 0.001, cluster-level corrected for multiple comparisons). The data suggest that these regions of parietal cortex are necessary to implement attention shifting in the context of visual dimensional change.

P300 amplitudes in the concealed information test are less affected by depth of processing than electrodermal responses

The Concealed Information Test (CIT) has been used in the laboratory as well as in field applications to detect concealed crime related memories. The presentation of crime relevant details to guilty suspects has been shown to elicit enhanced N200 and P300 amplitudes of the event-related brain potentials (ERPs) as well as greater skin conductance responses (SCRs) as compared to neutral test items. These electrophysiological and electrodermal responses were found to incrementally contribute to the validity of the test, thereby suggesting that these response systems are sensitive to different psychological processes. In the current study, we tested whether depth of processing differentially affects N200, P300, and SCR amplitudes in the CIT. Twenty participants carried out a mock crime and became familiar with central and peripheral crime details. A CIT that was conducted 1 week later revealed that SCR amplitudes were larger for central details although central and peripheral items were remembered equally well in a subsequent explicit memory test. By contrast, P300 amplitudes elicited by crime related details were larger but did not differ significantly between question types. N200 amplitudes did not allow for detecting concealed knowledge in this study. These results indicate that depth of processing might be one factor that differentially affects central and autonomic nervous system responses to concealed information. Such differentiation might be highly relevant for field applications of the CIT.

The effect of task order predictability in audio-visual dual task performance: Just a central capacity limitation?

In classic Psychological-Refractory-Period (PRP) dual-task paradigms, decreasing stimulus onset asynchronies (SOA) between the two tasks typically lead to increasing reaction times (RT) to the second task and, when task order is non-predictable, to prolonged RTs to the first task. Traditionally, both RT effects have been advocated to originate exclusively from the dynamics of a central bottleneck. By focusing on two specific electroencephalographic brain responses directly linkable to perceptual or motor processing stages, respectively, the present study aimed to provide a more detailed picture as to the origin(s) of these behavioral PRP effects. In particular, we employed 2-alternative forced-choice (2AFC) tasks requiring participants to identify the pitch of a tone (high versus low) in the auditory, and the orientation of a target object (vertical versus horizontal) in the visual, task, with task order being either predictable or non-predictable. Our findings show that task order predictability (TOP) and inter-task SOA interactively determine the speed of (visual) perceptual processes (as indexed by the PCN timing) for both the first and the second task. By contrast, motor response execution times (as indexed by the LRP timing) are influenced independently by TOP for the first, and SOA for the second, task. Overall, this set of findings complements classical as well as advanced versions of the central bottleneck model by providing electrophysiological evidence for modulations of both perceptual and motor processing dynamics that, in summation with central capacity limitations, give rise to the behavioral PRP outcome.

Electrophysiologic evidence for multilevel deficits in emotional face processing in patients with bulimia nervosa

BACKGROUND

Empirical evidence suggests substantial deficits regarding emotion recognition in bulimia nervosa (BN). The aim of the current study was to investigate electrophysiologic evidence for deficits in emotional face processing in patients with BN.

METHODS

Event-related potentials were recorded from 13 women with BN and 13 matched healthy controls while viewing neutral, happy, fearful, and angry facial expressions. Participants' recognition performance for emotional faces was tested in a subsequent categorization task. In addition, the degree of alexithymia, depression, and anxiety were assessed via questionnaires.

RESULTS

Categorization of emotional faces was hampered in BN (p = .01). Amplitudes of event-related potentials differed during emotional face processing: face-specific N170 amplitudes were less pronounced for angry faces in patients with BN (mean [M] [standard deviation {SD}] = 1.46 [0.56] µV versus M [SD] = -1.23 [0.61] µV, p = .02). In contrast, P3 amplitudes were more pronounced in patients with BN as compared with controls (M [SD] = 2.64 [0.46] µV versus M [SD] = 1.25 [0.39] µV, p = .04), independent of emotional expression.

CONCLUSIONS

The study provides novel electrophysiologic data showing that emotional faces are processed differently in patients with BN as compared with healthy controls. We suggest that deficits in early automatic emotion classification in BN are followed by an increased allocation of attentional resources to compensate for those deficits. These findings might contribute to a better understanding of the impaired social functioning in BN.

Dynamic weighting of feature dimensions in visual search: behavioral and psychophysiological evidence

Dimension-based accounts of visual search and selection have significantly contributed to the understanding of the cognitive mechanisms of attention. Extensions of the original approach assuming the existence of dimension-based feature contrast saliency signals that govern the allocation of focal attention have recently been employed to explain the spatial and temporal dynamics of the relative strengths of saliency representations. Here we review behavioral and neurophysiological findings providing evidence for the dynamic trial-by-trial weighting of feature dimensions in a variety of visual search tasks. The examination of the effects of feature and dimension-based inter-trial transitions in feature detection tasks shows that search performance is affected by the change of target-defining dimensions, but not features. The use of the redundant-signals paradigm shows that feature contrast saliency signals are integrated at a pre-selective processing stage. The comparison of feature detection and compound search tasks suggests that the relative significance of dimension-dependent and dimension-independent saliency representations is task-contingent. Empirical findings that explain reduced dimension-based effects in compound search tasks are discussed. Psychophysiological evidence is presented that confirms the assumption that the locus of the effects of feature dimension changes is perceptual pre-selective rather than post-selective response-based. Behavioral and psychophysiological results are considered within in the framework of the dimension weighting account of selective visual attention.

Electroencephalography in eating disorders

Clinical applications of electroencephalography (EEG) are used with different objectives, EEG being a noninvasive and painless procedure. In respect of eating disorders, in the 1950s a new line of study about the neurological bases of anorexia nervosa was started and has since been developed. The purpose of this review is to update the existing literature data on the main findings in respect of EEG in eating disorders by means of a search conducted in PubMed. Despite the fact that weight gain tends to normalize some brain dysfunctions assessed by means of EEG, the specific effect of gaining weight remains controversial. Different studies have reported that cortical dysfunctions can be found in patients with anorexia nervosa even after weight gain, whereas others have reported a normalization of EEG in respect of the initial reduced alpha/ increased beta power in those patients with refeeding. Findings of studies that have analyzed the possible relationship between eating disorders and depression, based on sleep EEG disturbances, do not support the idea of eating disorders as a variant of depression or affective disorders. Some EEG findings are very consistent with previous neuroimaging results on patients with anorexia nervosa, reporting neural disturbances in response to stimuli that are relevant to the pathology (eg, stimuli like food exposure, different emotional situations, or body images).

Using Redundant Visual Information From Different Dimensions for Attentional Selection

The present study investigated the use of redundant information for attentional selection of a visual object. Each display contained two overlapping objects, and participants had to report the color of the occluding object. A baseline condition did not require object selection because the objects were identical. A single-cue condition required object selection based on spatial arrangement (i.e., occlusion) because the objects had the same shape. A double-cue condition afforded object selection by occlusion and shape because the objects consistently differed in shape. Behavioral results showed that the redundant shape cue facilitated attentional selection, although participants were never supposed to respond to shape. The Event-Related Brain Potential (ERP) results showed a posterior N2 effect in both selection conditions, and a frontal N2 effect in the double-cue condition only. These results suggest that the redundancy gain in the double-cue condition relied on processes of voluntary attention, presumably the increase of attentional weights for visual shape information.

The timing of feature-based attentional effects during object perception

Allocating attention to basic features such as colour enhances perception of the respective features throughout the visual field. We have previously shown that feature-based attention also plays a role for more complex features required for object perception. To investigate at which level object perception is modulated by feature-based attention we recorded high-density event-related potentials (ERPs). Participants detected contour-defined objects or motion, and were informed to expect each feature dimension. Participants perceived contour-defined objects and motion better when they expected the congruent feature. This is consistent with modulation of the P1 when attending to lower-level features. For contours, modulation occurred at 290 ms, first at frontal electrodes and then at posterior sites, associated with sources in ventral visual areas accompanied by greater signal strength. This pattern of results is consistent with what has been observed in response to illusory contours. Our data provide novel insights into the contribution of feature-based attention to object perception that are associated with higher tier brain areas.

Motion and color generate coactivation at postgrouping identification stages

Response times (RTs) were measured in a postgrouping visual identification task. Shapes composed of multiple elements were distinguished by color, motion, orientation, and spatial frequency alone or in pairwise conjunctions. The largest amount of redundancy gain, requiring coactivation as revealed by a race model analysis, was obtained with color-motion conjunctions. In contrast, RTs for a pregrouping detection task using the same target shape as in the identification task, distinguished by color, motion, or a conjunction of these features, showed no evidence for coactivation. The results provide psychophysical evidence for coactivation of color and motion signals in cortical regions specialized for grouping and object identification, as opposed to separate processing of these features in cortical area V1, believed to limit performance in visual search and pregrouping detection.

Electrophysiological correlates of detecting a visual target and detecting its absence: the role of feature dimensions

Electrophysiological measurements were taken from observers performing a visual search within a single feature dimension, and between multiple dimensions. The N2pc to selected singleton target stimuli (rightward tilted lines) was increased when targets varied between feature dimensions, compared to the N2pc to the same rightward tilted line targets, in a condition in which targets varied only between feature values within the same dimension. The anterior and posterior N2 were not reliably modulated, but P3(b) amplitude was higher for singleton present trials that varied between dimensions than for those that varied within. The ERP elicited by singleton absent trials showed reduced P3 amplitude in the between-dimension condition. The electrophysiological modulations were accompanied by increased reaction times in the between-dimension condition, on both singleton present and absent trials. The results suggested that visual target detection is affected by early dimension-specific weighting of the current attentional task set. Furthermore, exhaustively searching multiple feature dimensions to determine the absence of a target incurs dimensional switching costs, possibly at a later stage.

Dimension-based attention modulates early visual processing

Target selection can be based on spatial or dimensional/featural mechanisms operating in a location-independent manner. We investigated whether dimension-based attention affects processing in early visual stages. Subjects searched for a singleton target among an 8-item array, with the search display preceded by an identical cue array with a dimensionally non-predictive, but spatially predictive singleton. Reaction times (RTs) were increased for changes in the target-defining dimension but not for featural changes within a dimension. This RT effect was mirrored by modulations of the P1 and anterior transition N2 (tN2). Current density reconstructions revealed increased activity in dorsal occipital cortex and decreased activity in left frontopolar cortex owing to repeated dimensional pop-out identities. These findings strengthen dimension-based theories of visual attention by indicating dimension-, rather than feature-, specific influences within the first 110 ms of visual processing.

Top-down weighting of visual dimensions: behavioral and electrophysiological evidence

Visual search for an odd-one-out target is speeded when observers are provided with a cue word indicating the most probable target-defining dimension (e.g., form) on a given trial (Müller, Reimann, & Krummenacher, 2003). According to the 'dimension-weighting' account (e.g., Müller, Heller, & Ziegler, 1995), this semantic cueing effect originates from a pre-attentive processing stage: the coding of stimulus saliency. However, alternative views (e.g., Theeuwes, Reimann, & Mortier, 2006) argue that pre-attentive saliency computations are top-down impenetrable, advocating a response-related origin of this effect. To establish the (pre-attentive and/or post-selective) locus of semantic dimension-cueing effects, the present study examined reaction time (RT) performance in combination with specific event-related brain potential components that are directly linkable to either pre-attentive or post-selective levels of processing. Targets preceded by valid (relative to invalid) cues were associated with faster RTs and both shorter peak latencies and larger amplitudes of the Posterior-Contralateral Negativity (PCN). In addition, dimension changes (relative to repetitions) across consecutive trials were accompanied by delayed PCN latencies, whereas response changes (relative to repetitions) gave rise to enhanced amplitudes of the (response-locked) Lateralised Readiness Potential (LRP). This pattern of effects clearly demonstrates that top-down dimensional sets modulate pre-attentive perceptual processing in the detection of pop-out signals. However, they cannot completely overcome automatic dimension-based weighting processes.

The anterior N1 component as an index of modality shifting

Processing of a given target is facilitated when it is defined within the same (e.g., visual-visual), compared to a different (e.g., tactile-visual), perceptual modality as on the previous trial [Spence, C., Nicholls, M., & Driver, J. The cost of expecting events in the wrong sensory modality. Perception & Psychophysics, 63, 330-336, 2001]. The present study was designed to identify electrocortical (EEG) correlates underlying this "modality shift effect." Participants had to discriminate (via foot pedal responses) the modality of the target stimulus, visual versus tactile (Experiment 1), or respond based on the target-defining features (Experiment 2). Thus, modality changes were associated with response changes in Experiment 1, but dissociated in Experiment 2. Both experiments confirmed previous behavioral findings with slower discrimination times for modality change, relative to repetition, trials. Independently of the target-defining modality, spatial stimulus characteristics, and the motor response, this effect was mirrored by enhanced amplitudes of the anterior N1 component. These findings are explained in terms of a generalized "modality-weighting" account, which extends the "dimension-weighting" account proposed by Found and Müller [Searching for unknown feature targets on more than one dimension: Investigating a "dimension-weighting" account. Perception & Psychophysics, 58, 88-101, 1996] for the visual modality. On this account, the anterior N1 enhancement is assumed to reflect the detection of a modality change and initiation of the readjustment of attentional weight-setting from the old to the new target-defining modality in order to optimize target detection.

Anterior prefrontal involvement in implicit contextual change detection

Anterior prefrontal cortex is usually associated with high level executive functions. Here, we show that the frontal pole, specifically left lateral frontopolar cortex, is involved in signaling change in implicitly learned spatial contexts, in the absence of conscious change detection. In a variant of the contextual cueing paradigm, participants first learned contingencies between distractor contexts and target locations implicitly. After learning, repeated distractor contexts were paired with new target locations. Left lateral frontopolar [Brodmann area (BA) 10] and superior frontal (BA9) cortices showed selective signal increase for this target location change in repeated displays in an event-related fMRI experiment, which was most pronounced in participants with high contextual facilitation before the change. The data support the view that left lateral frontopolar cortex is involved in signaling contextual change to posterior brain areas as a precondition for adaptive changes of attentional resource allocation. This signaling occurs in the absence of awareness of learned contingencies or contextual change.

Impaired central processing of emotional faces in anorexia nervosa

OBJECTIVES

To elucidate the potential relationship between classification of emotional faces and impaired central processing in eating disorders and to investigate the potential mediatory role of alexithymia and depression in this relationship.

METHODS

Visual-evoked potentials (VEPs) to emotional faces and classification performance were assessed in 12 anorexic females and matched healthy controls.

RESULTS

Patients with anorexia nervosa showed no modulation of emotional face processing and displayed significantly increased N200 amplitudes in response to all emotional categories and decreased VEPs in response to unpleasant emotional faces in the P300 time range as compared with healthy controls. They also made more mistakes in emotional face recognition, in particular, for neutral, sad, and disgusted content.

CONCLUSIONS

There are marked differences in evoked potentials and emotion recognition performances of patients with anorexia nervosa and controls in facial processing. Differences in brain dynamics might contribute to difficulties in the correct recognition of facially expressed emotions, deficits in social functioning, and in turn the maintenance of eating disorders.

Electrophysiological markers of visual dimension changes and response changes

In cross-dimensional visual search tasks, target discrimination is faster when the previous trial contained a target defined in the same visual dimension as the current trial. The dimension-weighting account (DWA; A. Found & H. J. Müller, 1996) explains this intertrial facilitation by assuming that visual dimensions are weighted at an early perceptual stage of processing. Recently, this view has been challenged by models claiming that intertrial facilitation effects are generated at later stages that follow attentional target selection (K. Mortier, J. Theeuwes, & P. A. Starreveld, 2005). To determine whether intertrial facilitation is generated at a perceptual stage, at the response selection stage, or both, the authors focused on specific event-related brain potential components (directly linkable to perceptual and response-related processing) during a compound search task. Visual dimension repetitions were mirrored by shorter latencies and enhanced amplitudes of the N2-posterior- contralateral, suggesting a facilitated allocation of attentional resources to the target. Response repetitions and changes systematically modulated the lateralized readiness potential amplitude, suggesting a benefit from residual activations of the previous trial biasing the correct response. Overall, the present findings strengthen the DWA by indicating a perceptual origin of dimension change costs in visual search.

Detecting perceptual conflict by the feedback-related negativity in brain potentials

The feedback-related negativity (FRN) in brain potentials is typically observed for the outcome evaluation concerning one's performance or monetary reward. Using a task in which the participant guesses whether the first stimulus (S1) would have the same color as the subsequently presented second stimulus (S2), this study demonstrates that the FRN to S2, which serves as feedback to the guessing, is also sensitive to the conflict between perceptual representations of S1 and S2 in working memory. The FRN effect for the feedback concerning the correctness of one's performance is modulated by the congruency between perceptual properties of the stimuli. The anterior cingulate cortex, which generates the FRN, is thus a general conflict-monitoring device detecting both response and perceptual conflicts.