Electrophysiological analysis of cortical mechanisms of selective attention to high and low spatial frequencies

Event-related potential (ERP) evidence for visual processing differences in children and adults with cystinosis (CTNS gene mutations)

BACKGROUND

Cystinosis, a rare lysosomal storage disease caused by mutations in the CTNS gene, is characterized by cystine crystallization and accumulation within multiple tissues, including kidney and brain. Its impact on neural function appears mild relative to its effects on other organs during early disease, but since therapeutic advances have led to substantially increased life expectancy, neurological implications are of increasing interest, necessitating deeper understanding of the impact of cystinosis on neurocognitive function. Behavioral difficulties have been reported in cystinosis in the visual domain. Very little is known, however, about how the brains of people living with cystinosis process visual information. This is especially interesting given that cystine accumulation in the cornea and posterior ocular structures is a hallmark of cystinosis.

METHODS

Here, high-density scalp electrophysiology was recorded to visual stimuli (during a Go/No-Go task) to investigate visual processing in individuals with cystinosis, compared to age-matched controls. Analyses focused on early stages of cortical visual processing.

RESULTS

The groups differed in their initial cortical response, with individuals with cystinosis exhibiting a significantly larger visual evoked potential (VEP) in the 130-150 ms time window. The groups also differed in the associations between neural responses and verbal abilities: While controls with higher IQ scores presented larger neural responses, that relationship was not observed in cystinosis.

CONCLUSIONS

The enlarged VEP in cystinosis could be the result of cortical hyperexcitability and/or differences in attentional engagement and explain, at least partially, the visual and visual-spatial difficulties described in this population.

Event-related potential (ERP) evidence for early visual processing differences in children and adults with Cystinosis (CTNS gene mutations)

Background

Cystinosis, a rare lysosomal storage disease caused by mutations in the CTNS gene, is characterized by cystine crystallization and accumulation within multiple tissues, including kidney and brain. Its impact on neural function appears mild relative to its effects on other organs during early disease, but since therapeutic advances have led to substantially increased life expectancy, neurological implications are of increasing interest, necessitating deeper understanding of the impact of cystinosis on neurocognitive function. Behavioral difficulties have been reported in cystinosis in the visual domain. Very little is known, however, about how the brains of people living with cystinosis process visual information. This is especially interesting given that cystine accumulation in the cornea and posterior ocular structures is a hallmark of cystinosis.

Methods

Here, high-density scalp electrophysiology was recorded to visual stimuli (during a Go/No-Go task) to investigate early visual processing in individuals with cystinosis, compared to age-matched controls. Analyses focused on early stages of cortical visual processing.

Results

The groups differed in their initial cortical response, with individuals with cystinosis exhibiting a significantly larger visual evoked potential (VEP) in the 130-150 ms time window. The groups also differed in the associations between neural responses and verbal abilities: While controls with higher IQ scores presented larger neural responses, that relationship was not observed in cystinosis.

Conclusions

The enlarged VEP in cystinosis could be the result of cortical hyperexcitability and/or differences in attentional engagement and explain, at least partially, the visual and visual-spatial difficulties described in this population.

Acute aerobic exercise benefits allocation of neural resources related to selective attention

A single session of aerobic exercise has been shown to potentially benefit subsequent performance in a wide range of cognitive tasks, but the underlying mechanisms are still not fully understood. In this study, we investigated the effects of exercise on selective attention, a cognitive process that involves prioritized processing of a subset of available inputs over others. Twenty-four healthy participants (12 women) underwent two experimental interventions in a random, crossover, and counterbalanced design: a vigorous-intensity exercise (60-65% HRR) and a seated rest (control) condition. Before and after each protocol, participants performed a modified selective attention task that demanded attending stimuli of different spatial frequencies. Event-related magnetic fields were concurrently recorded using magnetoencephalography. The results showed that exercise, relative to the seated rest condition, reduced neural processing of unattended stimuli and increased processing of attended stimuli. The findings suggest that changes in neural processing related to selective attention may be one of the mechanisms underlying exercise-induced improvements in cognition.

Event-related potential (ERP) evidence of early visual processing differences in cystinosis

Cystinosis, a rare lysosomal storage disease, is characterized by cystine crystallization and accumulation within tissues and organs, including the kidneys and brain. Its impact on neural function appears mild relative to its effects on other organs, but therapeutic advances have led to substantially increased life expectancy, necessitating deeper understanding of its impact on neurocognitive function. Behavioral difficulties have been reported in cystinosis in the visual and visual-processing domain. Very little is known, however, about how the brains of people living with cystinosis process visual information, although cysteamine accumulation in the retina is a prominent feature of cystinosis. Here, electrophysiology was recorded during a Go/No-Go task to investigate early visual processing in cystinosis, compared to an age-matched control group. Analyses focused on early stages of cortical visual processing. The groups differed in their initial cortical response, with individuals with cystinosis exhibiting a significantly larger visual evoked potential (VEP) in the 130 to 150 ms time window. The timing and topography of this response suggested an enhanced P1 in cystinosis that could be the result of cortical hyperexcitability and/or differences in attentional engagement and explain, at least partially, the visual and visual-spatial difficulties described in this population. The groups also differed in the associations between neural responses and verbal abilities: While controls with higher IQ scores presented larger neural responses, that relationship was not observed in cystinosis.

Meridional Attentional Asymmetries in Astigmatic Eyes

Purpose

To investigate the impact of attention orientation in young myopic adults with astigmatism.

Methods

The effect of attention on foveal meridional performance and anisotropy was measured in corrected myopes with various levels of astigmatism (with-the-rule astigmatism ≤ -0.75D, Axis: 180 ± 20) using orientation-based attention. Attention was manipulated by instructing subjects to attend to either the horizontal or the vertical line of a central pre-stimulus (a pulsed cross) along separate blocks of trials. For each attention condition, meridional acuity and reaction times were measured via an annulus Gabor target situated remotely from the cross and presented at random horizontally and vertically in a two-alternative forced-choice employing two interleaved staircase procedures (one-up/one-down). Attention modulations were estimated by the difference in performance between horizontal and vertical attention.

Results

Foveal meridional performance and anisotropy were strongly affected by the orientation of attention, which appeared critical for the enhancement of reaction times and resolution. Under congruent orienting of attention, foveal meridional anisotropy was correlated with the amount of defocus for both reaction time and resolution, demonstrating greater vertical performance than horizontal performance as myopia increased. Compatible with an attentional compensation of blur through optimal orienting of attention, vertical attention enhanced reaction times compared to horizontal attention and was accompanied by an increase in overall acuity when myopia increased. Increased astigmatism was associated with smaller attention effects and asymmetry, suggesting potential deficits in the compensation of blur in astigmatic eyes.

Conclusion

Collectively, attention to orientation plays a significant role in horizontal-vertical foveal meridional anisotropy and can modulate the asymmetry of foveal perception imposed by the optics of the eye in episodes of uncorrected vision. Further work is necessary to understand how attention and refractive errors interact during visual development. These results may have practical implications for methods to enhance vision with attention training in myopic astigmats.

Spatial frequency impacts perceptual and attentional ERP components across cultures

Culture impacts visual perception in several ways.To identify stages of perceptual processing that differ between cultures, we usedelectroencephalography measures of perceptual and attentional responses to simple visual stimuli.Gabor patches of higher or lower spatialfrequencywere presented at high contrast to 25 American and 31 East Asian participants while they were watching for the onset of aninfrequent, oddball stimulus. Region of interest and mass univariate analyses assessed how cultural background and stimuli spatial frequency affected the visual evoked response potentials. Across both groups, the Gabor of lower spatial frequency produced stronger evoked response potentials in the anterior N1 and P3 than did the higher frequency Gabor. The mass univariate analyses also revealed effects of spatial frequency, including a frontal negativity around 150 ms and a widespread posterior positivity around 300 ms. The effects of spatial frequency generally differed little across cultures; although there was some evidence for cultural differences in the P3 response to different frequencies at the Pz electrode, this effect did not emerge in the mass univariate analyses. We discuss these results in relation to those from previous studies, and explore the potential advantages of mass univariate analyses for cultural neuroscience.

The Impact of Right Temporal Lobe Epilepsy On Nonverbal Memory: Meta-regression of Stimulus- and Task-related Moderators

Nonverbal memory tests have great potential value for detecting the impact of lateralized pathology and predicting the risk of memory loss following right temporal lobe resection (TLR) for temporal lobe epilepsy (TLE) patients, but this potential has not been realized. Previous reviews suggest that stimulus type moderates the capacity of nonverbal memory tests to detect right-lateralized pathology (i.e., faces > designs), but the roles of other task-related factors have not been systematically explored. We address these limitations using mixed model meta-regression (k = 158) of right-lateralization effects (right worse than left TLE) testing the moderating effects of: 1) stimulus type (designs, faces, spatial), 2) learning format (single trial, repeated trials), 3) testing delay (immediate or long delay), and 4) testing format (recall, recognition) for three patient scenarios: 1) presurgical, 2) postsurgical, and 3) postsurgical change. Stimulus type significantly moderated the size of the right-lateralization effect (faces > designs) for postsurgical patients, test format moderated the size of the right-lateralization effect for presurgical-postsurgical change (recognition > recall) but learning format and test delay had no right-lateralization effect for either sample. For presurgical patients, none of the task-related factors significantly increased right-lateralization effects. This comprehensive review reveals the value of recognition testing in gauging the risk of nonverbal memory decline.

Scalp-recorded N40 visual evoked potential: Sensory and attentional properties

N40 is a well-known component of evoked potentials with respect to the auditory and somatosensory modality but not much recognized with regard to the visual modality. To be detected with event-related potentials (ERPs), it requires an optimal signal-to-noise ratio. To investigate the nature of visual N40, we recorded EEG/ERP signals from 20 participants. Each of them was presented with 1800 spatial frequency gratings of 0.75, 1.5, 3 and 6 c/deg. Data were collected from 128 sites while participants were engaged in both passive viewing and attention conditions. N40 (30-55 ms) was modulated by alertness and selective attention; in fact, it was larger to targets than irrelevant and passively viewed spatial frequency gratings. Its strongest intracranial sources were the bilateral thalamic nuclei of pulvinar, according to swLORETA. The active network included precuneus, insula and inferior parietal lobule. An N80 component (60-90 ms) was also identified, which was larger to targets than irrelevant/passive stimuli and more negative to high than low spatial frequencies. In contrast, N40 was not sensitive to spatial frequency per se, nor did it show a polarity inversion as a function of spatial frequency. Attention, alertness and spatial frequency effects were also found for the later components P1, N2 and P300. The attentional effects increased in magnitude over time. The data showed that ERPs can pick up the earliest synchronized activity, deriving in part from thalamic nuclei, before the visual information has actually reached the occipital cortex.

Realistic (3D) looming of emotional visual stimuli: Attentional effects at neural and behavioral levels

Previous research shows that endogenous attention (the controlled selection of certain aspects of our environment) is enhanced toward emotional stimuli due to its biological relevance. Although looming affective stimuli such as threat seem even more critical for survival, little is known about their effect on endogenous attention. Here, we recorded neural (event-related potentials, ERPs) and behavioral responses (errors and reaction times) to explore the combined effect of emotion and looming motion. 3D-recreated static and moving animals assessed as emotionally positive, negative, and neutral, were presented to participants (n = 71), who performed an indirect categorization task (vertebrate vs. invertebrate). Behavioral results showed better task performance, as reflected by lower number of errors and reaction times, in response to threatening stimuli. Neural indices revealed significant early (P1p, 150 milliseconds), intermediate (P2p, 240), and late (LPP, 450) effects, the latter being more intensely associated with behavior, as revealed by regression analyses. In general, neural indexes of attention to both static and dynamic stimuli showed a positivity offset in early stages and a negativity bias in subsequent phases. However, and importantly, the progressive inclusion of negative stimuli in the attentional focus is produced earlier in the case of dynamic (at P2p latency) than in static versions (at LPP). These results point to an enhancement of attention, particularly in temporal terms, toward stimuli combining motion and biological significance.

Hemispheric Asymmetry in Visual Processing: An ERP Study on Spatial Frequency Gratings

A hemispheric asymmetry for the processing of global versus local visual information is known. In this study, we investigated the existence of a hemispheric asymmetry for the visual processing of low versus high spatial frequency gratings. The event-related potentials were recorded in a group of healthy right-handed volunteers from 30 scalp sites. Six types of stimuli (1.5, 3 and 6 c/deg gratings) were randomly flashed 180 times in the left and right upper hemifields. The stimulus duration was 80 ms, and the interstimulus interval (ISI) ranged between 850 and 1000 ms. Participants paid attention and responded to targets based on their spatial frequency and location. The C1 and P1 visual responses, as well as a later selection negativity and a P300 component of event-related potentials (ERPs), were quantified and subjected to repeated-measure analyses of variance (ANOVAs). Overall, the performance was faster for the right visual field (RVF), thus suggesting a left hemispheric advantage for the attentional selection of local elements. Similarly, the analysis of the mean area amplitude of the C1 (60–110 ms) sensory response showed a stronger attentional effect (F+L+ vs. F−L+) at the left occipital areas, thus suggesting the sensory nature of this hemispheric asymmetry.

Increasing Perceptual Salience Diminishes the Motor Interference Effect From Dangerous Objects

Existing research has indicated that dangerous objects may conflict with an individual’s prepared motor actions and thus slow responses. This phenomenon is called the motor interference effect from dangerous objects. However, its origin remains arguable. The current study aimed to preclude an alternative origin and to investigate whether the efficiency of processing a prepared response toward a dangerous object could benefit from increasing the perceptual salience of the object by painting the object red. The design used a shape categorization task to emphasize the dangerous elements of target objects and manipulated target color (gray versus red), target dangerousness (safe versus dangerous) and prime-target congruency (congruent versus incongruent). The null effect of N2 amplitudes between the dangerous and safe conditions precluded the alternative origin and suggested that the motor interference effect did not originate from response inhibition. Furthermore, the results indicated a modulation effect of the motor interference effect in different colors. The classic motor interference effect was observed in the gray target condition, but it diminished in the red target condition. The underlying cognitive processes were reflected in ERPs. More positive P2 and frontal P3 amplitudes were identified in the red target condition than in the gray target condition, which indicated that deeper feature detection was assigned to and more attentional resources were automatically recruited for the red targets than for the gray targets. Analysis of the parietal P3 amplitudes identified a similar result pattern as the mean RTs. A more positive P3 amplitude was identified in the dangerous condition than in the safe condition when the targets were painted gray. In contrast, the P3 amplitudes were identical between the dangerous condition and the safe condition when the targets were painted red. The results indicated that the increased attentional resources facilitated the evaluation of red target dangerousness and thus accelerated reactions to the red dangerous targets; the reaction speeds to those targets were close to those for the reaction speeds to the red safe targets. Detailed processes that underline these components are discussed.

Left-Hemispheric Asymmetry for Object-Based Attention: an ERP Study

It has been shown that selective attention enhances the activity in visual regions associated with stimulus processing. The left hemisphere seems to have a prominent role when non-spatial attention is directed towards specific stimulus features (e.g., color, spatial frequency). The present electrophysiological study investigated the time course and neural correlates of object-based attention, under the assumption of left-hemispheric asymmetry. Twenty-nine right-handed participants were presented with 3D graphic images representing the shapes of different object categories (wooden dummies, chairs, structures of cubes) which lacked detail. They were instructed to press a button in response to a target stimulus indicated at the beginning of each run. The perception of non-target stimuli elicited a larger anterior N2 component, which was likely associated with motor inhibition. Conversely, target selection resulted in an enhanced selection negativity (SN) response lateralized over the left occipito-temporal regions, followed by a larger centro-parietal P300 response. These potentials were interpreted as indexing attentional selection and categorization processes, respectively. The standardized weighted low-resolution electromagnetic tomography (swLORETA) source reconstruction showed the engagement of a fronto-temporo-limbic network underlying object-based visual attention. Overall, the SN scalp distribution and relative neural generators hinted at a left-hemispheric advantage for non-spatial object-based visual attention.

Atypical Symptoms in Migraine-Related Alice in Wonderland Syndrome: Expansion of the Phenotype and Reflection on the Pathomechanism

We report an 8-year-old girl who experienced daily episodes of visual and somesthetic distortion and was diagnosed with Alice in wonderland syndrome (AIWS). Ophthalmologic assessment revealed best-corrected visual acuity of 0.2 in both eyes, and bilateral constricted tubular or spiral visual fields. Augmented amplitude of visually evoked potentials was revealed, and treatment with lomerizine and valproate showed favorable effect on the visual/somesthetic distortion as well as the visual field and acuity. Psychogenic visual problems can co-exist with the typical sensory distortion in AIWS, similarly to the case of psychogenic pseudo-seizures in subjects with epilepsy. Otherwise, an ambiguous borderline between psychological and physical pathomechanisms in migraine may also be characteristic of the migraine-related AIWS.

The relationship between attention and consciousness: an expanded taxonomy and implications for 'no-report' paradigms

Tensions between global neuronal workspace theory and recurrent processing theory have sparked much debate in the field of consciousness research. Here, we focus on one of the key distinctions between these theories: the proposed relationship between attention and consciousness. By reviewing recent empirical evidence, we argue that both theories contain key insights and that certain aspects of each theory can be reconciled into a novel framework that may help guide future research. Alternative theories are also considered, including attended intermediate-level representations theory, integrated information theory and higher order thought theory. With the aim of offering a fresh and nuanced perspective to current theoretical debates, an updated taxonomy of conscious and non-conscious states is proposed. This framework maps a wider spectrum of conscious states by incorporating contemporary views from cognitive neuroscience regarding the variety of attentional mechanisms that are known to interact with sensory processing. Whether certain types of attention are necessary for phenomenal and access consciousness is considered and incorporated into this extended taxonomy. To navigate this expanded space, we review recent 'no-report' paradigms and address several methodological misunderstandings in order to pave a clear path forward for identifying the neural basis of perceptual awareness.This article is part of the theme issue 'Perceptual consciousness and cognitive access'.

Recurrent Activation of Neural Circuits during Attention to Global and Local Visual Information

The attentional selection of different hierarchical level within compound (Navon) figures has been studied with event related potentials (ERPs), by controlling the ERPs obtained during attention to the global or the local echelon. These studies, using the canonical Navon figures, have produced contradictory results, with doubts regarding the scalp distribution of the effects. Moreover, the evidence about the temporal evolution of the processing of these two levels is not clear. Here, we unveiled global and local letters at distinct times, which enabled separation of their ERP responses. We combine this approach with the temporal generalization methodology, a novel multivariate technique which facilitates exploring the temporal structure of these ERPs. Opposite lateralization patterns were obtained for the selection negativities generated when attending global and local distracters (D statistics, p < .005), with maxima in right and left occipito-temporal scalp regions, respectively (η2 = .111, p < .01; η2 = .042, p < .04). However, both discrimination negativities elicited when comparing targets and distractors at the global or the local level were lateralized to the left hemisphere (η2 = .25, p < .03 and η2 = .142, p < .05 respectively). Recurrent activation patterns were found for both global and local stimuli, with scalp topographies corresponding to early preparatory stages reemerging during the attentional selection process, thus indicating recursive attentional activation. This implies that selective attention to global and local hierarchical levels recycles similar neural correlates at different time points. These neural correlates appear to be mediated by visual extra-striate areas.

The effect of category learning on attentional modulation of visual cortex

Learning about visual object categories causes changes in the way we perceive those objects. One likely mechanism by which this occurs is the application of attention to potentially relevant objects. Here we test the hypothesis that category membership influences the allocation of attention, allowing attention to be applied not only to object features, but to entire categories. Participants briefly learned to categorize a set of novel cartoon animals after which EEG was recorded while participants distinguished between a target and non-target category. A second identical EEG session was conducted after two sessions of categorization practice. The category structure and task design allowed parametric manipulation of number of target features while holding feature frequency and category membership constant. We found no evidence that category membership influenced attentional selection: a postero-lateral negative component, labeled the selection negativity/N250, increased over time and was sensitive to number of target features, not target categories. In contrast, the right hemisphere N170 was not sensitive to target features. The P300 appeared sensitive to category in the first session, but showed a graded sensitivity to number of target features in the second session, possibly suggesting a transition from rule-based to similarity based categorization.

Investigating the Effectiveness of Spatial Frequencies to the Left and Right of Central Vision during Reading: Evidence from Reading Times and Eye Movements

Printed words are complex visual stimuli containing a range of different spatial frequencies, and several studies have suggested that various spatial frequencies are effective for skilled adult reading. But while it is well known that the area of text from which information is acquired during reading extends to the left and right of each fixation, the effectiveness of spatial frequencies falling each side of fixation has yet to be determined. To investigate this issue, we used a spatial frequency adaptation of the gaze-contingent moving-window paradigm in which sentences were shown to skilled adult readers either entirely as normal or filtered to contain only low, medium, or high spatial frequencies except for a window of normal text around each point of fixation. Windows replaced filtered text either symmetrically 1 character to the left and right of each fixated character, or asymmetrically, 1 character to the left and 7 or 13 to the right, or 1 character to the right and 7 or 13 to the left. Reading times and eye-movement measures showed that reading performance for sentences presented entirely as normal generally changed very little with filtered displays when windows extended to the right but was often disrupted when windows extended to the left. However, asymmetrical windows affected performance on both sides of fixation. Indeed, increasing the leftward extent of windows from 7 to 13 characters produced decreases in both reading times and fixation durations, suggesting that reading was influenced by the spatial frequency content of leftward areas of text some considerable distance from fixation. Overall, the findings show that while a range of different spatial frequencies can be used by skilled adult readers, the effectiveness of spatial frequencies differs for text on each side of central vision, and may reflect different roles played by these two areas of text during reading.

Relative Spatial Frequency Processing Drives Hemispheric Asymmetry in Conscious Awareness

Visual stimuli with different spatial frequencies (SFs) are processed asymmetrically in the two cerebral hemispheres. Specifically, low SFs are processed relatively more efficiently in the right hemisphere than the left hemisphere, whereas high SFs show the opposite pattern. In this study, we ask whether these differences between the two hemispheres reflect a low-level division that is based on absolute SF values or a flexible comparison of the SFs in the visual environment at any given time. In a recent study, we showed that conscious awareness of SF information (i.e., visual perceptual selection from multiple SFs simultaneously present in the environment) differs between the two hemispheres. Building upon that result, here we employed binocular rivalry to test whether this hemispheric asymmetry is due to absolute or relative SF processing. In each trial, participants viewed a pair of rivalrous orthogonal gratings of different SFs, presented either to the left or right of central fixation, and continuously reported which grating they perceived. We found that the hemispheric asymmetry in perception is significantly influenced by relative processing of the SFs of the simultaneously presented stimuli. For example, when a medium SF grating and a higher SF grating were presented as a rivalry pair, subjects were more likely to report that they initially perceived the medium SF grating when the rivalry pair was presented in the left visual hemifield (right hemisphere), compared to the right hemifield. However, this same medium SF grating, when it was paired in rivalry with a lower SF grating, was more likely to be perceptually selected when it was in the right visual hemifield (left hemisphere). Thus, the visual system’s classification of a given SF as “low” or “high” (and therefore, which hemisphere preferentially processes that SF) depends on the other SFs that are present, demonstrating that relative SF processing contributes to hemispheric differences in visual perceptual selection.

Event-Related Potential Effects of Object Repetition Depend on Attention and Part-Whole Configuration

The effects of spatial attention and part-whole configuration on recognition of repeated objects were investigated with behavioral and event-related potential (ERP) measures. Short-term repetition effects were measured for probe objects as a function of whether a preceding prime object was shown as an intact image or coarsely scrambled (split into two halves) and whether or not it had been attended during the prime display. In line with previous behavioral experiments, priming effects were observed from both intact and split primes for attended objects, but only from intact (repeated same-view) objects when they were unattended. These behavioral results were reflected in ERP waveforms at occipital–temporal locations as more negative-going deflections for repeated items in the time window between 220 and 300 ms after probe onset (N250r). Attended intact images showed generally more enhanced repetition effects than split ones. Unattended images showed repetition effects only when presented in an intact configuration, and this finding was limited to the right-hemisphere electrodes. Repetition effects in earlier (before 200 ms) time windows were limited to attended conditions at occipito-temporal sites during the N1, a component linked to the encoding of object structure, while repetition effects at central locations during the same time window (P150) were found for attended and unattended probes but only when repeated in the same intact configuration. The data indicate that view-generalization is mediated by a combination of analytic (part-based) representations and automatic view-dependent representations.

Spontaneous Fluctuations in Sensory Processing Predict Within-Subject Reaction Time Variability

When engaged in a repetitive task our performance fluctuates from trial-to-trial. In particular, inter-trial reaction time variability has been the subject of considerable research. It has been claimed to be a strong biomarker of attention deficits, increases with frontal dysfunction, and predicts age-related cognitive decline. Thus, rather than being just a consequence of noise in the system, it appears to be under the control of a mechanism that breaks down under certain pathological conditions. Although the underlying mechanism is still an open question, consensual hypotheses are emerging regarding the neural correlates of reaction time inter-trial intra-individual variability. Sensory processing, in particular, has been shown to covary with reaction time, yet the spatio-temporal profile of the moment-to-moment variability in sensory processing is still poorly characterized. The goal of this study was to characterize the intra-individual variability in the time course of single-trial visual evoked potentials and its relationship with inter-trial reaction time variability. For this, we chose to take advantage of the high temporal resolution of the electroencephalogram (EEG) acquired while participants were engaged in a 2-choice reaction time task. We studied the link between single trial event-related potentials (ERPs) and reaction time using two different analyses: (1) time point by time point correlation analyses thereby identifying time windows of interest; and (2) correlation analyses between single trial measures of peak latency and amplitude and reaction time. To improve extraction of single trial ERP measures related with activation of the visual cortex, we used an independent component analysis (ICA) procedure. Our ERP analysis revealed a relationship between the N1 visual evoked potential and reaction time. The earliest time point presenting a significant correlation of its respective amplitude with reaction time occurred 175 ms after stimulus onset, just after the onset of the N1 peak. Interestingly, single trial N1 latency correlated significantly with reaction time, while N1 amplitude did not. In conclusion, our findings suggest that inter-trial variability in the timing of extrastriate visual processing contributes to reaction time variability.

Spatial frequency selection and integration of global and local information in visual processing: A selective review and tribute to Shlomo Bentin

Previous research has suggested a relationship between processing lower versus higher spatial frequencies (SFs) and global/local perception, respectively. Here we honor Shlomo Bentin by reviewing the work we conducted with him regarding this issue. This work was aimed at investigating the mechanisms by which selective attention to spatial frequency (SF) mediates global and local perception in general and how these perceptual levels are integrated with the shapes that define them. The experiments demonstrate that attention to global and local aspects of a hierarchical display biases the flexible selection of relatively lower and relatively higher SFs during image processing. Additionally, attentional selection of SF allows for the shapes in a hierarchical display to be integrated with the level (global/local) at which they occur. The studies reviewed here provide strong evidence that the flexible, top-down selection of low-level SF channels mediates the perception of global and local elements of visual displays. The studies also support a hemisphere asymmetry in this process, with right hemisphere functions biased toward global perception and left hemisphere functions biased toward local.

Neural oscillatory deficits in schizophrenia predict behavioral and neurocognitive impairments

Paying attention to visual stimuli is typically accompanied by event-related desynchronizations (ERD) of ongoing alpha (7-14 Hz) activity in visual cortex. The present study used time-frequency based analyses to investigate the role of impaired alpha ERD in visual processing deficits in schizophrenia (Sz). Subjects viewed sinusoidal gratings of high (HSF) and low (LSF) spatial frequency (SF) designed to test functioning of the parvo- vs. magnocellular pathways, respectively. Patients with Sz and healthy controls paid attention selectively to either the LSF or HSF gratings which were presented in random order. Event-related brain potentials (ERPs) were recorded to all stimuli. As in our previous study, it was found that Sz patients were selectively impaired at detecting LSF target stimuli and that ERP amplitudes to LSF stimuli were diminished, both for the early sensory-evoked components and for the attend minus unattend difference component (the Selection Negativity), which is generally regarded as a specific index of feature-selective attention. In the time-frequency domain, the differential ERP deficits to LSF stimuli were echoed in a virtually absent theta-band phase locked response to both unattended and attended LSF stimuli (along with relatively intact theta-band activity for HSF stimuli). In contrast to the theta-band evoked responses which were tightly stimulus locked, stimulus-induced desynchronizations of ongoing alpha activity were not tightly stimulus locked and were apparent only in induced power analyses. Sz patients were significantly impaired in the attention-related modulation of ongoing alpha activity for both HSF and LSF stimuli. These deficits correlated with patients' behavioral deficits in visual information processing as well as with visually based neurocognitive deficits. These findings suggest an additional, pathway-independent, mechanism by which deficits in early visual processing contribute to overall cognitive impairment in Sz.

Asynchronous presentation of global and local information reveals effects of attention on brain electrical activity specific to each level

The neural basis of selective attention within hierarchically organized Navon figures has been extensively studied with event related potentials (ERPs), by contrasting responses obtained when attending the global and the local echelons. The findings are inherently ambiguous because both levels are always presented together. Thus, only a mixture of the brain responses to two levels can be observed. Here, we use a method that allows unveiling of global and local letters at distinct times, enabling estimation of separate ERPs related to each level. Two interspersed oddball streams were presented, each using letters from one level and comprised of frequent distracters and rare targets. Previous work and our Experiment 1 show that it is difficult to divide attention between two such streams of stimuli. ERP recording in Experiment 2 evinced an early selection negativity (SN, with latencies to the 50% area of about 266 ms for global distracters and 276 ms for local distracters) that was larger for attended relative to unattended distracters. The SN was larger over right posterior occipito-temporal derivations for global stimuli and over left posterior occipito-temporal derivations for local stimuli (although the latter was less strongly lateralized). A discrimination negativity (DN, accompanied by a P3b) was larger for attended targets relative to attended distracters, with latencies to the 50% area of about 316 ms for global stimuli and 301 ms for local stimuli, which presented a similar distribution for both levels over left temporo-parietal electrodes. The two negativities apparently index successive stages in the processing of a selected level within a compound figure. By resolving the ambiguity of traditional designs, our method allowed us to observe the effects of attention for each hierarchical level on its own.

Attending to global versus local stimulus features modulates neural processing of low versus high spatial frequencies: an analysis with event-related brain potentials

Spatial frequency (SF) selection has long been recognized to play a role in global and local processing, though the nature of the relationship between SF processing and global/local perception is debated. Previous studies have shown that attention to relatively lower SFs facilitates global perception, and that attention to relatively higher SFs facilitates local perception. Here we recorded event-related brain potentials (ERPs) to investigate whether processing of low versus high SFs is modulated automatically during global and local perception, and to examine the time course of any such effects. Participants compared bilaterally presented hierarchical letter stimuli and attended to either the global or local levels. Irrelevant SF grating probes flashed at the center of the display 200 ms after the onset of the hierarchical letter stimuli could either be low or high in SF. It was found that ERPs elicited by the SF grating probes differed as a function of attended level (global versus local). ERPs elicited by low SF grating probes were more positive in the interval 196–236 ms during global than local attention, and this difference was greater over the right occipital scalp. In contrast, ERPs elicited by the high SF gratings were more positive in the interval 250–290 ms during local than global attention, and this difference was bilaterally distributed over the occipital scalp. These results indicate that directing attention to global versus local levels of a hierarchical display facilitates automatic perceptual processing of low versus high SFs, respectively, and this facilitation is not limited to the locations occupied by the hierarchical display. The relatively long latency of these attention-related ERP modulations suggests that initial (early) SF processing is not affected by attention to hierarchical level, lending support to theories positing a higher level mechanism to underlie the relationship between SF processing and global versus local perception.

Persistent hemispheric differences in the perceptual selection of spatial frequencies

Previous research has shown that the right hemisphere processes low spatial frequencies more efficiently than the left hemisphere, which preferentially processes high spatial frequencies. These studies have typically measured RTs to single, briefly flashed gratings and/or have directed observers to attend to a particular spatial frequency immediately before making a judgment about a subsequently presented stimulus. Thus, it is unclear whether the hemispheres differ in perceptual selection from multiple spatial frequencies that are simultaneously present in the environment, without bias from selective attention. Moreover, the time course of hemispheric asymmetry in spatial frequency processing is unknown. We addressed both of these questions with binocular rivalry, a measure of perceptual selection from competing alternatives over time. Participants viewed a pair of rivalrous orthogonal gratings with different spatial frequencies, presented either to the left or right of central fixation, and continuously reported which grating they perceived. At the beginning of a trial, the low spatial frequency grating was perceptually selected more often when presented in the left hemifield (right hemisphere) than in the right hemifield (left hemisphere), whereas the high spatial frequency grating showed the opposite pattern of results. This hemispheric asymmetry in perceptual selection persisted for the entire 30-sec stimulus presentation, continuing long after stimulus onset. These results indicate stable differences in the resolution of ambiguity across spatial locations and demonstrate the importance of considering sustained differences in perceptual selection across space when characterizing conscious representations of complex scenes.

Early spatial frequency processing of natural images: an ERP study

The present study examined the role of spatial stimulus frequencies in the early visual processing of natural scenes. The content of initially degraded (low- or high-pass filtered) pictures was progressively revealed in a sequence of steps by adding high or low spatial frequencies. Event Related Potentials (ERPs) were used to track the early stages of visual processing. Picture degradation modulated the topography of the P1, with an occipital midline distribution for the most degraded pictures, which became progressively more laterally distributed as pictures became more complete. Picture degradation also modulated the amplitude of the P2. For both low-passed and high-passed scenes, a linear relationship between the spectral power and the amplitude of the P1 and P2 was observed. These results are likely to reflect the progressive engagement of the lateral occipital complex as the amount of information in both the low and high portions of the frequency spectrum increased.

Electrophysiological evidence for ventral stream deficits in schizophrenia patients

Schizophrenic patients suffer from many deficits including visual, attentional, and cognitive ones. Visual deficits are of particular interest because they are at the fore-end of information processing and can provide clear examples of interactions between sensory, perceptual, and higher cognitive functions. Visual deficits in schizophrenic patients are often attributed to impairments in the dorsal (where) rather than the ventral (what) stream of visual processing. We used a visual-masking paradigm in which patients and matched controls discriminated small vernier offsets. We analyzed the evoked electroencephalography (EEG) responses and applied distributed electrical source imaging techniques to estimate activity differences between conditions and groups throughout the brain. Compared with controls, patients showed strongly reduced discrimination accuracy, confirming previous work. The behavioral deficits corresponded to pronounced decreases in the evoked EEG response at around 200 ms after stimulus onset. At this latency, patients showed decreased activity for targets in left parietal cortex (dorsal stream), but the decrease was most pronounced in lateral occipital cortex (in the ventral stream). These deficiencies occurred at latencies that reflect object processing and fine shape discriminations. We relate the reduced ventral stream activity to deficient top-down processing of target stimuli and provide a framework for relating the commonly observed dorsal stream deficiencies with the currently observed ventral stream deficiencies.

Retinotopic and lateralized processing of spatial frequencies in human visual cortex during scene categorization

Using large natural scenes filtered in spatial frequencies, we aimed to demonstrate that spatial frequency processing could not only be retinotopically mapped but could also be lateralized in both hemispheres. For this purpose, participants performed a categorization task using large black and white photographs of natural scenes (indoors vs. outdoors, with a visual angle of 24° × 18°) filtered in low spatial frequencies (LSF), high spatial frequencies (HSF), and nonfiltered scenes, in block-designed fMRI recording sessions. At the group level, the comparison between the spatial frequency content of scenes revealed first that, compared with HSF, LSF scene categorization elicited activation in the anterior half of the calcarine fissures linked to the peripheral visual field, whereas, compared with LSF, HSF scene categorization elicited activation in the posterior part of the occipital lobes, which are linked to the fovea, according to the retinotopic property of visual areas. At the individual level, functional activations projected on retinotopic maps revealed that LSF processing was mapped in the anterior part of V1, whereas HSF processing was mapped in the posterior and ventral part of V2, V3, and V4. Moreover, at the group level, direct interhemispheric comparisons performed on the same fMRI data highlighted a right-sided occipito-temporal predominance for LSF processing and a left-sided temporal cortex predominance for HSF processing, in accordance with hemispheric specialization theories. By using suitable method of analysis on the same data, our results enabled us to demonstrate for the first time that spatial frequencies processing is mapped retinotopically and lateralized in human occipital cortex.

Detection of spatial frequency in brain-damaged patients: influence of hemispheric asymmetries and hemineglect

Hemispheric specialization for spatial frequency processing was investigated by measuring the contrast sensitivity curves of sine-wave gratings in 30 left or right brain-damaged patients using different spatial frequencies compared with healthy participants. The results showed that left brain-damaged patients were selectively impaired in processing high frequencies, whereas right brain-damaged patients were more impaired in the processing low frequencies, regardless of the presence of visuo-spatial neglect. These visual processing results can be interpreted in terms of spatial frequency discrimination, with both hemispheres participating in this process in different ways.

Direct current stimulation (tDCS) reveals parietal asymmetry in local/global and salience-based selection

Data from neuropsychology and neuroimaging studies indicate hemispheric asymmetries in processing object's global form versus local parts. However the attentional mechanisms subtending visual selection of different levels of information are poorly understood. The classical left hemisphere/local-right hemisphere/global dichotomy has been recently challenged by studies linking the asymmetry of activation in the posterior parietal cortex (PPC) with the relative salience of the stimulus rather than with the local/global level. The present study aimed to assess hemispheric asymmetry in local-global and salience-based selection in hierarchical stimuli by using transcranial direct current stimulation (tDCS). To this end, tDCS has been applied to the PPC of both the hemispheres. Our data revealed that tDCS did affect the selection of the target on the basis of its relative salience in a manner that depended on the tDCS polarity applied to the two hemispheres. This result is in line with previous findings that the left PPC is critically involved in attention for low-salience stimuli in the presence of high-salience distractor information, while right PPC is involved in attending to more salient stimuli. Hemispheric asymmetries were also found in local/global selection. Overall the results suggest that neural activation in the PPC is related to both the salience and the level of stimulus representations mediating responses to hierarchical stimuli. The comparison of the results from Experiments 1 and 2 in local/global-based selection suggests that the effect of stimulation could be completely opposite depending on subtle differences in demands of attentional control (sustained attention vs task switching).

Consequences of magnocellular dysfunction on processing attended information in schizophrenia

Schizophrenia is associated with perceptual and cognitive dysfunction including impairments in visual attention. These impairments may be related to deficits in early stages of sensory/perceptual processing, particularly within the magnocellular/dorsal visual pathway. In the present study, subjects viewed high and low spatial frequency (SF) gratings designed to test functioning of the parvocellular/magnocellular pathways, respectively. Schizophrenia patients and healthy controls attended to either the low SF (magnocellularly biased) or high SF (parvocellularly biased) gratings. Functional magnetic resonance imaging (fMRI) and recordings of event-related potentials (ERPs) were carried out during task performance. Patients were impaired at detecting low-frequency targets. ERP amplitudes to low-frequency gratings were diminished, both for the early sensory-evoked components and for the attend minus unattend difference component (the selection negativity), which is regarded as a neural index of feature-selective attention. Similarly, fMRI revealed that activity in extrastriate visual cortex was reduced in patients during attention to low, but not high, SF. In contrast, activity in frontal and parietal areas, previously implicated in the control of attention, did not differ between patients and controls. These findings suggest that impaired sensory processing of magnocellularly biased stimuli lead to impairments in the effective processing of attended stimuli, even when the attention control systems themselves are intact.

Emotion-associated tones attract enhanced attention at early auditory processing: magnetoencephalographic correlates

Emotionally significant objects and events in our environment attract attention based on their motivational relevance for survival. Such kind of emotional attention is thought to lead to affect-specific amplified processing that closely resembles effects of directed attention. Although there has been extensive research on prioritized processing of visual emotional stimuli, the spatio-temporal dynamics of motivated attention mechanisms in auditory processing are less clearly understood. We investigated modulatory effects of emotional attention at early auditory processing stages using time-sensitive whole-head magnetoencephalography. A novel associative learning procedure involving multiple conditioned stimuli (CSs) per affective category was introduced to specifically test whether affect-specific modulation can proceed in a rapid and highly differentiating fashion in humans. Auditory evoked fields (AEFs) were recorded in response to 42 different ultrashort, click-like sounds before and after affective conditioning with pleasant, unpleasant, or neutral auditory scenes. As hypothesized, emotional attention affected neural click tone processing at time intervals of the P20-50m (20-50 ms) and the N1m (100-130 ms), two early AEF components sensitive to directed selective attention (Woldorff et al., 1993). Distributed source localization revealed amplified processing of tones associated with aversive or pleasant compared with neutral auditory scenes at auditory sensory, frontal and parietal cortex regions. Behavioral tests did not indicate any awareness for the contingent CS-UCS (unconditioned stimulus) relationships in the participants, suggesting affective associative learning in absence of contingency awareness. Our findings imply early and highly differentiating affect-specific modulation of auditory stimulus processing supported by neural mechanisms and circuitry comparable with those reported for directed auditory attention.

New visual information processing abnormality biomarker for the diagnosis of Schizophrenia

INTRODUCTION: Schizophrenia is currently diagnosed on the basis of patient reports and clinical observations. A diagnosis based on aetiology is inherently more reliable due to being closer to the disease process than the overt clinical manifestations. Accordingly, recent research in schizophrenia has focused on the development of biomarkers in a bit to improve the reliability and neurobiological relevance of the diagnosis. Visual information processing is one of these promising fields of recent biomarker research. AREAS COVERED: This article provides an overview of the available literature regarding deficits in schizophrenia detectable through psychophysical (contrast and motion sensitivity, visual backward-masking), ERP (P1 and N1 visual evoked potentials) and oscillatory (signal power and phase-locking factor of evoked oscilations) measures and their validity as trait or state biomarkers of the disease. The methodology included a search on articles related to visual information processing in schizophrenia on the PubMed database. EXPERT OPINION: Biomarker research in schizophrenia is a rapidly expanding area. Evidence exists to suggest that both psychotic and manic symptoms are associated with visual processing abnormalities. A specific impairment confined to the magnocellular component of the visual system might be a trait biomarker of schizophrenia.

Electrical neuroimaging evidence that spatial frequency-based selective attention affects V1 activity as early as 40-60 ms in humans

Background

Karns and Knight (2009) [1] demonstrated by using ERP and gamma band oscillatory responses that intermodal attention modulates visual processing at the latency of the early phase of the C1 response (62-72 ms) thought to be generated in the primary visual cortex. However, the timing of attentional modulation of visual cortex during object-based attention remains a controversial issue.

Results

In this study, EEG recording and LORETA source reconstruction were performed. A large number of subjects (29) and of trial repetitions were used (13,312). EEG was recorded from 128 scalp sites at a sampling rate of 512 Hz. Four square-wave gratings (0.75, 1.5, 3, 6 c/deg) were randomly presented in the 4 quadrants of the visual field. Participants were instructed to pay conjoined attention to a given stimulus quadrant and spatial frequency. The C1 and P1 sensory-evoked components of ERPs were quantified by measuring their mean amplitudes across time within 5 latency ranges 40-60, 60-80, 80-100, 100-120 and 120-140 ms.

Conclusions

Early attention effects were found in the form of an enhanced C1 response (40-80 ms) to frequency-relevant gratings. LORETA, within its spatial resolution limits, identified the neural generators of this effect in the striate cortex (BA17), among other areas.

Adaptation to leftward-shifting prisms reduces the global processing bias of healthy individuals

When healthy individuals are presented with peripheral figures in which small letters are arranged to form a large letter, they are faster to identify the global- than the local-level information, and have difficulty ignoring global information when identifying the local level. The global reaction time (RT) advantage and global interference effect imply preferential processing of global-level information in the normal brain. This contrasts with the local processing bias demonstrated following lesions to the right temporo-parietal junction (TPJ), such as those that lead to hemispatial neglect (neglect). Recent research from our lab demonstrated that visuo-motor adaptation to rightward-shifting prisms, which ameliorates many leftward performance deficits of neglect patients, improved the local processing bias of patients with right TPJ lesions (Bultitude, Rafal, & List, 2009). Here we demonstrate that adaptation to leftward-shifting prisms, which can induce neglect-like performance in neurologically healthy individuals, also reduces the normal global processing bias. Forty-eight healthy participants were asked to identify the global or local forms of hierarchical figures before and after adaptation to leftward- or rightward-shifting prisms. Prior to prism adaptation, both groups had greater difficulty ignoring irrelevant global information when identifying the local level (global interference) compared to their ability to ignore irrelevant local-level information when identifying the global level (local interference). Participants who adapted to leftward-shifting prisms showed a significant reduction in global interference, but there was no change in the performance of the rightward-shifting Prism Group. These results show, for the first time, that in addition to previously demonstrated effects on lateralised attention, prism adaptation can influence non-lateralised spatial attention in healthy individuals.

The folding fingerprint of visual cortex reveals the timing of human V1 and V2

Primate neocortex contains over 30 visual areas. Recent techniques such as functional magnetic resonance imaging (fMRI) have successfully identified many of these areas in the human brain, but have been of limited value for revealing the temporal dynamics between visual areas. The electroencephalogram (EEG) provides information with high temporal precision, but has had limited success separating out the signals from individual neighboring cortical areas. Consequently, controversies exist over the temporal dynamics across cortical areas. In order to address this problem we developed a new method to identify the sources of the EEG. An individual's unique cortical pattern of sulci and gyri along with a visual area's functional retinotopic layout provides a folding fingerprint that predicts specific scalp topographies for stimuli presented in different parts of the visual field. Using this folding fingerprint with a 96 or 192 location stimulus severely constrains the solution space making it relatively easy to extract the temporal response of multiple visual areas to multiple stimulus locations. The large number of stimuli also provides a means to validate the waveforms by comparing across stimulus sets, an important feature not present in most EEG source identification procedures. Using this method our data reveal that both V1 and V2 waveforms have similar onset latencies, and their temporal dynamics provide new information regarding the response latencies of these areas in humans. Our method enables the previously unattainable separation of EEG responses from neighboring brain areas. While we applied the method to the first two cortical visual areas, V1 and V2, this method is also applicable to somatosensory areas that have defined mappings. This method provides a means to study the rapid information flow in the human brain to reveal top-down and bottom-up cognitive processes.

Interactions between endogenous and exogenous attention during vigilance

The ability to remain vigilant over long periods of time is critical for many everyday tasks, but controlled studies of visual sustained attention show that performance declines over time when observers are required to respond to rare stimulus events (targets) occurring in a sequence of standard stimulus events (nontargets). When target discrimination is perceptually difficult, this vigilance decrement manifests as a decline in perceptual sensitivity. We examined whether sudden-onset stimuli could act as exogenous attentional cues to improve sensitivity during a traditional sustained attention task. Sudden-onset cues presented immediately before each stimulus attenuated the sensitivity decrement, but only when stimulus timing (the interstimulus interval [ISI]) was constant. When stimulus timing was variable, exogenous cues increased overall sensitivity but did not prevent performance decline. Finally, independent of the effects of sudden onsets, a constant ISI improved vigilance performance. Our results demonstrate that exogenous attention enhances perceptual sensitivity during vigilance performance, but that this effect is dependent on observers' being able to predict the timing of stimulus events. Such a result indicates a strong interaction between endogenous and exogenous attention during vigilance. We relate our findings to a resource model of vigilance, as well as to theories of endogenous and exogenous attention over short time periods.

Differential Lateralization for Words and Faces: Category or Psychophysics?

This set of three experiments assessed the influence of different psychophysical factors on the lateralization of the N170 event-related potential (ERP) component to words and faces. In all experiments, words elicited a left-lateralized N170, whereas faces elicited a right-lateralized or nonlateralized N170 depending on presentation conditions. Experiment 1 showed that lateralization for words (but not for faces) was influenced by spatial frequency. Experiment 2 showed that stimulus presentation time influenced N170 lateralization independently of spatial frequency composition. Finally, Experiment 3 showed that stimulus size and resolution did not influence N170 lateralization, but did influence N170 amplitude, albeit differentially for words and faces. These findings suggest that differential lateralization for words and faces, at least as measured by the N170, is influenced by spatial frequency (words), stimulus presentation time, and category.