Visual activity in the human frontal eye field

The involvement of the human prefrontal cortex in the emergence of visual awareness

Exploring the neural mechanisms of awareness is a fundamental task of cognitive neuroscience. There is an ongoing dispute regarding the role of the prefrontal cortex (PFC) in the emergence of awareness, which is partially raised by the confound between report- and awareness-related activity. To address this problem, we designed a visual awareness task that can minimize report-related motor confounding. Our results show that saccadic latency is significantly shorter in the aware trials than in the unaware trials. Local field potential (LFP) data from six patients consistently show early (200-300ms) awareness-related activity in the PFC, including event-related potential and high-gamma activity. Moreover, the awareness state can be reliably decoded by the neural activity in the PFC since the early stage, and the neural pattern is dynamically changed rather than being stable during the representation of awareness. Furthermore, the enhancement of dynamic functional connectivity, through the phase modulation at low frequency, between the PFC and other brain regions in the early stage of the awareness trials may explain the mechanism of conscious access. These results indicate that the PFC is critically involved in the emergence of awareness.

Early neural activity changes associated with stimulus detection during visual conscious perception

The earliest cortical neural signals following consciously perceived visual stimuli in humans are poorly understood. Using intracranial electroencephalography, we investigated neural activity changes associated with the earliest stages of stimulus detection during visual conscious perception. Participants (N = 10; 1,693 electrode contacts) completed a continuous performance task where subjects were asked to press a button when they saw a target letter among a series of nontargets. Broadband gamma power (40-115 Hz) was analyzed as marker of cortical population neural activity. Regardless of target or nontarget letter type, we observed early gamma power changes within 30-180 ms from stimulus onset in a network including increases in bilateral occipital, fusiform, frontal (including frontal eye fields), and medial temporal cortex; increases in left lateral parietal-temporal cortex; and decreases in the right anterior medial occipital cortex. No significant differences were observed between target and nontarget stimuli until >180 ms post-stimulus, when we saw greater gamma power increases in left motor and premotor areas, suggesting a possible role in perceptual decision-making and/or motor responses with the right hand. The early gamma power findings support a broadly distributed cortical visual detection network that is engaged at early times tens of milliseconds after signal transduction from the retina.

Early cortical signals in visual stimulus detection

During visual conscious perception, the earliest responses linked to signal detection are little known. The current study aims to reveal the cortical neural activity changes in the earliest stages of conscious perception using recordings from intracranial electrodes. Epilepsy patients (N=158) were recruited from a multi-center collaboration and completed a visual word recall task. Broadband gamma activity (40-115Hz) was extracted with a band-pass filter and gamma power was calculated across subjects on a common brain surface. Our results show early gamma power increases within 0-50ms after stimulus onset in bilateral visual processing cortex, right frontal cortex (frontal eye fields, ventral medial/frontopolar, orbital frontal) and bilateral medial temporal cortex regardless of whether the word was later recalled. At the same early times, decreases were seen in the left rostral middle frontal gyrus. At later times after stimulus onset, gamma power changes developed in multiple cortical regions. These included sustained changes in visual and other association cortical networks, and transient decreases in the default mode network most prominently at 300-650ms. In agreement with prior work in this verbal memory task, we also saw greater increases in visual and medial temporal regions as well as prominent later (> 300ms) increases in left hemisphere language areas for recalled versus not recalled stimuli. These results suggest an early signal detection network in the frontal, medial temporal, and visual cortex is engaged at the earliest stages of conscious visual perception.

Joint representation of working memory and uncertainty in human cortex

Neural representations of visual working memory (VWM) are noisy, and thus, decisions based on VWM are inevitably subject to uncertainty. However, the mechanisms by which the brain simultaneously represents the content and uncertainty of memory remain largely unknown. Here, inspired by the theory of probabilistic population codes, we test the hypothesis that the human brain represents an item maintained in VWM as a probability distribution over stimulus feature space, thereby capturing both its content and uncertainty. We used a neural generative model to decode probability distributions over memorized locations from fMRI activation patterns. We found that the mean of the probability distribution decoded from retinotopic cortical areas predicted memory reports on a trial-by-trial basis. Moreover, in several of the same mid-dorsal stream areas, the spread of the distribution predicted subjective trial-by-trial uncertainty judgments. These results provide evidence that VWM content and uncertainty are jointly represented by probabilistic neural codes.

Effect of brightness of visual stimuli on EEG signals

The aim of this study was to examine brightness effect, which is the perceptual property of visual stimuli, on brain responses obtained during visual processing of these stimuli. For this purpose, brain responses of the brain to changes in brightness were explored comparatively using different emotional images (pleasant, unpleasant and neutral) with different luminance levels. In the study, electroencephalography recordings from 12 different electrode sites of 31 healthy participants were used. The power spectra obtained from the analysis of the recordings using short time Fourier transform were analyzed, and a statistical analysis was performed on features extracted from these power spectra. Statistical findings were compared with those obtained from behavioral data. The results showed that the brightness of visual stimuli affected the power of brain responses depending on frequency, time and location. According to the statistically verified findings, the increase in the brightness of pleasant and neutral images increased the average power of responses in the parietal and occipital regions whereas the increase in the brightness of unpleasant images decreased the average power of responses in these regions. Moreover, the statistical results obtained for unpleasant images were found to be in accordance with the behavioral data. The results revealed that the brightness of visual stimuli could be represented by changing the activity power of the brain cortex. The findings emphasized that the brightness of visual stimuli should be viewed as an important parameter in studies using emotional image techniques such as image classification, emotion evaluation and neuro-marketing.

Revisiting mental rotation with stereoscopic disparity: A new spin for a classic paradigm

To understand how the presence of stereoscopic disparity influences cognitive and neural processing, we recorded participants' behavior and scalp electrical activity while they performed a mental rotation task. Participants wore active shutter 3D goggles, allowing us to present stimuli with or without stereoscopic disparity on a trial-by-trial basis. Participants were more accurate and faster when stimuli were presented with stereoscopic disparity. This improvement in performance was accompanied by changes in neural activity recorded from scalp electrodes at parietal and occipital regions; stereoscopic disparity produced earlier P2 peaks, larger N2 amplitudes, and earlier, smaller P300 peak amplitudes. The presence of stereoscopic disparity also produced greater neural entropy at occipital electrode sites, and lower entropy at frontal sites. These findings suggest that the nature of the benefit afforded by stereoscopic disparity occurs at both low-level perceptual processing and higher-level cognitive processing, and results in more accurate and rapid performance.

Temporal Dissociation of Neocortical and Hippocampal Contributions to Mental Time Travel Using Intracranial Recordings in Humans

In mental time travel (MTT) one is “traveling” back-and-forth in time, remembering, and imagining events. Despite intensive research regarding memory processes in the hippocampus, it was only recently shown that the hippocampus plays an essential role in encoding the temporal order of events remembered, and therefore plays an important role in MTT. Does it also encode the temporal relations of these events to the remembering self? We asked patients undergoing pre-surgical evaluation with depth electrodes penetrating the temporal lobes bilaterally toward the hippocampus to project themselves in time to a past, future, or present time-point, and then make judgments regarding various events. Classification analysis of intracranial evoked potentials revealed clear temporal dissociation in the left hemisphere between lateral-temporal electrodes, activated at ~100–300 ms, and hippocampal electrodes, activated at ~400–600 ms. This dissociation may suggest a division of labor in the temporal lobe during self-projection in time, hinting toward the different roles of the lateral-temporal cortex and the hippocampus in MTT and the temporal organization of the related events with respect to the experiencing self.

Visual field map clusters in human frontoparietal cortex

The visual neurosciences have made enormous progress in recent decades, in part because of the ability to drive visual areas by their sensory inputs, allowing researchers to define visual areas reliably across individuals and across species. Similar strategies for parcellating higher-order cortex have proven elusive. Here, using a novel experimental task and nonlinear population receptive field modeling, we map and characterize the topographic organization of several regions in human frontoparietal cortex. We discover representations of both polar angle and eccentricity that are organized into clusters, similar to visual cortex, where multiple gradients of polar angle of the contralateral visual field share a confluent fovea. This is striking because neural activity in frontoparietal cortex is believed to reflect higher-order cognitive functions rather than external sensory processing. Perhaps the spatial topography in frontoparietal cortex parallels the retinotopic organization of sensory cortex to enable an efficient interface between perception and higher-order cognitive processes. Critically, these visual maps constitute well-defined anatomical units that future studies of frontoparietal cortex can reliably target.

Functional connectivity between prefrontal and parietal cortex drives visuo-spatial attention shifts

It is well established that the frontal eye-fields (FEF) in the dorsal attention network (DAN) guide top-down selective attention. In addition, converging evidence implies a causal role for the FEF in attention shifting, which is also known to recruit the ventral attention network (VAN) and fronto-striatal regions. To investigate the causal influence of the FEF as (part of) a central hub between these networks, we applied thetaburst transcranial magnetic stimulation (TBS) off-line, combined with functional magnetic resonance (fMRI) during a cued visuo-spatial attention shifting paradigm.

We found that TBS over the right FEF impaired performance on a visual discrimination task in both hemifields following attention shifts, while only left hemifield performance was affected when participants were cued to maintain the focus of attention. These effects recovered ca. 20 min post stimulation. Furthermore, particularly following attention shifts, TBS suppressed the neural signal in bilateral FEF, right inferior and superior parietal lobule (IPL/SPL) and bilateral supramarginal gyri (SMG). Immediately post stimulation, functional connectivity was impaired between right FEF and right SMG as well as right putamen. Importantly, the extent of decreased connectivity between right FEF and right SMG correlated with behavioural impairment following attention shifts.

The main finding of this study demonstrates that influences from right FEF on SMG in the ventral attention network causally underly attention shifts, presumably by enabling disengagement from the current focus of attention.

•

Thetaburst stimulation to the right FEF temporarily impairs bilateral attention shifts.

•

Lateralised behavioural deficits in the contralateral hemifield are observed when cued to maintain attention.

•

These effects recover ca. 20 min post stimulation.

•

During shifts, neural activity is suppressed following right FEF TBS in the dorsal attention network and supramarginal gyri.

•

Influences from right FEF to SMG causally underlie attention shifts, presumably by enabling disengagement from current focus.

Neural Differences between Covert and Overt Attention Studied using EEG with Simultaneous Remote Eye Tracking

Research on neural mechanisms of attention has generally instructed subjects to direct attention covertly while maintaining a fixed gaze. This study combined simultaneous eye tracking and electroencephalogram (EEG) to measure neural attention responses during exogenous cueing in overt attention shifts (with saccadic eye movements to a target) and compared these with covert attention shifts (responding manually while maintaining central fixation). EEG analysis of the period preceding the saccade latency showed similar occipital response amplitudes for overt and covert shifts, although response latencies differed. However, a frontal positivity was greater during covert attention shifts, possibly reflecting saccade inhibition to maintain fixation. The results show that combined EEG and eye tracking can be successfully used to study natural overt shifts of attention (applicable to non-verbal infants) and that requiring inhibition of saccades can lead to additional frontal responses. Such data can be used to refine current neural models of attention that have been mainly based on covert shifts.

Intracranial recordings reveal transient response dynamics during information maintenance in human cerebral cortex

Despite an extensive body of work, it is still not clear how short term maintenance of information is implemented in the human brain. Most prior research has focused on "working memory"-typically involving the storage of a number of items, requiring the use of a phonological loop and focused attention during the delay period between encoding and retrieval. These studies largely support a model of enhanced activity in the delay interval as the central mechanism underlying working memory. However, multi-item working memory constitutes only a subset of storage phenomena that may occur during daily life. A common task in naturalistic situations is short term memory of a single item-for example, blindly reaching to a previously placed cup of coffee. Little is known about such single-item, effortless, storage in the human brain. Here, we examined the dynamics of brain responses during a single-item maintenance task, using intracranial recordings implanted for clinical purpose in patients (ECoG). Our results reveal that active electrodes were dominated by transient short latency visual and motor responses, reflected in broadband high frequency power increases in occipito-temporal, frontal, and parietal cortex. Only a very small set of electrodes showed activity during the early part of the delay period. Interestingly, no cortical site displayed a significant activation lasting to the response time. These results suggest that single item encoding is characterized by transient high frequency ECoG responses, while the maintenance of information during the delay period may be mediated by mechanisms necessitating only low-levels of neuronal activations.

Evidence for a functional subdivision of Premotor Ear-Eye Field (Area 8B)

The Supplementary Eye Field (SEF) and the Frontal Eye Field (FEF) have been described as participating in gaze shift control. Recent evidence suggests, however, that other areas of the dorsomedial prefrontal cortex also influence gaze shift. Herein, we have investigated electrically evoked ear- and eye movements from the Premotor Ear-Eye Field, or PEEF (area 8B) of macaque monkeys. We stimulated PEEF during spontaneous condition (outside the task performance) and during the execution of a visual fixation task (VFT). In the first case, we functionally identified two regions within the PEEF: a core and a belt. In the core region, stimulation elicited forward ear movements; regarding the evoked eye movements, in some penetrations, stimulation elicited contraversive fixed-vectors with a mean amplitude of 5.14°; while in other penetrations, we observed prevalently contralateral goal-directed eye movements having end-points that fell within 15° in respect to the primary eye position. On the contrary, in the belt region, stimulation elicited backward ear movements; regarding the eye movements, in some penetrations stimulation elicited prevalently contralateral goal-directed eye movements having end-points that fell within 15° in respect to the primary eye position, while in the lateral edge of the investigated region, stimulation elicited contralateral goal-directed eye movements having end-points that fell beyond 15° in respect to the primary eye position. Stimulation during VFT either did not elicit eye movements or evoked saccades of only a few degrees. Finally, even though no head rotation movements were observed during the stimulation period, we viewed a relationship between the duration of stimulation and the neck forces exerted by the monkey's head. We propose an updated vision of the PEEF composed of two functional regions, core and belt, which may be involved in integrating auditory and visual information important to the programming of gaze orienting movements.

Frontal eye field, where art thou? Anatomy, function, and non-invasive manipulation of frontal regions involved in eye movements and associated cognitive operations

The planning, control and execution of eye movements in 3D space relies on a distributed system of cortical and subcortical brain regions. Within this network, the Eye Fields have been described in animals as cortical regions in which electrical stimulation is able to trigger eye movements and influence their latency or accuracy. This review focuses on the Frontal Eye Field (FEF) a “hub” region located in Humans in the vicinity of the pre-central sulcus and the dorsal-most portion of the superior frontal sulcus. The straightforward localization of the FEF through electrical stimulation in animals is difficult to translate to the healthy human brain, particularly with non-invasive neuroimaging techniques. Hence, in the first part of this review, we describe attempts made to characterize the anatomical localization of this area in the human brain. The outcome of functional Magnetic Resonance Imaging (fMRI), Magneto-encephalography (MEG) and particularly, non-invasive mapping methods such a Transcranial Magnetic Stimulation (TMS) are described and the variability of FEF localization across individuals and mapping techniques are discussed. In the second part of this review, we will address the role of the FEF. We explore its involvement both in the physiology of fixation, saccade, pursuit, and vergence movements and in associated cognitive processes such as attentional orienting, visual awareness and perceptual modulation. Finally in the third part, we review recent evidence suggesting the high level of malleability and plasticity of these regions and associated networks to non-invasive stimulation. The exploratory, diagnostic, and therapeutic interest of such interventions for the modulation and improvement of perception in 3D space are discussed.

Maps of space in human frontoparietal cortex

Prefrontal cortex (PFC) and posterior parietal cortex (PPC) are neural substrates for spatial cognition. We here review studies in which we tested the hypothesis that human frontoparietal cortex may function as a priority map. According to priority map theory, objects or locations in the visual world are represented by neural activity that is proportional to their attentional priority. Using functional magnetic resonance imaging (fMRI), we first identified topographic maps in PFC and PPC as candidate priority maps of space. We then measured fMRI activity in candidate priority maps during the delay periods of a covert attention task, a spatial working memory task, and a motor planning task to test whether the activity depended on the particular spatial cognition. Our hypothesis was that some, but not all, candidate priority maps in PFC and PPC would be agnostic with regard to what was being prioritized, in that their activity would reflect the location in space across tasks rather than a particular kind of spatial cognition (e.g., covert attention). To test whether patterns of delay period activity were interchangeable during the spatial cognitive tasks, we used multivariate classifiers. We found that decoders trained to predict the locations on one task (e.g., working memory) cross-predicted the locations on the other tasks (e.g., covert attention and motor planning) in superior precentral sulcus (sPCS) and in a region of intraparietal sulcus (IPS2), suggesting that these patterns of maintenance activity may be interchangeable across the tasks. Such properties make sPCS in frontal cortex and IPS2 in parietal cortex viable priority map candidates, and suggest that these areas may be the human homologs of the monkey frontal eye field (FEF) and lateral intraparietal area (LIP).

Prioritized maps of space in human frontoparietal cortex

Priority maps are theorized to be composed of large populations of neurons organized topographically into a map of gaze-centered space whose activity spatially tags salient and behaviorally relevant information. Here, we identified four priority map candidates along human posterior intraparietal sulcus (IPS0-IPS3) and two along the precentral sulcus (PCS) that contained reliable retinotopically organized maps of contralateral visual space. Persistent activity increased from posterior-to-anterior IPS areas and from inferior-to-superior PCS areas during the maintenance of a working memory representation, the maintenance of covert attention, and the maintenance of a saccade plan. Moreover, decoders trained to predict the locations on one task (e.g., working memory) cross-predicted the locations on other tasks (e.g., attention) in superior PCS and IPS2, suggesting that these patterns of maintenance activity may be interchangeable across the tasks. Such properties make these two areas in frontal and parietal cortex viable priority map candidates.

Human finger somatotopy in areas 3b, 1, and 2: a 7T fMRI study using a natural stimulus

To study the properties of human primary somatosensory (S1) cortex as well as its role in cognitive and social processes, it is necessary to noninvasively localize the cortical representations of the body. Being arguably the most relevant body parts for tactile exploration, cortical representations of fingers are of particular interest. The aim of the present study was to investigate the cortical representation of individual fingers (D1-D5), using human touch as a stimulus. Utilizing the high BOLD sensitivity and spatial resolution at 7T, we found that each finger is represented within three subregions of S1 in the postcentral gyrus. Within each of these three areas, the fingers are sequentially organized (from D1 to D5) in a somatotopic manner. Therefore, these finger representations likely reflect distinct activations of BAs 3b, 1, and 2, similar to those described in electrophysiological work in non-human primates. Quantitative analysis of the local BOLD responses revealed that within BA3b, each finger representation is specific to its own stimulation without any cross-finger responsiveness. This finger response selectivity was less prominent in BA 1 and in BA 2. A test-retest procedure highlighted the reproducibility of the results and the robustness of the method for BA 3b. Finally, the representation of the thumb was enlarged compared to the other fingers within BAs 1 and 2. These findings extend previous human electrophysiological and neuroimaging data but also reveal differences in the functional organization of S1 in human and nonhuman primates.

Ultra-rapid categorization of fourier-spectrum equalized natural images: macaques and humans perform similarly

BACKGROUND

Comparative studies of cognitive processes find similarities between humans and apes but also monkeys. Even high-level processes, like the ability to categorize classes of object from any natural scene under ultra-rapid time constraints, seem to be present in rhesus macaque monkeys (despite a smaller brain and the lack of language and a cultural background). An interesting and still open question concerns the degree to which the same images are treated with the same efficacy by humans and monkeys when a low level cue, the spatial frequency content, is controlled.

METHODOLOGY/PRINCIPAL FINDINGS

We used a set of natural images equalized in Fourier spectrum and asked whether it is still possible to categorize them as containing an animal and at what speed. One rhesus macaque monkey performed a forced-choice saccadic task with a good accuracy (67.5% and 76% for new and familiar images respectively) although performance was lower than with non-equalized images. Importantly, the minimum reaction time was still very fast (100 ms). We compared the performances of human subjects with the same setup and the same set of (new) images. Overall mean performance of humans was also lower than with original images (64% correct) but the minimum reaction time was still short (140 ms).

CONCLUSION

Performances on individual images (% correct but not reaction times) for both humans and the monkey were significantly correlated suggesting that both species use similar features to perform the task. A similar advantage for full-face images was seen for both species. The results also suggest that local low spatial frequency information could be important, a finding that fits the theory that fast categorization relies on a rapid feedforward magnocellular signal.

Electrical source dynamics in three functional localizer paradigms

The visual cortex exhibits functional specialization that can be routinely demonstrated using hemodynamic measures like fMRI and PET. To understand the dynamic nature of cortical processes, however, source imaging with a high temporal resolution is necessary. Here, we asked how well distributed EEG source localization (LAURA) identifies functionally specialized visual processes. We tested three stimulus paradigms commonly used in fMRI with the aim to localize striate cortex, motion-sensitive areas, and face-sensitive areas. EEG source localization showed initial activations in striate and extra-striate areas at around 70ms after stimulus onset. These were quickly followed by extensive cortical, as well as subcortical activation. Functional motion and face-selective areas were localized with margins of below 2cm, at around 170 and 150ms, respectively. The results furthermore show for the first time that the C1 component has generators in the insula and frontal eye fields, but also in subcortical areas like the parahippocampus and the thalamus.

Event-related potentials reveal rapid registration of features of infrequent changes during change blindness

Background

Change blindness refers to a failure to detect changes between consecutively presented images separated by, for example, a brief blank screen. As an explanation of change blindness, it has been suggested that our representations of the environment are sparse outside focal attention and even that changed features may not be represented at all. In order to find electrophysiological evidence of neural representations of changed features during change blindness, we recorded event-related potentials (ERPs) in adults in an oddball variant of the change blindness flicker paradigm.

Methods

ERPs were recorded when subjects performed a change detection task in which the modified images were infrequently interspersed (p = .2) among the frequently (p = .8) presented unmodified images. Responses to modified and unmodified images were compared in the time window of 60-100 ms after stimulus onset.

Results

ERPs to infrequent modified images were found to differ in amplitude from those to frequent unmodified images at the midline electrodes (Fz, Pz, Cz and Oz) at the latency of 60-100 ms even when subjects were unaware of changes (change blindness).

Conclusions

The results suggest that the brain registers changes very rapidly, and that changed features in images are neurally represented even without participants' ability to report them.

Ultra-rapid sensory responses in the human frontal eye field region

Most of what we know about the human frontal eye field (FEF) is extrapolated from studies in animals. There is ample evidence that this region is crucial for eye movements. However, evidence is accumulating that this region also plays a role in sensory processing and that it belongs to a "fast brain" system. We set out to investigate these issues in humans, using intracerebral recordings in patients with drug-refractory epilepsy. Event-related potential recordings were obtained from 11 epileptic patients from within the FEF region while they passed a series of visual and auditory perceptual tests. No eye movement was required. Ultra-rapid responses were observed, with mean onset latencies at 24 ms after stimulus to auditory stimuli and 45 ms to visual stimuli. Such early responses were compatible with cortical routes as assessed with simultaneous recordings in primary auditory and visual cortices. Components were modulated very early by the sensory characteristics of the stimuli, in the 30-60 ms period for auditory stimuli and in the 45-60 ms period for visual stimuli. Although the frontal lobes in humans are generally viewed as being involved in high-level cognitive processes, these results indicate that the human FEF is a remarkably quickly activated multimodal region that belongs to a network of low-level neocortical sensory areas.

Spatio-temporal dynamics of neural mechanisms underlying component operations in working memory

Neuroimaging and neurophysiology evidence suggests that component operations in working memory (WM) emerge from the coordinated interaction of posterior perceptual cortices with heteromodal regions in the prefrontal and parietal cortices. Still, little is known about bottom-up and top-down signaling during the formation and retrieval of WM representations. In the current set of experiments, we combine complementary fMRI and EEG measures to obtain high-resolution spatial and temporal measures of neural activity during WM encoding and retrieval processes. Across both experiments, participants performed a face delayed recognition WM task in which the nature of sensory input across stages was held constant. In experiment 1, we utilized a latency-resolved fMRI approach to assess temporal parameters of the BOLD response during stage-specific encoding and retrieval waveforms. Relative to the latency at encoding, the PFC exhibited an earlier peak of fMRI activity at retrieval showing stage-specific differences in the temporal dynamics of PFC engagement across WM operations. In experiment 2, we analyzed the first 200 ms of the ERP response during this WM task providing a more sensitive temporal measure of these differences. Divergence of the ERP pattern during encoding and retrieval began as early as 60 ms post-stimulus. The parallel fMRI and ERP results during memory-guided decisions support a key role of the PFC in top-down biasing of perceptual processing and reveal rapid differences across WM component operations in the presence of identical bottom-up sensory input.

Saccade preparation signals in the human frontal and parietal cortices

Our ability to prepare an action in advance allows us to respond to our environment quickly, accurately, and flexibly. Here, we used event-related functional MRI to measure human brain activity while subjects maintained an active state of preparedness. At the beginning of each trial, subjects were instructed to prepare a pro- or antisaccade to a visual cue that was continually present during a long and variable preparation interval, but to defer the saccade's execution until a go signal. The deferred saccade task eliminated the mnemonic component inherent in memory-guided saccade tasks and placed the emphasis entirely on advance motor preparation. During the delay while subjects were in an active state of motor preparedness, the blood oxygen level-dependent signal in the frontal cortex showed 1) a sustained elevation throughout the preparation interval; 2) a linear increase with increasing delay length; 3) a bias for contra- rather than ipsiversive movements; 4) greater activity when the specific metrics of the planned saccade were known compared with when they were not; and 5) increased activity when the saccade was directed toward an internal versus an external representation (i.e., anticue location). These findings support the hypothesis that both the human frontal and parietal cortices are involved in the spatial selection and preparation of saccades.

Cortical activity time locked to the shift and maintenance of spatial attention

Attention increases the gain of visual neurons, which improves visual performance. How attention is controlled, however, remains unknown. Clear correlations between attention and saccade planning indicate that the control of attention is mediated through mechanisms housed in the oculomotor network. Here, we used event-related functional magnetic resonance imaging to compare overt and covert attention shifts. Subjects covertly or overtly shifted attention based on an endogenous cue and maintained attention throughout a long and variable delay. To insure continued attention, subjects counted when the attended target dimmed at near-threshold contrast levels. Overt and covert tasks used identical stimuli and required identical motor responses. Additionally, a staircase procedure that adjusted the target-dimming contrast separately for covert and overt trials equated the difficulty between conditions and across subjects. We found that the same regions along the precentral and intraparietal sulci were active during shifts of covert and overt attention. We also found sustained activation in the hemisphere contralateral to the attended visual field. We conclude that maps of prioritized locations are represented in areas classically associated with oculomotor control. The readout of these spatial maps by posterior visual areas directs spatial attention just as the readout by downstream saccade generators directs saccades.

Rapid and slow brain systems of abstract and concrete words differentiation

Previous studies have repeatedly found that late (300-800 ms) components of event-related potentials (ERP) reflected semantic analysis, i.e. the differentiation between abstract and concrete words. However, the human brain may detect the meaning of the words much earlier. This study investigated the brain mechanisms of the processing of abstract and concrete written words in four experimental conditions: i) Simple Reading, during which volunteers were required to silently read words; ii) Simple Classification, during which volunteers were required to classify the presented word into the abstract and concrete categories; and iii) Cued and iv) Uncued Selective Classification conditions, during which subjects had to classify only the words typed in a particular colour. 19-channel EEG was recorded during the experiment from 13 subjects. The ERP to abstract and concrete words differed not only at the late but also at early (40-100 ms) latencies in the Simple Reading and Classification conditions, as well as for the words that should not be explicitly classified in the Cued Selective Classification condition. This means that semantic analysis can occur in a manner which is both very rapid and implicit. Moreover, increasing task demands can even suppress this rapid semantic analysis. The functional microstate analysis revealed a topographical difference in response to abstract and concrete words, which indicated that at least partly distinct brain networks are involved in the processing of words during both early (implicit differentiation) and late (explicit classification) latencies.

REVIEW ARTICLE: Cortical control of eye and head movements: integration of movements and percepts

The cortical control of eye movements is well known. It remains unclear, however, as to how the eye fields of the frontal lobes generate and coordinate eye and head movements. Here, we review the recent advances in electrical stimulation studies and evaluate relevant models. As electrical stimulation is conducted in head-unrestrained, behaving subjects with the evoked eye and head movements sometimes being indistinguishable from natural gaze shifts, a pertinent question becomes whether these movements are evoked by motor programs or sensory percepts. Recent stimulation studies in the visual cortex and the eye fields of the frontal lobes have begun to bring both possibilities to light. In addition, cognitive variables often interact with behavioral states that can affect movements evoked by stimulation. Identifying and controlling these variables are critical to our understanding of experimental results based on electrically evoked movements. This understanding is needed before one can draw inferences from such results to elucidate the neural mechanisms underlying natural and complex movements.

Visuo-motor pathways in humans revealed by event-related fMRI

Whether different brain networks are involved in generating unimanual responses to a simple visual stimulus presented in the ipsilateral versus contralateral hemifield remains a controversial issue. Visuo-motor routing was investigated with event-related functional magnetic resonance imaging (fMRI) using the Poffenberger reaction time task. A 2 hemifield x 2 response hand design generated the "crossed" and "uncrossed" conditions, describing the spatial relation between these factors. Both conditions, with responses executed by the left or right hand, showed a similar spatial pattern of activated areas, including striate and extrastriate areas bilaterally, SMA, and M1 contralateral to the responding hand. These results demonstrated that visual information is processed bilaterally in striate and extrastriate visual areas, even in the "uncrossed" condition. Additional analyses based on sorting data according to subjects' reaction times revealed differential crossed versus uncrossed activity only for the slowest trials, with response strength in infero-temporal cortices significantly correlating with crossed-uncrossed differences (CUD) in reaction times. Collectively, the data favor a parallel, distributed model of brain activation. The presence of interhemispheric interactions and its consequent bilateral activity is not determined by the crossed anatomic projections of the primary visual and motor pathways. Distinct visuo-motor networks need not be engaged to mediate behavioral responses for the crossed visual field/response hand condition. While anatomical connectivity heavily influences the spatial pattern of activated visuo-motor pathways, behavioral and functional parameters appear to also affect the strength and dynamics of responses within these pathways.

Linking out-of-body experience and self processing to mental own-body imagery at the temporoparietal junction

The spatial unity of self and body is challenged by various philosophical considerations and several phenomena, perhaps most notoriously the "out-of-body experience" (OBE) during which one's visual perspective and one's self are experienced to have departed from their habitual position within one's body. Although researchers started examining isolated aspects of the self, the neurocognitive processes of OBEs have not been investigated experimentally to further our understanding of the self. With the use of evoked potential mapping, we show the selective activation of the temporoparietal junction (TPJ) at 330-400 ms after stimulus onset when healthy volunteers imagined themselves in the position and visual perspective that generally are reported by people experiencing spontaneous OBEs. Interference with the TPJ by transcranial magnetic stimulation (TMS) at this time impaired mental transformation of one's own body in healthy volunteers relative to TMS over a control site. No such TMS effect was observed for imagined spatial transformations of external objects, suggesting the selective implication of the TPJ in mental imagery of one's own body. Finally, in an epileptic patient with OBEs originating from the TPJ, we show partial activation of the seizure focus during mental transformations of her body and visual perspective mimicking her OBE perceptions. These results suggest that the TPJ is a crucial structure for the conscious experience of the normal self, mediating spatial unity of self and body, and also suggest that impaired processing at the TPJ may lead to pathological selves such as OBEs.

Can whole brain nerve conduction velocity be derived from surface-recorded visual evoked potentials?

Reed, Vernon, and Johnson [Reed, T. E., Vernon, P. A., & Johnson, A. M. (2004). Sex difference in brain nerve conduction velocity in normal humans. Neuropsychologia, 42, 1709-1714] reported that "nerve conduction velocity" (NCV) of visual transmission from retina to the primary visual area (V1) is significantly faster in males than females. The authors estimated the NCV by dividing head length (nasion-to-inion distance) by the latency of the well-known P100 component of the visual evoked potential (VEP). Here, we critically examine these metrics and we contend that knowledge of the underlying physiology of neural transmission across the initial stages of the visual processing hierarchy dictates that a number of their assumptions cannot be reasonably upheld. Alternative, and we believe, more parsimonious interpretations of the data are also proposed.

EEG source imaging

OBJECTIVE

Electroencephalography (EEG) is an important tool for studying the temporal dynamics of the human brain's large-scale neuronal circuits. However, most EEG applications fail to capitalize on all of the data's available information, particularly that concerning the location of active sources in the brain. Localizing the sources of a given scalp measurement is only achieved by solving the so-called inverse problem. By introducing reasonable a priori constraints, the inverse problem can be solved and the most probable sources in the brain at every moment in time can be accurately localized.

METHODS AND RESULTS

Here, we review the different EEG source localization procedures applied during the last two decades. Additionally, we detail the importance of those procedures preceding and following source estimation that are intimately linked to a successful, reliable result. We discuss (1) the number and positioning of electrodes, (2) the varieties of inverse solution models and algorithms, (3) the integration of EEG source estimations with MRI data, (4) the integration of time and frequency in source imaging, and (5) the statistical analysis of inverse solution results.

CONCLUSIONS AND SIGNIFICANCE

We show that modern EEG source imaging simultaneously details the temporal and spatial dimensions of brain activity, making it an important and affordable tool to study the properties of cerebral, neural networks in cognitive and clinical neurosciences.

Timing of target discrimination in human frontal eye fields

Frontal eye field (FEF) neurons discharge in response to behaviorally relevant stimuli that are potential targets for saccades. Distinct visual and motor processes have been dissociated in the FEF of macaque monkeys, but little is known about the visual processing capacity of FEF in humans. We used double-pulse transcranial magnetic stimulation [(d)TMS] to investigate the timing of target discrimination during visual conjunction search. We applied dual TMS pulses separated by 40 msec over the right FEF and vertex. These were applied in five timing conditions to sample separate time windows within the first 200 msec of visual processing. (d)TMS impaired search performance, reflected in reduced d' scores. This effect was limited to a time window between 40 and 80 msec after search array onset. These parameters correspond with single-cell activity in FEF that predicts monkeys' behavioral reports on hit, miss, false alarm, and correct rejection trials. Our findings demonstrate a crucial early role for human FEF in visual target discrimination that is independent of saccade programming.

Cortical Motion Deafness

The extent to which the auditory system, like the visual system, processes spatial stimulus characteristics such as location and motion in separate specialized neuronal modules or in one homogeneously distributed network is unresolved. Here we present a patient with a selective deficit for the perception and discrimination of auditory motion following resection of the right anterior temporal lobe and the right posterior superior temporal gyrus (STG). Analysis of stimulus identity and location within the auditory scene remained intact. In addition, intracranial auditory evoked potentials, recorded preoperatively, revealed motion-specific responses selectively over the resected right posterior STG, and electrical cortical stimulation of this region was experienced by the patient as incoming moving sounds. Collectively, these data present a patient with cortical motion deafness, providing evidence that cortical processing of auditory motion is performed in a specialized module within the posterior STG.

Control of fixation and saccades in humans with chronic lesions of oculomotor cortex

To elucidate the dynamic interactions of cortical and subcortical oculomotor systems, the authors investigated reflexive and strategic control over fixation and saccades in patients with chronic unilateral lesions that involved either frontal or parietal cortex. They measured the effects of indicating the location of the forthcoming target and removing the fixation stimulus on the latencies of eye movements toward a peripheral visual target in 12 patients with frontal eye field (FEF) lesions, 9 patients with lesions restricted to parietal cortex, and 12 neurologically healthy controls. They found that chronic damage to FEF cortex disrupts cortico-collicular interactions, resulting in hypoactivity in the contralesional superior colliculus and a loss of strategic control over the intrinsic collicular circuits that regulate fixation.

Chapter 65 The speed of visual cognition

Intracranial electrophysiological recordings in primates showed repeatedly that neurons in several cortical areas are activated very early after visual stimulus presentation, practically at the same time (or even before) the activation of primary sensory neurons. Even neurons at the highest hierarchical levels of the visual system are activated in less than 100 ms. These findings challenge the classical interpretation of human evoked potential (EP) data that assume that the first, "exogenous", EP components from 50 to 150 ms reflect the initial volley of sensory activation in the striate and extrastriate visual cortex and are not yet influenced by cognitive task demands. Indeed, several recent EP studies using analysis methods that go beyond the classical approach of defining "components" at certain scalp positions indicate that highly complex stimulus features can influence EP responses within the first 100 ms. This indicates that sophisticated cognitive processing is much faster than previously thought and opens new perspectives with respect to the role of both, bottom-up as well as top-down mechanisms in visual processing.

Transcranial magnetic stimulation of the human frontal eye field facilitates visual awareness

What are the brain mechanisms allowing a stimulus to enter our awareness? Some theories suggest that this process engages resources overlapping with those required for action control, but experimental support for these ideas is still required. Here, we investigated whether the human frontal eye field (FEF), an area known to control eye movements, is involved in visual awareness. Volunteers participated in a backward masking task in which they were able to detect a target in a small proportion of trials. We observed that a single pulse of transcranial magnetic stimulation applied over the FEF shortly before the target's onset facilitated visual sensitivity; subjects were able to detect an otherwise subliminal object. These results show that modulating the neuronal activity of the FEF can enhance visual detection, thereby yielding new insights into the neural basis of visual awareness.

Microstimulation of the frontal eye field and its effects on covert spatial attention

Many studies have established that the strength of visual perception and the strength of visual representations within visual cortex vary according to the focus of covert spatial attention. While it is clear that attention can modulate visual signals, the source of this modulation remains unknown. We have examined the possibility that saccade related mechanisms provide a source of spatial attention by studying the effects of electrical microstimulation of the frontal eye fields (FEF) on spatial attention. Monkeys performed a task in which they had to detect luminance changes of a peripheral target while ignoring a flashing distracter. The target luminance change could be preceded by stimulation of the FEF at current levels below that which evoked saccadic eye movements. We found that when the target change was preceded by stimulation of FEF, the monkey could detect smaller changes in target luminance. The increased sensitivity to the target change only occurred when the target was placed in the part of the visual field represented by neurons at the stimulation site. The magnitude of improvement depended on the temporal asynchrony of the stimulation onset and the target event. No significant effect of stimulation was observed when long intervals (>300 ms) between stimulation and the target event were used, and the magnitude of the increased sensitivity decreased systematically with increasing asynchrony. At the shortest asynchrony, FEF stimulation temporally overlapped the target event and the magnitude of the improvement was comparable to that of removing the distracter from the task. These results demonstrate that transient, but potent improvements in the deployment of covert spatial attention can be obtained by microstimulation of FEF sites from which saccadic eye movements are also evoked.

Mapping of the neuronal networks of human cortical brain functions

OBJECTIVE

The principles and methodology of event-related fMRI, electromagnetic source imaging and intracranial evoked potentials will be described along with some examples of the mapping of the neuronal networks of human cortical brain functions with the use of these techniques.

INTRODUCTION

Functional brain mapping using PET or fMRI has provided clues on the functioning brain and notably on the functional neuroanatomy of cognitive functions. These mapping possibilities can be used to delineate in an individual patient the brain areas subserving a cerebral function that might be compromised by a surgery in a nearby location, or to target a functional neurosurgical procedure.

BACKGROUND

Brain functions and notably "higher brain functions" are served by a complex network of interrelating brain regions. Deeper insights into the functioning of a neuronal network can be gained by adding dynamic, i.e. temporal, information to the functional maps. This will demonstrate the orchestration of the activation of the different brain areas constituting the network, which gives clues to the information processing and therefore to the functioning of the different modules of the network. In order to track the flow of information and the sequential activation of the different brain regions constituting the network, brain activity has to be recorded at the speed of transfer of activation from one neuronal population to the other. The temporal resolution needed to achieve this is not in the range of traditional subtractive or comparative PET or fMRI techniques.

NEW DEVELOPMENTS

Novel fMRI methods that record haemodynamic signal changes after single events (event-related fMRI) are now able to determine sequential neural processing by distinguishing the relative onset-time of activity between different areas. The temporal resolution of event-related (ER) fMRI is sufficient to detect changes of mental activity within the order of several hundreds of milliseconds. This allows the exploration of a broad range of cognitive functions. Nevertheless, this technique is currently not rapid enough to observe the transient coordinations and oscillations of neuronal activities occurring across certain cortical areas during the performance of cognitive tasks. The temporal resolution needed for that is within the order of tens or a few milliseconds and is only accessible by EEG or MEG that allow true real-time measurements of the neuronal activity elicited by a stimulus. Surface recordings of multichannel EEG or MEG combined with novel electromagnetic source localisation algorithms allow a relatively precise estimation of the activated areas. A more direct localisation of electric activity is achieved by intracranial recordings in patients having implanted electrodes for diagnostic reasons. In these cases, a high temporal and spatial resolution is achieved but with a limited sampling of brain regions.

CONCLUSION

Although the temporal resolution of ER fMRI is due to improve, the temporal measures provided by EEG, MEG or intracranial event-related potentials (ERPs) are absolute, which remains a unique feature of these techniques. Therefore, ER fMRI and electromagnetic source imaging are complementary. The maps obtained with ER fMRI may be refined by electromagnetic ERPs that provide further insights into the temporal coordination or orchestration between the cortical areas already detected by ER fMRI and constituting a neuronal network, and ER fMRI can be used to precisely locate the areas coarsely situated and delineated by electromagnetic source imaging. Thus, the combination of ER fMRI and electromagnetic ERPs is essential in order to produce a mapping method with a millimetre spatial resolution and a millisecond temporal resolution. Future applications should combine these techniques to localise precisely and non-invasively relevant sensory, motor and cognitive processes in order to adequately tailor any brain surgery.

Cortical motor mapping in epilepsy patients: information from subdural electrodes in presurgical evaluation

It is essential to delineate an epileptogenic zone and to define the eloquent cortices at or close to the epileptogenic zone in patients with neocortical epilepsy for epilepsy surgery. Prolonged implantation of the subdural electrode in presurgical evaluation is currently one of the best clinical methods to provide the essential information before epilepsy surgery. Electric cortical stimulation and recording of sensory evoked potentials by means of subdural electrodes are widely used for functional cortical mapping. Bereitschaftspotential (BP) is clinically useful to delineate the primary and nonprimary motor cortices such as supplementary motor area proper (SMA proper) and pre-SMA, because BP occurs for any type of voluntary movements of the body, and because it is not associated with the risk of seizure induction in contrast with high-frequency cortical electric stimulation. Single-pulse electric cortical stimulation to record motor evoked potentials (MEPs) also could complement currently used high-frequency cortical electric stimulation, especially for mapping of the primary motor and premotor cortices with lower risk of seizure induction.

Transcranial magnetic stimulation of the human frontal eye field: effects on visual perception and attention

When looking at one object, human subjects can shift their attention to another object in their visual field without moving the eyes. Such shifts of attention activate the same brain regions as those involved in the execution of eye movements. Here we investigate the role of one of the main cortical oculomotor area, namely, the frontal eye field (FEF), in shifts of attention. We used transcranial magnetic stimulation (TMS), a technique known to disrupt transiently eye-movements preparation. We hypothesized that if the FEF is a necessary element in the network involved in shifting attention without moving the eyes, then#10; TMS should also disrupt visuospatial attention. For each volunteer, we positioned the TMS coil over the probabilistic anatomical location of the FEF, and we verified that single pulses delayed eye movements. We then applied TMS during a visuospatial attention task. In this task, a central arrow directed shifts of attention and the subject responded by a keypress to a subsequent visual peripheral target without moving the eyes from the central fixation point. In a few trials, the cue was invalid or uninformative, yielding slower responses than when the cue was valid. We delivered single pulses either 53 msec before or 70 msec after target onset. Contrary to our prediction, the main effect of the stimulation was a decrease in reaction time when it was applied 53 msec before target onset. TMS over the left hemisphere facilitated responses to targets in the right hemifield only and for all cueing conditions, whereas TMS over the right hemisphere had a bilateral effect for valid and neutral but not invalid cueing. Thus, TMS interfered with shift of attention only in the case of right hemisphere stimulation: it increased the cost of invalid cueing. Our results suggest that TMS over the FEF facilitates visual detection, and thereby reduces reaction time. This finding provides new insights into the role of the human FEF in processing visual information. The functional asymmetry observed for both facilitation of visual detection and interference with shifts of attention provides further evidence for the dominance of the right hemisphere for those processes. Our results also underline that the disruptive or facilitative effect of TMS over a given region depends upon the behavioral context.

Intracranial Neurophysiological Correlates Related to the Processing of Faces

Face perception and recognition is an intriguing ability, already present in neonates. Numerous studies in patients with brain lesions identified the temporo-occipital cortex as the crucial structure for this capacity. Analysis of electrical signals (EEG) inside the brain of patients implanted with intracranial electrodes for diagnostic purposes allows researchers to describe the temporal and spatial organization of responses to various aspects of face processing in human subjects. Several findings have emerged and appear relevant for cerebral organization in general: (1) Selective face responses were obtained from the basal temporo-occipital cortex at around 200 ms (N200); however, other structures such as the lateral temporal lobe and frontal cortex also participate in face recognition and perception tasks. (2) Each structure has a distinct "response profile"; that is, with respect to a given task certain structures respond strongly, others less or not at all. This profile might change with a different task, although the physical parameters of the stimuli remain the same. (3) The right hemispheric predominance of face processing, as suggested by patient data and studies in healthy volunteers, seemed to be restricted to its early stages (i.e., before 100-150 ms). (4) Recognition of faces might be associated with differential intracranial responses, despite an incorrect overt response, reflecting neurophysiological correlates of implicit memory. (5) The more the stimulus resembled a complete human face, the earlier and larger the N200 response was found, in particular over the basal temporobasal cortex. Analysis of electrical signals from intracranial electrodes might help to improve our understanding of the underlying physiological and anatomical constraints of cognitive processes.

Visual activation of frontal cortex: segregation from occipital activity

Studies in primates have found visually responsive neurons that are distributed beyond cortical areas typically described as directly involved in vision. Among these areas are premotor cortex, supplementary motor area, dorsolateral prefrontal cortex and frontal eye fields. Given these findings, visual stimulation would be expected to result in activation of human frontal cortex. However, few human studies have described sensory activations in frontal regions in response to simple visual stimulation. Such studies have classically described event-related potential (ERP) components over occipital regions. The present study sought to further characterize the spatiotemporal dynamics of visually-evoked electrocortical responses elicited by simple visual stimuli using scalp current density measures derived from high-density ERP recordings, with particular emphasis on the distribution of stimulus-related activity over frontal cortex. Hemiretinal stimuli were viewed passively and during a simple ipsi- or contramanual (RT) task. The motor requirement was included to investigate the effects of response preparation on premovement frontal activations. The results indicate early frontocentral activation, particularly over the right hemisphere (peak magnitude 124-148 ms) that is independent of input visual field or motor response requirement, and that is clearly separate in timecourse from the posterior responses elicited by visual input. These findings are in accord with the multiplicity of visual inputs to frontal cortex and are discussed in terms of frontal lobe functions as may be required in these tasks.

Evidence for premotor cortex activity during dynamic visuospatial imagery from single-trial functional magnetic resonance imaging and event-related slow cortical potentials

A strong correspondence has been repeatedly observed between actually performed and mentally imagined object rotation. This suggests an overlap in the brain regions involved in these processes. Functional neuroimaging studies have consistently revealed parietal and occipital cortex activity during dynamic visuospatial imagery. However, results concerning the involvement of higher-order cortical motor areas have been less consistent. We investigated if and when premotor structures are active during processing of a three-dimensional cube comparison task that requires dynamic visuospatial imagery. In order to achieve a good temporal and spatial resolution, single-trial functional magnetic resonance imaging (fMRI) and scalp-recorded event-related slow cortical potentials (SCPs) were recorded from the same subjects in two separate measurement sessions. In order to reduce inter-subject variability in brain activity due to individual differences, only male subjects (n = 13) with high task-specific ability were investigated. Functional MRI revealed consistent bilateral activity in the occipital (Brodmann area BA18/19) and parietal cortex (BA7), in lateral and medial premotor areas (BA6), the dorsolateral prefrontal cortex (BA9), and the anterior insular cortex. The time-course of SCPs indicated that task-related activity in these areas commenced approximately 550-650 ms after stimulus presentation and persisted until task completion. These results provide strong and consistent evidence that the human premotor cortex is involved in dynamic visuospatial imagery.

Electrical cortical stimulation of the human prefrontal cortex evokes complex visual hallucinations

Complex visual hallucinations are a well-known feature of electrical stimulation or epileptic discharge in the temporal lobe. It has been proposed that these visual hallucinations result from an electrical interference with the ventral visual processing stream in the lateral temporal lobe and the memory system in medial temporal structures, which explains their frequent visual and mnestic features. Even though recent studies have demonstrated visual and memory functions in the prefrontal cortex, up to now epileptic discharge or electrical stimulation of prefrontal structures has only rarely been reported to induce visual phenomena. We report on two patients undergoing invasive presurgical epilepsy evaluation in which electrical cortical stimulation of the left prefrontal cortex repeatedly induced complex visual hallucinations. Interestingly, the induced visual responses differed with respect to their spatial organization: whereas those evoked on the inferior frontal gyrus were perceived in the whole visual field, complex visual responses on the middle frontal gyrus were restricted to the contralateral hemispace. Based on the spatial organization of the visual experiences in our patients, animal work, and neuroimaging data it might be suggested that specific subregions of the human prefrontal cortex might contain separate visual and mnemonic processing mechanisms.