Early visual cortical responses produced by checkerboard pattern stimulation

Decoding electroencephalographic responses to visual stimuli compatible with electrical stimulation

Electrical stimulation of the visual nervous system could improve the quality of life of patients affected by acquired blindness by restoring some visual sensations, but requires careful optimization of stimulation parameters to produce useful perceptions. Neural correlates of elicited perceptions could be used for fast automatic optimization, with electroencephalography as a natural choice as it can be acquired non-invasively. Nonetheless, its low signal-to-noise ratio may hinder discrimination of similar visual patterns, preventing its use in the optimization of electrical stimulation. Our work investigates for the first time the discriminability of the electroencephalographic responses to visual stimuli compatible with electrical stimulation, employing a newly acquired dataset whose stimuli encompass the concurrent variation of several features, while neuroscience research tends to study the neural correlates of single visual features. We then performed above-chance single-trial decoding of multiple features of our newly crafted visual stimuli using relatively simple machine learning algorithms. A decoding scheme employing the information from multiple stimulus presentations was implemented, substantially improving our decoding performance, suggesting that such methods should be used systematically in future applications. The significance of the present work relies in the determination of which visual features can be decoded from electroencephalographic responses to electrical stimulation-compatible stimuli and at which granularity they can be discriminated. Our methods pave the way to using electroencephalographic correlates to optimize electrical stimulation parameters, thus increasing the effectiveness of current visual neuroprostheses.

Relationship between function and structure in the visual cortex in healthy individuals and in patients with severe mental disorders

Patients with schizophrenia spectrum disorders (SCZ_spect) and bipolar disorders (BD) show impaired function in the primary visual cortex (V1), indicated by altered visual evoked potential (VEP). While the neural substrate for altered VEP in these patients remains elusive, altered V1 structure may play a role. One previous study found a positive relationship between the amplitude of the P100 component of the VEP and V1 surface area, but not V1 thickness, in a small sample of healthy individuals. Here, we aimed to replicate these findings in a larger healthy control (HC) sample (n = 307) and to examine the same relationship in patients with SCZ_spect (n = 30) or BD (n = 45). We also compared the mean P100 amplitude, V1 surface area and V1 thickness between controls and patients and found no significant group differences. In HC only, we found a significant positive P100-V1 surface area association, while there were no significant P100-V1 thickness relationships in HC, SCZ_spect or BD. Together, our results confirm previous findings of a positive P100-V1 surface area association in HC, whereas larger patient samples are needed to further clarify the function-structure relationship in V1 in SCZ_spect and BD.

Early neural activity changes associated with stimulus detection during visual conscious perception

The earliest cortical neural signals following consciously perceived visual stimuli in humans are poorly understood. Using intracranial electroencephalography, we investigated neural activity changes associated with the earliest stages of stimulus detection during visual conscious perception. Participants (N = 10; 1,693 electrode contacts) completed a continuous performance task where subjects were asked to press a button when they saw a target letter among a series of nontargets. Broadband gamma power (40-115 Hz) was analyzed as marker of cortical population neural activity. Regardless of target or nontarget letter type, we observed early gamma power changes within 30-180 ms from stimulus onset in a network including increases in bilateral occipital, fusiform, frontal (including frontal eye fields), and medial temporal cortex; increases in left lateral parietal-temporal cortex; and decreases in the right anterior medial occipital cortex. No significant differences were observed between target and nontarget stimuli until >180 ms post-stimulus, when we saw greater gamma power increases in left motor and premotor areas, suggesting a possible role in perceptual decision-making and/or motor responses with the right hand. The early gamma power findings support a broadly distributed cortical visual detection network that is engaged at early times tens of milliseconds after signal transduction from the retina.

Improved correspondence of fMRI visual field localizer data after cortex-based macroanatomical alignment

Studying the visual system with fMRI often requires using localizer paradigms to define regions of interest (ROIs). However, the considerable interindividual variability of the cerebral cortex represents a crucial confound for group-level analyses. Cortex-based alignment (CBA) techniques reliably reduce interindividual macroanatomical variability. Yet, their utility has not been assessed for visual field localizer paradigms, which map specific parts of the visual field within retinotopically organized visual areas. We evaluated CBA for an attention-enhanced visual field localizer, mapping homologous parts of each visual quadrant in 50 participants. We compared CBA with volume-based alignment and a surface-based analysis, which did not include macroanatomical alignment. CBA led to the strongest increase in the probability of activation overlap (up to 86%). At the group level, CBA led to the most consistent increase in ROI size while preserving vertical ROI symmetry. Overall, our results indicate that in addition to the increased signal-to-noise ratio of a surface-based analysis, macroanatomical alignment considerably improves statistical power. These findings confirm and extend the utility of CBA for the study of the visual system in the context of group analyses. CBA should be particularly relevant when studying neuropsychiatric disorders with abnormally increased interindividual macroanatomical variability.

Spatiotemporal Dynamics of Covert Attention With Different Degrees of Central Visual Field Defects: An ERP and sLORETA Study

Purpose

The present study aimed to investigate the spatiotemporal dynamics of covert attention by simulating different degrees of central visual field defects in healthy subjects.

Methods

An electroencephalogram (EEG) was recorded while 40 normal-sighted subjects performed a target discrimination task. Target stimuli simulated different defect degrees of the central visual field by artificially central scotomas (5, 10, 20, and 30 degrees of visual angle) masked on the center of black-and-white checkerboards. Event-related potentials (ERPs) and standardized low-resolution brain electromagnetic tomography (sLORETA) based on ERPs were analyzed.

Results

ERP results indicated that during early perceptual processes, compared with 5-degree and 10-degree defects, N1 amplitudes of 20-degree and 30-degree defects decreased, whereas P2 amplitudes significantly reduced in 30-degree defects. During later discrimination and decision processing, N2 amplitudes gradually increased from 5-degree to 30-degree defects, whereas P3 amplitudes gradually decreased. Source localization indicated that 5-degree and 10-degree defects had stronger activations than 20-degree and 30-degree defects from the occipital cortex to the ventral stream and dorsal streams. Especially, 30-degree defects primarily recruited additional activations in the ventrolateral prefrontal cortex and ventral stream and later caused the disconnection of dorsolateral prefrontal-posterior parietal cortices in the dorsal stream.

Conclusions

Different degrees of central visual field defects differed in distinct spatiotemporal characteristics at multiple stages of covert attention, from top-down forward feedback and attentional allocation to executive controls through ventral and dorsal processing streams, suggesting that the combination of ERP and source localization can reveal the spatiotemporal control capacity of the cortex on central visual field defects.

Riemannian classification of single-trial surface EEG and sources during checkerboard and navigational images in humans

OBJECTIVE

Different visual stimuli are classically used for triggering visual evoked potentials comprising well-defined components linked to the content of the displayed image. These evoked components result from the average of ongoing EEG signals in which additive and oscillatory mechanisms contribute to the component morphology. The evoked related potentials often resulted from a mixed situation (power variation and phase-locking) making basic and clinical interpretations difficult. Besides, the grand average methodology produced artificial constructs that do not reflect individual peculiarities. This motivated new approaches based on single-trial analysis as recently used in the brain-computer interface field.

APPROACH

We hypothesize that EEG signals may include specific information about the visual features of the displayed image and that such distinctive traits can be identified by state-of-the-art classification algorithms based on Riemannian geometry. The same classification algorithms are also applied to the dipole sources estimated by sLORETA.

MAIN RESULTS AND SIGNIFICANCE

We show that our classification pipeline can effectively discriminate between the display of different visual items (Checkerboard versus 3D navigational image) in single EEG trials throughout multiple subjects. The present methodology reaches a single-trial classification accuracy of about 84% and 93% for inter-subject and intra-subject classification respectively using surface EEG. Interestingly, we note that the classification algorithms trained on sLORETA sources estimation fail to generalize among multiple subjects (63%), which may be due to either the average head model used by sLORETA or the subsequent spatial filtering failing to extract discriminative information, but reach an intra-subject classification accuracy of 82%.

Early cortical signals in visual stimulus detection

During visual conscious perception, the earliest responses linked to signal detection are little known. The current study aims to reveal the cortical neural activity changes in the earliest stages of conscious perception using recordings from intracranial electrodes. Epilepsy patients (N=158) were recruited from a multi-center collaboration and completed a visual word recall task. Broadband gamma activity (40-115Hz) was extracted with a band-pass filter and gamma power was calculated across subjects on a common brain surface. Our results show early gamma power increases within 0-50ms after stimulus onset in bilateral visual processing cortex, right frontal cortex (frontal eye fields, ventral medial/frontopolar, orbital frontal) and bilateral medial temporal cortex regardless of whether the word was later recalled. At the same early times, decreases were seen in the left rostral middle frontal gyrus. At later times after stimulus onset, gamma power changes developed in multiple cortical regions. These included sustained changes in visual and other association cortical networks, and transient decreases in the default mode network most prominently at 300-650ms. In agreement with prior work in this verbal memory task, we also saw greater increases in visual and medial temporal regions as well as prominent later (> 300ms) increases in left hemisphere language areas for recalled versus not recalled stimuli. These results suggest an early signal detection network in the frontal, medial temporal, and visual cortex is engaged at the earliest stages of conscious visual perception.

Contactless measurements of retinal activity using optically pumped magnetometers

Optically pumped magnetometers (OPMs) have been adopted for the measurement of brain activity. Without the need to be cooled to cryogenic temperatures, an array of these sensors can be placed more flexibly, which allows for the recording of neuronal structures other than neocortex. Here we use eight OPM sensors to record human retinal activity following flash stimulation. We compare this magnetoretinographic (MRG) activity to the simultaneously recorded electroretinogram of the eight participants. The MRG shows the familiar flash-evoked potentials (a-wave and b-wave) and shares a highly significant amount of information with the electroretinogram (both in a simultaneous and separate measurement). We conclude that OPM sensors have the potential to become a contactless alternative to fiber electrodes for the measurement of retinal activity. Such a contactless solution can benefit both clinical and neuroscientific settings.

"Multiplexing" cells of the visual cortex and the timing enigma of the binding problem

In this opinion essay, I address the perennial binding problem, that is to say of how independently processed visual attributes such as form, colour and motion are brought together to give us a unified and holistic picture of the visual world. A solution to this central issue in neurobiology remains as elusive as ever. No one knows today how it is implemented. The issue is not a new one and, though discussed most commonly in the context of the visual brain, it is not unique to it either. Karl Lashley summarized it well years ago when he wrote that a critical problem for brain studies is to understand how "the specialized areas of the cerebral cortex interact to provide the integration evident in thought and behaviour" (Lashley, 1931).

Variability and bias between magnetoencephalography systems in localization of the primary visual cortex

OBJECTIVES

When using MEG for pre-surgical mapping it is critically important that reliable estimates of functional locations, such as the primary visual cortex (V1) can be provided. Several different models of MEG systems exist, each with varying software and hardware configurations, and it is not currently known how the system type contributes to variability in V1 localization.

PATIENTS AND METHODS

In this study, participants underwent MEG sessions using two different systems (Vector View and CTF) during which they were presented with a repeating grating stimulus to the lower-left visual quadrant to generate a visual evoked field (VEF). The location, amplitude and latency of the VEF source was compared between systems for each participant.

RESULTS

No significant differences were found in latency and amplitude between systems, however, a significant bias in the latero-medial position of the localization was present. The median inter-system Euclidian distance between V1 localization across participants was 10.5 mm.

CONCLUSIONS

Overall, our results indicate that mapping of V1 can be reliably reproduced within approximately one centimetre by different MEG systems.

SIGNIFICANCE

This result provides knowledge of the useful limits on the reliability of localization which can be taken into consideration in clinical practice.

Human posterior parietal cortex responds to visual stimuli as early as peristriate occipital cortex

Much of what is known about the timing of visual processing in the brain is inferred from intracranial studies in monkeys, with human data limited to mainly noninvasive methods with lower spatial resolution. Here, we estimated visual onset latencies from electrocorticographic (ECoG) recordings in a patient who was implanted with 112 subdural electrodes, distributed across the posterior cortex of the right hemisphere, for presurgical evaluation of intractable epilepsy. Functional MRI prior to surgery was used to determine boundaries of visual areas. The patient was presented with images of objects from several categories. Event-related potentials (ERPs) were calculated across all categories excluding targets, and statistically reliable onset latencies were determined, using a bootstrapping procedure over the single trial baseline activity in individual electrodes. The distribution of onset latencies broadly reflected the known hierarchy of visual areas, with the earliest cortical responses in primary visual cortex, and higher areas showing later responses. A clear exception to this pattern was a robust, statistically reliable and spatially localized, very early response, on the bank of the posterior intraparietal sulcus (IPS). The response in the IPS started nearly simultaneously with responses detected in peristriate visual areas, around 60 ms poststimulus onset. Our results support the notion of early visual processing in the posterior parietal lobe, not respecting traditional hierarchies, and give direct evidence for onset times of visual responses across the human cortex.

Reduced effects of pictorial distinctiveness on false memory following dynamic visual noise

High levels of false recognition for non-presented items typically occur following exposure to lists of associated words. These false recognition effects can be reduced by making the studied items more distinctive by the presentation of pictures during encoding. One explanation of this is that during recognition, participants expect or attempt to retrieve distinctive pictorial information in order to evaluate the study status of the test item. If this involves the retrieval and use of visual imagery, then interfering with imagery processing should reduce the effectiveness of pictorial information in false memory reduction. In the current experiment, visual-imagery processing was disrupted at retrieval by the use of dynamic visual noise (DVN). It was found that effects of DVN dissociated true from false memory. Memory for studied words was not influenced by the presence of an interfering noise field. However, false memory was increased and the effects of picture-induced distinctiveness was eliminated. DVN also increased false recollection and remember responses to unstudied items.