Learning to see 3-D: psychophysics and brain electrical activity

EEG response in humans for frequency-tagged anticorrelated random-dot stereograms: Increased coherency and alpha oscillations

In humans, the presence of a neural mechanism triggered by anticorrelated random-dot stereograms have been theorized based on animal models from invasive studies, but have not been experimentally verified with the use of electroencephalography. In this study, we employed a phase-consistent, temporally modulated alternating depth stereogram stimulus, where we created anticorrelation by inverting the contrast between the eyes. We recorded the electrical response of the resulting brain oscillations of our four participants using EEG in both the correlated and anticorrelated conditions and whether they perceived depth movement. Our analysis found that the correlated stereograms elicited a strong coherency at the even harmonics of the depth alternation, and the anticorrelated stimulus created lower coherency peaks at the first harmonic of the depth alternation, even when participants did not report the depth movement to be visible. While both conditions created a diminishment of spectral power in the beta band, we found that the anticorrelated condition created increased spectral power in the alpha band. We experimentally verified the presence of a neural mechanism triggered by anticorrelated random-dot stereograms in the human brain with our coherency analysis and that it would not have been detected with the conventional spectral analysis due to the weakness of the response. We hypothesize that the decreased beta oscillations are related to either visual discomfort and visual attention to our stimulus, and that the increased alpha oscillations in the anticorrelated condition is a response to the incorrect depth information created by the stereogram.

Associations Between Binocular Depth Perception and Performance Gains in Laparoscopic Skill Acquisition

The ability to perceive differences in depth is important in many daily life situations. It is also of relevance in laparoscopic surgical procedures that require the extrapolation of three-dimensional visual information from two-dimensional planar images. Besides visual-motor coordination, laparoscopic skills and binocular depth perception are demanding visual tasks for which learning is important. This study explored potential relations between binocular depth perception and individual variations in performance gains during laparoscopic skill acquisition in medical students naïve of such procedures. Individual differences in perceptual learning of binocular depth discrimination when performing a random dot stereogram (RDS) task were measured as variations in the slope changes of the logistic disparity psychometric curves from the first to the last blocks of the experiment. The results showed that not only did the individuals differ in their depth discrimination; the extent with which this performance changed across blocks also differed substantially between individuals. Of note, individual differences in perceptual learning of depth discrimination are associated with performance gains from laparoscopic skill training, both with respect to movement speed and an efficiency score that considered both speed and precision. These results indicate that learning-related benefits for enhancing demanding visual processes are, in part, shared between these two tasks. Future studies that include a broader selection of task-varying monocular and binocular cues as well as visual-motor coordination are needed to further investigate potential mechanistic relations between depth perceptual learning and laparoscopic skill acquisition. A deeper understanding of these mechanisms would be important for applied research that aims at designing behavioral interventions for enhancing technology-assisted laparoscopic skills.

Optimal Approach for Signal Detection in Steady-State Visual Evoked Potentials in Humans Using Single-Channel EEG and Stereoscopic Stimuli

In EEG studies, one of the most common ways to detect a weak periodic signal in the steady-state visual evoked potential (SSVEP) is spectral evaluation, a process that detects peaks of power present at notable temporal frequencies. However, the presence of noise decreases the signal-to-noise ratio (SNR), which in turn lowers the probability of successful detection of these spectral peaks. In this paper, using a single EEG channel, we compare the detection performance of four different metrics to analyse the SSVEP: two metrics that use spectral power density, and two other metrics that use phase coherency. We employ these metrics find weak signals with a known temporal frequency hidden in the SSVEP, using both simulation and real data from a stereoscopic apparent depth movement perception task. We demonstrate that out of these metrics, the phase coherency analysis is the most sensitive way to find weak signals in the SSVEP, provided that the phase information of the stimulus eliciting the SSVEP is preserved.

The EEG Activity during Binocular Depth Perception of 2D Images

The central brain functions underlying a stereoscopic vision were a subject of numerous studies investigating the cortical activity during binocular perception of depth. However, the stereo vision is less explored as a function promoting the cognitive processes of the brain. In this work, we investigated a cortical activity during the cognitive task consisting of binocular viewing of a false image which is observed when the eyes are refocused out of the random-dot stereogram plane (3D phenomenon). The power of cortical activity before and after the onset of the false image perception was assessed using the scull EEG recording. We found that during stereo perception of the false image the power of alpha-band activity decreased in the left parietal area and bilaterally in frontal areas of the cortex, while activity in beta-1, beta-2, and delta frequency bands remained to be unchanged. We assume that this suppression of alpha rhythm is presumably associated with increased attention necessary for refocusing the eyes at the plane of the false image.

Vision improvement in pilots with presbyopia following perceptual learning

Israeli Air Force (IAF) pilots continue flying combat missions after the symptoms of natural near-vision deterioration, termed presbyopia, begin to be noticeable. Because modern pilots rely on the displays of the aircraft control and performance instruments, near visual acuity (VA) is essential in the cockpit. We aimed to apply a method previously shown to improve visual performance of presbyopes, and test whether presbyopic IAF pilots can overcome the limitation imposed by presbyopia. Participants were selected by the IAF aeromedical unit as having at least initial presbyopia and trained using a structured personalized perceptual learning method (GlassesOff application), based on detecting briefly presented low-contrast Gabor stimuli, under the conditions of spatial and temporal constraints, from a distance of 40 cm. Our results show that despite their initial visual advantage over age-matched peers, training resulted in robust improvements in various basic visual functions, including static and temporal VA, stereoacuity, spatial crowding, contrast sensitivity and contrast discrimination. Moreover, improvements generalized to higher-level tasks, such as sentence reading and aerial photography interpretation (specifically designed to reflect IAF pilots' expertise in analyzing noisy low-contrast input). In concert with earlier suggestions, gains in visual processing speed are plausible to account, at least partially, for the observed training-induced improvements.

Mechanisms of perceptual learning of depth discrimination in random dot stereograms

Perceptual learning is a training induced improvement in performance. Mechanisms underlying the perceptual learning of depth discrimination in dynamic random dot stereograms were examined by assessing stereothresholds as a function of decorrelation. The inflection point of the decorrelation function was defined as the level of decorrelation corresponding to 1.4 times the threshold when decorrelation is 0%. In general, stereothresholds increased with increasing decorrelation. Following training, stereothresholds and standard errors of measurement decreased systematically for all tested decorrelation values. Post training decorrelation functions were reduced by a multiplicative constant (approximately 5), exhibiting changes in stereothresholds without changes in the inflection points. Disparity energy model simulations indicate that a post-training reduction in neuronal noise can sufficiently account for the perceptual learning effects. In two subjects, learning effects were retained over a period of six months, which may have application for training stereo deficient subjects.

The Effect of Stimulation Frequency and Retinal Stimulus Location on Visual Evoked Potential Topography

The activity of cortical neurons is influenced by retinal stimulus location and temporal modulation. We investigated how reversal frequency of black-and-white checkerboard patterns presented in different parts of the visual field affects evoked potential topography. Visual evoked potentials were recorded from an array of 16 electrodes over the occipital cortex in 12 healthy adults. A checkerboard reversal stimulus (40' check size) was presented with frequencies between 1.95 reversals/s and 7.81 reversals/s in the center or in the left or right hemiretina. Evoked potential fields displayed the well-known components of pattern reversal evoked activity. Computation of FFT and wavelets displayed electrical brain responses directly related to stimulation frequency. Further analysis showed that both retinal stimulus location and stimulation frequency affected visual evoked activity. Field strength as well as scalp field topography changed significantly with different reversal frequency. In addition, the pattern of lateralization of components also depended on temporal frequency of stimulation. Electrical brain activity elicited by visual stimuli shows globally similar features which are modulated by stimulus location and frequency. Our results indicate that--at least partly--different neuronal assemblies are activated by stimuli of different temporal characteristics.

Neural correlates of monocular and binocular depth cues based on natural images: A LORETA analysis

Functional imaging studies investigating perception of depth rely solely on one type of depth cue based on non-natural stimulus material. To overcome these limitations and to provide a more realistic and complete set of depth cues natural stereoscopic images were used in this study. Using slow cortical potentials and source localization we aimed to identify the neural correlates of monocular and binocular depth cues. This study confirms and extends functional imaging studies, showing that natural images provide a good, reliable, and more realistic alternative to artificial stimuli, and demonstrates the possibility to separate the processing of different depth cues.

ERP topography and human perceptual learning in the peripheral visual field

We studied human perceptual learning in the peripheral visual field in 16 healthy adults. Horizontal or vertical vernier stimuli were presented simultaneously at 8 locations at an eccentricity of 4 degrees . One of the stimuli displayed an offset, and subjects were asked to detect the target offset. Training was performed with either vertical or horizontal stimuli by the repeated presentation of stimuli. Discrimination performance was also measured with the untrained stimuli. Before and after the psychophysical experiment, EEG was recorded from 30 electrodes over the occipital areas (between the inion and Cz) while targets were presented at all locations as vernier onset/offset stimuli. The EEG was averaged for each orientation separately. Improvement in discrimination performance was observed in about 70% of the subjects with the trained orientation only. The evoked potential maps displayed three components occurring between 80 and 160, 180 and 260, and 280 and 340 ms. The potential field topography of the first and third component showed significant differences before and after learning. In addition, field strength (global field power) of the second and third component increased with learning. No effects were seen with the untrained stimuli in the psychophysical and electrophysiological experiments. Our findings suggest that perceptual learning in the peripheral visual field is specifically related to neurophysiological changes induced by training, and it is not caused by unspecific changes of spatial attention. The changes of electrical brain activity reflect short-term plasticity related to human perceptual learning.

At what stage of neural processing do perspective depth cues make a difference?

The present study investigated the cortical processing of three-dimensional (3D) perspective cues in humans, to determine how the brain computes depth from a bidimensional retinal image. We recorded visual evoked potentials in 12 subjects in response to flat and in-perspective stimuli, which evoked biphasic potentials over posterior electrodes. The first, positive component (P1, at 90 ms) was not sensitive to perspective, while the second, negative peak (N1 at approximately 150 ms) was significantly larger for 3D stimuli, regardless of attention. The amplitude increase due to perspective was seen on all posterior electrodes, but was largest over the right hemisphere, particularly at parietal sites. Source modeling low-resolution electromagnetic tomography (LORETA) confirmed that among the different areas participating in two- and three-dimensional stimuli processing, the right parietal source is the most enhanced by perspective depth cues. We conclude that the extraction of depth from perspective cues occurs at a second level of stimulus processing, by increasing the activity of the regions involved in 2D stimuli processing, particularly in the right hemisphere, possibly through feedback loops from higher cortical areas. These modulations would participate in the fine-tuned analysis of the 3D features of stimuli.

Human central auditory plasticity associated with tone sequence learning

We investigated learning-related changes in amplitude, scalp topography, and source localization of the mismatch negativity (MMN), a neurophysiological response correlated with auditory discrimination ability. Participants (n = 32) underwent two EEG recordings while they watched silent films and ignored auditory stimuli. Stimuli were a standard (probability = 85%) and two deviant (probability = 7.5% each for high [HD] and low [LD]) eight-tone sequences that differed in the frequency of one tone. Between recordings, subjects practiced discriminating the HD or LD from the standard for 6 min. The amplitude of the LD MMN increased significantly across recordings in both groups, whereas the amplitude of the HD MMN did not. The LD was easier to discriminate than was the HD. Thus, practicing either discrimination increased the MMN for the easier discrimination. Learning and changes in the LD MMN amplitude were highly correlated. Source localizations of event-related potentials (ERPs) to all stimuli revealed bilateral sources in superior temporal regions. Compared with the standard ERP, the LD ERP revealed a stronger source in the left superior temporal region in both recordings, whereas the right-sided source became stronger after learning. Consistent with prior studies of auditory plasticity in animals and humans, tone sequence learning induced rapid neurophysiological plasticity in the human central auditory system. The results also suggest that there is asymmetric hemispheric involvement in tone sequence discrimination learning and that discrimination difficulty influences the time course of learning-related neurophysiological changes.

Stereoscopic visual evoked potentials in normal subjects and patients with open-angle glaucomas

PURPOSE

To evaluate stereoscopic visual evoked potentials (S-VEP) in normal controls and in patients with glaucomatous optic nerve damage.

METHODS

Computer-generated dynamic random-dot stereograms were used to elicit cortical visual evoked potentials using wireless electric liquid crystal shutter glasses. Normal subjects (n=22) and patients with glaucoma (n=22) were investigated using five different disparities from 9 to 40 arc min. Statistical dependency of measurements with different stimulus at identical patients was adjusted for.

RESULTS

Peak times of onset and offset response of S-VEP can be significantly delayed in glaucomas. A general linear regression model confirmed that differences between patients and normals depend on disparity. S-VEP onset shows no significant difference between controls and glaucomas at 9 arc min disparity. At high disparities, however, peak time of the onset response was significantly (p<0.01) delayed in glaucomas when compared with normals (normals: 125.8+/-13 ms, glaucomas: 148.2+/-25.6 ms at 40 arc min).

CONCLUSIONS

Visual evoked potential elicited by the onset of a random-dot stereogram can be used for objective measurement of stereoacuity in a clinical setting. Differences between controls and glaucomas in high and low disparities could indicate a stereo-specific deficit in glaucoma.

Human perceptual learning in the peripheral visual field: sensory thresholds and neurophysiological correlates

Perceptual learning in the peripheral visual field was studied in 24 adults using vernier targets. The aim was to relate perceptual improvements to changes of electrical brain activity. Thresholds were measured before, during, and after training, and on the next day. During training, the subjects passively looked at suprathreshold targets, and EEG activity was recorded from 30 electrodes over the occipital brain areas. Mean evoked potentials were computed for the first and second block of 1200 stimulus presentations, and the scalp topography of visual evoked potential (VEP) activity was analysed. Only for the stimulated area, training resulted initially in increased thresholds that, however, decreased significantly after consolidation. Electrical brain activity displayed smaller field strength and altered topography after training. Some of the effects were caused by habituation or adaptation to the training stimuli resulting in less efficient neurophysiological processing. The topographical changes indicate that different neuronal elements were activated after perceptual learning.

The processing of stereoscopic information in human visual cortex: psychophysical and electrophysiological evidence

Three-dimensional depth perception relies in part on the binocular fusion of horizontally disparate stimuli presented to the left and right eye. The mammalian visual system offers a unique possibility to study electrophysiologically cortical neuronal mechanisms: since the input of the two eyes remains separated up to the level of the visual cortex, evoked potential components that are generated exclusively by cortical structures may be explored when dynamic random-dot stereograms (dRDS) are presented. In a series of independent studies, we determined the scalp topography of dRDS evoked brain activity in different groups of healthy subjects, and we found consistent results. Major differences between stereoscopic and contrast evoked brain activity are seen in the strength of the potential fields as well as in their topography. Our findings suggest that there are fewer neurons in the human visual cortex that are responsive to horizontal disparity, and that higher visual areas like V2 are more engaged with stereoscopic processing than the primary visual cortex. On the other hand, component latencies of evoked brain activity show no effect signifying that the binocular information flow to the visual cortex has a similar time course for both the processing of contrast information and of dRDS stimuli. We could also verify that healthy subjects can learn to perceive 3D structure contained in dRDS. Changes in perceptual ability as measured with psychophysical tests are paralleled by systematic alterations in the topography of stereoscopically evoked potential fields. Stereoscopic VEP recordings may also be of clinical use: in patients with selectively disturbed depth perception but normal visual acuity there is a high correlation between clinical symptoms, perceptual deficiency, and altered VEP amplitudes and latencies.

Perceptual learning: psychophysical thresholds and electrical brain topography

We studied perceptual learning by determining psychophysical discrimination thresholds for visual hyper acuity targets (vernier stimuli) as a function of stimulus orientation. One aim was to relate perceptual improvements to changes of electrophysiological activity of the human brain. A group of 43 healthy adults participated in a psychophysical experiment where vernier thresholds for vertical and horizontal vernier targets were compared. In 16 subjects thresholds were measured for each orientation twice at an interval of 25 min. Between threshold estimations, evoked brain activity was recorded from 30 electrodes over the occipital brain areas while the subjects observed appearance and disappearance of supra-threshold vernier offsets. Mean evoked potentials were computed for the first and second 600 stimulus presentations, and the scalp topography of electrical brain activity was analyzed. Vertically oriented stimuli yielded significantly better performance than horizontal targets, and thresholds were significantly lower in the second half of the experiment, i.e. after prolonged viewing of stimuli. The improvements in discrimination performance were specific for stimulus orientation and did not generalize. Learning effects were also observed with electrical brain activity, and field strength of the potentials increased significantly as a function of time. Scalp topography of the evoked components was significantly affected indicating a shift of activation between different neuronal elements induced by perceptual learning.

Neural representation of consciously imperceptible speech sound differences

The concept of subliminal perception has been a subject of interest and controversy for decades. Of interest in the present investigation was whether a neurophysiologic index of stimulus change could be elicited to speech sound contrasts that were consciously indiscriminable. The stimuli were chosen on the basis of each individual subject's discrimination threshold. The speech stimuli (which varied along an F3 onset frequency continuum from /da/ to /ga/) were synthesized so that the acoustical properties of the stimuli could be tightly controlled. Subthreshold and suprathreshold stimuli were chosen on the basis of behavioral ability demonstrated during psychophysical testing. A significant neural representation of stimulus change, reflected by the mismatch negativity response, was obtained in all but 1 subject in response to subthreshold stimuli. Grand average responses differed significantly from responses obtained in a control condition consisting of physiologic responses elicited by physically identical stimuli. Furthermore, responses to suprathreshold stimuli (close to threshold) did not differ significantly from subthreshold responses with respect to latency, amplitude, or area. These results suggest that neural representation of consciously imperceptible stimulus differences occurs and that this representation occurs at a preattentive level.

Associative learning in humans--conditioning of sensory-evoked brain activity

A classical conditioning paradigm was employed in two experiments performed on 35 human volunteers. In nine subjects, the presentation of Landolt rings (conditioned stimuli, CS + ) was paired with an electric stimulus (unconditioned stimuli, UCS) applied to the left median nerve. Neutral visual control stimuli were full circles (CS -) that were not paired with the UCS. The skin conductance response (SCR) was determined in a time interval of 5 s after onset of the visual stimuli, and it was measured in the acquisition and test phase. Associative learning was reflected by a SCR occurring selectively with CS +. The same experiment was repeated with another group of 26 adults while electroencephalogram (EEG) was recorded from 30 electrodes. For each subject, mean evoked potentials were computed. In 13 of the subjects, a conditioning paradigm was followed while the other subjects served as the control group (non-contingent stimulation). There were somatosensory and visual brain activity evoked by the stimuli. Conditioned components were identified by computing cross-correlation between evoked somatosensory components and the averaged EEG. In the visual evoked brain activity, three components with mean latencies of 105.4, 183.2, and 360.3 ms were analyzed. Somatosensory stimuli were followed by major components that occurred at mean latencies of 48.8, 132.5, 219.7, 294.8, and 374.2 ms latency after the shock. All components were analyzed in terms of latency, field strength, and topographic characteristics, and were compared between groups and experimental conditions. Both visual and somatosensory brain activity was significantly affected by classical conditioning. Our data illustrate how associative learning affects the topography of brain electrical activity elicited by presentation of conditioned visual stimuli.