Visual persistence of stereoscopic stimuli: electric brain activity without perceptual correlate

Three Dimensional Video Imaging for Endoscopic Sinus Surgery and Diagnosis

Technological advances in video imaging over the last decade have resulted in remarkable additions to the armamentarium of instrumentation for the otolaryngologist. The use of video cameras and computer generated imaging in the operating room and office is invaluable for documentation and teaching purposes. Despite the obvious advantages of these systems, problems are evident, the most serious of which include image distortion and inability to judge depth of field. For more than 6 decades 3D imaging has been neither technically nor commercially successful. Reasons include alignment difficulties and image distortion. The result is “visual fatigue,” usually in about 15 minutes. At its extreme, this may be characterized by headache, nausea, and even vomiting. In this study, we employed the first 3D video imager to electronically manipulate a single video source to produce 3D images; therefore, neither alignment nor image distortions were produced. Of interest to the clinical surgeon, “visual fatigue” does not seem to occur; however, with prolonged procedures (greater than 2 hours) there exists the potential for physical intolerance for some individuals. This is the first unit that is compatible with any rigid or flexible videoendoscopic system and the small diameter endoscopes available for endoscopic sinus surgery. Moreover, prerecorded 2D tapes may be viewed in 3D on an existing VCR. The 3D image seems to provide enhanced anatomic awareness with less image distortion. We have found this system to be optically superior to the 2D video imagers currently available.

The Effect of Stimulation Frequency and Retinal Stimulus Location on Visual Evoked Potential Topography

The activity of cortical neurons is influenced by retinal stimulus location and temporal modulation. We investigated how reversal frequency of black-and-white checkerboard patterns presented in different parts of the visual field affects evoked potential topography. Visual evoked potentials were recorded from an array of 16 electrodes over the occipital cortex in 12 healthy adults. A checkerboard reversal stimulus (40' check size) was presented with frequencies between 1.95 reversals/s and 7.81 reversals/s in the center or in the left or right hemiretina. Evoked potential fields displayed the well-known components of pattern reversal evoked activity. Computation of FFT and wavelets displayed electrical brain responses directly related to stimulation frequency. Further analysis showed that both retinal stimulus location and stimulation frequency affected visual evoked activity. Field strength as well as scalp field topography changed significantly with different reversal frequency. In addition, the pattern of lateralization of components also depended on temporal frequency of stimulation. Electrical brain activity elicited by visual stimuli shows globally similar features which are modulated by stimulus location and frequency. Our results indicate that--at least partly--different neuronal assemblies are activated by stimuli of different temporal characteristics.

fMRI reveals a preference for near viewing in the human parieto-occipital cortex

Posterior parietal cortex in primates contains several functional areas associated with visual control of body effectors (e.g., arm, hand and head) which contain neurons tuned to specific depth ranges appropriate for the effector. For example, the macaque ventral intraparietal area (VIP) is involved in head movements and is selective for motion in near-space around the head. We used functional magnetic resonance imaging to examine activation in the putative human VIP homologue (pVIP), as well as parietal and occipital cortex, as a function of viewing distance when multiple cues to target depth were available (Expt 1) and when only oculomotor cues were available (Expt 2). In Experiment 1, subjects viewed stationary or moving disks presented at three distances (with equal retinal sizes). Although activation in pVIP showed no preference for any particular spatial range, the dorsal parieto-occipital sulcus (dPOS) demonstrated a near-space preference, with activation highest for near viewing, moderate for arm's length viewing, and lowest for far viewing. In Experiment 2, we investigated whether the near response alone (convergence of the eyes, accommodation of the lens and pupillary constriction) was sufficient to elicit this same activation pattern. Subjects fixated lights presented at three distances which were illuminated singly (with luminance and visual angle equated across distances). dPOS displayed the same gradient of activation (Near>Medium>Far) as that seen in Experiment 1, even with reduced cues to depth. dPOS seems to reflect the status of the near response (perhaps driven largely by vergence angle) and may provide areas in the dorsal visual stream with spatial information useful for guiding actions toward targets in depth.

The effects of ageing on stereopsis. A VEP study

Differences in brain activation between young (n = 11, ages 21-35) and elderly (n = 8, ages 70-84) healthy participants were studied using visual evoked potentials (VEPs) to different kinds of computer generated random-dot patterns. The main stimulus of interest was a 2 x 2 array of rectangles whose rectangles moved to and fro in depth. Control conditions were similar 2 x 2 arrays, one with side-to-side lateral motion (LM) of the rectangles, and one a stationary baseline condition. The third non-stereo stimulus was an expanding field of small dots in radial motion (RM). Significant stereo related activation was found in both age groups. The stereo VEPs showed a longer latency of depth reversal triggered VEP peaks compared to control LM VEPs. The amplitudes of LM VEPs were larger than the baseline VEPs. Age-related differences were found not only in stereo but also in the other conditions. Thus the latency of early VEP peaks was shorter and their amplitude higher in the elderly for LM and baseline conditions, and the younger participants showed significantly higher activation in the later VEP peaks of all conditions. Our main finding is no evidence for age related stereo specific effects in brain activation, but instead more general and subtle changes that affect widely different visual stimulus conditions.

Stereoscopic visual evoked potentials in normal subjects and patients with open-angle glaucomas

PURPOSE

To evaluate stereoscopic visual evoked potentials (S-VEP) in normal controls and in patients with glaucomatous optic nerve damage.

METHODS

Computer-generated dynamic random-dot stereograms were used to elicit cortical visual evoked potentials using wireless electric liquid crystal shutter glasses. Normal subjects (n=22) and patients with glaucoma (n=22) were investigated using five different disparities from 9 to 40 arc min. Statistical dependency of measurements with different stimulus at identical patients was adjusted for.

RESULTS

Peak times of onset and offset response of S-VEP can be significantly delayed in glaucomas. A general linear regression model confirmed that differences between patients and normals depend on disparity. S-VEP onset shows no significant difference between controls and glaucomas at 9 arc min disparity. At high disparities, however, peak time of the onset response was significantly (p<0.01) delayed in glaucomas when compared with normals (normals: 125.8+/-13 ms, glaucomas: 148.2+/-25.6 ms at 40 arc min).

CONCLUSIONS

Visual evoked potential elicited by the onset of a random-dot stereogram can be used for objective measurement of stereoacuity in a clinical setting. Differences between controls and glaucomas in high and low disparities could indicate a stereo-specific deficit in glaucoma.

The processing of stereoscopic information in human visual cortex: psychophysical and electrophysiological evidence

Three-dimensional depth perception relies in part on the binocular fusion of horizontally disparate stimuli presented to the left and right eye. The mammalian visual system offers a unique possibility to study electrophysiologically cortical neuronal mechanisms: since the input of the two eyes remains separated up to the level of the visual cortex, evoked potential components that are generated exclusively by cortical structures may be explored when dynamic random-dot stereograms (dRDS) are presented. In a series of independent studies, we determined the scalp topography of dRDS evoked brain activity in different groups of healthy subjects, and we found consistent results. Major differences between stereoscopic and contrast evoked brain activity are seen in the strength of the potential fields as well as in their topography. Our findings suggest that there are fewer neurons in the human visual cortex that are responsive to horizontal disparity, and that higher visual areas like V2 are more engaged with stereoscopic processing than the primary visual cortex. On the other hand, component latencies of evoked brain activity show no effect signifying that the binocular information flow to the visual cortex has a similar time course for both the processing of contrast information and of dRDS stimuli. We could also verify that healthy subjects can learn to perceive 3D structure contained in dRDS. Changes in perceptual ability as measured with psychophysical tests are paralleled by systematic alterations in the topography of stereoscopically evoked potential fields. Stereoscopic VEP recordings may also be of clinical use: in patients with selectively disturbed depth perception but normal visual acuity there is a high correlation between clinical symptoms, perceptual deficiency, and altered VEP amplitudes and latencies.

Electroencephalographic cortical oscillations and saccadic eye movements in humans

A model predicting different types of saccades has suggested that the presence of rhythmic brain activity determines whether a subject will produce regular or express saccades. We studied cortical oscillations preceding saccadic eye movements. Brain electrical activity was recorded in nine healthy adults continuously from 30 electrodes while subjects performed saccades. In a so-called gap condition multimodal latency distributions resulted. Express saccades were preceded by different oscillatory activity than regular saccades. This was a highly significant finding restricted to the alpha and beta bands of the EEG. Step-wise discriminant analysis showed that cortical oscillations measured from only few electrode sites allowed to predict reliably which type of saccade a subject will make. These findings support the notion that stimulus-induced oscillations of the human EEG may modulate thresholds for triggering saccades.

Learning to see 3-D: psychophysics and brain electrical activity

We investigated human perceptual learning with stereoscopic stimuli presented below threshold. Different visual patterns were shown as dynamic random dot stereograms in a forced-choice design in order to determine the psychophysical thresholds of 16 adults. Brain electrical activity was recorded from 30 electrodes over parieto-occipital areas while stereograms were presented with horizontal disparities below threshold. During the observation of sub-threshold stimuli, we tested repeatedly whether implicit perceptual learning occurred. More than half of the subjects learned to see stereoscopic targets. This was accompanied by topographic changes in the pattern of activation of neural assemblies in the visual cortex where the center of activity shifted towards the right hemisphere. Subjects who did not improve in perception, displayed no such effects.

Depth perception and evoked brain activity: the influence of horizontal disparity and visual field location

The perception of dynamic random-dot stereograms (RDS) depends on the physiological fusion of horizontally disparate binocular visual input. Thus, the use of RDS offers the possibility to study selectively cortical processing of visual information in man. We investigated the influence of horizontal disparity on the scalp topography of RDS evoked brain activity in 33 healthy subjects. Stereoscopic checkerboard patterns were presented in the center or lateralized in the left or right visual field with horizontal disparities changing at temporal frequencies of six or eight depth reversals/s using different disparity values ranging from 3.5 to 28 min of arc. In 11 subjects evoked potential fields were recorded from 16 electrodes, and 21 subjects participated in 30-channel recordings with electrodes located over the parietal and occipital brain areas. Stimulation frequency-related brain activity was obtained with all disparity values; however, with large or small disparities the potential field strength decreased significantly while largest responses were obtained with intermediate disparities. Significant differences were observed in RDS evoked brain activity when central and lateralized stimulus locations were compared. With lateral stimuli (extending from the fovea to 17.1-deg eccentricity) maximal amplitudes were obtained at larger disparities than with central stimuli. In addition there were pronounced differences between brain activity evoked with stimuli presented in the left or right visual field; however, there were very similar evoked potential signals recorded from electrodes located over the left and right hemispheres. Our findings indicate that the processing of disparity information with lateralized stimuli is different from the processing in the center of the visual field. In addition, lateralized stimulation yields a significant disparity tuning mainly with stereoscopic targets occurring to the right from the fixation point (but not with stimuli to the left) suggesting a functional difference between the visual half-fields.

The perception of temporal structure and auditory evoked brain activity

The processing and perception of auditory signals depends on the temporal structure of stimulus characteristics. We studied 26 healthy subjects who participated in psychophysical experiments and in electrophysiological recordings of auditory evoked potentials from C2, C3, C4, T3 and T4. Stimuli consisted of tone series presented binaurally as tones or gaps with a base duration of 100 ms. In the psychophysical experiments, difference thresholds as indicators of temporal discrimination performance were significantly lower for tones than for gaps. In the electrophysiological recordings, gaps often failed to elicit N100 components. Tones produced shortest component latencies with largest amplitudes. In addition, brain activity was strongest at C2, and showed a symmetrical fall-off over both hemispheres. N100 components had significantly longer latencies and smaller amplitudes when they were evoked by the end of the gap (i.e. with the continuation of the tone) than by tones. Our data illustrate how the temporal structure of auditory stimuli affects neuronal responses of the brain. Similar effects were observed in psychophysical and electrophysiological experiments, and we were able to demonstrate a direct relationship between subjective sensory thresholds and auditory evoked brain activity.

Electrophysiological correlates of texture segregation in the human visual evoked potential

We investigated whether the visual evoked potential (VEP) reflects cortical processing associated with preattentive texture segregation. On a visual display unit we presented stimuli with various arrangements of oriented line segments that either led to the appearance of a "preattentive" checkerboard or did not. Two presentation modes were used (pattern onset at 1 Hz and rapid pattern change at 4.3 Hz), while luminance (57 cd/m2) and contrast (92%) of the line segments remained constant. VEPs were recorded in 7 human subjects. The VEP was analyzed as a linear combination of putative components, which are evoked by either local pattern, quasi-local orientation contrast or global preattentive structure. In the transient VEP, we found a negativity over the posterior pole at a latency between 161 and 225 msec (FWHM) in the linear combination designed to extract segregation-specific components. Peak amplitude reached 3.1 +/- 0.8 microV (mean +/- SEM) at 199 msec. This negative peak appeared only for textures containing orientation contrast. Steady-state analysis of the rapid presentation also revealed a significant component (P = 0.002) associated with texture segregation. These potentials either represent processing of orientation contrast or global processing of texture segregation. The results suggest that specific surface potentials, differing from cognitive potentials, can be derived which are associated with preattentive processing.

42-channel potential map series to visual contrast and stereo stimuli: perceptual and cognitive event-related segments

Event-related potential maps to perceptual (stimulus type) and cognitive (stimulus relevance) manipulations were studied in 12 healthy volunteers using 42-channel mapping. Perceptual manipulation used three types of visual stimuli: rectangles constituted by: (1) contrast; (2) different densities of monocular Dynamic Random Dots (Flat DRD); and (3) different binocular disparities of Dynamic Random Dots (Stereo DRD). Cognitive manipulation within each stimulus type consisted of presenting the rectangles horizontally and vertically, one of the two with a probability of 33%, and requesting the subjects to count and thus attend to the 'rare' rectangles. Spatial characteristics of the maps were analyzed; this allowed conclusions about the generating sources. The map series were adaptively segmented using the minima points of the grand mean Global Field Power curve. Segment strength (Global Field Power) and segment landscape (locations of extreme potentials) were assessed. Stimulus type had effects from 78 to 310 ms, stimulus relevance was effective from 210 to 1000 ms. In the 78-174 ms segment, Stereo DRD and Flat DRD stimuli produced similar map landscapes, while contrast stimuli produced different map landscapes. Attended and ignored stimuli produced contrary effects on landscapes at 210-310 ms as compared to those at 310-546 ms, indicative of different neural populations activated by attention processes during these late event-related potential segments. Interaction between perceptual and cognitive manipulation occurred at 210-310 ms when perceiving stereo stimuli and attending to relevant monocular visible stimuli produced similar map landscapes, suggesting a common brain resource during this segment for automatic figure perception and voluntary attention. The observed functional differences of the segments contribute to the identification of global functional microstates of brain electric activity.

Contrast and stereoscopic visual stimuli yield lateralized scalp potential fields associated with different neural generators

The use of dynamic random-dot stereograms (RDS) allows to investigate evoked potential components generated exclusively by cortical structures. We analyzed the scalp distribution of stereoscopically evoked or contrast evoked potential field by recording electrical brain activity in 20 channels simultaneously from an electrode array covering the occipital scalp areas. Evoked brain activity was obtained from 13 healthy adults with dynamic RDS stimuli presented as a stereoscopic checkerboard pattern in the center, or in the right or left visual half-field. Such stereoscopically evoked scalp potential distributions were compared to those elicited by a conventional 2-dimensional checkerboard reversal stimulus of the same mean luminance and retinal extent. We found that the latencies of the major evoked components were similar for contrast and stereoscopic stimuli, while significant differences were observed when we compared the strength of the evoked potential fields or the topographical pattern elicited by lateralized stereoscopic and contrast stimuli. The functional relation of evoked electrical brain activity to the retinal stimulus location was significantly different for stereoscopic and contrast stimuli. We present evidence that stereoscopic perception relies on the activation of cortical structures in the human visual system that are different from those activated by comparable contrast stimuli, supporting the conclusions derived from our earlier electrophysiological experiments on stereoscopic vision. These data on the physiological correlates of processing of stereoscopic information in humans are in line with the results obtained with single neuron recordings from the cat and monkey visual cortex.

Cortical and retinal refractory periods in the human visual system

Refractory periods of the visual system were investigated in 12 healthy subjects by simultaneously recording retinal (ERG) and cortical (VEP) evoked electrical activity. Double-flash stimuli were presented at different interstimulus intervals, and response components evoked by the second flash were analyzed in detail, and related to psychophysical detection thresholds. With short interstimulus intervals ERG b-wave peak latencies were increased and b-wave amplitudes were significantly reduced, while P100 component latencies of the VEP were significantly influenced only at long interstimulus intervals. Regression analysis of the individual data as well as analysis of the retinocortical transmission times showed that the cortical latency changes were not simply caused by changes on the level of the retina. Additional influences of the interstimulus interval on nonretinal structures of the human visual system must be assumed. The subjective psychophysical detection thresholds were significantly higher than the threshold values at which reliable electrical or cortical response components could be elicited.