Functional MRI of self-controlled stereoscopic depth perception

The effect of immersive virtual reality on proximal and conditioned threat

Virtual reality lets the user be immersed in a 3-dimensional environment, which can enhance certain emotional responses to stimuli relative to experiencing them on a flat computer screen. We here tested whether displaying two different types of threats in immersive virtual reality enhanced threat related autonomic responses measured by skin conductance responses (SCRs). We studied innate and learned threat responses because these types of threats have been shown to depend on different neural circuits in animals. Therefore, it is possible that immersive virtual reality may modulate one of these threats but not the other. Innate threat responses were provoked by the sudden appearance of characters at proximal egocentric distance, which were compared to the sudden appearance of distant characters (proximal threat). Learned threat responses were studied by conditioning two of the characters to an electric shock (conditioned threat) and contrasting SCRs to these characters with SCRs to two other characters that were never paired with shock. We found that displaying stimuli in immersive virtual reality enhanced proximal threat responses but not conditioned threat responses. Findings show that immersive virtual reality can enhance an innate type of threat responses without affecting a learned threat response, suggesting that separate neural pathways serve these threat responses.

Using Functional Near Infrared Spectroscopy (fNIRS) to Study Dynamic Stereoscopic Depth Perception

The parietal cortex has been widely implicated in the processing of depth perception by many neuroimaging studies, yet functional near infrared spectroscopy (fNIRS) has been an under-utilised tool to examine the relationship of oxy- ([HbO]) and de-oxyhaemoglobin ([HbR]) in perception. Here we examine the haemodynamic response (HDR) to the processing of induced depth stimulation using dynamic random-dot-stereograms (RDS). We used fNIRS to measure the HDR associated with depth perception in healthy young adults (n = 13, mean age 24). Using a blocked design, absolute values of [HbO] and [HbR] were recorded across parieto-occipital and occipital cortices, in response to dynamic RDS. Control and test images were identical except for the horizontal shift in pixels in the RDS that resulted in binocular disparity and induced the percept of a 3D sine wave that ‘popped out’ of the test stimulus. The control stimulus had zero disparity and induced a ‘flat’ percept. All participants had stereoacuity within normal clinical limits and successfully perceived the depth in the dynamic RDS. Results showed a significant effect of this complex visual stimulation in the right parieto-occipital cortex (p < 0.01, η² = 0.54). The test stimulus elicited a significant increase in [HbO] during depth perception compared to the control image (p < 0.001, 99.99 % CI [0.008–0.294]). The similarity between the two stimuli may have resulted in the HDR of the occipital cortex showing no significant increase or decrease of cerebral oxygenation levels during depth stimulation. Cerebral oxygenation measures of [HbO] confirmed the strong association of the right parieto-occipital cortex with processing depth perception. Our study demonstrates the validity of fNIRS to investigate [HbO] and [HbR] during high-level visual processing of complex stimuli.

The role of the posterior parietal cortex in stereopsis and hand-eye coordination during motor task behaviours

The field of 'Neuroergonomics' has the potential to improve safety in high-risk operative environments through a better appreciation of the way in which the brain responds during human-tool interactions. This is especially relevant to minimally invasive surgery (MIS). Amongst the many challenges imposed on the surgeon by traditional MIS (laparoscopy), arguably the greatest is the loss of depth perception. Robotic MIS platforms, on the other hand, provide the surgeon with a magnified three-dimensional view of the environment, and as a result may offload a degree of the cognitive burden. The posterior parietal cortex (PPC) plays an integral role in human depth perception. Therefore, it can be hypothesized that differences in PPC activation between monoscopic and stereoscopic vision may be observed. In order to investigate this hypothesis, the current study explores disparities in PPC responses between monoscopic and stereoscopic visual perception to better de-couple the burden imposed by laparoscopy and robotic surgery on the operator's brain. Fourteen participants conducted tasks of depth perception and hand-eye coordination under both monoscopic and stereoscopic visual feedback. Cortical haemodynamic responses were monitored throughout using optical functional neuroimaging. Overall, recruitment of the bilateral superior parietal lobule was observed during both depth perception and hand-eye coordination tasks. This occurred contrary to our hypothesis, regardless of the mode of visual feedback. Operator technical performance was significantly different in two- and three-dimensional visual displays. These differences in technical performance do not appear to be explained by significant differences in parietal lobe processing.

Sensitivity of human visual cortical area V6 to stereoscopic depth gradients associated with self-motion

The principal visual cue to self-motion (egomotion) is optic flow, which is specified in terms of local 2D velocities in the retinal image without reference to depth cues. However, in general, points near the center of expansion of natural flow fields are distant, whereas those in the periphery are closer, creating gradients of horizontal binocular disparity. To assess whether the brain combines disparity gradients with optic flow when encoding egomotion, stereoscopic gradients were applied to expanding dot patterns presented to observers during functional MRI scanning. The gradients were radially symmetrical, disparity changing as a function of eccentricity. The depth cues were either consistent with egomotion (peripheral dots perceived as near and central dots perceived as far) or inconsistent (the reverse gradient, central dots near, peripheral dots far). The BOLD activity generated by these stimuli was compared in a range of predefined visual regions in 13 participants with good stereoacuity. Visual area V6, in the parieto-occipital sulcus, showed a unique pattern of results, responding well to all optic flow patterns but much more strongly when they were paired with consistent rather than inconsistent or zero-disparity gradients. Of the other areas examined, a region of the precuneus and parietoinsular vestibular cortex also differentiate between consistent and inconsistent gradients, but with weak or suppressive responses. V3A, V7, MT, and ventral intraparietal area responded more strongly in the presence of a depth gradient but were indifferent to its depth-flow congruence. The results suggest that depth and flow cues are integrated in V6 to improve estimation of egomotion.

Methods for dichoptic stimulus presentation in functional magnetic resonance imaging - a review

Dichoptic stimuli (different stimuli displayed to each eye) are increasingly being used in functional brain imaging experiments using visual stimulation. These studies include investigation into binocular rivalry, interocular information transfer, three-dimensional depth perception as well as impairments of the visual system like amblyopia and stereodeficiency. In this paper, we review various approaches of displaying dichoptic stimulus used in functional magnetic resonance imaging experiments. These include traditional approaches of using filters (red-green, red-blue, polarizing) with optical assemblies as well as newer approaches of using bi-screen goggles.

Symmetry versus repetition in cyclopean vision: A microgenetic analysis

In four experiments, participants had to detect symmetries or repetitions distributed over two depth planes, under presentation times of 200-1000 ms. Structurally corresponding elements were placed in different planes (Experiments 1a and 1b) or in the same plane (Experiments 2a and 2b). Results suggest (a) an ongoing interaction between regularity cues and depth cues, and (b) that efficient detection of symmetry but not of repetition depends on structural correspondences within depth planes. The latter confirms the idea that, to perceptual organization, symmetry is a cue for the presence of one object, whereas repetition is a cue for the presence of multiple objects.

The specificity of cortical region KO to depth structure

Functional MRI studies have identified a cortical region designated as KO between retinotopic areas V3A/B and motion area V5 in human cortex as particularly responsive to motion-defined or kinetic borders. To determine the response of the KO region to more general aspects of structure, we used stereoscopic depth borders and disparate planes with no borders, together with three stimulus types that evoked no depth percept: luminance borders, line contours and illusory phase borders. Responses to these stimuli in the KO region were compared with the responses in retinotopically defined areas that have been variously associated with disparity processing in neurophysiological and fMRI studies. The strongest responses in the KO region were to stimuli evoking perceived depth structure from either disparity or motion cues, but it showed negligible responses either to luminance-based contour stimuli or to edgeless disparity stimuli. We conclude that the region designated as KO is best regarded as a primary center for the generic representation of depth structure rather than any kind of contour specificity.

Is the human primary motor cortex involved in motor imagery?

Participation of the primary motor cortex (M1) in motor imagery was addressed using functional magnetic resonance imaging at 2.0 T and 2 x 2 x 4 mm3 resolution in six right-handed subjects. Paradigms comprised visually cued execution and imagination of a sequential finger-to-thumb opposition task (12 s) contrasted with motor rest and visual imagery (18 s), respectively. Motor execution activated M1 as well as other parts of the motor system including supplementary motor area (SMA) and premotor areas (PM). In contrast, motor imagery did not lead to activations in M1 except for 1/6 subjects but involved SMA and PM bilaterally as well as the anterior intraparietal cortex. Moreover, a region-of-interest analysis revealed a weak initial MRI signal increase in M1 in 4/6 subjects. This novel finding of a transient response reflecting the onset of imagination which does not lead to sustained M1 activation may explain previous contradictory reports.

Representation of stereoscopic structure in human and monkey cortex

Tsao et al. have recently used functional magnetic resonance imaging to compare processing for moving stereoscopic forms in macaque and human brains. Most humans exhibited activation in a swath of lateral occipital areas, extending into the intraparietal sulcus, with a limited version of the same pattern in monkeys. However, neither species showed strong activation of the motion area known as MT in monkey or its human homolog.