Visual perception of motion and 3-D structure from motion: an fMRI study

Development of human visual cortical function: A scoping review of task- and naturalistic-fMRI studies through the interactive specialization and maturational frameworks

Overarching theories such as the interactive specialization and maturational frameworks have been proposed to describe human functional brain development. However, these frameworks have not yet been systematically examined across the fMRI literature. Visual processing is one of the most well-studied fields in neuroimaging, and research in this area has recently expanded to include naturalistic paradigms that facilitate study in younger age ranges, allowing for an in-depth critical appraisal of these frameworks across childhood. To this end, we conducted a scoping review of 94 developmental visual fMRI studies, including both traditional experimental task and naturalistic studies, across multiple sub-domains (early visual processing, category-specific higher order processing, naturalistic visual processing). We found that across domains, many studies reported progressive development, but few studies describe regressive or emergent changes necessary to fit the maturational or interactive specialization frameworks. Our findings suggest a need for the expansion of developmental frameworks and clearer reporting of both progressive and regressive changes, along with well-powered, longitudinal studies.

Hands off, brain off? A meta-analysis of neuroimaging data during active and passive driving

BACKGROUND

Car driving is more and more automated, to such an extent that driving without active steering control is becoming a reality. Although active driving requires the use of visual information to guide actions (i.e., steering the vehicle), passive driving only requires looking at the driving scene without any need to act (i.e., the human is passively driven).

MATERIALS & METHODS

After a careful search of the scientific literature, 11 different studies, providing 17 contrasts, were used to run a comprehensive meta-analysis contrasting active driving with passive driving.

RESULTS

Two brain regions were recruited more consistently for active driving compared to passive driving, the left precentral gyrus (BA3 and BA4) and the left postcentral gyrus (BA4 and BA3/40), whereas a set of brain regions was recruited more consistently in passive driving compared to active driving: the left middle frontal gyrus (BA6), the right anterior lobe and the left posterior lobe of the cerebellum, the right sub-lobar thalamus, the right anterior prefrontal cortex (BA10), the right inferior occipital gyrus (BA17/18/19), the right inferior temporal gyrus (BA37), and the left cuneus (BA17).

DISCUSSION

From a theoretical perspective, these findings support the idea that the output requirement of the visual scanning process engaged for the same activity can trigger different cerebral pathways, associated with different cognitive processes. A dorsal stream dominance was found during active driving, whereas a ventral stream dominance was obtained during passive driving. From a practical perspective, and contrary to the dominant position in the Human Factors community, our findings support the idea that a transition from passive to active driving would remain challenging as passive and active driving engage distinct neural networks.

Reduced 2D form coherence and 3D structure from motion sensitivity in developmental dyscalculia

Developmental dyscalculia (DD) is a specific learning disability affecting the development of numerical and arithmetical skills. The origin of DD is typically attributed to the suboptimal functioning of key regions within the dorsal visual stream (parietal cortex) which support numerical cognition. While DD individuals are often impaired in visual numerosity perception, the extent to which they also show a wider range of visual dysfunctions is poorly documented. In the current study we measured sensitivity to global motion (translational and flow), 2D static form (Glass patterns) and 3D structure from motion in adults with DD and control subjects. While sensitivity to global motion was comparable across groups, thresholds for static form and structure from motion were higher in the DD compared to the control group, irrespective of associated reading impairments. Glass pattern sensitivity predicted numerical abilities, and this relation could not be explained by recently reported differences in visual crowding. Since global form sensitivity has often been considered an index of ventral stream function, our findings could indicate a cortical dysfunction extending beyond the dorsal visual stream. Alternatively, they would fit with a role of parietal cortex in form perception under challenging conditions requiring multiple element integration.

Intracranial Recordings Reveal Unique Shape and Timing of Responses in Human Visual Cortex during Illusory Visual Events

During binocular rivalry, perception spontaneously changes without any alteration to the visual stimulus. What neural events bring about this illusion that a constant stimulus is changing? We recorded from intracranial electrodes placed on the occipital and posterior temporal cortex of two patients with epilepsy while they experienced illusory changes of a face-house binocular-rivalry stimulus or observed a control stimulus that physically changed. We performed within-patient comparisons of broadband high-frequency responses, focusing on single epochs recorded along the ventral processing stream. We found transient face- and house-selective responses localized to the same electrodes for illusory and physical changes, but the temporal characteristics of these responses markedly differed. In comparison with physical changes, responses to illusory changes were longer lasting, in particular exhibiting a characteristic slow rise. Furthermore, the temporal order of responses across the visual hierarchy was reversed for illusory as compared to physical changes: for illusory changes, higher order fusiform and parahippocampal regions responded before lower order occipital regions. Our tentative interpretation of these findings is that two stages underlie the initiation of illusory changes: a destabilization stage in which activity associated with the impending change gradually accumulates across the visual hierarchy, ultimately graduating in a top-down cascade of activity that may stabilize the new perceptual interpretation of the stimulus.

Dissociated modulations of multivoxel activation patterns in the ventral and dorsal visual pathways by the temporal dynamics of stimuli

INTRODUCTION

Previous studies suggested temporal limitations of visual object identification in the ventral pathway. Moreover, multivoxel pattern analyses (MVPA) of fMRI activation have shown reliable encoding of various object categories including faces and tools in the ventral pathway. By contrast, the dorsal pathway is involved in reaching a target and grasping a tool, and quicker in processing the temporal dynamics of stimulus change. However, little is known about how activation patterns in both pathways may change according to the temporal dynamics of stimulus change.

METHODS

Here, we measured fMRI responses of two consecutive stimuli with varying interstimulus intervals (ISIs), and we compared how the two visual pathways respond to the dynamics of stimuli by using MVPA and information-based searchlight mapping.

RESULTS

We found that the temporal dynamics of stimuli modulate responses of the two visual pathways in opposite directions. Specifically, slower temporal dynamics (longer ISIs) led to greater activity and better MVPA results in the ventral pathway. However, faster temporal dynamics (shorter ISIs) led to greater activity and better MVPA results in the dorsal pathway.

CONCLUSIONS

These results are the first to show how temporal dynamics of stimulus change modulated multivoxel fMRI activation pattern change. And such temporal dynamic response function in different ROIs along the two visual pathways may shed lights on understanding functional relationship and organization of these ROIs.

Generalized Representation of Stereoscopic Surface Shape and Orientation in the Human Visual Cortex

The brain's ability to extract three-dimensional (3D) shape and orientation information from viewed objects is vital in daily life. Stereoscopic 3D surface perception relies on binocular disparity. Neurons selective to binocular disparity are widely distributed among visual areas, but the manner in these areas are involved in stereoscopic 3D surface representation is unclear. To address this, participants were instructed to observe random dot stereograms (RDS) depicting convex and concave curved surfaces and the blood oxygenation level-dependent (BOLD) signal of visual cortices was recorded. Two surface types were: (i) horizontally positioned surfaces defined by shear disparity; and (ii) vertically positioned surfaces defined by compression disparity. The surfaces were presented at different depth positions per trial. Functional magnetic resonance imaging (fMRI) data were classified from early visual areas to higher visual areas. We determined whether cortical areas were selective to shape and orientation by assessing same-type stimuli classification accuracies based on multi-voxel activity patterns per area. To identify whether some areas were related to a more generalized sign of curvature or orientation representation, transfer classification was used by training classifiers on one dataset type and testing classifiers on another type. Same-type stimuli classification results showed that most selected visual areas were selective to shape and all were selective to the orientation of disparity-defined 3D surfaces. Transfer classification results showed that in the dorsal visual area V3A, classification accuracies for the discriminate sign of surface curvature were higher than the baseline of statistical significance for all types of classifications, demonstrating that V3A is related to generalized shape representation. Classification accuracies for discriminating horizontal-vertical surfaces in higher dorsal areas V3A and V7 and ventral area lateral occipital complex (LOC) as well as in some areas of intraparietal sulcus (IPS) were higher than the baseline of statistical significance, indicating their relation to the generalized representation of 3D surface orientation.

Differential cortical activation during the perception of moving objects along different trajectories

Detection of 3D object-motion trajectories depends on the integration of two distinct visual cues: translational displacement and looming. Electrophysiological studies have identified distinct neuronal populations, whose activity depends on the precise motion cues present in the stimulus. This distinction, however, has been less clear in humans, and it is confounded by differences in the behavioral task being performed. We analyzed whole-brain fMRI, while subjects performed a common time-to-arrival task for objects moving along three trajectories: moving directly towards the observer (collision course), with trajectories parallel to the line of sight (passage course), and with trajectories perpendicular to the line of sight (gap closure). We found that there was substantial overlap in the pattern of activation associated with each of the three tasks, with differences among conditions limited to the human motion area (hMT+), which showed greater activation extent in the gap closure condition than for either collision or passage courses. These results support a common substrate for temporal judgments of an object's time-to-arrival, wherein the special cases of object motion directly toward, or perpendicular to, the observer represent two extremes within the broader continuum of 3D passage trajectories relative to the observer.

A widespread visually-sensitive functional network relates to symptoms in essential tremor

Essential tremor is a neurological syndrome of heterogeneous pathology and aetiology that is characterized by tremor primarily in the upper extremities. This tremor is commonly hypothesized to be driven by a single or multiple neural oscillator(s) within the cerebello-thalamo-cortical pathway. Several studies have found an association of blood-oxygen level-dependent (BOLD) signal in the cerebello-thalamo-cortical pathway with essential tremor, but there is behavioural evidence that also points to the possibility that the severity of tremor could be influenced by visual feedback. Here, we directly manipulated visual feedback during a functional MRI grip force task in patients with essential tremor and control participants, and hypothesized that an increase in visual feedback would exacerbate tremor in the 4-12 Hz range in essential tremor patients. Further, we hypothesized that this exacerbation of tremor would be associated with dysfunctional changes in BOLD signal and entropy within, and beyond, the cerebello-thalamo-cortical pathway. We found that increases in visual feedback increased tremor in the 4-12 Hz range in essential tremor patients, and this increase in tremor was associated with abnormal changes in BOLD amplitude and entropy in regions within the cerebello-thalamo-motor cortical pathway, and extended to visual and parietal areas. To determine if the tremor severity was associated with single or multiple brain region(s), we conducted a birectional stepwise multiple regression analysis, and found that a widespread functional network extending beyond the cerebello-thalamo-motor cortical pathway was associated with changes in tremor severity measured during the imaging protocol. Further, this same network was associated with clinical tremor severity measured with the Fahn, Tolosa, Marin Tremor Rating Scale, suggesting this network is clinically relevant. Since increased visual feedback also reduced force error, this network was evaluated in relation to force error but the model was not significant, indicating it is associated with force tremor but not force error. This study therefore provides new evidence that a widespread functional network is associated with the severity of tremor in patients with essential tremor measured simultaneously at the hand during functional imaging, and is also associated with the clinical severity of tremor. These findings support the idea that the severity of tremor is exacerbated by increased visual feedback, suggesting that designers of new computing technologies should consider using lower visual feedback levels to reduce tremor in essential tremor.

Areal differences in depth cue integration between monkey and human

Electrophysiological evidence suggested primarily the involvement of the middle temporal (MT) area in depth cue integration in macaques, as opposed to human imaging data pinpointing area V3B/kinetic occipital area (V3B/KO). To clarify this conundrum, we decoded monkey functional MRI (fMRI) responses evoked by stimuli signaling near or far depths defined by binocular disparity, relative motion, and their combination, and we compared results with those from an identical experiment previously performed in humans. Responses in macaque area MT are more discriminable when two cues concurrently signal depth, and information provided by one cue is diagnostic of depth indicated by the other. This suggests that monkey area MT computes fusion of disparity and motion depth signals, exactly as shown for human area V3B/KO. Hence, these data reconcile previously reported discrepancies between depth processing in human and monkey by showing the involvement of the dorsal stream in depth cue integration using the same technique, despite the engagement of different regions.

In everyday life, we interact with a three-dimensional world that we perceive via our two-dimensional retinas. Our brain can reconstruct the third dimension from these flat retinal images using multiple sources of visual information, or cues. The horizontal displacement of the two retinal images, known as binocular disparity, and the relative motion between different objects are two important depth cues. However, to make the most of the information provided by each cue, our brains must efficiently integrate across them. To examine this process, we used neuroimaging in monkeys to record brain responses evoked by stimuli signaling depths defined by either binocular disparity or relative motion in isolation, and also when the two cues are combined congruently or incongruently. We found that cortical area MT in monkeys is involved in the fusion of these two particular depth cues, in contrast to previous human imaging data that pinpoint a more posterior cortical area, V3B/KO. Our findings support the existence of depth cue integration mechanisms in primates; however, this fusion appears to be computed in slightly different areas in humans and monkeys.

Magnetoencephalography adaptation reveals depth-cue-invariant object representations in the visual cortex

Independent of edges and 2-D shape that can be highly informative of object identity, depth cues alone can also give rise to vivid and effective object percepts. The processing of different depth cues engages segregated cortical areas, and an efficient object representation would be one that is invariant to depth cues. Here, we investigated depth-cue invariance of object representations by measuring the category-specific response to faces-the M170 response measured with magnetoencephalography. The M170 response is strongest to faces and is sensitive to adaptation, such that repeated presentation of a face diminishes subsequent M170 responses. We used this feature of the M170 and measured the degree to which the adaptation effect is affected by variations in depth cue and 3-D object shape. Subjects viewed a rapid presentation of two stimuli-an adaptor and a test stimulus. The adaptor was either a face, a chair, or a face-like oval surface, and rendered with a single depth cue (shading, structure from motion, or texture). The test stimulus was always a shaded face of a random identity, thus completely controlling for low-level influences on the M170 response to the test stimulus. In the left fusiform face area, we found strong M170 adaptation when the adaptor was a face regardless of its depth cue. This adaptation was marginal in the right fusiform and negligible in the occipital regions. Our results support the presence of depth-cue-invariant representations in the human visual system, alongside size, position, and viewpoint invariance.

A Generic Mechanism for Perceptual Organization in the Parietal Cortex

Our visual system's ability to group visual elements into meaningful entities and to separate them from others is referred to as scene segmentation. Visual motion often provides a powerful cue for this process as parallax or coherence can inform the visual system about scene or object structure. Here we tested the hypothesis that scene segmentation by motion cues relies on a common neural substrate in the parietal cortex. We used fMRI and a set of three entirely distinct motion stimuli to examine scene segmentation in the human brain. The stimuli covered a wide range of high-level processes, including perceptual grouping, transparent motion, and depth perception. All stimuli were perceptually bistable such that percepts alternated every few seconds while the physical stimulation remained constant. The perceptual states were asymmetric, in that one reflected the default (nonsegmented) interpretation, and the other the non-default (segmented) interpretation. We confirmed behaviorally that upon stimulus presentation, the default percept was always perceived first, before perceptual alternations ensued. Imaging results showed that across all stimulus classes perceptual scene-segmentation was associated with an increase of activity in the posterior parietal cortex together with a decrease of neural signal in the early visual cortex. This pattern of activation is compatible with predictive coding models of visual perception, and suggests that parietal cortex hosts a generic mechanism for scene segmentation.SIGNIFICANCE STATEMENT Making sense of cluttered visual scenes is crucial for everyday perception. An important cue to scene segmentation is visual motion: slight movements of scene elements give away which elements belong to the foreground or background or to the same object. We used three distinct stimuli that engage visual scene segmentation mechanisms based on motion. They involved perceptual grouping, transparent motion, and depth perception. Brain activity associated with all three mechanisms converged in the same parietal region with concurrent deactivation of early visual areas. The results suggest that posterior parietal cortex is a hub involved in structuring visual scenes based on different motion cues, and that feedback modulates early cortical processing in accord with predictive coding theory.

Towards a unified perspective of object shape and motion processing in human dorsal cortex

Although object-related areas were discovered in human parietal cortex a decade ago, surprisingly little is known about the nature and purpose of these representations, and how they differ from those in the ventral processing stream. In this article, we review evidence for the unique contribution of object areas of dorsal cortex to three-dimensional (3-D) shape representation, the localization of objects in space, and in guiding reaching and grasping actions. We also highlight the role of dorsal cortex in form-motion interaction and spatiotemporal integration, possible functional relationships between 3-D shape and motion processing, and how these processes operate together in the service of supporting goal-directed actions with objects. Fundamental differences between the nature of object representations in the dorsal versus ventral processing streams are considered, with an emphasis on how and why dorsal cortex supports veridical (rather than invariant) representations of objects to guide goal-directed hand actions in dynamic visual environments.

An fMRI study of coherent visual motion processing in children and adults

There is a large corpus of brain imaging studies examining the dorsal visual pathway, especially area V5/MT during visual motion perception. However, despite evidence suggesting a protracted development of the dorsal visual stream, and a role of this pathway in neurodevelopmental disorders, V5/MT has not been characterized developmentally. Further, experiential factors such as reading acquisition may play a modulating role in any age-dependent changes. Here we used a coherent visual motion detection task to examine V5/MT activity and connectivity in typical participants in two studies: a Cross- Sectional Study comparing adults and children; and a Longitudinal Study of 2nd graders followed into 3rd grade. In the Cross-Sectional Study, a whole-brain analysis revealed no differences between the two groups, whereas a region of interest (ROI) approach identified greater activation in left (right trending) V5/MT in adults compared to children. However, when we measured V5/MT activation individually for each participant, children and adults showed no difference in the location or intensity of activation, although children did exhibit relatively larger extent of V5/MT activation bilaterally. There was also relatively greater functional connectivity in the children between left and right occipitotemporal cortex, including V5/MT. The Longitudinal Study revealed no changes in V5/MT activation for any measures of activation or functional connectivity from 2nd to 3rd grade. Finally, there was no evidence of an association between reading and V5/MT over time, nor predictive power of V5/MT activity for later reading. Together, our results indicate similar V5/MT activity across age groups, with relatively greater extent of V5/MT activation and functional connectivity in children relative to adults, bilaterally. These differences were not apparent over the time course of one year, suggesting that these developmental changes occur over a more protracted period.

Cortical responses to shape-from-motion stimuli in the infant

Our ability to extract three-dimensional (3-D) object structure from motion-carried information is a basic visual capacity that is fundamental to object perception. Despite a rich body of behavioral work demonstrating that infants are sensitive to motion-carried information from the early months of life, little is known about the cortical networks that support infants' use of motion-carried information to extract 3-D object structure. This study assessed patterns of cortical activation in infants aged 4 to 6 months as they viewed two types of visual stimuli: (a) shape-from-motion (SFM) displays, where coherent motion of randomly distributed dots gave rise to the percept of 3-D shape and (b) random motion (RM) displays, where dots' motions lacked a coherent structure and gave rise to the percept of randomly moving dots. Functional near-infrared spectroscopy was used to assess activation in occipital, inferior parietal, and posterior temporal cortex. The optical imaging data revealed differential responding to SFM and RM in lower level object processing areas than typically observed in the adult. Possible explanations for this pattern of results are considered.

Visual feedback alters force control and functional activity in the visuomotor network after stroke

Modulating visual feedback may be a viable option to improve motor function after stroke, but the neurophysiological basis for this improvement is not clear. Visual gain can be manipulated by increasing or decreasing the spatial amplitude of an error signal. Here, we combined a unilateral visually guided grip force task with functional MRI to understand how changes in the gain of visual feedback alter brain activity in the chronic phase after stroke. Analyses focused on brain activation when force was produced by the most impaired hand of the stroke group as compared to the non-dominant hand of the control group. Our experiment produced three novel results. First, gain-related improvements in force control were associated with an increase in activity in many regions within the visuomotor network in both the stroke and control groups. These regions include the extrastriate visual cortex, inferior parietal lobule, ventral premotor cortex, cerebellum, and supplementary motor area. Second, the stroke group showed gain-related increases in activity in additional regions of lobules VI and VIIb of the ipsilateral cerebellum. Third, relative to the control group, the stroke group showed increased activity in the ipsilateral primary motor cortex, and activity in this region did not vary as a function of visual feedback gain. The visuomotor network, cerebellum, and ipsilateral primary motor cortex have each been targeted in rehabilitation interventions after stroke. Our observations provide new insight into the role these regions play in processing visual gain during a precisely controlled visuomotor task in the chronic phase after stroke.

Responses in early visual areas to contour integration are context dependent

It has been shown that early visual areas are involved in contour processing. However, it is not clear how local and global context interact to influence responses in those areas, nor has the interarea coordination that yields coherent structural percepts been fully studied, especially in human observers. In this study, we used functional magnetic resonance imaging (fMRI) to measure activity in early visual cortex while observers performed a contour detection task in which alignment of Gabor elements and background clutter were manipulated. Six regions of interest (two regions, containing either the cortex representing the target or the background clutter, in each of areas V1, V2, and V3) were predefined using separate target versus background functional localizer scans. The first analysis using a general linear model showed that in the presence of background clutter, responses in V1 and V2 target regions of interest were significantly stronger to aligned than unaligned contours, whereas when background clutter was absent, no significant difference was observed. The second analysis using interarea correlations showed that with background clutter, there was an increase in V1–V2 coordination within the target regions when perceiving aligned versus unaligned contours; without clutter, however, correlations between V1 and V2 were similar no matter whether aligned contours were present or not. Both the average response magnitude and the connectivity analysis suggest different mechanisms support contour processing with or without background distractors. Coordination between V1 and V2 may play a major role in coherent structure perception, especially with complex scene organization.

Intracranial Recordings of Occipital Cortex Responses to Illusory Visual Events

Ambiguous visual stimuli elicit different perceptual interpretations over time, creating the illusion that a constant stimulus is changing. We investigate whether such spontaneous changes in visual perception involve occipital brain regions specialized for processing visual information, despite the absence of concomitant changes in stimulation. Spontaneous perceptual changes observed while viewing a binocular rivalry stimulus or an ambiguous structure-from-motion stimulus were compared with stimulus-induced perceptual changes that occurred in response to an actual stimulus change. Intracranial recordings from human occipital cortex revealed that spontaneous and stimulus-induced perceptual changes were both associated with an early transient increase in high-frequency power that was more spatially confined than a later transient decrease in low-frequency power. We suggest that the observed high-frequency and low-frequency modulations relate to initiation and maintenance of a percept, respectively. Our results are compatible with the idea that spontaneous changes in perception originate from competitive interactions within visual neural networks.

SIGNIFICANCE STATEMENT

Ambiguous visual stimuli elicit different perceptual interpretations over time, creating the illusion that a constant stimulus is changing. The literature on the neural correlates of conscious visual perception remains inconclusive regarding the extent to which such spontaneous changes in perception involve sensory brain regions. In an attempt to bridge the gap between existing animal and human studies, we recorded from intracranial electrodes placed on the human occipital lobe. We compared two different kinds of ambiguous stimuli, binocular rivalry and the phenomenon of ambiguous structure-from-motion, enabling generalization of our findings across different stimuli. Our results indicate that spontaneous and stimulus-induced changes in perception (i.e., "illusory" and "real" changes in the stimulus, respectively) may involve sensory regions to a similar extent.

Distinct Visual Evoked Potential Morphological Patterns for Apparent Motion Processing in School-Aged Children

Measures of visual cortical development in children demonstrate high variability and inconsistency throughout the literature. This is partly due to the specificity of the visual system in processing certain features. It may then be advantageous to activate multiple cortical pathways in order to observe maturation of coinciding networks. Visual stimuli eliciting the percept of apparent motion and shape change is designed to simultaneously activate both dorsal and ventral visual streams. However, research has shown that such stimuli also elicit variable visual evoked potential (VEP) morphology in children. The aim of this study was to describe developmental changes in VEPs, including morphological patterns, and underlying visual cortical generators, elicited by apparent motion and shape change in school-aged children. Forty-one typically developing children underwent high-density EEG recordings in response to a continuously morphing, radially modulated, circle-star grating. VEPs were then compared across the age groups of 5-7, 8-10, and 11-15 years according to latency and amplitude. Current density reconstructions (CDR) were performed on VEP data in order to observe activated cortical regions. It was found that two distinct VEP morphological patterns occurred in each age group. However, there were no major developmental differences between the age groups according to each pattern. CDR further demonstrated consistent visual generators across age and pattern. These results describe two novel VEP morphological patterns in typically developing children, but with similar underlying cortical sources. The importance of these morphological patterns is discussed in terms of future studies and the investigation of a relationship to visual cognitive performance.

Motion Processing Deficits in Migraine

This study was designed to determine whether cortical motion processing abnormalities are present in individuals with migraine. Performance was measured using a visual motion coherence task (motion coherence perimetry, MCP) thought to depend on the operation of cortical area V5. Motion coherence thresholds were measured using stimuli composed of moving dots at 17 locations in the central ± 20° of visual field. Pre-cortical visual function was also measured using frequency doubling perimetry (FDP) at the same 17 locations. Several migraine subjects demonstrated significant pre-cortical visual functional abnormalities, however, most subjects had normal visual fields measured with FDP. Abnormal MCP performance was measured in 15 of 19 migraine-with-aura subjects, and 11 of 17 migraine-without-aura subjects. A decreased ability to detect coherent motion may possibly be explained by an increase in baseline neuronal noise, such as would be consistent with the concept of cortical hyperexcitability in migraine.

Dorsal and ventral stream contributions to form-from-motion perception in a patient with form-from motion deficit: a case report

The main model of visual processing in primates proposes an anatomo-functional distinction between the dorsal stream, specialized in spatio-temporal information, and the ventral stream, processing essentially form information. However, these two pathways also communicate to share much visual information. These dorso-ventral interactions have been studied using form-from-motion (FfM) stimuli, revealing that FfM perception first activates dorsal regions (e.g., MT+/V5), followed by successive activations of ventral regions (e.g., LOC). However, relatively little is known about the implications of focal brain damage of visual areas on these dorso-ventral interactions. In the present case report, we investigated the dynamics of dorsal and ventral activations related to FfM perception (using topographical ERP analysis and electrical source imaging) in a patient suffering from a deficit in FfM perception due to right extrastriate brain damage in the ventral stream. Despite the patient's FfM impairment, both successful (observed for the highest level of FfM signal) and absent/failed FfM perception evoked the same temporal sequence of three processing states observed previously in healthy subjects. During the first period, brain source localization revealed cortical activations along the dorsal stream, currently associated with preserved elementary motion processing. During the latter two periods, the patterns of activity differed from normal subjects: activations were observed in the ventral stream (as reported for normal subjects), but also in the dorsal pathway, with the strongest and most sustained activity localized in the parieto-occipital regions. On the other hand, absent/failed FfM perception was characterized by weaker brain activity, restricted to the more lateral regions. This study shows that in the present case report, successful FfM perception, while following the same temporal sequence of processing steps as in normal subjects, evoked different patterns of brain activity. By revealing a brain circuit involving the most rostral part of the dorsal pathway, this study provides further support for neuro-imaging studies and brain lesion investigations that have suggested the existence of different brain circuits associated with different profiles of interaction between the dorsal and the ventral streams.

The neural representation of objects formed through the spatiotemporal integration of visual transients

Oftentimes, objects are only partially and transiently visible as parts of them become occluded during observer or object motion. The visual system can integrate such object fragments across space and time into perceptual wholes or spatiotemporal objects. This integrative and dynamic process may involve both ventral and dorsal visual processing pathways, along which shape and spatial representations are thought to arise. We measured fMRI BOLD response to spatiotemporal objects and used multi-voxel pattern analysis (MVPA) to decode shape information across 20 topographic regions of visual cortex. Object identity could be decoded throughout visual cortex, including intermediate (V3A, V3B, hV4, LO1-2,) and dorsal (TO1-2, and IPS0-1) visual areas. Shape-specific information, therefore, may not be limited to early and ventral visual areas, particularly when it is dynamic and must be integrated. Contrary to the classic view that the representation of objects is the purview of the ventral stream, intermediate and dorsal areas may play a distinct and critical role in the construction of object representations across space and time.

Using Functional Near Infrared Spectroscopy (fNIRS) to Study Dynamic Stereoscopic Depth Perception

The parietal cortex has been widely implicated in the processing of depth perception by many neuroimaging studies, yet functional near infrared spectroscopy (fNIRS) has been an under-utilised tool to examine the relationship of oxy- ([HbO]) and de-oxyhaemoglobin ([HbR]) in perception. Here we examine the haemodynamic response (HDR) to the processing of induced depth stimulation using dynamic random-dot-stereograms (RDS). We used fNIRS to measure the HDR associated with depth perception in healthy young adults (n = 13, mean age 24). Using a blocked design, absolute values of [HbO] and [HbR] were recorded across parieto-occipital and occipital cortices, in response to dynamic RDS. Control and test images were identical except for the horizontal shift in pixels in the RDS that resulted in binocular disparity and induced the percept of a 3D sine wave that ‘popped out’ of the test stimulus. The control stimulus had zero disparity and induced a ‘flat’ percept. All participants had stereoacuity within normal clinical limits and successfully perceived the depth in the dynamic RDS. Results showed a significant effect of this complex visual stimulation in the right parieto-occipital cortex (p < 0.01, η² = 0.54). The test stimulus elicited a significant increase in [HbO] during depth perception compared to the control image (p < 0.001, 99.99 % CI [0.008–0.294]). The similarity between the two stimuli may have resulted in the HDR of the occipital cortex showing no significant increase or decrease of cerebral oxygenation levels during depth stimulation. Cerebral oxygenation measures of [HbO] confirmed the strong association of the right parieto-occipital cortex with processing depth perception. Our study demonstrates the validity of fNIRS to investigate [HbO] and [HbR] during high-level visual processing of complex stimuli.

The Visual Priming of Motion-Defined 3D Objects

The perception of a stimulus can be influenced by previous perceptual experience, a phenomenon known as perceptual priming. However, there has been limited investigation on perceptual priming of shape perception of three-dimensional object structures defined by moving dots. Here we examined the perceptual priming of a 3D object shape defined purely by motion-in-depth cues (i.e., Shape-From-Motion, SFM) using a classic prime-target paradigm. The results from the first two experiments revealed a significant increase in accuracy when a “cloudy” SFM stimulus (whose object structure was difficult to recognize due to the presence of strong noise) was preceded by an unambiguous SFM that clearly defined the same transparent 3D shape. In contrast, results from Experiment 3 revealed no change in accuracy when a “cloudy” SFM stimulus was preceded by a static shape or a semantic word that defined the same object shape. Instead, there was a significant decrease in accuracy when preceded by a static shape or a semantic word that defined a different object shape. These results suggested that the perception of a noisy SFM stimulus can be facilitated by a preceding unambiguous SFM stimulus—but not a static image or a semantic stimulus—that defined the same shape. The potential neural and computational mechanisms underlying the difference in priming are discussed.

Aesthetic preference recognition of 3D shapes using EEG

Recognition and identification of aesthetic preference is indispensable in industrial design. Humans tend to pursue products with aesthetic values and make buying decisions based on their aesthetic preferences. The existence of neuromarketing is to understand consumer responses toward marketing stimuli by using imaging techniques and recognition of physiological parameters. Numerous studies have been done to understand the relationship between human, art and aesthetics. In this paper, we present a novel preference-based measurement of user aesthetics using electroencephalogram (EEG) signals for virtual 3D shapes with motion. The 3D shapes are designed to appear like bracelets, which is generated by using the Gielis superformula. EEG signals were collected by using a medical grade device, the B-Alert X10 from advance brain monitoring, with a sampling frequency of 256 Hz and resolution of 16 bits. The signals obtained when viewing 3D bracelet shapes were decomposed into alpha, beta, theta, gamma and delta rhythm by using time-frequency analysis, then classified into two classes, namely like and dislike by using support vector machines and K-nearest neighbors (KNN) classifiers respectively. Classification accuracy of up to 80 % was obtained by using KNN with the alpha, theta and delta rhythms as the features extracted from frontal channels, Fz, F3 and F4 to classify two classes, like and dislike.

Human visual cortical responses to specular and matte motion flows

Determining the compositional properties of surfaces in the environment is an important visual capacity. One such property is specular reflectance, which encompasses the range from matte to shiny surfaces. Visual estimation of specular reflectance can be informed by characteristic motion profiles; a surface with a specular reflectance that is difficult to determine while static can be confidently disambiguated when set in motion. Here, we used fMRI to trace the sensitivity of human visual cortex to such motion cues, both with and without photometric cues to specular reflectance. Participants viewed rotating blob-like objects that were rendered as images (photometric) or dots (kinematic) with either matte-consistent or shiny-consistent specular reflectance profiles. We were unable to identify any areas in low and mid-level human visual cortex that responded preferentially to surface specular reflectance from motion. However, univariate and multivariate analyses identified several visual areas; V1, V2, V3, V3A/B, and hMT+, capable of differentiating shiny from matte surface flows. These results indicate that the machinery for extracting kinematic cues is present in human visual cortex, but the areas involved in integrating such information with the photometric cues necessary for surface specular reflectance remain unclear.

Neural Mechanism for Mirrored Self-face Recognition

Self-face recognition in the mirror is considered to involve multiple processes that integrate 2 perceptual cues: temporal contingency of the visual feedback on one's action (contingency cue) and matching with self-face representation in long-term memory (figurative cue). The aim of this study was to examine the neural bases of these processes by manipulating 2 perceptual cues using a "virtual mirror" system. This system allowed online dynamic presentations of real-time and delayed self- or other facial actions. Perception-level processes were identified as responses to only a single perceptual cue. The effect of the contingency cue was identified in the cuneus. The regions sensitive to the figurative cue were subdivided by the response to a static self-face, which was identified in the right temporal, parietal, and frontal regions, but not in the bilateral occipitoparietal regions. Semantic- or integration-level processes, including amodal self-representation and belief validation, which allow modality-independent self-recognition and the resolution of potential conflicts between perceptual cues, respectively, were identified in distinct regions in the right frontal and insular cortices. The results are supportive of the multicomponent notion of self-recognition and suggest a critical role for contingency detection in the co-emergence of self-recognition and empathy in infants.

Functional Reorganization of the Visual Dorsal Stream as Probed by 3-D Visual Coherence in Williams Syndrome

Object and depth perception from motion cues involves the recruitment of visual dorsal stream brain areas. In 3-D structure-from-motion (SFM) perception, motion and depth information are first extracted in this visual stream to allow object categorization, which is in turn mediated by the ventral visual stream. Such interplay justifies the use of SFM paradigms to understand dorsal–ventral integration of visual information. The nature of such processing is particularly interesting to be investigated in a neurological model of cognitive dissociation between dorsal (impaired) and ventral stream (relatively preserved) processing, Williams syndrome (WS). In the current fMRI study, we assessed dorsal versus ventral stream processing by using a performance-matched 3-D SFM object categorization task. We found evidence for substantial reorganization of the dorsal stream in WS as assessed by whole-brain ANOVA random effects analysis, with subtle differences in ventral activation. Dorsal reorganization was expressed by larger medial recruitment in WS (cuneus, precuneus, and retrosplenial cortex) in contrast with controls, which showed the expected dorsolateral pattern (caudal intraparietal sulcus and lateral occipital cortex). In summary, we found a substantial reorganization of dorsal stream regions in WS in response to simple visual categories and 3-D SFM perception, with less affected ventral stream. Our results corroborate the existence of a medial dorsal pathway that provides the substrate for information rerouting and reorganization in the presence of lateral dorsal stream vulnerability. This interpretation is consistent with recent findings suggesting parallel routing of information in medial and lateral parts of dorsal stream.

Cortical activation to object shape and speed of motion during the first year

A great deal is known about the functional organization of cortical networks that mediate visual object processing in the adult. The current research is part of a growing effort to identify the functional maturation of these pathways in the developing brain. The current research used near-infrared spectroscopy to investigate functional activation of the infant cortex during the processing of featural information (shape) and spatiotemporal information (speed of motion) during the first year of life. Our investigation focused on two areas that were implicated in previous studies: anterior temporal cortex and posterior parietal cortex. Neuroimaging data were collected with 207 infants across three age groups: 3-6 months (Experiment 1), 7-8 months (Experiment 2), and 10-12 months (Experiments 3 and 4). The neuroimaging data revealed age-related changes in patterns of activation to shape and speed information, mostly involving posterior parietal areas, some of which were predicted and others that were not. We suggest that these changes reflect age-related differences in the perceptual and/or cognitive processes engaged during the task.

Structure-from-motion: dissociating perception, neural persistence, and sensory memory of illusory depth and illusory rotation

In the structure-from-motion paradigm, physical motion on a screen produces the vivid illusion of an object rotating in depth. Here, we show how to dissociate illusory depth and illusory rotation in a structure-from-motion stimulus using a rotationally asymmetric shape and reversals of physical motion. Reversals of physical motion create a conflict between the original illusory states and the new physical motion: Either illusory depth remains constant and illusory rotation reverses, or illusory rotation stays the same and illusory depth reverses. When physical motion reverses after the interruption in presentation, we find that illusory rotation tends to remain constant for long blank durations (T (blank) ≥ 0.5 s), but illusory depth is stabilized if interruptions are short (T (blank) ≤ 0.1 s). The stability of illusory depth over brief interruptions is consistent with the effect of neural persistence. When this is curtailed using a mask, stability of ambiguous vision (for either illusory depth or illusory rotation) is disrupted. We also examined the selectivity of the neural persistence of illusory depth. We found that it relies on a static representation of an interpolated illusory object, since changes to low-level display properties had little detrimental effect. We discuss our findings with respect to other types of history dependence in multistable displays (sensory stabilization memory, neural fatigue, etc.). Our results suggest that when brief interruptions are used during the presentation of multistable displays, switches in perception are likely to rely on the same neural mechanisms as spontaneous switches, rather than switches due to the initial percept choice at the stimulus onset.

Dynamic cortical activity during the perception of three-dimensional object shape from two-dimensional random-dot motion

Recent neuroimaging studies implicate that both the dorsal and ventral visual pathways, as well as the middle temporal (MT) areas which are critical for the perception of visual motion, are involved in the perception of three-dimensional (3D) structure from two-dimensional (2D) motion (3D-SFM). However, the neural dynamics underlying the reconstruction of a 3D object from 2D optic flow is not known. Here we combined magnetoencephalography (MEG) and functional MRI (fMRI) measurements to investigate the spatiotemporal brain dynamics during 3D-SFM. We manipulated parametrically the coherence of randomly moving groups of dots to create different levels of 3D perception and to study the associated changes in brain activity. At different latencies, the posterior infero-temporal (pIT), the parieto-occipital (PO), and the intraparietal (IP) regions showed increased neural activity during highly coherent motion conditions in which subjects perceived a robust 3D object. Causality analysis between these regions indicated significant causal influence from IP to pIT and from pIT to PO only in conditions where subjects perceived a robust 3D object. Current results suggest that the perception of a 3D object from 2D motion includes integration of global motion and 3D mental image processing, as well as object recognition that are accomplished by interactions between the dorsal and ventral visual pathways.

The male advantage in child facial resemblance detection: behavioral and ERP evidence

Males have been suggested to have advantages over females in reactions to child facial resemblance, which reflects the evolutionary pressure on males to solve the adaptive paternal uncertainty problem and to identify biological offspring. However, previous studies showed inconsistent results and the male advantage in child facial resemblance perception, as a kin detection mechanism, is still unclear. Here, we investigated the behavioral and brain mechanisms underlying the self-resembling faces processing and how it interacts with sex and age using event-related potential (ERP) technique. The results showed a stable male advantage in self-resembling child faces processing, such that males have higher detectability to self-resembling child faces than females. For ERP results, males showed smaller N2 and larger late positive component (LPC) amplitudes for self-resembling child faces, which may reflect face-matching and self-referential processing in kin detection, respectively. Further source analysis showed that the N2 component and LPC were originated from the anterior cingulate cortex and medial frontal gyrus, respectively. Our results support the male advantage in self-resembling child detection and further indicate that such distinctions can be found in both early and late processing stages in the brain at different regions.

Automatic processing of unattended object features by functional connectivity

Observers can selectively attend to object features that are relevant for a task. However, unattended task-irrelevant features may still be processed and possibly integrated with the attended features. This study investigated the neural mechanisms for processing both task-relevant (attended) and task-irrelevant (unattended) object features. The Garner paradigm was adapted for functional magnetic resonance imaging (fMRI) to test whether specific brain areas process the conjunction of features or whether multiple interacting areas are involved in this form of feature integration. Observers attended to shape, color, or non-rigid motion of novel objects while unattended features changed from trial to trial (change blocks) or remained constant (no-change blocks) during a given block. This block manipulation allowed us to measure the extent to which unattended features affected neural responses which would reflect the extent to which multiple object features are automatically processed. We did not find Garner interference at the behavioral level. However, we designed the experiment to equate performance across block types so that any fMRI results could not be due solely to differences in task difficulty between change and no-change blocks. Attention to specific features localized several areas known to be involved in object processing. No area showed larger responses on change blocks compared to no-change blocks. However, psychophysiological interaction (PPI) analyses revealed that several functionally-localized areas showed significant positive interactions with areas in occipito-temporal and frontal areas that depended on block type. Overall, these findings suggest that both regional responses and functional connectivity are crucial for processing multi-featured objects.

Perceptual experience modulates cortical circuits involved in visual awareness

Successful interactions with the environment entail interpreting ambiguous sensory information. To address this challenge it has been suggested that the brain optimizes performance through experience. Here we used functional magnetic resonance imaging (fMRI) to investigate whether perceptual experience modulates the cortical circuits involved in visual awareness. Using ambiguous visual stimuli (binocular rivalry or ambiguous structure-from-motion) we were able to disentangle the co-occurring influences of stimulus repetition and perceptual repetition. For both types of ambiguous stimuli we observed that the mere repetition of the stimulus evoked an entirely different pattern of activity modulations than the repetition of a particular perceptual interpretation of the stimulus. Regarding stimulus repetition, decreased fMRI responses were evident during binocular rivalry but weaker during 3-D motion rivalry. Perceptual repetition, on the other hand, entailed increased activity in stimulus-specific visual brain regions - for binocular rivalry in the early visual regions and for ambiguous structure-from-motion in both early as well as higher visual regions. This indicates that the repeated activation of a visual network mediating a particular percept facilitated its later reactivation. Perceptual repetition was also associated with a response change in the parietal cortex that was similar for the two types of ambiguous stimuli, possibly relating to the temporal integration of perceptual information. We suggest that perceptual repetition is associated with a facilitation of neural activity within and between percept-specific visual networks and parietal networks involved in the temporal integration of perceptual information, thereby enhancing the stability of previously experienced percepts.

Stimulus dependency of object-evoked responses in human visual cortex: an inverse problem for category specificity

Many studies have linked the processing of different object categories to specific event-related potentials (ERPs) such as the face-specific N170. Despite reports showing that object-related ERPs are influenced by visual stimulus features, there is consensus that these components primarily reflect categorical aspects of the stimuli. Here, we re-investigated this idea by systematically measuring the effects of visual feature manipulations on ERP responses elicited by both structure-from-motion (SFM)-defined and luminance-defined object stimuli. SFM objects elicited a novel component at 200-250 ms (N250) over parietal and posterior temporal sites. We found, however, that the N250 amplitude was unaffected by restructuring SFM stimuli into meaningless objects based on identical visual cues. This suggests that this N250 peak was not uniquely linked to categorical aspects of the objects, but is strongly determined by visual stimulus features. We provide strong support for this hypothesis by parametrically manipulating the depth range of both SFM- and luminance-defined object stimuli and showing that the N250 evoked by SFM stimuli as well as the well-known N170 to static faces were sensitive to this manipulation. Importantly, this effect could not be attributed to compromised object categorization in low depth stimuli, confirming a strong impact of visual stimulus features on object-related ERP signals. As ERP components linked with visual categorical object perception are likely determined by multiple stimulus features, this creates an interesting inverse problem when deriving specific perceptual processes from variations in ERP components.

The integration of motion and disparity cues to depth in dorsal visual cortex

Humans exploit a range of visual depth cues to estimate three-dimensional structure. For example, the slant of a nearby tabletop can be judged by combining information from binocular disparity, texture and perspective. Behavioral tests show humans combine cues near-optimally, a feat that could depend on discriminating the outputs from cue-specific mechanisms or on fusing signals into a common representation. Although fusion is computationally attractive, it poses a substantial challenge, requiring the integration of quantitatively different signals. We used functional magnetic resonance imaging (fMRI) to provide evidence that dorsal visual area V3B/KO meets this challenge. Specifically, we found that fMRI responses are more discriminable when two cues (binocular disparity and relative motion) concurrently signal depth, and that information provided by one cue is diagnostic of depth indicated by the other. This suggests a cortical node important when perceiving depth, and highlights computations based on fusion in the dorsal stream.

MEG-fMRI integration to visualize brain dynamics while perceiving 3-D object shape from motion

Here, we combine magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI) to detect the dynamic brain responses to 3D-SFM. We manipulated the coherence of randomly moving dots to create different levels of 3D perception and investigated the associated changes in brain activity. Results of the fMRI analysis were used to impose plausible constraints on the MEG inverse calculation to improve spatial resolution of the spatiotemporal activity estimates. Time-frequency analysis was also employed to elucidate spatiotemporal dynamic changes in the spontaneous brain activities. MEG-fMRI combined analysis showed that the activities the posterior infero-temporal (pIT), parieto-occipital (PO), and intra-parietal (IP) regions were increased at different latencies during highly coherent motion conditions in which subjects perceived a robust 3D object. Results of the time-frequency analysis indicated the suppression of alpha- and beta-band activities in these regions which reflect the commitment of these areas in the perception of 3D-SFM. Current results suggest that the interactions between the dorsal and ventral visual subsystems are crucial for the perception of 3D object from 2D optic flow.

Psychometrically matched tasks evaluating differential fMRI activation during form and motion processing

OBJECTIVE

Deficits in visual perception and working memory are commonly observed in neuropsychiatric disorders and have been investigated using functional MRI (fMRI). However, interpretation of differences in brain activation may be confounded with differences in task performance between groups. Differences in task difficulty across conditions may also pose interpretative issues in studies of visual processing in healthy subjects.

METHOD

To address these concerns, the present study characterized brain activation in tasks that were psychometrically matched for difficulty; fMRI was used to assess brain activation in 10 healthy subjects during discrimination and working memory judgments for static and moving stimuli. For all task conditions, performance accuracy was matched at 70.7%.

RESULTS

Areas associated with V2 and V5 in the dorsal stream were activated during motion processing tasks and V4 in the ventral stream were activated during form processing tasks. Frontoparietal areas associated with working memory were also statistically significant during the working memory tasks.

CONCLUSIONS

Application of psychophysical methods to equate task demands provides a practical method to equate performance levels across conditions in fMRI studies and to compare healthy and cognitively impaired groups at comparable levels of effort. These psychometrically matched tasks can be applied to patients with a variety of cognitive disorders to investigate dysfunction of multiple a priori defined brain regions. Measuring the changes in typical activation patterns in patients with these diseases can be useful for monitoring disease progression, evaluating new drug treatments, and possibly for developing methods for early diagnosis.

The extraction of 3D shape in the visual system of human and nonhuman primates

Depth structure, the third dimension of object shape, is extracted from disparity, motion, texture, and shading in the optic array. Gradient-selective neurons play a key role in this process. Such neurons occur in CIP, AIP, TEs, and F5 (for first- or second-order disparity gradients), in MT/V5, in FST (for speed gradients), and in CIP and TEs (for texture gradients). Most of these regions are activated during magnetic resonance scanning in alert monkeys by comparing 3D conditions with the 2D controls for the different cues. Similarities in activation patterns of monkeys and humans tested with identical paradigms suggest that like gradient-selective neurons are found in corresponding human cortical areas. This view gains credence as the homologies between such areas become more evident. Furthermore, 3D shape-processing networks are similar in the two species, with the exception of the greater involvement of human posterior parietal cortex in the extraction of 3D shape from motion. Thus we can begin to understand how depth structure is extracted from motion, disparity, and texture in the primate brain, but the extraction of depth structure from shading and that of wire-like objects requires further scrutiny.

Rapid communication: Seeing and doing: Ability to act moderates orientation effects in object perception

We investigated whether the impact of an object's orientation on a perceiver's actions (an orientation effect) is moderated by the perceiver's ability to act on the object in question. To do this, we manipulated the physical location of presented objects (Experiment 1) and the perceiver's action capacity (Experiment 2). Regardless of the physical distance of the object, manual responses were sensitive to the object's orientation (the orientation effect) when the object was within the participant's action range but not when the object was outside of the action range. These results support an embodied view of object perception and shed light on peripersonal space representation.

Spatiotemporal tuning of brain activity and force performance

The spatial and temporal features of visual stimuli are either processed independently or are conflated in specific cells of visual cortex. Although spatial and temporal features of visual stimuli influence motor performance, it remains unclear how spatiotemporal information is processed beyond visual cortex in brain regions that control movement. We used functional magnetic resonance imaging to examine how brain activity and force control are influenced by visual gain at a high visual feedback frequency of 6.4 Hz and a low visual feedback frequency of 0.4 Hz. At 6.4 Hz, increasing visual gain led to improved force performance and increased activity in classic areas of the visuomotor system-V5, IPL, SPL, PMv, SMA-proper, and M1. At 0.4 Hz, increasing gain also led to improved force performance. In addition to activation in M1/PMd and IPL in the visuomotor system, increasing visual gain at 0.4 Hz also corresponded with activity in the striatal-frontal circuit including DLPFC, ACC, and widespread activity in putamen, caudate, and SMA-proper. This study demonstrates that the frequency of visual feedback drives where in the brain visual gain mediated reductions in force error are regulated.

Perception of object motion in three-dimensional space induced by cast shadows

Cast shadows can be salient depth cues in three-dimensional (3D) vision. Using a motion illusion in which a ball is perceived to roll in depth on the bottom or to flow in the front plane depending on the slope of the trajectory of its cast shadow, we investigated cortical mechanisms underlying 3D vision based on cast shadows using fMRI techniques. When modified versions of the original illusion, in which the slope of the shadow trajectory (shadow slope) was changed in 5 steps from the same one as the ball trajectory to the horizontal, were presented to participants, their perceived ball trajectory shifted gradually from rolling on the bottom to floating in the front plane as the change of the shadow slope. This observation suggests that the perception of the ball trajectory in this illusion is strongly affected by the motion of the cast shadow. In the fMRI study, cortical activity during observation of the movies of the illusion was investigated. We found that the bilateral posterior-occipital sulcus (POS) and right ventral precuneus showed activation related to the perception of the ball trajectory induced by the cast shadows in the illusion. Of these areas, it was suggested that the right POS may be involved in the inferring of the ball trajectory by the given spatial relation between the ball and the shadow. Our present results suggest that the posterior portion of the medial parietal cortex may be involved in 3D vision by cast shadows.

Selective regions of the visuomotor system are related to gain-induced changes in force error

When humans perform movements and receive on-line visual feedback about their performance, the spatial qualities of the visual information alter performance. The spatial qualities of visual information can be altered via the manipulation of visual gain and changes in visual gain lead to changes in force error. The current study used functional magnetic resonance imaging during a steady-state precision grip force task to examine how cortical and subcortical brain activity can change with visual gain induced changes in force error. Small increases in visual gain < 1° were associated with a substantial reduction in force error and a small increase in the spatial amplitude of visual feedback. These behavioral effects corresponded with an increase in activation bilaterally in V3 and V5 and in left primary motor cortex and left ventral premotor cortex. Large increases in visual gain > 1° were associated with a small change in force error and a large change in the spatial amplitude of visual feedback. These behavioral effects corresponded with increased activity bilaterally in dorsal and ventral premotor areas and right inferior parietal lobule. Finally, activity in the left and right lobule VI of the cerebellum and left and right putamen did not change with increases in visual gain. Together, these findings demonstrate that the visuomotor system does not respond uniformly to changes in the gain of visual feedback. Instead, specific regions of the visuomotor system selectively change in activity related to large changes in force error and large changes in the spatial amplitude of visual feedback.

3D surface perception from motion involves a temporal-parietal network

Previous research has suggested that three-dimensional (3D) structure-from-motion (SFM) perception in humans involves several motion-sensitive occipital and parietal brain areas. By contrast, SFM perception in nonhuman primates seems to involve the temporal lobe including areas MT, MST and FST. The present functional magnetic resonance imaging study compared several motion-sensitive regions of interest including the superior temporal sulcus (STS) while human observers viewed horizontally moving dots that defined either a 3D corrugated surface or a 3D random volume. Low-level stimulus features such as dot density and velocity vectors as well as attention were tightly controlled. Consistent with previous research we found that 3D corrugated surfaces elicited stronger responses than random motion in occipital and parietal brain areas including area V3A, the ventral and dorsal intraparietal sulcus, the lateral occipital sulcus and the fusiform gyrus. Additionally, 3D corrugated surfaces elicited stronger activity in area MT and the STS but not in area MST. Brain activity in the STS but not in area MT correlated with interindividual differences in 3D surface perception. Our findings suggest that area MT is involved in the analysis of optic flow patterns such as speed gradients and that the STS in humans plays a greater role in the analysis of 3D SFM than previously thought.

The processing of three-dimensional shape from disparity in the human brain

Three-dimensional (3D) shape is important for the visual control of grasping and manipulation and for object recognition. Although there has been some progress in our understanding of how 3D shape is extracted from motion and other monocular cues, little is known of how the human brain extracts 3D shape from disparity, commonly regarded as the strongest depth cue. Previous fMRI studies in the awake monkey have established that the interaction between stereo (present or absent) and the order of disparity (zero or second order) constitutes the MR signature of regions housing second-order disparity-selective neurons (Janssen et al., 2000; Srivastava et al., 2006; Durand et al., 2007; Joly et al., 2007). Testing the interaction between stereo and order of disparity in a large cohort of human subjects, revealed the involvement of five IPS regions (VIPS/V7*, POIPS, DIPSM, DIPSA, and phAIP), as well as V3 and the V3A complex in occipital cortex, the posterior inferior temporal gyrus (ITG), and ventral premotor cortex (vPrCS) in the extraction and processing of 3D shape from stereo. Control experiments ruled out attention and convergence eye movements as confounding factors. Many of these regions, DIPSM, DIPSA, phAIP, and probably posterior ITG and ventral premotor cortex, correspond to monkey regions with similar functionality, whereas the evolutionarily new or modified regions are located in occipital (the V3A complex) and occipitoparietal cortex (VIPS/V7* and POIPS). Interestingly, activity in these occipital regions correlates with the depth amplitude perceived by the subjects in the 3D surfaces used as stimuli in these fMRI experiments.

Category-specificity in visual object recognition

Are all categories of objects recognized in the same manner visually? Evidence from neuropsychology suggests they are not: some brain damaged patients are more impaired in recognizing natural objects than artefacts whereas others show the opposite impairment. Category-effects have also been demonstrated in neurologically intact subjects, but the findings are contradictory and there is no agreement as to why category-effects arise. This article presents a pre-semantic account of category-effects (PACE) in visual object recognition. PACE assumes two processing stages: shape configuration (the binding of shape elements into elaborate shape descriptions) and selection (among competing representations in visual long-term memory), which are held to be differentially affected by the structural similarity between objects. Drawing on evidence from clinical studies, experimental studies with neurologically intact subjects and functional imaging studies, it is argued that PACE can account for category-effects at both behavioural and neural levels in patients and neurologically intact subjects. The theory also accounts for the way in which category-effects are affected by different task parameters (the degree of perceptual differentiation called for), stimulus characteristics (whether stimuli are presented as silhouettes, full line-drawings, or fragmented forms), stimulus presentation (stimulus exposure duration and position) as well as interactions between these parameters.