'What' Is Happening in the Dorsal Visual Pathway

Functional outcomes following lesions in visual cortex: Implications for plasticity of high-level vision

Understanding the nature and extent of neural plasticity in humans remains a key challenge for neuroscience. Importantly, however, a precise characterization of plasticity and its underlying mechanism has the potential to enable new approaches for enhancing reorganization of cortical function. Investigations of the impairment and subsequent recovery of cognitive and perceptual functions following early-onset cortical lesions in humans provide a unique opportunity to elucidate how the brain changes, adapts, and reorganizes. Specifically, here, we focus on restitution of visual function, and we review the findings on plasticity and re-organization of the ventral occipital temporal cortex (VOTC) in published reports of 46 patients with a lesion to or resection of the visual cortex early in life. Findings reveal that a lesion to the VOTC results in a deficit that affects the visual recognition of more than one category of stimuli (faces, objects and words). In addition, the majority of pediatric patients show limited recovery over time, especially those in whom deficits in low-level vision also persist. Last, given that neither the equipotentiality nor the modularity view on plasticity was clearly supported, we suggest some intermediate possibilities in which some plasticity may be evident but that this might depend on the area that was affected, its maturational trajectory as well as its structural and functional connectivity constraints. Finally, we offer suggestions for future research that can elucidate plasticity further.

The value of cognitive neuropsychology: The case of vision research

Cognitive neuropsychological evidence is widely viewed as inherently flawed or weak, despite well-reasoned arguments to the contrary by many theorists. Rather than attempting yet another defence of cognitive neuropsychology on logical grounds, we point out through examples that in practice, cognitive neuropsychological evidence is widely accepted as valid and important, and has had a major impact on cognitive theory and research. Objections offered in the abstract rarely arise in the context of actual studies. We develop these points through examples from the domain of vision, discussing cerebral achromatopsia and akinetopsia, selective impairment and sparing of face recognition, perception-action dissociations, and blindsight.

Task-context-dependent Linear Representation of Multiple Visual Objects in Human Parietal Cortex

A host of recent studies have reported robust representations of visual object information in the human parietal cortex, similar to those found in ventral visual cortex. In ventral visual cortex, both monkey neurophysiology and human fMRI studies showed that the neural representation of a pair of unrelated objects can be approximated by the averaged neural representation of the constituent objects shown in isolation. In this study, we examined whether such a linear relationship between objects exists for object representations in the human parietal cortex. Using fMRI and multivoxel pattern analysis, we examined object representations in human inferior and superior intraparietal sulcus, two parietal regions previously implicated in visual object selection and encoding, respectively. We also examined responses from the lateral occipital region, a ventral object processing area. We obtained fMRI response patterns to object pairs and their constituent objects shown in isolation while participants viewed these objects and performed a 1-back repetition detection task. By measuring fMRI response pattern correlations, we found that all three brain regions contained representations for both single object and object pairs. In the lateral occipital region, the representation for a pair of objects could be reliably approximated by the average representation of its constituent objects shown in isolation, replicating previous findings in ventral visual cortex. Such a simple linear relationship, however, was not observed in either parietal region examined. Nevertheless, when we equated the amount of task information present by examining responses from two pairs of objects, we found that representations for the average of two object pairs were indistinguishable in both parietal regions from the average of another two object pairs containing the same four component objects but with a different pairing of the objects (i.e., the average of AB and CD vs. that of AD and CB). Thus, when task information was held consistent, the same linear relationship may govern how multiple independent objects are represented in the human parietal cortex as it does in ventral visual cortex. These findings show that object and task representations coexist in the human parietal cortex and characterize one significant difference of how visual information may be represented in ventral visual and parietal regions.

How do the two visual streams interact with each other?

The current consensus divides primate cortical visual processing into two broad networks or "streams" composed of highly interconnected areas (Milner and Goodale 2006, 2008; Goodale 2014). The ventral stream, passing from primary visual cortex (V1) through to inferior parts of the temporal lobe, is considered to mediate the transformation of the contents of the visual signal into the mental furniture that guides memory, recognition and conscious perception. In contrast the dorsal stream, passing from V1 through to various areas in the posterior parietal lobe, is generally considered to mediate the visual guidance of action, primarily in real time. The brain, however, does not work through mutually insulated subsystems, and indeed there are well-documented interconnections between the two streams. Evidence for contributions from ventral stream systems to the dorsal stream comes from human neuropsychological and neuroimaging research, and indicates a crucial role in mediating complex and flexible visuomotor skills. Complementary evidence points to a role for posterior dorsal-stream visual analysis in certain aspects of 3-D perceptual function in the ventral stream. A series of studies of a patient with visual form agnosia has been instrumental in shaping our knowledge of what each stream can achieve in isolation; but it has also helped us to tease apart the relative dependence of parietal visuomotor systems on direct bottom-up visual inputs versus inputs redirected via perceptual systems within the ventral stream.

Objective analysis of the topological organization of the human cortical visual connectome suggests three visual pathways

The cortical visual system is composed of many areas serving various visual functions. In non-human primates, these are broadly organised into two distinct processing pathways: a ventral pathway for object recognition, and a dorsal pathway for action. In humans, recent theoretical proposals suggest the possible existence of additional pathways, but direct empirical evidence has yet to be presented. Here, we estimated the connectivity patterns between 22 human visual areas using resting-state functional MRI data of 470 individuals, leveraging the unprecedented data quantity and quality of the Human Connectome Project and a novel probabilistic atlas. An objective, data-driven analysis into the topological organisation of connectivity and subsequent quantitative confirmation revealed a highly significant triple dissociation between the retinotopic areas on the dorsal, ventral and lateral surfaces of the human occipital lobe. This suggests that the functional organisation of the human visual system involves not two but three cortical pathways.

Hard-wired feed-forward visual mechanisms of the brain compensate for affine variations in object recognition

Humans perform object recognition effortlessly and accurately. However, it is unknown how the visual system copes with variations in objects' appearance and the environmental conditions. Previous studies have suggested that affine variations such as size and position are compensated for in the feed-forward sweep of visual information processing while feedback signals are needed for precise recognition when encountering non-affine variations such as pose and lighting. Yet, no empirical data exist to support this suggestion. We systematically investigated the impact of the above-mentioned affine and non-affine variations on the categorization performance of the feed-forward mechanisms of the human brain. For that purpose, we designed a backward-masking behavioral categorization paradigm as well as a passive viewing EEG recording experiment. On a set of varying stimuli, we found that the feed-forward visual pathways contributed more dominantly to the compensation of variations in size and position compared to lighting and pose. This was reflected in both the amplitude and the latency of the category separability indices obtained from the EEG signals. Using a feed-forward computational model of the ventral visual stream, we also confirmed a more dominant role for the feed-forward visual mechanisms of the brain in the compensation of affine variations. Taken together, our experimental results support the theory that non-affine variations such as pose and lighting may need top-down feedback information from higher areas such as IT and PFC for precise object recognition.

Functional interactions between the macaque dorsal and ventral visual pathways during three-dimensional object vision

The division of labor between the dorsal and the ventral visual stream in the primate brain has inspired numerous studies on the visual system in humans and in nonhuman primates. However, how and under which circumstances the two visual streams interact is still poorly understood. Here we review evidence from anatomy, modelling, electrophysiology, electrical microstimulation (EM), reversible inactivation and functional imaging in the macaque monkey aimed at clarifying at which levels in the hierarchy of visual areas the two streams interact, and what type of information might be exchanged between the two streams during three-dimensional (3D) object viewing. Neurons in both streams encode 3D structure from binocular disparity, synchronized activity between parietal and inferotemporal areas is present during 3D structure categorization, and clusters of 3D structure-selective neurons in parietal cortex are anatomically connected to ventral stream areas. In addition, caudal intraparietal cortex exerts a causal influence on 3D-structure related activations in more anterior parietal cortex and in inferotemporal cortex. Thus, both anatomical and functional evidence indicates that the dorsal and the ventral visual stream interact during 3D object viewing.