Structural and functional changes across the visual cortex of a patient with visual form agnosia

Hemispheric lateralization of language processing: insights from network-based symptom mapping and patient subgroups

The hemispheric laterality of language processing has become a hot topic in modern neuroscience. Although most previous studies have reported left-lateralized language processing, other studies found it to be bilateral. A previous neurocomputational model has proposed a unified framework to explain that the above discrepancy might be from healthy and patient individuals. This model posits an initial symmetry but imbalanced capacity in language processing for healthy individuals, with this imbalance contributing to language recovery disparities following different hemispheric injuries. The present study investigated this model by analyzing the lateralization patterns of language subnetworks across multiple attributes with a group of 99 patients (compared to nonlanguage processing) and examining the lateralization patterns of language subnetworks in subgroups with damage to different hemispheres. Subnetworks were identified using a whole-brain network-based lesion-symptom mapping method, and the lateralization index was quantitatively measured. We found that all the subnetworks in language processing were left-lateralized, while subnetworks in nonlanguage processing had different lateralization patterns. Moreover, diverse hemisphere-injury subgroups exhibited distinct language recovery effects. These findings provide robust support for the proposed neurocomputational model of language processing.

A review of the impairments, preserved visual functions, and neuropathology in 21 patients with visual form agnosia - A unique defect with line drawings

We present a comprehensive review of the rare syndrome visual form agnosia (VFA). We begin by documenting its history, including the origins of the term, and the first case study labelled as VFA. The defining characteristics of the syndrome, as others have previously defined it, are then described. The impairments, preserved aspects of visual perception, and areas of brain damage in 21 patients who meet these defining characteristics are described in detail, including which tests were used to verify the presence or absence of key symptoms. From this, we note important similarities along with notable areas of divergence between patients. Damage to the occipital lobe (20/21), an inability to recognise line drawings (19/21), preserved colour vision (14/21), and visual field defects (16/21) were areas of consistency across most cases. We found it useful to distinguish between shape and form as distinct constructs when examining perceptual abilities in VFA patients. Our observations suggest that these patients often exhibit difficulties in processing simplified versions of form. Deficits in processing orientation and size were uncommon. Motion perception and visual imagery were not widely tested for despite being typically cited as defining features of the syndrome - although in the sample described, motion perception was never found to be a deficit. Moreover, problems with vision (e.g., poor visual acuity and the presence of hemianopias/scotomas in the visual fields) are more common than we would have thought and may also contribute to perceptual impairments in patients with VFA. We conclude that VFA is a perceptual disorder where the visual system has a reduced ability to synthesise lines together for the purposes of making sense of what images represent holistically.

Pictorial depth cues always influence reaching distance

We report five experiments to test the influence of pictorial depth on reaching. Our core method is to project a wide-field background of linear perspective and/or texture gradient onto a tabletop, and to measure the amplitude of reaches made to targets within it. In 63 healthy participants performing immediate open-loop reaches across Experiments 1-4, we observed a clear effect of pictorial depth. This effect was driven specifically by the convergence of the background pattern at the target position: for each additional degree of pictorial convergence, reaching distance increased by half a millimetre. In the individual experiments, we applied manipulations that might be expected to modify the influence of pictorial depth. We found no evidence that the effect was modified with monocular viewing, or when participants responded with the left hand, or if a memory delay was inserted before the response. Nor did participants become less susceptible to pictorial depth when visual feedback of terminal reaching errors was provided, although visual feedback during the reach did mitigate the influence of pictorial depth. Finally, the visual form agnosic patient DF showed an entirely normal effect of pictorial depth cues, which leads us to question the idea that this effect emanates from visual analyses of size and shape in the ventral stream, rather than from the dorsal stream, or from earlier stages of visual processing.

Similar object shape representation encoded in the inferolateral occipitotemporal cortex of sighted and early blind people

We can sense an object's shape by vision or touch. Previous studies suggested that the inferolateral occipitotemporal cortex (ILOTC) implements supramodal shape representations as it responds more to seeing or touching objects than shapeless textures. However, such activation in the anterior portion of the ventral visual pathway could be due to the conceptual representation of an object or visual imagery triggered by touching an object. We addressed these possibilities by directly comparing shape and conceptual representations of objects in early blind (who lack visual experience/imagery) and sighted participants. We found that bilateral ILOTC in both groups showed stronger activation during a shape verification task than during a conceptual verification task made on the names of the same manmade objects. Moreover, the distributed activity in the ILOTC encoded shape similarity but not conceptual association among objects. Besides the ILOTC, we also found shape representation in both groups' bilateral ventral premotor cortices and intraparietal sulcus (IPS), a frontoparietal circuit relating to object grasping and haptic processing. In contrast, the conceptual verification task activated both groups' left perisylvian brain network relating to language processing and, interestingly, the cuneus in early blind participants only. The ILOTC had stronger functional connectivity to the frontoparietal circuit than to the left perisylvian network, forming a modular structure specialized in shape representation. Our results conclusively support that the ILOTC selectively implements shape representation independently of visual experience, and this unique functionality likely comes from its privileged connection to the frontoparietal haptic circuit.

Visual objects and their colors

The ventral temporal cortex hosts key regions for the high-level visual processing of object shape and color. These areas represent nodes of large-scale neural circuits dedicated to object recognition. In the language-dominant hemisphere, some of these regions communicate with the language systems; by assigning verbal labels to percepts, these circuits speedup stimulus categorization, and permit fast and accurate interindividual communication. By impairing the functioning of these circuits, neurological damage may provoke disabling disorders of the processing of visual objects and of their colors. Brain damage of vascular, degenerative, toxic, or traumatic origin can induce deficits at different levels of visual processing, from the building of shape- or wavelength-invariant percepts, to their connections with semantic knowledge and with the appropriate lexical entry. After an overview of the neuroimaging of domain-preferring regions for object shape and color in the ventral temporal cortex, this chapter reviews evidence from historical and recent cases of acquired visual agnosia and color processing deficits. A recurrent motif emerging from patients' patterns of performance and lesion locations is the existence of caudo-rostral gradients in the ventral occipito-temporal cortex, spanning from more perceptual to more cognitive stages of processing.

Acquired dyslexias following temporal lesions

The acquisition of reading by children is supported by deep changes in the brain systems devoted to vision and language. The left temporal lobe contributes critically to both systems, and lesions affecting it may therefore cause both peripheral vision-related and central language-related reading impairments. The diversity of peripheral dyslexias reflects the anatomical and functional division of the visual cortex into early visual regions, whose lesions have a limited impact on reading; ventral regions, whose lesions are mostly associated to Pure Alexia; and dorsal regions, whose lesions may yield spatial, neglect-related, and attentional dyslexias. Similarly, central alexias reflect the broad distinction, within language processes, between phonological and lexico-semantic components. Phonological and surface dyslexias roughly result from impairment of the former and the latter processes, respectively, while deep dyslexia may be seen as the association of both. In this chapter, we review such types of acquired dyslexias, their clinical features, pathophysiology, and anatomical correlates.

The Ties that Bind: Agnosia, Neglect and Selective Attention to Visual Scale

PURPOSE OF REVIEW

Historical and contemporary treatments of visual agnosia and neglect regard these disorders as largely unrelated. It is thought that damage to different neural processes leads directly to one or the other condition, yet apperceptive variants of agnosia and object-centered variants of neglect share remarkably similar deficits in the quality of conscious experience. Here we argue for a closer association between "apperceptive" variants of visual agnosia and "object-centered" variants of visual neglect. We introduce a theoretical framework for understanding these conditions based on "scale attention", which refers to selecting boundary and surface information at different levels of the structural hierarchy in the visual array.

RECENT FINDINGS

We review work on visual agnosia, the cortical structures and cortico-cortical pathways that underlie visual perception, visuospatial neglect and object-centered neglect, and attention to scale. We highlight direct and indirect pathways involved in these disorders and in attention to scale. The direct pathway involves the posterior vertical segments of the superior longitudinal fasciculus that are positioned to link the established dorsal and ventral attentional centers in the parietal cortex with structures in the inferior occipitotemporal cortex associated with visual apperceptive agnosia. The connections in the right hemisphere appear to be more important for visual conscious experience, whereas those in the left hemisphere appear to be more strongly associated with the planning and execution of visually guided grasps directed at multi-part objects such as tools. In the latter case, semantic and functional information must drive the selection of the appropriate hand posture and grasp points on the object. This view is supported by studies of grasping in patients with agnosia and in patients with neglect that show that the selection of grasp points when picking up a tool involves both scale attention and semantic contributions from inferotemporal cortex. The indirect pathways, which include the inferior fronto-occipital and horizontal components of the superior longitudinal fasciculi, involve the frontal lobe, working memory and the "multiple demands" network, which can shape the content of visual awareness through the maintenance of goal- and task-based abstractions and their influence on scale attention. Recent studies of human cortico-cortical pathways necessitate revisions to long-standing theoretical views on visual perception, visually guided action and their integrations. We highlight findings from a broad sample of seemingly disparate areas of research to support the proposal that attention to scale is necessary for typical conscious visual experience and for goal-directed actions that depend on functional and semantic information. Furthermore, we suggest that vertical pathways between the parietal and occipitotemporal cortex, along with indirect pathways that involve the premotor and prefrontal cortex, facilitate the operations of scale attention.

Human primary visual cortex shows larger population receptive fields for binocular disparity-defined stimuli

The visual perception of 3D depth is underpinned by the brain's ability to combine signals from the left and right eyes to produce a neural representation of binocular disparity for perception and behaviour. Electrophysiological studies of binocular disparity over the past 2 decades have investigated the computational role of neurons in area V1 for binocular combination, while more recent neuroimaging investigations have focused on identifying specific roles for different extrastriate visual areas in depth perception. Here we investigate the population receptive field properties of neural responses to binocular information in striate and extrastriate cortical visual areas using ultra-high field fMRI. We measured BOLD fMRI responses while participants viewed retinotopic mapping stimuli defined by different visual properties: contrast, luminance, motion, correlated and anti-correlated stereoscopic disparity. By fitting each condition with a population receptive field model, we compared quantitatively the size of the population receptive field for disparity-specific stimulation. We found larger population receptive fields for disparity compared with contrast and luminance in area V1, the first stage of binocular combination, which likely reflects the binocular integration zone, an interpretation supported by modelling of the binocular energy model. A similar pattern was found in region LOC, where it may reflect the role of disparity as a cue for 3D shape. These findings provide insight into the binocular receptive field properties underlying processing for human stereoscopic vision.

Review: Sport Performance and the Two-visual-system Hypothesis of Vision: Two Pathways but Still Many Questions

SIGNIFICANCE

The two-visual-system hypothesis (TVSH) provides a framework for understanding the nature of the visual information athletes are likely to rely on during competition. If valid, the framework provides a valuable means of evaluating the likely efficacy of different vision training tools that claim to improve the sport performance of athletes.The TVSH has been used to explain that many of the existing methods of testing and training vision may be ineffective to improve on-field sport performance. The TVSH suggests that the visual pathway used to control actions on-field may be different-and rely on different visual information-to the pathway often tested and trained off-field. However, the central claims of the TVSH are increasingly questioned, and this has implications for our understanding of vision and sport performance. The aim of this article is to outline the implications of the TVSH for the visual control of actions in sport. We first provide a summary of the TVSH and outline how the visual information used to control actions might differ from that usually tested. Second, we look at the evidence from studies of sports that are (and are not) consistent with the TVSH and the implications they have for training vision. Finally, we take a wider look at the impact of the TVSH on the sport sciences and other complementary theories that hold implications for training vision to improve sport performance.

Neuroanatomy and Sampling of Central Projections for the Visual System in Mammals Used in Toxicity Testing

Visual system toxicity may manifest anywhere in the visual system, from the eye proper to the visual brain. Therefore, effective screening for visual system toxicity must evaluate not only ocular structures (ie, eye and optic nerve) but also multiple key brain regions involved in vision (eg, optic tract, subcortical relay nuclei, and primary and secondary visual cortices). Despite a generally comparable pattern across species, the neuroanatomic organization and function of the visual brain in rodents and rabbits exhibit appreciable differences relative to nonrodents. Currently recognized sampling practices for general toxicity studies in animals, which are based on easily discerned external neuroanatomic landmarks and guided by extant stereotaxic brain atlases, typically will permit histopathologic evaluation of many brain centers involved in visual sensation (eg, optic chiasm, optic tract, dorsal lateral geniculate nucleus, primary and secondary visual cortices) and often some subcortical brain nuclei involved in light-modulated nonvisual activities needed for visual attention and orientation (eg, rostral colliculus in quadrupeds, termed the superior colliculus in bipeds; several cranial nerve nuclei). Pathologic findings induced by toxicants in the visual brain centers are similar to those that are produced in other brain regions.

Higher Cortical Visual Disorders

PURPOSE OF REVIEW

This article reviews the disorders that result from disruption of extrastriate regions of the cerebral cortex responsible for higher visual processing. For each disorder, a historical perspective is offered and relevant neuroscientific studies are reviewed.

RECENT FINDINGS

Careful analysis of the consequences of lesions that disrupt visual functions such as facial recognition and written language processing has improved understanding of the role of key regions in these networks. In addition, modern imaging techniques have built upon prior lesion studies to further elucidate the functions of these cortical areas. For example, functional MRI (fMRI) has identified and characterized the response properties of ventral regions that contribute to object recognition and dorsal regions that subserve motion perception and visuospatial attention. Newer network-based functional imaging studies have shed light on the mechanisms behind various causes of spontaneous visual hallucinations.

SUMMARY

Understanding the regions and neural networks responsible for higher-order visual function helps the practicing neurologist to diagnose and manage associated disorders of visual processing and to identify and treat responsible underlying disease.

Preserved extrastriate visual network in a monkey with substantial, naturally occurring damage to primary visual cortex

Lesions of primary visual cortex (V1) lead to loss of conscious visual perception with significant impact on human patients. Understanding the neural consequences of such damage may aid the development of rehabilitation methods. In this rare case of a Rhesus macaque (monkey S), likely born without V1, the animal's in-group behaviour was unremarkable, but visual task training was impaired. With multi-modal magnetic resonance imaging, visual structures outside of the lesion appeared normal. Visual stimulation under anaesthesia with checkerboards activated lateral geniculate nucleus of monkey S, while full-field moving dots activated pulvinar. Visual cortical activation was sparse but included face patches. Consistently across lesion and control monkeys, functional connectivity analysis revealed an intact network of bilateral dorsal visual areas temporally correlated with V5/MT activation, even without V1. Despite robust subcortical responses to visual stimulation, we found little evidence for strengthened subcortical input to V5/MT supporting residual visual function or blindsight-like phenomena.

Real-world size coding of solid objects, but not 2-D or 3-D images, in visual agnosia patients with bilateral ventral lesions

Patients with visual agnosia show severe deficits in recognizing two-dimensional (2-D) images of objects, despite the fact that early visual processes such as figure-ground segmentation, and stereopsis, are largely intact. Strikingly, however, these patients can nevertheless show a preservation in their ability to recognize real-world objects -a phenomenon known as the 'real-object advantage' (ROA) in agnosia. To uncover the mechanisms that support the ROA, patients were asked to identify objects whose size was congruent or incongruent with typical real-world size, presented in different display formats (real objects, 2-D and 3-D images). While recognition of images was extremely poor, real object recognition was surprisingly preserved, but only when physical size matched real-world size. Analogous display format and size manipulations did not influence the recognition of common geometric shapes that lacked real-world size associations. These neuropsychological data provide evidence for a surprising preservation of size-coding of real-world-sized tangible objects in patients for whom ventral contributions to image processing are severely disrupted. We propose that object size information is largely mediated by dorsal visual cortex and that this information, together with detailed representation of object shape which is also subserved by dorsal cortex, serve as the basis of the ROA.

Microstructural properties of the vertical occipital fasciculus explain the variability in human stereoacuity

Seeing in the three-dimensional world—stereopsis—is an innate human ability, but it varies substantially among individuals. The neurobiological basis of this variability is not understood. We combined diffusion and quantitative MRI imaging with a psychophysical measurements, and found that variability in stereoacuity is associated with microstructural differences in the right vertical occipital fasciculus, a white matter tract connecting dorsal and ventral visual cortex. This result suggests that the microstructure of the pathways that support information transmission across dorsal and ventral visual areas plays an important role human stereopsis.

Stereopsis is a fundamental visual function that has been studied extensively. However, it is not clear why depth discrimination (stereoacuity) varies more significantly among people than other modalities. Previous studies have reported the involvement of both dorsal and ventral visual areas in stereopsis, implying that not only neural computations in cortical areas but also the anatomical properties of white matter tracts connecting those areas can impact stereopsis. Here, we studied how human stereoacuity relates to white matter properties by combining psychophysics, diffusion MRI (dMRI), and quantitative MRI (qMRI). We performed a psychophysical experiment to measure stereoacuity and, in the same participants, we analyzed the microstructural properties of visual white matter tracts on the basis of two independent measurements, dMRI (fractional anisotropy, FA) and qMRI (macromolecular tissue volume; MTV). Microstructural properties along the right vertical occipital fasciculus (VOF), a major tract connecting dorsal and ventral visual areas, were highly correlated with measures of stereoacuity. This result was consistent for both FA and MTV, suggesting that the behavioral–structural relationship reflects differences in neural tissue density, rather than differences in the morphological configuration of fibers. fMRI confirmed that binocular disparity stimuli activated the dorsal and ventral visual regions near VOF endpoints. No other occipital tracts explained the variance in stereoacuity. In addition, the VOF properties were not associated with differences in performance on a different psychophysical task (contrast detection). These series of experiments suggest that stereoscopic depth discrimination performance is, at least in part, constrained by dorso-ventral communication through the VOF.

A Tale of Two Visual Systems: Invariant and Adaptive Visual Information Representations in the Primate Brain

Visual information processing contains two opposite needs. There is both a need to comprehend the richness of the visual world and a need to extract only pertinent visual information to guide thoughts and behavior at a given moment. I argue that these two aspects of visual processing are mediated by two complementary visual systems in the primate brain-specifically, the occipitotemporal cortex (OTC) and the posterior parietal cortex (PPC). The role of OTC in visual processing has been documented extensively by decades of neuroscience research. I review here recent evidence from human imaging and monkey neurophysiology studies to highlight the role of PPC in adaptive visual processing. I first document the diverse array of visual representations found in PPC. I then describe the adaptive nature of visual representation in PPC by contrasting visual processing in OTC and PPC and by showing that visual representations in PPC largely originate from OTC.

Psychophysical and neuroimaging responses to moving stimuli in a patient with the Riddoch phenomenon due to bilateral visual cortex lesions

Patients with injury to early visual cortex or its inputs can display the Riddoch phenomenon: preserved awareness for moving but not stationary stimuli. We provide a detailed case report of a patient with the Riddoch phenomenon, MC. MC has extensive bilateral lesions to occipitotemporal cortex that include most early visual cortex and complete blindness in visual field perimetry testing with static targets. Nevertheless, she shows a remarkably robust preserved ability to perceive motion, enabling her to navigate through cluttered environments and perform actions like catching moving balls. Comparisons of MC's structural magnetic resonance imaging (MRI) data to a probabilistic atlas based on controls reveals that MC's lesions encompass the posterior, lateral, and ventral early visual cortex bilaterally (V1, V2, V3A/B, LO1/2, TO1/2, hV4 and VO1 in both hemispheres) as well as more extensive damage to right parietal (inferior parietal lobule) and left ventral occipitotemporal cortex (VO1, PHC1/2). She shows some sparing of anterior occipital cortex, which may account for her ability to see moving targets beyond ~15 degrees eccentricity during perimetry. Most strikingly, functional and structural MRI revealed robust and reliable spared functionality of the middle temporal motion complex (MT+) bilaterally. Moreover, consistent with her preserved ability to discriminate motion direction in psychophysical testing, MC also shows direction-selective adaptation in MT+. A variety of tests did not enable us to discern whether input to MT+ was driven by her spared anterior occipital cortex or subcortical inputs. Nevertheless, MC shows rich motion perception despite profoundly impaired static and form vision, combined with clear preservation of activation in MT+, thus supporting the role of MT+ in the Riddoch phenomenon.

Is neuroimaging measuring information in the brain?

Psychology moved beyond the stimulus response mapping of behaviorism by adopting an information processing framework. This shift from behavioral to cognitive science was partly inspired by work demonstrating that the concept of information could be defined and quantified (Shannon, 1948). This transition developed further from cognitive science into cognitive neuroscience, in an attempt to measure information in the brain. In the cognitive neurosciences, however, the term information is often used without a clear definition. This paper will argue that, if the formulation proposed by Shannon is applied to modern neuroimaging, then numerous results would be interpreted differently. More specifically, we argue that much modern cognitive neuroscience implicitly focuses on the question of how we can interpret the activations we record in the brain (experimenter-as-receiver), rather than on the core question of how the rest of the brain can interpret those activations (cortex-as-receiver). A clearer focus on whether activations recorded via neuroimaging can actually act as information in the brain would not only change how findings are interpreted but should also change the direction of empirical research in cognitive neuroscience.

Single-case cognitive neuropsychology in the age of big data

Historically, single-case studies of brain-damaged individuals have contributed substantially to our understanding of cognitive processes. However, the role of single-case cognitive neuropsychology has diminished with the proliferation of techniques that measure neural activity in humans. Instead, large-scale informatics approaches in which data are gathered from hundreds of neuroimaging studies have become popular. It has been claimed that utilizing these informatics approaches can address problems found in single imaging studies. We first discuss reasons for why cognitive neuropsychology is thought to be in decline. Next, we note how these informatics approaches, while having benefits, are not particularly suited for understanding functional architectures. We propose that the single-case cognitive neuropsychological approach, which is focused on developing models of cognitive processing, addresses several of the weaknesses inherent in informatics approaches. Furthermore, we discuss how using neural data from brain-damaged individuals provides data that can inform both cognitive and neural models of cognitive processing.

Effects of cortical damage on binocular depth perception

Stereoscopic depth perception requires considerable neural computation, including the initial correspondence of the two retinal images, comparison across the local regions of the visual field and integration with other cues to depth. The most common cause for loss of stereoscopic vision is amblyopia, in which one eye has failed to form an adequate input to the visual cortex, usually due to strabismus (deviating eye) or anisometropia. However, the significant cortical processing required to produce the percept of depth means that, even when the retinal input is intact from both eyes, brain damage or dysfunction can interfere with stereoscopic vision. In this review, I examine the evidence for impairment of binocular vision and depth perception that can result from insults to the brain, including both discrete damage, temporal lobectomy and more systemic diseases such as posterior cortical atrophy.

This article is part of the themed issue ‘Vision in our three-dimensional world’.

Nothing magical: pantomimed grasping is controlled by the ventral system

In a recent amendment to the two-visual-system model, it has been proposed that actions must result in tactile contact with the goal object for the dorsal system to become engaged (Whitwell et al., Neuropsychologia 55:41-50, 2014). The present study tested this addition by assessing the use of allocentric information in normal and pantomime actions. To this end, magicians, and participants who were inexperienced in performing pantomime actions made normal and pantomime grasps toward objects embedded in the Müller-Lyer illusion. During pantomime grasping, a grasp was made next to an object that was in full view (i.e., a displaced pantomime grasping task). The results showed that pantomime grasps took longer, were slower, and had smaller hand apertures than normal grasping. Most importantly, hand apertures were affected by the illusion during pantomime grasping but not in normal grasping, indicating that displaced pantomime grasping is based on allocentric information. This was true for participants without experience in performing pantomime grasps as well as for magicians with experience in pantomiming. The finding that the illusory bias is limited to pantomime grasping and persists with experience supports the conjecture that the normal engagement of the dorsal system's contribution requires tactile contact with a goal object. If no tactile contact is made, then movement control shifts toward the ventral system.

How do the two visual streams interact with each other?

The current consensus divides primate cortical visual processing into two broad networks or "streams" composed of highly interconnected areas (Milner and Goodale 2006, 2008; Goodale 2014). The ventral stream, passing from primary visual cortex (V1) through to inferior parts of the temporal lobe, is considered to mediate the transformation of the contents of the visual signal into the mental furniture that guides memory, recognition and conscious perception. In contrast the dorsal stream, passing from V1 through to various areas in the posterior parietal lobe, is generally considered to mediate the visual guidance of action, primarily in real time. The brain, however, does not work through mutually insulated subsystems, and indeed there are well-documented interconnections between the two streams. Evidence for contributions from ventral stream systems to the dorsal stream comes from human neuropsychological and neuroimaging research, and indicates a crucial role in mediating complex and flexible visuomotor skills. Complementary evidence points to a role for posterior dorsal-stream visual analysis in certain aspects of 3-D perceptual function in the ventral stream. A series of studies of a patient with visual form agnosia has been instrumental in shaping our knowledge of what each stream can achieve in isolation; but it has also helped us to tease apart the relative dependence of parietal visuomotor systems on direct bottom-up visual inputs versus inputs redirected via perceptual systems within the ventral stream.

A TMS Investigation on the Role of Lateral Occipital Complex and Caudal Intraparietal Sulcus in the Perception of Object Form and Orientation

We used TMS to assess the causal roles of the lateral occipital (LO) and caudal intraparietal sulcus (cIPS) areas in the perceptual discrimination of object features. All participants underwent fMRI to localize these areas using a protocol in which they passively viewed images of objects that varied in both form and orientation. fMRI identified six significant brain regions: LO, cIPS, and the fusiform gyrus, bilaterally. In a separate experimental session, we applied TMS to LO or cIPS while the same participants performed match-to-sample form or orientation discrimination tasks. Compared with sham stimulation, TMS to either the left or right LO increased RTs for form but not orientation discrimination, supporting a critical role for LO in form processing for perception- and judgment-based tasks. In contrast, we did not observe any effects when we applied TMS to cIPS. Thus, despite the clear functional evidence of engagement for both LO and cIPS during the passive viewing of objects in the fMRI experiment, the TMS experiment revealed that cIPS is not critical for making perceptual judgments about their form or orientation.

Functional modulation of contralateral bias in early and object-selective areas after stroke of the occipital ventral cortices

Object agnosia is a rare symptom, occurring mainly after bilateral damage of the ventral visual cortex. Most patients suffering from unilateral ventral lesions are clinically non-agnosic. Here, we studied the effect of unilateral occipito-temporal lesions on object categorization and its underlying neural correlates in visual areas. Thirteen non-agnosic stroke patients and twelve control subjects performed an event-related rapid object categorization task in the fMRI scanner where images were presented either to the left or to the right of a fixed point. Eight patients had intact central visual fields within at least 10° eccentricity while five patients showed an incomplete hemianopia. Patients made more errors than controls for both contra- and ipsilesional presentation, meaning that object categorization was impaired bilaterally in both patient groups. The activity in cortical visual areas is usually higher when a stimulus is presented contralaterally compared to presented ipsilaterally (contralateral bias). A region of interest analysis of early visual (V1-V4) and object-selective areas (lateral occipital complex, LOC; fusiform face area, FFA; and parahippocampal place area, PPA) revealed that the lesioned-hemisphere of patients showed reduced contralateral bias in early visual areas and LOC. In contrast, literally no contralateral bias in FFA and PPA was found. These findings indicate disturbed processing in the lesioned hemisphere, which might be related to the processing of visually presented objects. Thus, unilateral occipito-temporal damage leads to altered contralateral bias in the lesioned hemisphere, which might be the cause of impaired categorization performance in both visual hemifields in clinically non-agnosic patients. We conclude that both hemispheres need to be functionally intact for unimpaired object processing.

Two Visual Pathways in Primates Based on Sampling of Space: Exploitation and Exploration of Visual Information

Evidence is strong that the visual pathway is segregated into two distinct streams—ventral and dorsal. Two proposals theorize that the pathways are segregated in function: The ventral stream processes information about object identity, whereas the dorsal stream, according to one model, processes information about either object location, and according to another, is responsible in executing movements under visual control. The models are influential; however recent experimental evidence challenges them, e.g., the ventral stream is not solely responsible for object recognition; conversely, its function is not strictly limited to object vision; the dorsal stream is not responsible by itself for spatial vision or visuomotor control; conversely, its function extends beyond vision or visuomotor control. In their place, we suggest a robust dichotomy consisting of a ventral stream selectively sampling high-resolution/focal spaces, and a dorsal stream sampling nearly all of space with reduced foveal bias. The proposal hews closely to the theme of embodied cognition: Function arises as a consequence of an extant sensory underpinning. A continuous, not sharp, segregation based on function emerges, and carries with it an undercurrent of an exploitation-exploration dichotomy. Under this interpretation, cells of the ventral stream, which individually have more punctate receptive fields that generally include the fovea or parafovea, provide detailed information about object shapes and features and lead to the systematic exploitation of said information; cells of the dorsal stream, which individually have large receptive fields, contribute to visuospatial perception, provide information about the presence/absence of salient objects and their locations for novel exploration and subsequent exploitation by the ventral stream or, under certain conditions, the dorsal stream. We leverage the dichotomy to unify neuropsychological cases under a common umbrella, account for the increased prevalence of multisensory integration in the dorsal stream under a Bayesian framework, predict conditions under which object recognition utilizes the ventral or dorsal stream, and explain why cells of the dorsal stream drive sensorimotor control and motion processing and have poorer feature selectivity. Finally, the model speculates on a dynamic interaction between the two streams that underscores a unified, seamless perception. Existing theories are subsumed under our proposal.

Visual motion serves but is not under the purview of the dorsal pathway

Visual motion processing is often attributed to the dorsal visual pathway despite visual motion's involvement in almost all visual functions. Furthermore, some visual motion tasks critically depend on the structural integrity of regions outside the dorsal pathway. Here, based on numerous studies, I propose that visual motion signals are swiftly transmitted via multiple non-hierarchical routes to primary motion-dedicated processing regions (MT/V5 and MST) that are not part of the dorsal pathway, and then propagated to a multiplicity of brain areas according to task demands, reaching these regions earlier than the dorsal/ventral hierarchical flow. This not only places MT/V5 at the same or even earlier visual processing stage as that of V1, but can also elucidate many findings with implications to visual awareness. While the integrity of the non-hierarchical motion pathway is necessary for all visual motion perception, it is insufficient on its own, and the transfer of visual motion signals to additional brain areas is crucial to allow the different motion perception tasks (e.g. optic flow, visuo-vestibular balance, movement observation, dynamic form detection and perception, and even reading). I argue that this lateral visual motion pathway can be distinguished from the dorsal pathway not only based on faster response latencies and distinct anatomical connections, but also based on its full field representation. I also distinguish between this primary lateral visual motion pathway sensitive to all motion in the visual field, and a much less investigated optic flow sensitive medial processing pathway (from V1 to V6 and V6A) that appears to be part of the dorsal pathway. Multiple additional predictions are provided that allow testing this proposal and distinguishing between the visual pathways.

Lesions to right posterior parietal cortex impair visual depth perception from disparity but not motion cues

The posterior parietal cortex (PPC) is understood to be active when observers perceive three-dimensional (3D) structure. However, it is not clear how central this activity is in the construction of 3D spatial representations. Here, we examine whether PPC is essential for two aspects of visual depth perception by testing patients with lesions affecting this region. First, we measured subjects' ability to discriminate depth structure in various 3D surfaces and objects using binocular disparity. Patients with lesions to right PPC (N = 3) exhibited marked perceptual deficits on these tasks, whereas those with left hemisphere lesions (N = 2) were able to reliably discriminate depth as accurately as control subjects. Second, we presented an ambiguous 3D stimulus defined by structure from motion to determine whether PPC lesions influence the rate of bistable perceptual alternations. Patients' percept durations for the 3D stimulus were generally within a normal range, although the two patients with bilateral PPC lesions showed the fastest perceptual alternation rates in our sample. Intermittent stimulus presentation reduced the reversal rate similarly across subjects. Together, the results suggest that PPC plays a causal role in both inferring and maintaining the perception of 3D structure with stereopsis supported primarily by the right hemisphere, but do not lend support to the view that PPC is a critical contributor to bistable perceptual alternations.This article is part of the themed issue 'Vision in our three-dimensional world'.

Memory-guided reaching in a patient with visual hemiagnosia

The two-visual-systems hypothesis (TVSH) postulates that memory-guided movements rely on intact functions of the ventral stream. Its particular importance for memory-guided actions was initially inferred from behavioral dissociations in the well-known patient DF. Despite of rather accurate reaching and grasping movements to visible targets, she demonstrated grossly impaired memory-guided grasping as much as impaired memory-guided reaching. These dissociations were later complemented by apparently reversed dissociations in patients with dorsal damage and optic ataxia. However, grasping studies in DF and optic ataxia patients differed with respect to the retinotopic position of target objects, questioning the interpretation of the respective findings as a double dissociation. In contrast, the findings for reaching errors in both types of patients came from similar peripheral target presentations. However, new data on brain structural changes and visuomotor deficits in DF also questioned the validity of a double dissociation in reaching. A severe visuospatial short-term memory deficit in DF further questioned the specificity of her memory-guided reaching deficit. Therefore, we compared movement accuracy in visually-guided and memory-guided reaching in a new patient who suffered a confined unilateral damage to the ventral visual system due to stroke. Our results indeed support previous descriptions of memory-guided movements' inaccuracies in DF. Furthermore, our data suggest that recently discovered optic-ataxia like misreaching in DF is most likely caused by her parieto-occipital and not by her ventral stream damage. Finally, multiple visuospatial memory measurements in HWS suggest that inaccuracies in memory-guided reaching tasks in patients with ventral damage cannot be explained by visuospatial short-term memory or perceptual deficits, but by a specific deficit in visuomotor processing.

Reprint of: Visual processing of words in a patient with visual form agnosia: A behavioural and fMRI study

Patient D.F. has a profound and enduring visual form agnosia due to a carbon monoxide poisoning episode suffered in 1988. Her inability to distinguish simple geometric shapes or single alphanumeric characters can be attributed to a bilateral loss of cortical area LO, a loss that has been well established through structural and functional fMRI. Yet despite this severe perceptual deficit, D.F. is able to "guess" remarkably well the identity of whole words. This paradoxical finding, which we were able to replicate more than 20 years following her initial testing, raises the question as to whether D.F. has retained specialized brain circuitry for word recognition that is able to function to some degree without the benefit of inputs from area LO. We used fMRI to investigate this, and found regions in the left fusiform gyrus, left inferior frontal gyrus, and left middle temporal cortex that responded selectively to words. A group of healthy control subjects showed similar activations. The left fusiform activations appear to coincide with the area commonly named the visual word form area (VWFA) in studies of healthy individuals, and appear to be quite separate from the fusiform face area (FFA). We hypothesize that there is a route to this area that lies outside area LO, and which remains relatively unscathed in D.F.

Brain-decoding fMRI reveals how wholes relate to the sum of parts

The human brain performs many nonlinear operations in order to extract relevant information from local inputs. How can we observe and quantify these effects within and across large patches of cortex? In this paper, we discuss the application of multi-voxel pattern analysis (MVPA) in functional magnetic resonance imaging (fMRI) to address this issue. Specifically, we show how MVPA (i) allows to compare various possibilities of part combinations into wholes, such as taking the mean, weighted mean, or the maximum of responses to the parts; (ii) can be used to quantify the parameters of these combinations; and (iii) can be applied in various experimental paradigms. Through these procedures, fMRI helps to obtain a computational understanding of how local information is integrated into larger wholes in various cortical regions.

The Two Visual Systems Hypothesis: New Challenges and Insights from Visual form Agnosic Patient DF

Patient DF, who developed visual form agnosia following carbon monoxide poisoning, is still able to use vision to adjust the configuration of her grasping hand to the geometry of a goal object. This striking dissociation between perception and action in DF provided a key piece of evidence for the formulation of Goodale and Milner's Two Visual Systems Hypothesis (TVSH). According to the TVSH, the ventral stream plays a critical role in constructing our visual percepts, whereas the dorsal stream mediates the visual control of action, such as visually guided grasping. In this review, we discuss recent studies of DF that provide new insights into the functional organization of the dorsal and ventral streams. We confirm recent evidence that DF has dorsal as well as ventral brain damage - and that her dorsal-stream lesions and surrounding atrophy have increased in size since her first published brain scan. We argue that the damage to DF's dorsal stream explains her deficits in directing actions at targets in the periphery. We then focus on DF's ability to accurately adjust her in-flight hand aperture to changes in the width of goal objects (grip scaling) whose dimensions she cannot explicitly report. An examination of several studies of DF's grip scaling under natural conditions reveals a modest though significant deficit. Importantly, however, she continues to show a robust dissociation between form vision for perception and form vision-for-action. We also review recent studies that explore the role of online visual feedback and terminal haptic feedback in the programming and control of her grasping. These studies make it clear that DF is no more reliant on visual or haptic feedback than are neurologically intact individuals. In short, we argue that her ability to grasp objects depends on visual feedforward processing carried out by visuomotor networks in her dorsal stream that function in the much the same way as they do in neurologically intact individuals.

The blind brain: How (lack of) vision shapes the morphological and functional architecture of the human brain

Since the early days, how we represent the world around us has been a matter of philosophical speculation. Over the last few decades, modern neuroscience, and specifically the development of methodologies for the structural and the functional exploration of the brain have made it possible to investigate old questions with an innovative approach. In this brief review, we discuss the main findings from a series of brain anatomical and functional studies conducted in sighted and congenitally blind individuals by our’s and others' laboratories. Historically, research on the ‘blind brain’ has focused mainly on the cross-modal plastic changes that follow sensory deprivation. More recently, a novel line of research has been developed to determine to what extent visual experience is truly required to achieve a representation of the surrounding environment. Overall, the results of these studies indicate that most of the brain fine morphological and functional architecture is programmed to develop and function independently from any visual experience. Distinct cortical areas are able to process information in a supramodal fashion, that is, independently from the sensory modality that carries that information to the brain. These observations strongly support the hypothesis of a modality-independent, i.e. more abstract, cortical organization, and may contribute to explain how congenitally blind individuals may interact efficiently with an external world that they have never seen.

How (and why) the visual control of action differs from visual perception

Vision not only provides us with detailed knowledge of the world beyond our bodies, but it also guides our actions with respect to objects and events in that world. The computations required for vision-for-perception are quite different from those required for vision-for-action. The former uses relational metrics and scene-based frames of reference while the latter uses absolute metrics and effector-based frames of reference. These competing demands on vision have shaped the organization of the visual pathways in the primate brain, particularly within the visual areas of the cerebral cortex. The ventral 'perceptual' stream, projecting from early visual areas to inferior temporal cortex, helps to construct the rich and detailed visual representations of the world that allow us to identify objects and events, attach meaning and significance to them and establish their causal relations. By contrast, the dorsal 'action' stream, projecting from early visual areas to the posterior parietal cortex, plays a critical role in the real-time control of action, transforming information about the location and disposition of goal objects into the coordinate frames of the effectors being used to perform the action. The idea of two visual systems in a single brain might seem initially counterintuitive. Our visual experience of the world is so compelling that it is hard to believe that some other quite independent visual signal-one that we are unaware of-is guiding our movements. But evidence from a broad range of studies from neuropsychology to neuroimaging has shown that the visual signals that give us our experience of objects and events in the world are not the same ones that control our actions.

Pointing in visual periphery: is DF's dorsal stream intact?

Observations of the visual form agnosic patient DF have been highly influential in establishing the hypothesis that separate processing streams deal with vision for perception (ventral stream) and vision for action (dorsal stream). In this context, DF's preserved ability to perform visually-guided actions has been contrasted with the selective impairment of visuomotor performance in optic ataxia patients suffering from damage to dorsal stream areas. However, the recent finding that DF shows a thinning of the grey matter in the dorsal stream regions of both hemispheres in combination with the observation that her right-handed movements are impaired when they are performed in visual periphery has opened up the possibility that patient DF may potentially also be suffering from optic ataxia. If lesions to the posterior parietal cortex (dorsal stream) are bilateral, pointing and reaching deficits should be observed in both visual hemifields and for both hands when targets are viewed in visual periphery. Here, we tested DF's visuomotor performance when pointing with her left and her right hand toward targets presented in the left and the right visual field at three different visual eccentricities. Our results indicate that DF shows large and consistent impairments in all conditions. These findings imply that DF's dorsal stream atrophies are functionally relevant and hence challenge the idea that patient DF's seemingly normal visuomotor behaviour can be attributed to her intact dorsal stream. Instead, DF seems to be a patient who suffers from combined ventral and dorsal stream damage meaning that a new account is needed to explain why she shows such remarkably normal visuomotor behaviour in a number of tasks and conditions.

Configural Gestalts remain nothing more than the sum of their parts in visual agnosia

We report converging evidence that higher stages of the visual system are critically required for the whole to become more than the sum of its parts by studying patient DF with visual agnosia using a configural superiority paradigm. We demonstrate a clear dissociation between this patient and normal controls such that she could more easily report information about parts, demonstrating a striking reversal of the normal configural superiority effect. Furthermore, by comparing DF's performance to earlier neuroimaging and novel modeling work, we found a compelling consistency between her performance and representations in the early visual areas, which are spared in this patient. The reversed pattern of performance in this patient highlights that in some cases visual Gestalts do not emerge early on without processing in higher visual areas. More broadly, this study demonstrates how neuropsychological patients can be used to unmask representations maintained at early stages of processing.