Visuomotor performance in a patient with visual agnosia due to an early lesion

The size-weight illusion in visual form agnosic patient DF

The size-weight illusion is a perceptual illusion where smaller objects are judged as heavier than equally weighted larger objects. A previous informal report suggests that visual form agnosic patient DF does not experience the size-weight illusion when vision is the only available cue to object size. We tested this experimentally, comparing the magnitudes of DF's visual, kinesthetic and visual-kinesthetic size-weight illusions to those of 28 similarly-aged controls. A modified t-test found that DF's visual size-weight illusion was significantly smaller than that of controls (z_cc = -1.7). A test of simple dissociation based on the Revised Standardized Difference Test found that the discrepancy between the magnitude of DF's visual and kinesthetic size-weight illusions was not significantly different from that of controls (z_dcc = -1.054), thereby failing to establish a dissociation between the visual and kinesthetic conditions. These results are consistent with previous suggestions that visual form agnosia, following ventral visual stream damage, is associated with an abnormally reduced size-weight illusion. The results, however, do not confirm that this reduction is specific to the use of visual size cues to predict object weight, rather than reflecting more general changes in the processing of object size cues or in the use of predictive strategies for lifting.

The dorsal "action" pathway

In 1992, Goodale and Milner proposed a division of labor in the visual pathways of the primate cerebral cortex. According to their account, the ventral pathway, which projects to occipitotemporal cortex, constructs our visual percepts, while the dorsal pathway, which projects to posterior parietal cortex, mediates the visual control of action. Although the framing of the two-visual-system hypothesis has not been without controversy, it is clear that vision for action and vision for perception have distinct computational requirements, and significant support for the proposed neuroanatomic division has continued to emerge over the last two decades from human neuropsychology, neuroimaging, behavioral psychophysics, and monkey neurophysiology. In this chapter, we review much of this evidence, with a particular focus on recent findings from human neuroimaging and monkey neurophysiology, demonstrating a specialized role for parietal cortex in visually guided behavior. But even though the available evidence suggests that dedicated circuits mediate action and perception, in order to produce adaptive goal-directed behavior there must be a close coupling and seamless integration of information processing across these two systems. We discuss such ventral-dorsal-stream interactions and argue that the two pathways play different, yet complementary, roles in the production of skilled behavior.

How do the two visual streams interact with each other?

The current consensus divides primate cortical visual processing into two broad networks or "streams" composed of highly interconnected areas (Milner and Goodale 2006, 2008; Goodale 2014). The ventral stream, passing from primary visual cortex (V1) through to inferior parts of the temporal lobe, is considered to mediate the transformation of the contents of the visual signal into the mental furniture that guides memory, recognition and conscious perception. In contrast the dorsal stream, passing from V1 through to various areas in the posterior parietal lobe, is generally considered to mediate the visual guidance of action, primarily in real time. The brain, however, does not work through mutually insulated subsystems, and indeed there are well-documented interconnections between the two streams. Evidence for contributions from ventral stream systems to the dorsal stream comes from human neuropsychological and neuroimaging research, and indicates a crucial role in mediating complex and flexible visuomotor skills. Complementary evidence points to a role for posterior dorsal-stream visual analysis in certain aspects of 3-D perceptual function in the ventral stream. A series of studies of a patient with visual form agnosia has been instrumental in shaping our knowledge of what each stream can achieve in isolation; but it has also helped us to tease apart the relative dependence of parietal visuomotor systems on direct bottom-up visual inputs versus inputs redirected via perceptual systems within the ventral stream.

The representation of tool and non-tool object information in the human intraparietal sulcus

Humans have an amazing ability to quickly and efficiently recognize and interact with visual objects in their environment. The underlying neural processes supporting this ability have been mainly explored in the ventral visual stream. However, the dorsal stream has been proposed to play a critical role in guiding object-directed actions. This hypothesis is supported by recent neuroimaging studies that have identified object-selective and tool-related activity in human parietal cortex. In the present study, we sought to delineate tool-related information in the anterior portions of the human intraparietal sulcus (IPS) and relate it to recently identified motor-defined and topographic regions of interest (ROIs) using functional MRI in individual subjects. Consistent with previous reports, viewing pictures of tools compared with pictures of animals led to a higher blood oxygenation level-dependent (BOLD) response in the left anterior IPS. For every subject, this activation was located lateral, anterior, and inferior to topographic area IPS5 and lateral and inferior to a motor-defined human parietal grasp region (hPGR). In a separate experiment, subjects viewed pictures of tools, animals, graspable (non-tool) objects, and scrambled objects. An ROI-based time-course analysis showed that tools evoked a stronger BOLD response than animals throughout topographic regions of the left IPS. Additionally, graspable objects evoked stronger responses than animals, equal to responses to tools, in posterior regions and weaker responses than tools, equal to responses to animals, in anterior regions. Thus the left anterior tool-specific region may integrate visual information encoding graspable features of objects from more posterior portions of the IPS with experiential knowledge of object use and function to guide actions.

Size-weight illusion and anticipatory grip force scaling following unilateral cortical brain lesion

The prediction of object weight from its size is an important prerequisite of skillful object manipulation. Grip and load forces anticipate object size during early phases of lifting an object. A mismatch between predicted and actual weight when two different sized objects have the same weight results in the size-weight illusion (SWI), the small object feeling heavier. This study explores whether lateralized brain lesions in patients with or without apraxia alter the size-weight illusion and impair anticipatory finger force scaling. Twenty patients with left brain damage (LBD, 10 with apraxia, 10 without apraxia), ten patients with right brain damage (RBD), and matched control subjects lifted two different-sized boxes in alternation. All subjects experienced a similar size-weight illusion. The anticipatory force scaling of all groups was in correspondence with the size cue: higher forces and force rates were applied to the big box and lower forces and force rates to the small box during the first lifts. Within few lifts, forces were scaled to actual object weight. Despite the lack of significant differences at group level, 5 out of 20 LBD patients showed abnormal predictive scaling of grip forces. They differed from the LBD patients with normal predictive scaling by a greater incidence of posterior occipito-parietal lesions but not by a greater incidence of apraxia. The findings do not support a more general role for the motor-dominant left hemisphere, or an influence of apraxia per se, in the scaling of finger force according to object properties. However, damage in the vicinity of the parietal-occipital junction may be critical for deriving predictions of weight from size.

Perceptuo-motor interactions during prehension movements

Adaptive behavior relies on the integration of perceptual and motor processes. In this study, we aimed at characterizing the cerebral processes underlying perceptuo-motor interactions evoked during prehension movements in healthy humans, as measured by means of functional magnetic resonance imaging. We manipulated the viewing conditions (binocular or monocular) during planning of a prehension movement, while parametrically varying the slant of the grasped object. This design manipulates the relative relevance and availability of different depth cues necessary for accurate planning of the prehension movement, biasing visual information processing toward either the dorsal visual stream (binocular vision) or the ventral visual stream (monocular vision). Two critical nodes of the dorsomedial visuomotor stream [V6A (anterior visual area 6) and PMd (dorsal premotor cortex)] increased their activity with increasing object slant, regardless of viewing conditions. In contrast, areas in both the dorsolateral visuomotor stream [anterior intraparietal area (AIP) and ventral premotor cortex (PMv)] and in the ventral visual stream [lateral-occipital tactile-visual area (LOtv)] showed differential slant-related responses, with activity increasing when monocular viewing conditions and increasing slant required the processing of pictorial depth cues. These conditions also increased the functional coupling of AIP with both LOtv and PMv. These findings support the view that the dorsomedial stream is automatically involved in processing visuospatial parameters for grasping, regardless of viewing conditions or object characteristics. In contrast, the dorsolateral stream appears to adapt motor behavior to the current conditions by integrating perceptual information processed in the ventral stream into the prehension plan.

Are different affordances subserved by different neural pathways?

This paper questions whether affordances are allied exclusively to dorsal stream processing within the visual system, or whether in fact different affordances are subserved by functionally independent neural pathways. Using case study evidence from patients with various visual pathologies, I argue that affordances can be categorised into type based upon their respective neurological underpinning. Such categorisation has implications for the extent to which affordances are consciously perceived or non-consciously 'picked up' within the optic array, as well as whether they indicate merely potentials for action or provide necessary information in the actualisation of behaviour.

No double-dissociation between optic ataxia and visual agnosia: multiple sub-streams for multiple visuo-manual integrations

The current dominant view of the visual system is marked by the functional and anatomical dissociation between a ventral stream specialised for perception and a dorsal stream specialised for action. The "double-dissociation" between visual agnosia (VA), a deficit of visual recognition, and optic ataxia (OA), a deficit of visuo-manual guidance, considered as consecutive to ventral and dorsal damage, respectively, has provided the main argument for this dichotomic view. In the first part of this paper, we show that the currently available empirical data do not suffice to support a double-dissociation between OA and VA. In the second part, we review evidence coming from human neuropsychology and monkey data, which cast further doubts on the validity of a simple double-dissociation between perception and action because they argue for a far more complex organisation with multiple parallel visual-to-motor connections: 1. A dorso-dorsal pathway (involving the most dorsal part of the parietal and pre-motor cortices): for immediate visuo-motor control--with OA as typical disturbance. The latest research about OA is reviewed, showing how these patients exhibit deficits restricted to the most direct and fast visuo-motor transformations. We also propose that mild mirror ataxia, consisting of misreaching errors when the controlesional hand is guided to a visual goal though a mirror, could correspond to OA with an isolated "hand effect". 2. A ventral stream-prefrontal pathway (connections from the ventral visual stream to pre-frontal areas, by-passing the parietal areas): for "mediate" control (involving spatial or temporal transpositions [Rossetti, Y., & Pisella, L. (2003). Mediate responses as direct evidence for intention: Neuropsychology of Not to-, Not now- and Not there-tasks. In S. Johnson (Ed.), Cognitive Neuroscience perspectives on the problem of intentional action (pp. 67-105). MIT Press.])--with VA as typical disturbance. Preserved visuo-manual guidance in patients with VA is restricted to immediate goal-directed guidance, they exhibit deficits for delayed or pantomimed actions. 3. A ventro-dorsal pathway (involving the more ventral part of the parietal lobe and the pre-motor and pre-frontal areas): for complex planning and programming relying on high representational levels with a more bilateral organisation or an hemispheric lateralisation--with mirror apraxia, limb apraxia and spatial neglect as representatives. Mirror apraxia is a deficit that affects both hands after unilateral inferior parietal lesion with the patients reaching systematically and repeatedly toward the virtual image in the mirror. Limb apraxia is localized on a more advanced conceptual level of object-related actions and results from deficient integrative, computational and "working memory" capacities of the left inferior parietal lobule. A component of spatial working memory has recently been revealed also in spatial neglect consecutive to lesion involving the network of the right inferior parietal lobule and the right frontal areas. We conclude by pointing to the differential temporal constraints and integrative capabilities of these parallel visuo-motor pathways as keys to interpret the neuropsychological deficits.