20 years later: A second look on DF's motor behaviour

Unilateral resection of both cortical visual pathways in a pediatric patient alters action but not perception

The human cortical visual system consists of two major pathways, a ventral pathway that subserves perception and a dorsal pathway that primarily subserves visuomotor control. Previous studies have found that children with cortical resections of the ventral visual pathway retain largely normal visuoperceptual abilities. Whether visually guided actions, supported by computations carried out by the dorsal pathway, follow a similar pattern of preservation remains unknown. To address this question, we examined visuoperceptual and visuomotor behaviors in a pediatric patient, TC, who underwent a cortical resection that included portions of the left ventral and dorsal pathways. We collected kinematic data when TC used her right and left hands to perceptually estimate the width of blocks that varied in width and length, and, separately, to grasp the same blocks. TC's perceptual estimation performance was comparable to that of controls, independent of the hand used. In contrast, relative to controls, she showed reduced visuomotor sensitivity to object shape and this was more evident when she grasped the objects with her contralesional right hand. These results provide novel evidence for a striking difference in the competence of the two visual pathways to cortical injuries acquired in childhood.

A visual illusion that influences perception and action through the dorsal pathway

There are two main anatomically and physiologically defined visual pathways connecting the primary visual cortex with higher visual areas: the ventral and the dorsal pathway. The influential two-visual-systems hypothesis postulates that visual attributes are analyzed differently for different functions: in the dorsal pathway visual information is analyzed to guide actions, whereas in the ventral pathway visual information is analyzed for perceptual judgments. We here show that a person who cannot identify objects due to an extensive bilateral ventral brain lesion is able to judge the velocity at which an object moves. Moreover, both his velocity judgements and his interceptive actions are as susceptible to a motion illusion as those of people without brain lesions. These findings speak in favor of the idea that dorsal structures process information about attributes such as velocity, irrespective of whether such information is used for perceptual judgments or to guide actions.

Whether Visual-related Structural and Functional Changes Occur in Brain of Patients with Acute Incomplete Cervical Cord Injury: A Multimodal Based MRI Study

Visual-related cortex plays an important role in the process of movement. It is of great importance to clarify whether traumatic spinal cord injury (SCI), which is a typical disease that results in sensorimotor dysfunction, leads to the alteration of visual-related brain structure and function area. To address this issue, multimodality MRI was applied on eleven patients with acute incomplete cervical cord injury (ICCI) and eleven healthy controls (HCs) to explore possible structural and functional changes of the brain. Voxel-based morphometry (VBM) analysis was performed to investigate the changes in brain structure of ICCI patients. The fractional amplitude of low-frequency fluctuations (fALFF) was used to characterize changes in regional neural activities, and independent component analysis (ICA) was carried out to explore alterations in the resting-state networks (RSNs) after ICCI. We also investigated correlations among brain imaging metrics and between the metrics and clinical variables. Compared with HCs, ICCI patients exhibited significant gray matter atrophy in the left hippocampus and parahippocampal gyrus, right superior frontal gyrus (SFG), and middle frontal gyrus (MFG) and also a decrease in fALFF in the left orbitofrontal cortex (OFC). Moreover, ICCI patients exhibited decreased intra-network functional connectivity (FC) in the medial vision network (mVN). The mean fALFF value was correlated with clinical motor scores of the left extremities and the total motor scores. Our findings proved that ICCI can not only cause structural changes in visual-related brain regions, but also result in visual-related brain functional alterations, revealing the possible mechanism of the effects of visual feedback training in motor function rehabilitation of SCI patients.

Weber's law in 2D and 3D grasping

Visually guided grasping movements directed to real, 3D objects are characterized by a distinguishable trajectory pattern that evades the influence of Weber's law, a basic principle of perception. Conversely, grasping trajectories directed to 2D line drawings of objects adhere to Weber's law. It can be argued, therefore, that during 2D grasping, the visuomotor system fails at operating in analytic mode and is intruded by irrelevant perceptual information. Here, we explored the visual and tactile cues that enable such analytic processing during grasping. In Experiment 1, we compared grasping directed to 3D objects with grasping directed to 2D object photos. Grasping directed to photos adhered to Weber's law, suggesting that richness in visual detail does not contribute to analytic processing. In Experiment 2, we tested whether the visual presentation of 3D objects could support analytic processing even when only partial object-specific tactile information is provided. Surprisingly, grasping could be performed in an analytic fashion, violating Weber's law. In Experiment 3, participants were denied of any haptic feedback at the end of the movement and grasping trajectories again showed adherence to Weber's law. Taken together, the findings suggest that the presentation of real objects combined with indirect haptic information at the end of the movement is sufficient to allow analytic processing during grasp.

Errors in interception can be predicted from errors in perception

It has been hypothesised that our actions are less susceptible to visual illusions than our perceptual judgements because similar information is processed for perception and action in separate pathways. We test this hypothesis for subjects intercepting a moving object that appears to move at a different speed than its true speed due to an illusion. The object was a moving Gabor patch: a sinusoidal grating of which the luminance contrast is modulated by a two-dimensional Gaussian. We manipulated the patch's apparent speed by moving the grating relative to the Gaussian. We used separate two-interval forced choice discrimination tasks to determine how moving the grating influenced ten people's judgements of the object's position and velocity while they were fixating. Based on their perceptual judgements, and knowing that our ability to correct for errors that arise from relying on incorrect judgements are limited by a sensorimotor delay of about 100 msec, we predicted the extent to which subjects would tap ahead of or behind similar targets when trying to intercept them at the fixation location. The predicted errors closely matched the actual errors that subjects made when trying to intercept the targets. This finding does not support the two visual streams hypothesis. The results are consistent with the idea that the extent to which an illusion influences an action tells us something about the extent to which the action relies on the percept in question.

Visual motion serves but is not under the purview of the dorsal pathway

Visual motion processing is often attributed to the dorsal visual pathway despite visual motion's involvement in almost all visual functions. Furthermore, some visual motion tasks critically depend on the structural integrity of regions outside the dorsal pathway. Here, based on numerous studies, I propose that visual motion signals are swiftly transmitted via multiple non-hierarchical routes to primary motion-dedicated processing regions (MT/V5 and MST) that are not part of the dorsal pathway, and then propagated to a multiplicity of brain areas according to task demands, reaching these regions earlier than the dorsal/ventral hierarchical flow. This not only places MT/V5 at the same or even earlier visual processing stage as that of V1, but can also elucidate many findings with implications to visual awareness. While the integrity of the non-hierarchical motion pathway is necessary for all visual motion perception, it is insufficient on its own, and the transfer of visual motion signals to additional brain areas is crucial to allow the different motion perception tasks (e.g. optic flow, visuo-vestibular balance, movement observation, dynamic form detection and perception, and even reading). I argue that this lateral visual motion pathway can be distinguished from the dorsal pathway not only based on faster response latencies and distinct anatomical connections, but also based on its full field representation. I also distinguish between this primary lateral visual motion pathway sensitive to all motion in the visual field, and a much less investigated optic flow sensitive medial processing pathway (from V1 to V6 and V6A) that appears to be part of the dorsal pathway. Multiple additional predictions are provided that allow testing this proposal and distinguishing between the visual pathways.

The Two Visual Systems Hypothesis: New Challenges and Insights from Visual form Agnosic Patient DF

Patient DF, who developed visual form agnosia following carbon monoxide poisoning, is still able to use vision to adjust the configuration of her grasping hand to the geometry of a goal object. This striking dissociation between perception and action in DF provided a key piece of evidence for the formulation of Goodale and Milner's Two Visual Systems Hypothesis (TVSH). According to the TVSH, the ventral stream plays a critical role in constructing our visual percepts, whereas the dorsal stream mediates the visual control of action, such as visually guided grasping. In this review, we discuss recent studies of DF that provide new insights into the functional organization of the dorsal and ventral streams. We confirm recent evidence that DF has dorsal as well as ventral brain damage - and that her dorsal-stream lesions and surrounding atrophy have increased in size since her first published brain scan. We argue that the damage to DF's dorsal stream explains her deficits in directing actions at targets in the periphery. We then focus on DF's ability to accurately adjust her in-flight hand aperture to changes in the width of goal objects (grip scaling) whose dimensions she cannot explicitly report. An examination of several studies of DF's grip scaling under natural conditions reveals a modest though significant deficit. Importantly, however, she continues to show a robust dissociation between form vision for perception and form vision-for-action. We also review recent studies that explore the role of online visual feedback and terminal haptic feedback in the programming and control of her grasping. These studies make it clear that DF is no more reliant on visual or haptic feedback than are neurologically intact individuals. In short, we argue that her ability to grasp objects depends on visual feedforward processing carried out by visuomotor networks in her dorsal stream that function in the much the same way as they do in neurologically intact individuals.

Spatial task context makes short-latency reaches prone to induced Roelofs illusion

The perceptual localization of an object is often more prone to illusions than an immediate visuomotor action towards that object. The induced Roelofs effect (IRE) probes the illusory influence of task-irrelevant visual contextual stimuli on the processing of task-relevant visuospatial instructions during movement preparation. In the IRE, the position of a task-irrelevant visual object induces a shift in the localization of a visual target when subjects indicate the position of the target by verbal response, key-presses or delayed pointing to the target (“perception” tasks), but not when immediately pointing or reaching towards it without instructed delay (“action” tasks). This discrepancy was taken as evidence for the dual-visual-stream or perception-action hypothesis, but was later explained by a phasic distortion of the egocentric spatial reference frame which is centered on subjective straight-ahead (SSA) and used for reach planning. Both explanations critically depend on delayed movements to explain the IRE for action tasks. Here we ask: first, if the IRE can be observed for short-latency reaches; second, if the IRE in fact depends on a distorted egocentric frame of reference. Human subjects were tested in new versions of the IRE task in which the reach goal had to be localized with respect to another object, i.e., in an allocentric reference frame. First, we found an IRE even for immediate reaches in our allocentric task, but not for an otherwise similar egocentric control task. Second, the IRE depended on the position of the task-irrelevant frame relative to the reference object, not relative to SSA. We conclude that the IRE for reaching does not mandatorily depend on prolonged response delays, nor does it depend on motor planning in an egocentric reference frame. Instead, allocentric encoding of a movement goal is sufficient to make immediate reaches susceptible to IRE, underlining the context dependence of visuomotor illusions.

Pointing in visual periphery: is DF's dorsal stream intact?

Observations of the visual form agnosic patient DF have been highly influential in establishing the hypothesis that separate processing streams deal with vision for perception (ventral stream) and vision for action (dorsal stream). In this context, DF's preserved ability to perform visually-guided actions has been contrasted with the selective impairment of visuomotor performance in optic ataxia patients suffering from damage to dorsal stream areas. However, the recent finding that DF shows a thinning of the grey matter in the dorsal stream regions of both hemispheres in combination with the observation that her right-handed movements are impaired when they are performed in visual periphery has opened up the possibility that patient DF may potentially also be suffering from optic ataxia. If lesions to the posterior parietal cortex (dorsal stream) are bilateral, pointing and reaching deficits should be observed in both visual hemifields and for both hands when targets are viewed in visual periphery. Here, we tested DF's visuomotor performance when pointing with her left and her right hand toward targets presented in the left and the right visual field at three different visual eccentricities. Our results indicate that DF shows large and consistent impairments in all conditions. These findings imply that DF's dorsal stream atrophies are functionally relevant and hence challenge the idea that patient DF's seemingly normal visuomotor behaviour can be attributed to her intact dorsal stream. Instead, DF seems to be a patient who suffers from combined ventral and dorsal stream damage meaning that a new account is needed to explain why she shows such remarkably normal visuomotor behaviour in a number of tasks and conditions.

Visual evoked potentials to change in coloration of a moving bar

In our previous study we found that it takes less time to detect coloration change in a moving object compared to coloration change in a stationary one (Kreegipuu etal., 2006). Here, we replicated the experiment, but in addition to reaction times (RTs) we measured visual evoked potentials (VEPs), to see whether this effect of motion is revealed at the cortical level of information processing. We asked our subjects to detect changes in coloration of stationary (0(°)/s) and moving bars (4.4 and 17.6(°)/s). Psychophysical results replicate the findings from the previous study showing decreased RTs to coloration changes with increase of velocity of the color changing stimulus. The effect of velocity on VEPs was opposite to the one found on RTs. Except for component N1, the amplitudes of VEPs elicited by the coloration change of faster moving objects were reduced than those elicited by the coloration change of slower moving or stationary objects. The only significant effect of velocity on latency of peaks was found for P2 in frontal region. The results are discussed in the light of change-to-change interval and the two methods reflecting different processing mechanisms.

Tool manipulation knowledge is retrieved by way of the ventral visual object processing pathway

Using functional Magnetic Resonance Imaging (fMRI), we find that object manipulation knowledge is accessed by way of the ventral object processing pathway. We exploit the fact that parvocellular channels project to the ventral but not the dorsal stream, and show that increased neural responses for tool stimuli are observed in the inferior parietal lobule when those stimuli are visible only to the ventral object processing stream. In a control condition, tool-preferences were observed in a superior and posterior parietal region for stimuli titrated so as to be visible by the dorsal visual pathway. Functional connectivity analyses confirm the dissociation between sub-regions of parietal cortex according to whether their principal afferent input is via the ventral or dorsal visual pathway. These results challenge the 'Embodied Hypothesis of Tool Recognition', according to which tool identification critically depends on simulation of object manipulation knowledge. Instead, these data indicate that retrieval of object-associated manipulation knowledge is contingent on accessing the identity of the object, a process that is subserved by the ventral visual pathway.

Dissecting visual awareness with FMRI

In recent years, substantial progress has been made in the scientific study of perceptual awareness, or synonymously, the contents of consciousness. By many standards, the field of consciousness research is in a phase of unprecedented productivity and progress, with high-impact publications, popular science books, specialized journals, dedicated academic societies, scientific conferences, and, above all, competing cognitive and neurobiological theories of consciousness . In the present review, I highlight a selection of recent fMRI and related behavioral studies that examine the neuronal underpinnings of awareness in higher order and early visual cortex. After the introduction, I also provide a brief overview of the crucial problem of measurement, that is, the fact that any exploration of consciousness depends on some kind of report, which pertains to all studies summarized in this review.

Activity patterns in the category-selective occipitotemporal cortex predict upcoming motor actions

Converging lines of evidence point to the occipitotemporal cortex (OTC) as a critical structure in visual perception. For instance, human functional magnetic resonance imaging (fMRI) has revealed a modular organisation of object-selective, face-selective, body-selective and scene-selective visual areas in the OTC, and disruptions to the processing within these regions, either in neuropsychological patients or through transcranial magnetic stimulation, can produce category-specific deficits in visual recognition. Here we show, using fMRI and pattern classification methods, that the activity in the OTC also represents how stimuli will be interacted with by the body--a level of processing more traditionally associated with the preparatory activity in sensorimotor circuits of the brain. Combining functional mapping of different OTC areas with a real object-directed delayed movement task, we found that the pre-movement spatial activity patterns across the OTC could be used to predict both the action of an upcoming hand movement (grasping vs. reaching) and the effector (left hand vs. right hand) to be used. Interestingly, we were able to extract this wide range of predictive movement information even though nearly all OTC areas showed either baseline-level or below baseline-level activity prior to action onset. Our characterisation of different OTC areas according to the features of upcoming movements that they could predict also revealed a general gradient of effector-to-action-dependent movement representations along the posterior-anterior OTC axis. These findings suggest that the ventral visual pathway, which is well known to be involved in object recognition and perceptual processing, plays a larger than previously expected role in preparing object-directed hand actions.

The recognition of everyday objects changes grasp scaling

Current concepts of action and perception emphasise a dissociation between conscious visual recognition and visual action control. These models do not expect an effect of the recognisable identity of an object on the kinematic parameterisation of grasping movements under binocular viewing conditions without pre-test learning periods. We performed two experiments presenting participants with familiar everyday objects or neutral geometrical objects. The participants grasped either with full vision or without visual feedback after movement onset without an explicit training phase before the experiment. In general, the familiarity of objects increased the sensitivity to physical object size changes measured by the slope of the maximal grip aperture relative to object size. We conclude that associations between object identity and a particular size, presumably encoded in long-term memory, are integrated in the parameterisation of grasping movements upon the identification of individual objects.