Investigating the perceived timing of sensory events triggering actions in patients with Parkinson's disease and the effects of dopaminergic therapy

Few studies have investigated if Parkinson's disease (PD), advancing age, or exogenous dopamine therapy affect the perceived timing of past events. Here we show a phenomenon of 'temporal repulsion' of a sensory event relative to an action decision in patients with PD. In these patients, the timing of a sensory event triggering an action was perceived to have occurred earlier in time than it really did. In other words, the event appeared to be pushed away in time from the performance of the action. This finding stands in sharp contrast to the 'temporal binding' we have observed here and elsewhere (Yabe et al., 2017; Yabe & Goodale, 2015) in young healthy participants for whom the perceived onset of a sensory event triggering an action is typically delayed, as if it were pulled towards the action in time. In elderly patients, sensory events were neither repulsed nor pulled toward the action decision event. Exogenous dopamine alleviated the temporal repulsion in PD patients and normalized the temporal binding in healthy elderly controls. In contrast, dopaminergic therapy worsened temporal binding in healthy young participants. We discuss this pattern of findings, relating temporal binding processes to dopaminergic and striatal mechanisms.

The material-weight illusion disappears or inverts in objects made of two materials

The material-weight illusion (MWI) occurs when an object that looks heavy (e.g., stone) and one that looks light (e.g., Styrofoam) have the same mass. When such stimuli are lifted, the heavier-looking object feels lighter than the lighter-looking object, presumably because well-learned priors about the density of different materials are violated. We examined whether a similar illusion occurs when a certain weight distribution is expected (such as the metal end of a hammer being heavier), but weight is uniformly distributed. In experiment 1, participants lifted bipartite objects that appeared to be made of two materials (combinations of stone, Styrofoam, and wood) but were manipulated to have a uniform weight distribution. Most participants experienced an inverted MWI (i.e., the heavier-looking side felt heavier), suggesting an integration of incoming sensory information with density priors. However, a replication of the classic MWI was found when the objects appeared to be uniformly made of just one of the materials (experiment 2). Both illusions seemed to be independent of the forces used when the objects were lifted. When lifting bipartite objects but asked to judge the weight of the whole object, participants experienced no illusion (experiment 3). In experiment 4, we investigated weight perception in objects with a nonuniform weight distribution and again found evidence for an integration of prior and sensory information. Taken together, our seemingly contradictory results challenge most theories about the MWI. However, Bayesian integration of competing density priors with the likelihood of incoming sensory information may explain the opposing illusions.

NEW & NOTEWORTHY We report a novel weight illusion that contradicts all current explanations of the material-weight illusion: When lifting an object composed of two materials, the heavier-looking side feels heavier, even when the true weight distribution is uniform. The opposite (classic) illusion is found when the same materials are lifted in two separate objects. Identifying the common mechanism underlying both illusions will have implications for perception more generally. A potential candidate is Bayesian inference with competing priors.

Transient visual pathway critical for normal development of primate grasping behavior

An evolutionary hallmark of anthropoid primates, including humans, is the use of vision to guide precise manual movements. These behaviors are reliant on a specialized visual input to the posterior parietal cortex. Here, we show that normal primate reaching-and-grasping behavior depends critically on a visual pathway through the thalamic pulvinar, which is thought to relay information to the middle temporal (MT) area during early life and then swiftly withdraws. Small MRI-guided lesions to a subdivision of the inferior pulvinar subnucleus (PIm) in the infant marmoset monkey led to permanent deficits in reaching-and-grasping behavior in the adult. This functional loss coincided with the abnormal anatomical development of multiple cortical areas responsible for the guidance of actions. Our study reveals that the transient retino-pulvinar-MT pathway underpins the development of visually guided manual behaviors in primates that are crucial for interacting with complex features in the environment.

The dorsal "action" pathway

In 1992, Goodale and Milner proposed a division of labor in the visual pathways of the primate cerebral cortex. According to their account, the ventral pathway, which projects to occipitotemporal cortex, constructs our visual percepts, while the dorsal pathway, which projects to posterior parietal cortex, mediates the visual control of action. Although the framing of the two-visual-system hypothesis has not been without controversy, it is clear that vision for action and vision for perception have distinct computational requirements, and significant support for the proposed neuroanatomic division has continued to emerge over the last two decades from human neuropsychology, neuroimaging, behavioral psychophysics, and monkey neurophysiology. In this chapter, we review much of this evidence, with a particular focus on recent findings from human neuroimaging and monkey neurophysiology, demonstrating a specialized role for parietal cortex in visually guided behavior. But even though the available evidence suggests that dedicated circuits mediate action and perception, in order to produce adaptive goal-directed behavior there must be a close coupling and seamless integration of information processing across these two systems. We discuss such ventral-dorsal-stream interactions and argue that the two pathways play different, yet complementary, roles in the production of skilled behavior.

The Sander parallelogram illusion dissociates action and perception despite control for the litany of past confounds

The two visual systems hypothesis proposes that human vision is supported by an occipito-temporal network for the conscious visual perception of the world and a fronto-parietal network for visually-guided, object-directed actions. Two specific claims about the fronto-parietal network's role in sensorimotor control have generated much data and controversy: (1) the network relies primarily on the absolute metrics of target objects, which it rapidly transforms into effector-specific frames of reference to guide the fingers, hands, and limbs, and (2) the network is largely unaffected by scene-based information extracted by the occipito-temporal network for those same targets. These two claims lead to the counter-intuitive prediction that in-flight anticipatory configuration of the fingers during object-directed grasping will resist the influence of pictorial illusions. The research confirming this prediction has been criticized for confounding the difference between grasping and explicit estimates of object size with differences in attention, sensory feedback, obstacle avoidance, metric sensitivity, and priming. Here, we address and eliminate each of these confounds. We asked participants to reach out and pick up 3D target bars resting on a picture of the Sander Parallelogram illusion and to make explicit estimates of the length of those bars. Participants performed their grasps without visual feedback, and were permitted to grasp the targets after making their size-estimates to afford them an opportunity to reduce illusory error with haptic feedback. The results show unequivocally that the effect of the illusion is stronger on perceptual judgments than on grasping. Our findings from the normally-sighted population provide strong support for the proposal that human vision is comprised of functionally and anatomically dissociable systems.

A TMS Investigation on the Role of Lateral Occipital Complex and Caudal Intraparietal Sulcus in the Perception of Object Form and Orientation

We used TMS to assess the causal roles of the lateral occipital (LO) and caudal intraparietal sulcus (cIPS) areas in the perceptual discrimination of object features. All participants underwent fMRI to localize these areas using a protocol in which they passively viewed images of objects that varied in both form and orientation. fMRI identified six significant brain regions: LO, cIPS, and the fusiform gyrus, bilaterally. In a separate experimental session, we applied TMS to LO or cIPS while the same participants performed match-to-sample form or orientation discrimination tasks. Compared with sham stimulation, TMS to either the left or right LO increased RTs for form but not orientation discrimination, supporting a critical role for LO in form processing for perception- and judgment-based tasks. In contrast, we did not observe any effects when we applied TMS to cIPS. Thus, despite the clear functional evidence of engagement for both LO and cIPS during the passive viewing of objects in the fMRI experiment, the TMS experiment revealed that cIPS is not critical for making perceptual judgments about their form or orientation.

Orientation Discrimination in a Visual Form Agnosic: Evidence from the McCollough Effect

The McCollough effect is a color aftereffect contingent on pattern orientation. The effect was induced in a woman who has a profound impairment in orientation perception due to brain damage. The fact that she experiences the McCollough effect indicates that her visual system is still representing orientation at some level. Further, the finding that her occipital lobe damage is confined mainly to the prestriate regions suggests that the McCollough effect may be mediated by mechanisms at a low level in the visual system, perhaps in area 17.

The Effects of Different Aperture-Viewing Conditions on the Recognition of Novel Objects

The process of learning the structure of novel objects involves the selective use of information available in the distal stimulus. By allowing participants to explore the object within a limited field of view, we were able to examine more rigorously what regions of the object are actually selected in the learning process. Participants explored objects either by moving a circular aperture over a stationary novel object (the aperture-movement condition), or by moving the object behind a stationary aperture (the object-movement condition). Given the differences in how the spatial layout of object parts is revealed in the two study conditions, we expected that exploration would be more systematic in the aperture-movement condition than it would be in the object-movement condition, and would lead to better object recognition. We show evidence that in the aperture-movement condition exploration patterns were more related to the structure of the object and, as a consequence, the aperture-movement condition resulted in more accurate recognition in a later old--new discrimination test.

Temporal distortion in the perception of actions and events

In everyday life, actions and sensory events occur in complex sequences, with events triggering actions that in turn give rise to additional events and so on. Earlier work has shown that a sensory event that is triggered by a voluntary action is perceived to have occurred earlier in time than an identical event that is not triggered by an action. In other words, events that are believed to be caused by our actions are drawn forward in time towards our actions. Similarly, when a sensory event triggers an action, that event is again drawn in time towards the action and is thus perceived to have occurred later than it really did. This alteration in time perception serves to bind together events and actions that are causally linked. It is not clear, however, whether or not the perceived timing of a sensory event embedded within a longer series of actions and sensory events is also temporally bound to the actions in that sequence. In the current study, we measured the temporal binding in sequences consisting of two simple dyads of event-action and action-event in a series of manual action tasks: an event-action-event triad (Experiment 1) and an action-event-action triad (Experiment 2). Auditory tones either triggered an action or were presented 250ms after an action was performed. To reduce the influence of sensory events other than the tone, such as a noise associated with pressing a key on a keyboard, we used an optical sensor to detect hand movements where no contact was made with a surface. In Experiment 1, there appeared to be no change in the perceived onset of an auditory tone when the onset of that tone followed a hand movement and then the tone triggered a second hand movement. It was as if the temporal binding between the action and the tone and then the tone and the subsequent action summed algebraically and cancelled each other out. In Experiment 2, both the perceived onset of an initial tone which triggered an action and the perceived onset of a second tone which was presented 250ms after the action were temporally bound to the action. Taken together, the present study suggests that the temporal binding between our actions and sensory events occur separately in each dyad within a longer sequence of actions and events.

Echolocation in humans: an overview

Bats and dolphins are known for their ability to use echolocation. They emit bursts of sounds and listen to the echoes that bounce back to detect the objects in their environment. What is not as well-known is that some blind people have learned to do the same thing, making mouth clicks, for example, and using the returning echoes from those clicks to sense obstacles and objects of interest in their surroundings. The current review explores some of the research that has examined human echolocation and the changes that have been observed in the brains of echolocation experts. We also discuss potential applications and assistive technology based on echolocation. Blind echolocation experts can sense small differences in the location of objects, differentiate between objects of various sizes and shapes, and even between objects made of different materials, just by listening to the reflected echoes from mouth clicks. It is clear that echolocation may enable some blind people to do things that are otherwise thought to be impossible without vision, potentially providing them with a high degree of independence in their daily lives and demonstrating that echolocation can serve as an effective mobility strategy in the blind. Neuroimaging has shown that the processing of echoes activates brain regions in blind echolocators that would normally support vision in the sighted brain, and that the patterns of these activations are modulated by the information carried by the echoes. This work is shedding new light on just how plastic the human brain is. WIREs Cogn Sci 2016, 7:382-393. doi: 10.1002/wcs.1408 For further resources related to this article, please visit the WIREs website.

Equal-magnitude size-weight illusions experienced within and between object categories

In the size-weight illusion (SWI), small objects feel heavier than larger objects of the same mass. This effect is typically thought to be a consequence of the lifter's expectation that the large object will outweigh the small object, because objects of the same type typically get heavier as they get larger. Here, we show that this perceptual effect can occur across object category, where there are no strong expectations about the correspondence between size and mass. One group of participants lifted same-colored large and small cubes with the same mass as one another, while another group lifted differently-colored large and small cubes with the same mass as one another. The group who lifted the same-colored cubes experienced a robust SWI and initially lifted the large object with more force than the small object. By contrast, the group who lifted the different-colored objects did so with equal initial forces on the first trial, but experienced just as strong an illusion as those who lifted the same-colored objects. These results demonstrate that color cues can selectively influence the application of fingertip force rates while not impacting at all upon the lifter's perception of object weight, highlighting a stark dissociation in how prior information affects perception and action.

Perception of the Mccollough Effect Correlates with Activity in Extrastriate Cortex: A Functional Magnetic Resonance Imaging Study

The McCollough effect is a striking color aftereffect that is linked to the orientation of the patterns used to induce it. To produce the McCollough effect, two differently oriented grating patterns, such as a red-and-black vertical grating and a green-and-black horizontal grating, are viewed alternately for a few minutes. After such colored gratings are viewed, the white sections of a vertical black-and-white test grating appear to be tinged with green, and the white sections of a horizontal grating appear to be tinged with pink. We present evidence from a functional magnetic resonance imaging study that the perception of the McCollough effect correlates with increased activation in the lingual and fusiform gyri—extrastriate visual areas that have been implicated in color perception in humans.

Greater magnocellular saccadic suppression in high versus low autistic tendency suggests a causal path to local perceptual style

Saccadic suppression-the reduction of visual sensitivity during rapid eye movements-has previously been proposed to reflect a specific suppression of the magnocellular visual system, with the initial neural site of that suppression at or prior to afferent visual information reaching striate cortex. Dysfunction in the magnocellular visual pathway has also been associated with perceptual and physiological anomalies in individuals with autism spectrum disorder or high autistic tendency, leading us to question whether saccadic suppression is altered in the broader autism phenotype. Here we show that individuals with high autistic tendency show greater saccadic suppression of low versus high spatial frequency gratings while those with low autistic tendency do not. In addition, those with high but not low autism spectrum quotient (AQ) demonstrated pre-cortical (35-45 ms) evoked potential differences (saccade versus fixation) to a large, low contrast, pseudo-randomly flashing bar. Both AQ groups showed similar differential visual evoked potential effects in later epochs (80-160 ms) at high contrast. Thus, the magnocellular theory of saccadic suppression appears untenable as a general description for the typically developing population. Our results also suggest that the bias towards local perceptual style reported in autism may be due to selective suppression of low spatial frequency information accompanying every saccadic eye movement.

A cortical network that marks the moment when conscious representations are updated

In order to survive in a complex, noisy and constantly changing environment we need to categorize the world (e.g., Is this food edible or poisonous?) and we need to update our interpretations when things change. How does our brain update when object categories change from one to the next? We investigated the neural correlates associated with this updating process. We used event-related fMRI while people viewed a sequence of images that morphed from one object (e.g., a plane) to another (e.g., a shark). All participants were naïve as to the identity of the second object. The point at which participants 'saw' the second object was unpredictable and uncontaminated by any dramatic or salient change to the images themselves. The moment when subjective perceptual representations changed activated a circumscribed network including the anterior insula, medial and inferior frontal regions and inferior parietal cortex. In a setting where neither the timing nor nature of the visual transition was predictable, this restricted cortical network signals the time of updating a perceptual representation. The anterior insula and mid-frontal regions (including the ACC) were activated not only at the actual time when change was reported, but also immediately before, suggesting that these areas are also involved in processing alternative options after a mismatch has been detected.

Are there right hemisphere contributions to visually-guided movement? Manipulating left hand reaction time advantages in dextrals

Many studies have argued for distinct but complementary contributions from each hemisphere in the control of movements to visual targets. Investigators have attempted to extend observations from patients with unilateral left- and right-hemisphere damage, to those using neurologically-intact participants, by assuming that each hand has privileged access to the contralateral hemisphere. Previous attempts to illustrate right hemispheric contributions to the control of aiming have focussed on increasing the spatial demands of an aiming task, to attenuate the typical right hand advantages, to try to enhance a left hand reaction time advantage in right-handed participants. These early attempts have not been successful. The present study circumnavigates some of the theoretical and methodological difficulties of some of the earlier experiments, by using three different tasks linked directly to specialized functions of the right hemisphere: bisecting, the gap effect, and visuospatial localization. None of these tasks were effective in reducing the magnitude of left hand reaction time advantages in right handers. Results are discussed in terms of alternatives to right hemispheric functional explanations of the effect, the one-dimensional nature of our target arrays, power and precision given the size of the left hand RT effect, and the utility of examining the proportions of participants who show these effects, rather than exclusive reliance on measures of central tendency and their associated null hypothesis significance tests.

Transient visual responses reset the phase of low-frequency oscillations in the skeletomotor periphery

We recorded muscle activity from an upper limb muscle while human subjects reached towards peripheral targets. We tested the hypothesis that the transient visual response sweeps not only through the central nervous system, but also through the peripheral nervous system. Like the transient visual response in the central nervous system, stimulus-locked muscle responses (< 100 ms) were sensitive to stimulus contrast, and were temporally and spatially dissociable from voluntary orienting activity. Also, the arrival of visual responses reduced the variability of muscle activity by resetting the phase of ongoing low-frequency oscillations. This latter finding critically extends the emerging evidence that the feedforward visual sweep reduces neural variability via phase resetting. We conclude that, when sensory information is relevant to a particular effector, detailed information about the sensorimotor transformation, even from the earliest stages, is found in the peripheral nervous system.

Real-time vision, tactile cues, and visual form agnosia: removing haptic feedback from a "natural" grasping task induces pantomime-like grasps

Investigators study the kinematics of grasping movements (prehension) under a variety of conditions to probe visuomotor function in normal and brain-damaged individuals. “Natural” prehensile acts are directed at the goal object and are executed using real-time vision. Typically, they also entail the use of tactile, proprioceptive, and kinesthetic sources of haptic feedback about the object (“haptics-based object information”) once contact with the object has been made. Natural and simulated (pantomimed) forms of prehension are thought to recruit different cortical structures: patient DF, who has visual form agnosia following bilateral damage to her temporal-occipital cortex, loses her ability to scale her grasp aperture to the size of targets (“grip scaling”) when her prehensile movements are based on a memory of a target previewed 2 s before the cue to respond or when her grasps are directed towards a visible virtual target but she is denied haptics-based information about the target. In the first of two experiments, we show that when DF performs real-time pantomimed grasps towards a 7.5 cm displaced imagined copy of a visible object such that her fingers make contact with the surface of the table, her grip scaling is in fact quite normal. This finding suggests that real-time vision and terminal tactile feedback are sufficient to preserve DF’s grip scaling slopes. In the second experiment, we examined an “unnatural” grasping task variant in which a tangible target (along with any proxy such as the surface of the table) is denied (i.e., no terminal tactile feedback). To do this, we used a mirror-apparatus to present virtual targets with and without a spatially coincident copy for the participants to grasp. We compared the grasp kinematics from trials with and without terminal tactile feedback to a real-time-pantomimed grasping task (one without tactile feedback) in which participants visualized a copy of the visible target as instructed in our laboratory in the past. Compared to natural grasps, removing tactile feedback increased RT, slowed the velocity of the reach, reduced in-flight grip aperture, increased the slopes relating grip aperture to target width, and reduced the final grip aperture (FGA). All of these effects were also observed in the real time-pantomime grasping task. These effects seem to be independent of those that arise from using the mirror in general as we also compared grasps directed towards virtual targets to those directed at real ones viewed directly through a pane of glass. These comparisons showed that the grasps directed at virtual targets increased grip aperture, slowed the velocity of the reach, and reduced the slopes relating grip aperture to the widths of the target. Thus, using the mirror has real consequences on grasp kinematics, reflecting the importance of task-relevant sources of online visual information for the programming and updating of natural prehensile movements. Taken together, these results provide compelling support for the view that removing terminal tactile feedback, even when the grasps are target-directed, induces a switch from real-time visual control towards one that depends more on visual perception and cognitive supervision. Providing terminal tactile feedback and real-time visual information can evidently keep the dorsal visuomotor system operating normally for prehensile acts.

The two-visual-systems hypothesis and the perspectival features of visual experience

Some critics of the two-visual-systems hypothesis (TVSH) argue that it is incompatible with the fundamentally egocentric nature of visual experience (what we call the 'perspectival account'). The TVSH proposes that the ventral stream, which delivers up our visual experience of the world, works in an allocentric frame of reference, whereas the dorsal stream, which mediates the visual control of action, uses egocentric frames of reference. Given that the TVSH is also committed to the claim that dorsal-stream processing does not contribute to the contents of visual experience, it has been argued that the TVSH cannot account for the egocentric features of our visual experience. This argument, however, rests on a misunderstanding about how the operations mediating action and the operations mediating perception are specified in the TVSH. In this article, we emphasize the importance of the 'outputs' of the two-systems to the specification of their respective operations. We argue that once this point is appreciated, it becomes evident that the TVSH is entirely compatible with a perspectival account of visual experience.

A blind human expert echolocator shows size constancy for objects perceived by echoes

Some blind humans make clicking noises with their mouth and use the reflected echoes to perceive objects and surfaces. This technique can operate as a crude substitute for vision, allowing human echolocators to perceive silent, distal objects. Here, we tested if echolocation would, like vision, show size constancy. To investigate this, we asked a blind expert echolocator (EE) to echolocate objects of different physical sizes presented at different distances. The EE consistently identified the true physical size of the objects independent of distance. In contrast, blind and blindfolded sighted controls did not show size constancy, even when encouraged to use mouth clicks, claps, or other signals. These findings suggest that size constancy is not a purely visual phenomenon, but that it can operate via an auditory-based substitute for vision, such as human echolocation.

The size-weight illusion induced through human echolocation

Certain blind individuals have learned to interpret the echoes of self-generated sounds to perceive the structure of objects in their environment. The current work examined how far the influence of this unique form of sensory substitution extends by testing whether echolocation-induced representations of object size could influence weight perception. A small group of echolocation experts made tongue clicks or finger snaps toward cubes of varying sizes and weights before lifting them. These echolocators experienced a robust size-weight illusion. This experiment provides the first demonstration of a sensory substitution technique whereby the substituted sense influences the conscious perception through an intact sense.