Modulation of spatial orientation processing by mental imagery instructions: a MEG study of representational momentum

The role of cortical areas hMT/V5+ and TPJ on the magnitude of representational momentum and representational gravity: a transcranial magnetic stimulation study

The perceived vanishing location of a moving target is systematically displaced forward, in the direction of motion-representational momentum-, and downward, in the direction of gravity-representational gravity. Despite a wealth of research on the factors that modulate these phenomena, little is known regarding their neurophysiological substrates. The present experiment aims to explore which role is played by cortical areas hMT/V5+, linked to the processing of visual motion, and TPJ, thought to support the functioning of an internal model of gravity, in modulating both effects. Participants were required to perform a standard spatial localization task while the activity of the right hMT/V5+ or TPJ sites was selectively disrupted with an offline continuous theta-burst stimulation (cTBS) protocol, interspersed with control blocks with no stimulation. Eye movements were recorded during all spatial localizations. Results revealed an increase in representational gravity contingent on the disruption of the activity of hMT/V5+ and, conversely, some evidence suggested a bigger representational momentum when TPJ was stimulated. Furthermore, stimulation of hMT/V5+ led to a decreased ocular overshoot and to a time-dependent downward drift of gaze location. These outcomes suggest that a reciprocal balance between perceived kinematics and anticipated dynamics might modulate these spatial localization responses, compatible with a push-pull mechanism.

The visual representations of motion and of gravity are functionally independent: Evidence of a differential effect of smooth pursuit eye movements

The memory for the final position of a moving object which suddenly disappears has been found to be displaced forward, in the direction of motion, and downwards, in the direction of gravity. These phenomena were coined, respectively, Representational Momentum and Representational Gravity. Although both these and similar effects have been systematically linked with the functioning of internal representations of physical variables (e.g. momentum and gravity), serious doubts have been raised for a cognitively based interpretation, favouring instead a major role of oculomotor and perceptual factors which, more often than not, were left uncontrolled and even ignored. The present work aims to determine the degree to which Representational Momentum and Representational Gravity are epiphenomenal to smooth pursuit eye movements. Observers were required to indicate the offset locations of targets moving along systematically varied directions after a variable imposed retention interval. Each participant completed the task twice, varying the eye movements' instructions: gaze was either constrained or left free to track the targets. A Fourier decomposition analysis of the localization responses was used to disentangle both phenomena. The results show unambiguously that constraining eye movements significantly eliminates the harmonic components which index Representational Momentum, but have no effect on Representational Gravity or its time course. The found outcomes offer promising prospects for the study of the visual representation of gravity and its neurological substrates.

Can representational trajectory reveal the nature of an internal model of gravity?

The memory for the vanishing location of a horizontally moving target is usually displaced forward in the direction of motion (representational momentum) and downward in the direction of gravity (representational gravity). Moreover, this downward displacement has been shown to increase with time (representational trajectory). However, the degree to which different kinematic events change the temporal profile of these displacements remains to be determined. The present article attempts to fill this gap. In the first experiment, we replicate the finding that representational momentum for downward-moving targets is bigger than for upward motions, showing, moreover, that it increases rapidly during the first 300 ms, stabilizing afterward. This temporal profile, but not the increased error for descending targets, is shown to be disrupted when eye movements are not allowed. In the second experiment, we show that the downward drift with time emerges even for static targets. Finally, in the third experiment, we report an increased error for upward-moving targets, as compared with downward movements, when the display is compatible with a downward ego-motion by including vection cues. Thus, the errors in the direction of gravity are compatible with the perceived event and do not merely reflect a retinotopic bias. Overall, these results provide further evidence for an internal model of gravity in the visual representational system.

Spatial memory and explicit knowledge: an effect of instruction on representational momentum

Freyd (1987; Finke & Freyd, 1985) suggested that representational momentum (i.e., forward displacement in memory for the location of a moving target) is impervious to error feedback (i.e., is modular or cognitively impenetrable), but studies supporting this claim might not have allowed sufficient opportunity for learning to occur. In the experiment reported here, participants were (a) naive regarding representational momentum, (b) informed about representational momentum but not instructed to counteract it, or (c) informed about representational momentum and instructed to counteract it. All participants exhibited significant displacement. However, participants informed about representational momentum exhibited less forward displacement than did naive participants due to a greater tendency to respond same to probes behind the true--same position. Possible mechanisms of compensation and the notion that displacement reflects both modular (cognitively impenetrable) and nonmodular (cognitively penetrable) components are addressed.

Visual memory transformations in dyslexia

Representational Momentum refers to observers' distortion of recognition memory for pictures that imply motion because of an automatic mental process which extrapolates along the implied trajectory of the picture. Neuroimaging evidence suggests that activity in the magnocellular visual pathway is necessary for representational momentum to occur. It has been proposed that individuals with dyslexia have a magnocellular deficit, so it was hypothesised that these individuals would show reduced or absent representational momentum. In this study, 30 adults with dyslexia and 30 age-matched controls were compared on two tasks, one linear and one rotation, which had previously elicited the representational momentum effect. Analysis indicated significant differences in the performance of the two groups, with the dyslexia group having a reduced susceptibility to representational momentum in both linear and rotational directions. The findings highlight that deficits in temporal spatial processing may contribute to the perceptual profile of dyslexia.

Adaptation to Real Motion Reveals Direction-selective Interactions between Real and Implied Motion Processing

Viewing static pictures of running humans evokes neural activity in the dorsal motion-sensitive cortex. To establish whether this response arises from direction-selective neurons that are also involved in real motion processing, we measured the visually evoked potential to implied motion following adaptation to static or moving random dot patterns. The implied motion response was defined as the difference between evoked potentials to pictures with and without implied motion. Interaction between real and implied motion was found as a modulation of this difference response by the preceding motion adaptation. The amplitude of the implied motion response was significantly reduced after adaptation to motion in the same direction as the implied motion, compared to motion in the opposite direction. At 280 msec after stimulus onset, the average difference in amplitude reduction between opposite and same adapted direction was 0.5 μV on an average implied motion amplitude of 2.0 μV. These results indicate that the response to implied motion arises from direction-selective motion-sensitive neurons. This is consistent with interactions between real and implied motion processing at a neuronal level.

Mapping implied body actions in the human motor system

The human visual system is highly tuned to perceive actual motion as well as to extrapolate dynamic information from static pictures of objects or creatures captured in the middle of motion. Processing of implied motion activates higher-order visual areas that are also involved in processing biological motion. Imagery and observation of actual movements performed by others engenders selective activation of motor and premotor areas that are part of a mirror-neuron system matching action observation and execution. By using single-pulse transcranial magnetic stimulation, we found that the mere observation of static snapshots of hands suggesting a pincer grip action induced an increase in corticospinal excitability as compared with observation of resting, relaxed hands, or hands suggesting a completed action. This facilitatory effect was specific for the muscle that would be activated during actual execution of the observed action. We found no changes in responsiveness of the tested muscles during observation of nonbiological entities with (e.g., waterfalls) or without (e.g., icefalls) implied motion. Thus, extrapolation of motion information concerning human actions induced a selective activation of the motor system. This indicates that overlapping motor regions are engaged in the visual analysis of physical and implied body actions. The absence of motor evoked potential modulation during observation of end posture stimuli may indicate that the observation-execution matching system is preferentially activated by implied, ongoing but not yet completed actions.

Representational momentum and related displacements in spatial memory: A review of the findings

Memory for the final location of a moving target is often displaced in the direction of target motion, and this has been referred to as representational momentum. Characteristics of the target (e.g., velocity, size, direction, and identity), display (e.g., target format, retention interval, and response method), context (landmarks, expectations, and attribution of motion source), and observer (e.g., allocation of attention, eye movements, and psychopathology) that influence the direction and magnitude of displacement are reviewed. Specific conclusions regarding numerous variables that influence displacement (e.g., presence of landmarks or surrounding context), as well as broad-based conclusions regarding displacement in general (e.g., displacement does not reflect objective physical principles, may reflect aspects of naive physics, does not solely reflect eye movements, may involve some modular processing, and reflects high-level processes) are drawn. A possible computational theory of displacement is suggested in which displacement (1) helps bridge the gap between perception and action and (2) plays a critical part in localizing stimuli in the environment.

Duration of mentally simulated movement: a review

The authors review studies of mentally simulated movements. In automatic or cyclical movements, actual and motor imagery (MI) durations are similar. When athletes simulate only dynamic phases of movement or perform MI just before competing, however, environmental and time constraints lead to an underestimation of actual duration. Conversely, complex attention-demanding movements take longer to image. Finally, participants can modify the speed of MI voluntarily when they receive specific instructions. To complete the available data, the authors compared imagined and actual durations in tennis and gymnastics. Results showed systematic and disproportionate overestimation of actual duration. The authors found a relationship between complex motor skills and MI duration. They discuss the factors leading to over- and underestimation and the hypotheses that could be tested.

Engagement of the prefrontal cortex in representational momentum: an fMRI study

Behavioral studies have identified a robust phenomenon that an observer's memory of the final position of a moving target is shifted a little further in its motion direction, which is usually called representational momentum (RM). However, the neural substrates underlying RM are poorly understood. The current study measured hemodynamic responses in association with RM using functional magnetic resonance imaging (fMRI). Two experiments using block and event-related designs, respectively, were conducted in which subjects compared the orientation of a probe rectangle with the remembered orientation of the final inducing figures in a set of rotating rectangles. Both experiments showed that, relative to the control task in which behavioral data did not show RM effects, RM task induced stronger activation in the prefrontal cortex. However, no activation was found in MT/MST complex in association with RM. The fMRI results suggest that RM may not simply reflect implicit motion perception and high level cognitive mechanisms underpinned by the prefrontal cortex may be involved in the RM effect.

Functional Frontoparietal Connectivity During Short-Term Memory as Revealed by High-Resolution EEG Coherence Analysis

In this electroencephalographic study, the authors modeled the functional connectivity between frontal and parietal areas during short-term memory (STM) processes by spectral coherence analysis and the directed transfer function, that is, for the estimation of coherence "direction." A no-STM task was used as a reference. STM was characterized by an increased frontoparietal electroencephalograph coherence at high frequencies (beta and gamma, 14-45 Hz). In the control task, parietal-to-frontal flow prevailed at those frequencies. However, the STM task showed a bidirectional frontoparietal flow at the gamma band. In conclusion, frontoparietal connectivity would optimize "representational" memory during STM. In this context, the frontal areas would increase their influence on parietal areas for memory retention.

Implicit motion perception in schizotypy and schizophrenia: a Representational Momentum study

INTRODUCTION

Human observers exhibit a distortion in recognition memory for pictures that imply motion because of an automatic mental process, which extrapolates along the implied trajectory of the picture. This is known as Representational Momentum (RM). Converging evidence (functional imaging; magnetic stimulation studies) suggests activity in area MT/MST (V5) is necessary for RM to occur. Patients with schizophrenia and healthy schizotypic individuals have been found to show motion perception deficits and abnormal eye-tracking (both indicative of abnormal functioning within brain area V5), therefore it was hypothesised that these individuals would show a reduced or absent RM effect.

METHOD

Fifty healthy individuals and seven patients diagnosed with schizophrenia undertook a task previously found to elicit the RM effect.

RESULTS

Although the size of the RM effect was not significantly different between either low and high schizotypes or low schizotypes and patients, there was a trend (in the opposite direction to that predicted) for the patients with schizophrenia and the high schizotypes to exhibit a larger RM effect.

CONCLUSION

The findings are discussed in terms of functional connectivity between frontal areas and V5, and of schizophrenia involving a failure to inhibit automatic processes.