Representational momentum when attention is divided

Setting the scene for boundary extension: Methods, findings, connections, and theories

A previously viewed scene is often remembered as containing a larger extent of the background than was actually present, and information that was likely present just outside the boundaries of that view is often incorporated into the representation of that scene. This has been referred to as boundary extension. Methodologies used in studies on boundary extension (terminology, stimulus presentation, response measures) are described. Empirical findings regarding effects of characteristics of the stimulus (whether the stimulus depicts a scene, semantics of the scene, view angle, object size, object cropping, object orientation, object color, number of objects, depth of field, object distance, viewpoint production, scene orientation, motion, faces, emotions, modality, whether the scene is multimodal), characteristics of the display (aperture shape, aperture size, target duration, retention interval), and characteristics of the observer (allocation of attention, imagination, age, expectations and strategies, eye fixation, eye movements, monocular or binocular view, vantage point, confinement, prior exposure, expertise, arousal, pathology) on boundary extension are reviewed. Connections of boundary extension to other cognitive phenomena and processes (evolutionary adaptation, Gestalt principles, illusions, psychophysics, invariant physical principles, aesthetics, temporal boundary extension, normalization) are noted, and theories and theoretical considerations regarding boundary extension (multisource model, boundary transformation, mental imagery, 4E cognition, cognitive modularity, neurological mechanisms of scene representation) are discussed.

Sustained attention and the flash grab effect

When a stationary target is briefly presented on top of a moving background as it reverses direction, the target is displaced perceptually in the direction of the upcoming motion (the flash grab effect). To determine the role of attention in this effect, we investigated whether the predictability of the location of the flash grab target modulates the illusion. First, we established that effect was weaker for spatially predictable targets. Next, we showed that the flash grab effect decreased for a narrower spatial spread of attention before the onset of the target and that it was smaller for left hemifield presentations than right. Finally, we demonstrated that diverting attention away from the target and the background motion decreases the flash grab effect. In the first two experiments, the decrease in the illusion could be attributed to either increased attention to the target or decreased attention to the motion; we assume that increasing attention to the target necessarily decreases attention to the motion. However, in the final experiment, the central task decreases attention to both the target and the motion. The results show a decrease in the illusion and that reveals that attention to the motion is the primary causal factor.

Motion perception in touch: resolving contradictory findings by varying probabilities of different trial types

Representational momentum describes the typical overestimation of the final location of a moving stimulus in the direction of stimulus motion. While systematically observed in different sensory modalities, especially vision and audition, in touch, empirical findings indicate a mixed pattern of results, with some published studies suggesting the existence of the phenomenon, while others do not. In the present study, one possible moderating variable, the relative probabilities of different trial types, was explored in an attempt to resolve the seemingly contradictory findings in the literature. In some studies, only consistently moving target stimuli were presented and no representational momentum was observed, while other studies have included inconsistently moving target stimuli in the same experimental block, and observed representational momentum. Therefore, the present study was designed to systematically compare the localization of consistent target motion stimuli across two experimental blocks, for which either only consistent motion trials were presented, or else mixed with inconsistent target motion trials. The results indicate a strong influence of variations in the probability of different trial types on the occurrence of representational momentum. That is, representational momentum only occurred when both trial types (inconsistent and consistent target motion) were presented within one experimental block. The results are discussed in light of recent theoretical advancements in the literature, namely the speed prior account of motion perception.

Does a concurrent motor process influence representational momentum?

Whether the direction of a hand motion that is congruent or incongruent with a concurrent target motion can influence representational momentum for that target was examined. Participants viewed a leftward or rightward moving target while moving their hand rightward, leftward, or not moving their hand. Prior studies of mental rotation found that congruency or incongruency of the direction of mental rotation and the direction of a concurrent physical rotation of a stimulus influenced mental rotation. As mental rotation and representational momentum each involve extrapolation of target motion, it could be predicted that congruency of the direction of hand motion and the direction of target motion might influence representational momentum of the target. Robust representational momentum occurred in all conditions, but there was no effect of congruency of hand motion and target motion, nor of the presence or absence of hand motion, on representational momentum. The results are consistent with a hypothesis that the generation of representational momentum involves sensory processes rather than motor processes.

Relationships between the magnitude of representational momentum and the spatial and temporal anticipatory judgments of opponent's kicks in taekwondo

For successful actions in a fast, dynamic environment such as sports, a quick successful anticipation of a forthcoming environmental state is essential. However, the perceptual mechanisms involved in successful anticipation are not fully understood. This study examined the relationships between the magnitude of representational momentum (RM) as a forward displacement of the memory representation of the final position of a moving object (which implies that observers perceptually "see" a near future forthcoming dynamic environmental state) and the temporal and spatial anticipatory judgments of the opponent's high or middle kicks in taekwondo. Twenty-seven participants (university taekwondo club members and non-members) observed video clips of taekwondo kicks that vanished at one of 10 frame positions prior to the kick impact and performed three tasks consecutively: anticipatory coincidence timing (CT) with the arrival of kick impact, judgment of the kick type (high and middle kicks) by forced choice, and judgment of the vanishing frame position (measuring RM). Our results showed significant group effects for the number of correct kick-type judgments and the judgment threshold for kick-type choice (kick-typeJT), which was estimated in terms of individual psychometric function curves. A significant correlation was found between the magnitude of RM (estimated at kick-typeJT) and kick-typeJT, but not between the CT errors (estimated at kick-typeJT) and kick-typeJT. This indicates that the magnitude of RM may play an influential role in quick kick-type judgments, but not in coincidence timing while observing an opponent's kick motion. These findings suggest that subjective anticipatory perception or judgment of the future spatial state is vital to anticipatory actions under severe time constraints.

The Vanishing Coin Illusion: When sound congruence affects visual representation of motion

In the "classic" vanishing ball illusion (VBI), a magician pretends to throw a ball and the audience sees it go up and then disappear. To gain a better understanding of the mechanisms involved, we conducted two experiments to analyze the permeability of this type of illusion to auditory information. A modified version of the VBI (i.e., the Vanishing Coin Illusion [VCI]), was presented, and this was either accompanied by a sound or was not. The results show that the presence of a sound adds to the success of the illusion (Experiment 1), especially when this sound is congruent with the illusion (Experiment 2). Based on these results, we discuss the mechanisms at work in this illusion.

Phasic alertness boosts representational momentum

The final location of a moving object is always misremembered in the direction of the object’s motion; this occurrence is called representational momentum. Three experiments were conducted to investigate the effects of phasic alertness on representational momentum by presenting a visual or auditory warning cue. In experiment 1, the mouse pointer paradigm was used, and the results showed that external warning cues increased forward displacement. Experiment 2 indicated that the effects of phasic alertness and speed of motion on representational momentum were independent. In experiment 3, the probe paradigm was used, and the results showed that external warning cues increased forward displacement as well as participants’ sensitivity to the difference between the target and probe positions. These findings prove that phasic alertness boosts rather than reduces representational momentum. We propose that phasic alertness might influence representational momentum by modulating the process of executive control in the retention interval.

Prediction, Suppression of Visual Response, and Modulation of Visual Perception: Insights From Visual Evoked Potentials and Representational Momentum

When a visual object changes its position along with certain sequential regularities, the visual system rapidly and automatically forms a prediction regarding the future position of the object based on the regularities. Such prediction can drastically alter visual perception. A phenomenon called representational momentum (RM: a predictive displacement of the perceived final position of a visual object along its recent regular pattern) has provided extensive evidence for the predictive modulation of visual perception. The purpose of the present study was to identify neural effects that could explain individual differences in the strength of the predictive modulation of visual perception as measured by RM. For this purpose, in two experiments with a conventional RM paradigm where a bar was discretely presented in a regular rotation manner (with a step of 18° in Experiment 1 and a step of 20° in Experiment 2), visual evoked potentials (VEPs) in response to the regularly rotated bar were measured, and correlations between the magnitudes of RM and VEPs were examined. The results showed that the magnitudes of RM and central P2 were negatively correlated, consistently in both experiments; participants who showed a smaller central P2 tended to exhibit greater RM. Together with a previous proposal that central P2 would represent delayed reactivation of lower visual areas around the striate and prestriate cortices via reentrant feedback projections from higher areas, the present results suggest that greater suppression of delayed reactivation of lower visual areas (as indicated by smaller central P2) may underlie stronger predictive modulation of visual perception (as indicated by greater RM).

Tactile temporal offset cues reduce visual representational momentum

The perception of dynamic objects is sometimes biased. For example, localizing a moving object after it has disappeared results in a perceptual shift in the direction of motion, a bias known as representational momentum. We investigated whether the temporal characteristics of an irrelevant, spatially uninformative vibrotactile stimulus bias the perceived location of a visual target. In two visuotactile experiments, participants judged the final location of a dynamic, visual target. Simultaneously, a continuous (starting with the onset of the visual target, Experiments 1 and 2) or brief (33-ms stimulation, Experiment 2) vibrotactile stimulus (at the palm of participant's hands) was presented, and the offset disparity between the visual target and tactile stimulation was systematically varied. The results indicate a cross-modal influence of tactile stimulation on the perceived final location of the visual target. Closer inspection of the nature of this cross-modal influence, observed here for the first time, reveals that the vibrotactile stimulus was likely just taken as a temporal cue regarding the offset of the visual target, but no strong interaction and combined processing of the two stimuli occurred. The present results are related to similar cross-modal temporal illusions and current accounts of multisensory perception, integration, and cross-modal facilitation.

Representational momentum in vision and touch: Visual motion information biases tactile spatial localization

After an object disappears, the vanishing point is shifted in the direction of motion, a phenomenon known as representational momentum. The present study focused on the relationship between motion information and spatial location in a crossmodal setting. In two visuotactile experiments, we studied how motion information in one sensory modality affects the perceived final location of a motion signal (congruent vs. incongruent left-right motion direction) in another modality. The results revealed a unidirectional crossmodal influence of motion information on spatial localization performance. While visual motion information influenced the perceived final location of the tactile stimulus, tactile motion information had no influence on visual localization. These results therefore extend the existing literature on crossmodal influences on spatial location and are discussed in relation to current theories of multisensory perception.

Examining motion speed processing in schizophrenia using the flash lag illusion

Research on visual perception in schizophrenia suggests a deficit in motion processing. Specifically, difficulties with discriminating motion speed are commonly reported. However, speed discrimination tasks typically require participants to make judgments about the difference between two stimuli in a two-interval forced choice (2IFC) task. Such tasks not only tap into speed processing mechanisms, but also rely on higher executive functioning including working memory and attention which has been shown to be compromised in schizophrenia. We used the Flash Lag illusion to examine speed processing in patients with schizophrenia. Based on previous research showing a strong dependence between motion speed and the illusion magnitude, we expected a deficit in speed processing to alter this relationship. A motion processing deficit in patients would also predict overall reductions in perceived lag. We found the magnitude and speed dependence of the Flash Lag illusion to be similar in patients and controls. Together, the findings suggest no general abnormality in motion speed processing in schizophrenia.

The role of cortical areas hMT/V5+ and TPJ on the magnitude of representational momentum and representational gravity: a transcranial magnetic stimulation study

The perceived vanishing location of a moving target is systematically displaced forward, in the direction of motion-representational momentum-, and downward, in the direction of gravity-representational gravity. Despite a wealth of research on the factors that modulate these phenomena, little is known regarding their neurophysiological substrates. The present experiment aims to explore which role is played by cortical areas hMT/V5+, linked to the processing of visual motion, and TPJ, thought to support the functioning of an internal model of gravity, in modulating both effects. Participants were required to perform a standard spatial localization task while the activity of the right hMT/V5+ or TPJ sites was selectively disrupted with an offline continuous theta-burst stimulation (cTBS) protocol, interspersed with control blocks with no stimulation. Eye movements were recorded during all spatial localizations. Results revealed an increase in representational gravity contingent on the disruption of the activity of hMT/V5+ and, conversely, some evidence suggested a bigger representational momentum when TPJ was stimulated. Furthermore, stimulation of hMT/V5+ led to a decreased ocular overshoot and to a time-dependent downward drift of gaze location. These outcomes suggest that a reciprocal balance between perceived kinematics and anticipated dynamics might modulate these spatial localization responses, compatible with a push-pull mechanism.

Filling the gap despite full attention: the role of fast backward inferences for event completion

The comprehension of dynamic naturalistic events poses at least two challenges to the cognitive system: filtering relevant information with attention and dealing with information that was missing or missed. With four experiments, we studied the completion of missing information despite full attention. Participants watched short soccer video clips and we informed participants that we removed a critical moment of ball contact in half of the clips. We asked participants to detect whether these moments of ball contact were present or absent. In Experiment 1, participants gave their detection responses either directly during an event or delayed after an event. Although participants directed their full attention toward the critical contact moment, they were more likely to indicate seeing the missing ball contact if it was followed by a causally matching scene than if it was followed by an unrelated scene, both for the immediate and delayed responses. Thus, event completion occurs quickly. In Experiment 2, only a causally matching scene but neither a white mask nor an irrelevant scene caused the completion of missing information. This indicates that the completion of missing information is caused by backward inferences rather than predictive perception. In Experiment 3, we showed that event completion occurs directly during a trial and does not depend on expectations built up after seeing the same causality condition multiple times. In Experiment 4, we linked our findings to event cognition by asking participants to perform a natural segmentation task. We conclude that observers complete missing information during coherent events based on a fast backward inference mechanism even when directing their attention toward the missing information.

Visual mismatch negativity and representational momentum: Their possible involvement in the same automatic prediction

To maintain real-time interaction with a dynamically changing visual object, the brain is thought to automatically predict the next state of the object based on the pattern of its preceding changes. A behavioral phenomenon known as representational momentum (RM: forward displacement of the remembered final state of an object along its preceding change pattern) and an electrophysiological phenomenon known as visual mismatch negativity (VMMN: an event-related brain potential component that is elicited when an object suddenly deviates from its preceding change pattern) have each indicated the existence of such automatic predictive processes. However, there has been no direct investigation of whether or not these phenomena are involved in the same predictive processes. To address this issue, the present study examined the correlation between RM and VMMN by using a hybrid paradigm in which both phenomena can be measured for the rotation of a bar. The results showed that the magnitudes of RM and VMMN were positively correlated; participants who exhibited greater RM along the regular rotation of a bar tended to show greater VMMN in response to sudden reversal embedded in the regular rotation of a bar. This result provides empirical support for the hypothesis that RM and VMMN may be involved in the same automatic predictive processes. Due to the methodological limitations of a correlation analysis, this hypothesis has to be carefully tested in future studies that examine the relationship between RM and VMMN from multiple perspectives.

The ball vanishes in the air: can we blame representational momentum?

In the vanishing ball illusion (VBI), the magician throws a ball up into the air twice and then pretends to do a third throw. On the third (fake) throw, the audience sees the ball go up and then disappear. In this article, we study the psychological mechanisms at play in this magic trick. We test the hypothesis that the illusion is based on representational momentum (RM), a psychological phenomenon in which the observer perceives the stopping point of a moving scene as being located farther ahead in the direction of motion than it really is. To determine whether the mechanisms involved in VBI are similar to those underlying RM, we compared the results of a standard VBI task to those obtained on an RM task designed to be very close to the VBI task. The results showed that VBI sensitivity was not associated with a higher anticipation score on the RM task. Unexpectedly, we found that participants who were sensitive to the illusion even obtained a weaker RM effect. We discuss several hypotheses that might account for these results.

A novel dissociation between representational momentum and representational gravity through response modality

When people are required to indicate the vanishing location of a moving object, systematic biases forward, in the direction of motion, and downward, in the direction of gravity, are usually found. Both these displacements, called representational momentum and representational gravity, respectively, are thought to reflect anticipatory internal mechanisms aiming to overcome neural delays in the perception of motion. We challenge this view. There may not be such a single mechanism. Although both representational momentum and representational gravity follow a specific time-course, compatible with an anticipation of the object's dynamics, they do not seem to be commensurable with each other, as they are differentially modulated by relevant variables, such as eye movements and strength of motion signals. We found separate response components, one related to overt motor localization behaviour and one limited to purely perceptual judgement. Representational momentum emerged only for the motor localization task, revealing a motor overshoot. In contrast, representational gravity was mostly evident for spatial perceptual judgements. We interpret the results in support of a partial dissociation in the mechanisms that give rise to representational momentum and representational gravity, with the former but not the latter strongly modulated by the enrolment of the motor system.

Reduced attentional focus and the influence on expert anticipatory perception

The anticipatory memory encodings of expert and novice basketball players were examined under conditions of both full (attended condition) and reduced (unattended condition) attention (see also Gorman, Abernethy, & Farrow in Attention, Perception, & Psychophysics, 75, 835-844, 2013a). Participants completed a typical pattern recall task using dynamic playing sequences from basketball, and their responses were compared to both the original target pattern as well as to the series of patterns that occurred immediately after and immediately before the target image. The latter had not previously been employed in a pattern recall task when examining the anticipatory encoding of pattern information. Results revealed that the overall extent of the forward displacement for both the attended and unattended patterns was generally significantly greater for the experts, with the expert advantage tending to be most prominent for the attacking patterns. The novel addition of both forward and backward scenes may provide a more precise measure of the anticipatory effect, suggesting that future research in this domain should use a similar methodological design.

Toward a general theory of momentum-like effects

The future actions, behaviors, and outcomes of objects, individuals, and processes can often be anticipated, and some of these anticipations have been hypothesized to result from momentum-like effects. Five types of momentum-like effects (representational momentum, operational momentum, attentional momentum, behavioral momentum, psychological momentum) are briefly described. Potential similarities involving properties of momentum-like effects (continuation, coherence, role of chance or guessing, role of sensory processing, imperviousness to practice or error feedback, shifts in memory for position, effects of changes in velocity, rapid occurrence, effects of retention interval, attachment to an object rather than an abstract frame of reference, nonrigid transformation) are described, and potential constraints on a future theory of momentum-like effects (dynamic representation, nature of extrapolation, sensitivity to environmental contingencies, bridging gaps between stimulus and response, increasing adaptiveness to the environment, serving as a heuristic for perception and action, insensitivity to stimulus format, importance of subjective consequences, role of knowledge and belief, automaticity of occurrence, properties of functional architecture) are discussed. The similarity and ubiquity of momentum-like effects suggests such effects might result from a single or small number of mechanisms that operate over different dimensions, modalities, and time-scales and provide a fundamental adaptation for perception and action.

Crossmodal Modulation of Spatial Localization by Mimetic Words

The present study investigated whether aurally presented mimetic words affect the judgment of the final position of a moving object. In Experiment 1, horizontal apparent motion of a visual target was presented, and an auditory mimetic word of “byun” (representing rapid forward motion), “pitari” (representing stop of motion), or “nisahi” (nonsense syllable) was presented via headphones. Observers were asked to judge which of two test stimuli was horizontally aligned with the target. The results showed that forward displacement in the “pitari” condition was significantly smaller than in the “byun” and “nisahi” conditions. However, when non-mimetic but meaningful words were presented (Experiment 2), this effect did not occur. Our findings suggest that the mimetic words, especially that meaning stop of motion, affect spatial localization by means of mental imagery regarding “stop” established by the phonological information of the word.

Location estimation of approaching objects is modulated by the observer's inherent and momentary action capabilities

Action capability may be one of the factors that can influence our percept of the world. A distinction can be made between momentary action capability (action capability at that particular moment) and inherent action capability (representing a stable action capability). In the current study, we investigated whether there was a biasing effect of these two forms of action capability on visual perception of location. In a virtual reality room, subjects had to stop a moving ball from hitting a pillar. On some trials, the ball disappeared automatically during its motion. Subjects had to estimate the location of the ball's disappearance in these trials. We expected that if action is necessary but action capability (inherent or momentary) is limiting performance, the location of approaching objects with respect to the observer is underestimated. By judging the objects to be nearer than they really are, the need to select and execute the appropriate action increases, thereby facilitating quick action (Cole et al. in Psychol Sci 24(1):34-40, 2013. doi: 10.1177/0956797612446953 ). As a manipulation of inherent action capability in a virtual environment, two groups of participants (video game players vs. non-video game players) were entered into the study (high and low action capability). Momentary action capability was manipulated by using two difficulty levels in the experiment (Easy vs. Difficult). Results indicated that inherent and momentary action capabilities interacted together to influence online location judgments: Non-players underestimated locations when the task was Difficult. Taken together, our data suggest that both inherent and momentary action capabilities influence location judgments.

Asymmetric Mislocalization of a Visual Flash Ahead of and behind a Moving Object

When subjects localize a flash relative to another stationary stimulus, the flash appears displaced in the direction of nearby motion signals (position capture; Whitney and Cavanagh, 2000 Nature Neuroscience3 954–959). Our previous study had suggested that the position capture is larger for a flash presented ahead of a moving stimulus than for a flash behind it (Watanabe et al, 2003 Perception32 545–559). In the present study, I investigated the spatial asymmetry of position capture. Experiment 1 demonstrated that asymmetric position capture occurs primarily in a moving-object-centered coordinate. Experiment 2 showed evidence that the asymmetric position capture operates after individuation of single visual objects. Finally, experiment 3 demonstrated that, when attention was reduced with a dual-task procedure, the asymmetric position capture increased. These results suggest that the spatial asymmetry of position capture occurs without attention but the spatial bias can be reduced by attention. Therefore, the underlying mechanism for the asymmetric spatial bias may be different from attentive tracking (Cavanagh, 1992 Science257 1563–1565) and mislocalization during smooth pursuit (Brenner et al, 2001 Vision Research41 2253–2259).

The Modulation of the Flash-Lag Effect by Voluntary Attention

In the flash-lag effect (FLE), a flashing object appears to lag behind a moving object when both happen to be physically aligned to each other. According to an earlier account of the FLE (Baldo and Klein 1995 Nature378 565–566), this perceptual phenomenon would result from differential delays in the perceptual processing of moving and flashing stimuli, presumably involving attentional mechanisms. Here, we have attempted to demonstrate in a more convincing way the participation of voluntary attention as a major component of the FLE. In experiment 1 the observer's attentional set was induced by the spatial probability structure of the visual stimulus. A flashing dot (relative to which the location of a moving dot should be judged) was presented, in separate blocks, at fixed, alternating, or randomly chosen locations. The two former conditions, providing a higher spatial predictability, yielded a smaller FLE than the latter condition, which provided a lower spatial predictability of the flashing dot. In experiment 2 we employed a standard cueing procedure, in which a participant was instructed to shift covertly his/her attentional focus according to a symbolic cue. The cue indicated, with a validity of 80%, the visual hemifield at which the flashing dot would be presented. As predicted by our conceptual model, the mean magnitude of the FLE in the valid trials was significantly smaller than that found in the invalid ones. Therefore, both experiments provided strong evidence supporting the participation of voluntary attention in the FLE. Attentional mechanisms should be seen not as the primary cause of the FLE, but rather as an important modulatory component of a broader process whose spatiotemporal dynamics engenders the FLE and possibly other related phenomena. Even though we elected an account based on the influence of attention on perceptual latencies, our empirical findings are compatible with other theoretical models embraced by the current flash-lag controversy and should be accommodated by every attempt to explain this perceptual phenomenon.

Representational momentum reveals visual anticipation differences in the upper and lower visual fields

Recent empirical research has revealed differences in functional capacity between the upper and lower visual fields (VFs), with the lower VF exhibiting superiority in visual perception skills. Similarly, functional differences between the left and right hemispheres elicit a predominance for visuospatial processing in the left visual field (left VF). Both anatomical as well as evolutionary arguments have been adopted in accounting for these variations in function. Preceding upper and lower VF research has typically investigated either static stimulus perception or the visual processing of upper limb action. The aim of the current research was to investigate whether the lower VF benefits associated with limb control transcend to visual anticipation (the perception of motion). Methods were based on Khan and Lawrence (Exp Brain Res 164:395-398, 2005), who investigated upper/lower VF differences in visuomotor control, but utilising a representational momentum paradigm to isolate perceptual processes. Thirty-two participants were randomised into either a left or right VF group and completed a perceptual computer-based task in the upper and lower VF, where they were required to judge the final position of a moving object before it disappeared. Two aspects of the distributions of same responses were then analysed; the central tendency (weighted means) and the variability. Results revealed that in the left VF, weighted means for the lower VF were significantly greater than for the upper VF [t(14) = 2.242, p = 0.042]. In both left and right VFs, variability was greater in the upper compared to lower VF. This provides new findings regarding visual processes in the different visual fields. While visual search and large scene perception has been found to be superior in the upper VF, here we find that visual anticipation, like target-directed visuomotor skill, is superior in the lower VF.

Automatic prediction regarding the next state of a visual object: Electrophysiological indicators of prediction match and mismatch

Behavioral phenomena such as representational momentum suggest that the brain can automatically predict the next state of a visual object, based on sequential rules embedded in its preceding spatiotemporal context. To identify electrophysiological indicators of automatic visual prediction in terms of prediction match and mismatch, we recorded event-related brain potentials (ERPs) while participants passively viewed three types of task-irrelevant sequences of a bar stimulus: (1) an oddball sequence, which contained a sequential rule defined by stimulus repetition, providing repetition-rule-conforming (standard) and -violating (deviant) stimuli; (2) a rotating-oddball sequence, which contained a sequential rule defined by stimulus change (i.e., rotation), providing change-rule-conforming (regular) and -violating (irregular) stimuli; and (3) a random sequence, which did not contain a sequential rule, providing a neutral (control) stimulus. This protocol allowed us to expect that (1) an ERP effect that reflects a prediction-mismatch process should be exclusively observed in both the deviant-minus-control and irregular-minus-control comparisons and (2) an ERP effect that reflects a prediction-match process should be exclusively observed in both the standard-minus-control and regular-minus-control comparisons. The results showed that the ERP effect that met the criterion for prediction mismatch was an occipito-temporal negative deflection at around 170-300ms (visual mismatch negativity), while the ERP effect that met the criterion for prediction match was a frontal/central negative deflection at around 150-270ms (probably, the reduction of P2). These two contrasting ERP effects support a hypothetical view that automatic visual prediction would involve both an increase in the neural response to prediction-incongruent (i.e., novel) events and a decrease in the neural response to prediction-congruent (i.e., redundant) events. This article is part of a Special Issue entitled SI: Prediction and Attention.

An effect of contrast and luminance on visual representational momentum for location

Effects of the contrast of target luminance and background luminance, and of the absolute level of target luminance, on representational momentum for the remembered final location of a previously viewed moving target were examined. Targets were high in contrast or luminance, decreasing in contrast or luminance, increasing in contrast or luminance, or low in contrast or luminance; the background was black or white. Representational momentum for target location was larger if targets were high or increasing in contrast or luminance and smaller if targets were low or decreasing in contrast or luminance. Representational momentum for target location was larger if targets were presented on a white background than on a black background. Implications for theories of localization and for theories of representational momentum are discussed.

The expert advantage in dynamic pattern recall persists across both attended and unattended display elements

We examined how differences in attention influence how expert and novice basketball players encode into memory the specific structural information contained within patterns of play from their sport. Our participants were primed during a typical recall task to focus attention on either attacking or defending player formations before being asked to recall the attended or unattended portion of the pattern. Adherence to the instructional set was confirmed through an analysis of gaze distributions. Recall performance was superior for the experts relative to the novices across both the attended and unattended attacking and defensive pattern structures. Expert recall of attacker positions was unchanged with and without attention, whereas recall accuracy for the positions of defenders diminished without attention, as did the novices' recall of both attack and defense formations. The findings suggest that experienced performers are better than novices at encoding the elements from a complex and dynamic pattern in the absence of focused attention, with this advantage being especially evident in relation to the recall of attacking structure. Some revision of long-term memory theories of expertise will be necessary to accommodate these findings.

Identity categories and transformational paths for face changes across the age spectrum

How faces change across lengthy time periods and whether the changing appearance of a face functions as an identity category was investigated in two experiments. In Experiment 1, the faces of 15 individuals were multidimensionally scaled at each of seven age epochs (roughly <6 months to 75 years of age) and correlated with the same persons, but at different ages. In Experiment 2, three individuals at each of seven age epochs were multidimensionally scaled, and analyses explored the conceptual structure and transformational path of each person within the space. The results revealed that even the earliest age epochs (<6 months) were correlated with the later epochs, except for the most extreme age, with the correlation highest at intermediate ages. Transformational paths were found that emerged and terminated at haphazard points in the space. Results are discussed in terms of principled change in categories whose members systematically change across their life cycle, including suggestions for the need to incorporate systematic change in current theories of categorization.

Misperceptions in the trajectories of objects undergoing curvilinear motion

Trajectory perception is crucial in scene understanding and action. A variety of trajectory misperceptions have been reported in the literature. In this study, we quantify earlier observations that reported distortions in the perceived shape of bilinear trajectories and in the perceived positions of their deviation. Our results show that bilinear trajectories with deviation angles smaller than 90 deg are perceived smoothed while those with deviation angles larger than 90 degrees are perceived sharpened. The sharpening effect is weaker in magnitude than the smoothing effect. We also found a correlation between the distortion of perceived trajectories and the perceived shift of their deviation point. Finally, using a dual-task paradigm, we found that reducing attentional resources allocated to the moving target causes an increase in the perceived shift of the deviation point of the trajectory. We interpret these results in the context of interactions between motion and position systems.

Displacement of location in illusory line motion

Six experiments examined displacement in memory for the location of the line in illusory line motion (ILM; appearance or disappearance of a stationary cue is followed by appearance of a stationary line that is presented all at once, but the stationary line is perceived to "unfold" or "be drawn" from the end closest to the cue to the end most distant from the cue). If ILM was induced by having a single cue appear, then memory for the location of the line was displaced toward the cue, and displacement was larger if the line was closer to the cue. If ILM was induced by having one of two previously visible cues vanish, then memory for the location of the line was displaced away from the cue that vanished. In general, the magnitude of displacement increased and then decreased as retention interval increased from 50 to 250 ms and from 250 to 450 ms, respectively. Displacement of the line (a) is consistent with a combination of a spatial averaging of the locations of the cue and the line with a relatively weaker dynamic in the direction of illusory motion, (b) might be implemented in a spreading activation network similar to networks previously suggested to implement displacement resulting from implied or apparent motion, and (c) provides constraints and challenges for theories of ILM.

Paradoxical extension into the contralesional hemispace in spatial neglect

To explore the idea of a perceptual distortion of space in spatial neglect, neglect patients, age-matched healthy controls and right hemisphere control patients judged the vanishing point of horizontally and vertically-moving stimuli. Hemifield of presentation and movement direction of the stimulus presentation was manipulated. The results suggest that neglect patients show a stronger response bias in the direction of the moving stimuli ("representational momentum") than healthy and right hemisphere controls. Furthermore, neglect patients, but not the control groups, showed a direction-specific response whereby the presence of neglect was associated with a larger representational momentum for leftward-moving stimuli. The one left-hemisphere patient with right-sided neglect showed the opposite effect. Thus, neglect patients showed a relative overextension into their neglected side of space. While these findings are in line with the idea of an extension in the representation of contralesional space, other explanations such as deficient spatial remapping, impairments in smooth pursuit and distortions in memorized visuo-motor movements are considered.

Unintentional temporal context-based prediction of emotional faces: an electrophysiological study

The ability to extract sequential regularities embedded in the temporal context or temporal structure of sensory events and to predict upcoming events based on the extracted sequential regularities plays a central role in human cognition. In the present study, we demonstrate that, without any intention, upcoming emotional faces can be predicted based on sequential regularities, by showing that prediction error responses as reflected by visual mismatch negativity (MMN), an event-related brain potential (ERP) component, were evoked in response to emotional faces that violated a regular alternation pattern of 2 emotional faces (fearful and happy faces) under a situation where the emotional faces themselves were unrelated to the participant's task. Face-inversion and negative-bias effects in the visual MMN further indicated the involvement of holistic face representations. In addition, through successive source analyses of the visual MMN, it was revealed that the prediction error responses were composed of activations mainly in the face-responsible visual extrastriate areas and the prefrontal areas. The present results provide primary evidence for the existence of the unintentional temporal context-based prediction of biologically relevant visual stimuli as well as empirical support for the major engagement of the visual and prefrontal areas in unintentional temporal context-based prediction in vision.

Effects of spatial cuing on the onset repulsion effect

Effects of cuing the onset (initial) location of a moving target on memory for the onset location of that target were examined. If a cue presented prior to target onset indicated the location where that target would appear, the onset repulsion effect (in which the judged initial location of the target was displaced in the direction opposite to target motion) was decreased, and the onset repulsion effect was smaller if the cue was valid than if the cue was invalid. If a cue presented during target motion or after the target vanished indicated the location where that target had appeared, the onset repulsion effect was eliminated. The data (1) suggest that positional uncertainty might contribute to the onset repulsion effect, (2) provide the first evidence of an effect of expectancy regarding target trajectory on the onset repulsion effect, and (3) are partially consistent with previous data involving effects of attention and spatial cuing on the Fröhlich effect and on representational momentum.

Boundary extension: findings and theories

A view of a scene is often remembered as containing information that might have been present just beyond the actual boundaries of that view, and this is referred to as boundary extension. Characteristics of the view (e.g., scene or nonscene; close-up or wide-angle; whether objects are cropped, static, or in motion, emotionally neutral or emotionally charged), display (e.g., aperture shape and size; target duration; retention interval; whether probes of memory involve magnification/minification or change in physical distance), and observer (e.g., allocation of attention; age; planned fixation, gaze direction, and eye movements; monocular or binocular viewing; prior exposure; neurological correlates) that influence boundary extension are reviewed. Proposed mechanisms of boundary extension (perceptual, memory, or motion schema; extension-normalization; attentional selection; errors in source monitoring) are discussed, and possible relationships of boundary extension to other cognitive processes (e.g., representational momentum; remembered distance and remembered size; amodal completion; transsaccadic memory) are briefly addressed.

Representational momentum in children born preterm and at term

The term representational momentum (RM) refers to the idea that our memory representations for moving objects incorporate information about movement - a fact that can lead us to make errors when judging an object's location (the RM effect). In this study, we explored the RM effect in a sample of children born very prematurely and a sample born at term. Because preterm children are known to be at risk for problems with motion perception, we anticipated that they would show a weaker or absent RM effect. This prediction was confirmed. In addition, we found that, in both samples of children, 5-6year olds showed a reduced RM effect compared to 7-9year olds. These results demonstrate that the ability to represent motion information in memory shows continued development over this age range, and may help to elucidate factors contributing to problems with fine and gross motor planning and execution that have been observed in the preterm population. We propose that problems affecting the formation, maintenance, or use of predictive models, or motion extrapolation skills, may have cascading effects on the development of other abilities.

The onset-repulsion effect and motion-induced mislocalization of a stationary object

The influence of a moving target on memory for the location of a briefly presented stationary object aligned with the initial location of that moving target was examined. Memory for the location of the stationary object was displaced backward (ie in the direction opposite to target motion), and memory for the initial location of the moving target was also displaced backward (consistent with an onset-repulsion effect); displacement of the stationary object did not differ from displacement of the moving target. Displacement in memory for the initial location of a moving target was not influenced by whether or not a stationary object aligned with that initial location was also presented. The results demonstrate that motion-induced mislocalization can occur in a direction other than the direction of motion, and are consistent with the hypothesis that dynamics of a moving target can influence memory for a nearby stationary object.

Spatial memory and explicit knowledge: an effect of instruction on representational momentum

Freyd (1987; Finke & Freyd, 1985) suggested that representational momentum (i.e., forward displacement in memory for the location of a moving target) is impervious to error feedback (i.e., is modular or cognitively impenetrable), but studies supporting this claim might not have allowed sufficient opportunity for learning to occur. In the experiment reported here, participants were (a) naive regarding representational momentum, (b) informed about representational momentum but not instructed to counteract it, or (c) informed about representational momentum and instructed to counteract it. All participants exhibited significant displacement. However, participants informed about representational momentum exhibited less forward displacement than did naive participants due to a greater tendency to respond same to probes behind the true--same position. Possible mechanisms of compensation and the notion that displacement reflects both modular (cognitively impenetrable) and nonmodular (cognitively penetrable) components are addressed.