1
|
White PA. The perceptual timescape: Perceptual history on the sub-second scale. Cogn Psychol 2024; 149:101643. [PMID: 38452720 DOI: 10.1016/j.cogpsych.2024.101643] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Revised: 02/27/2024] [Accepted: 02/28/2024] [Indexed: 03/09/2024]
Abstract
There is a high-capacity store of brief time span (∼1000 ms) which information enters from perceptual processing, often called iconic memory or sensory memory. It is proposed that a main function of this store is to hold recent perceptual information in a temporally segregated representation, named the perceptual timescape. The perceptual timescape is a continually active representation of change and continuity over time that endows the perceived present with a perceived history. This is accomplished primarily by two kinds of time marking information: time distance information, which marks all items of information in the perceptual timescape according to how far in the past they occurred, and ordinal temporal information, which organises items of information in terms of their temporal order. Added to that is information about connectivity of perceptual objects over time. These kinds of information connect individual items over a brief span of time so as to represent change, persistence, and continuity over time. It is argued that there is a one-way street of information flow from perceptual processing either to the perceived present or directly into the perceptual timescape, and thence to working memory. Consistent with that, the information structure of the perceptual timescape supports postdictive reinterpretations of recent perceptual information. Temporal integration on a time scale of hundreds of milliseconds takes place in perceptual processing and does not draw on information in the perceptual timescape, which is concerned with temporal segregation, not integration.
Collapse
Affiliation(s)
- Peter A White
- School of Psychology, Cardiff University, Tower Building, Park Place, Cardiff, Wales CF10 3YG, United Kingdom.
| |
Collapse
|
2
|
Weng G, Akbarian A, Clark K, Noudoost B, Nategh N. Neural correlates of perisaccadic visual mislocalization in extrastriate cortex. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.11.06.565871. [PMID: 37986765 PMCID: PMC10659380 DOI: 10.1101/2023.11.06.565871] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/22/2023]
Abstract
When interacting with the visual world using saccadic eye movements (saccades), the perceived location of visual stimuli becomes biased, a phenomenon called perisaccadic mislocalization, which is indeed an exemplar of the brain's dynamic representation of the visual world. However, the neural mechanism underlying this altered visuospatial perception and its potential link to other perisaccadic perceptual phenomena have not been established. Using a combined experimental and computational approach, we were able to quantify spatial bias around the saccade target (ST) based on the perisaccadic dynamics of extrastriate spatiotemporal sensitivity captured by statistical models. This approach could predict the perisaccadic spatial bias around the ST, consistent with the psychophysical studies, and revealed the precise neuronal response components underlying representational bias. These findings also established the crucial role of response remapping toward ST representation for neurons with receptive fields far from the ST in driving the ST spatial bias. Moreover, we showed that, by allocating more resources for visual target representation, visual areas enhance their representation of the ST location, even at the expense of transient distortions in spatial representation. This potential neural basis for perisaccadic ST representation, also supports a general role for extrastriate neurons in creating the perception of stimulus location.
Collapse
Affiliation(s)
- Geyu Weng
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, USA
- Department of Ophthalmology and V7isual Sciences, University of Utah, Salt Lake City, UT, USA
| | - Amir Akbarian
- Department of Ophthalmology and V7isual Sciences, University of Utah, Salt Lake City, UT, USA
| | - Kelsey Clark
- Department of Ophthalmology and V7isual Sciences, University of Utah, Salt Lake City, UT, USA
| | - Behrad Noudoost
- Department of Ophthalmology and V7isual Sciences, University of Utah, Salt Lake City, UT, USA
| | - Neda Nategh
- Department of Ophthalmology and V7isual Sciences, University of Utah, Salt Lake City, UT, USA
- Department of Electrical and Computer Engineering, University of Utah, Salt Lake City, UT, USA
| |
Collapse
|
3
|
Deep learning helps EEG signals predict different stages of visual processing in the human brain. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102996] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
4
|
Malem-Shinitski N, Opper M, Reich S, Schwetlick L, Seelig SA, Engbert R. A mathematical model of local and global attention in natural scene viewing. PLoS Comput Biol 2020; 16:e1007880. [PMID: 33315888 PMCID: PMC7769622 DOI: 10.1371/journal.pcbi.1007880] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2020] [Revised: 12/28/2020] [Accepted: 10/23/2020] [Indexed: 11/24/2022] Open
Abstract
Understanding the decision process underlying gaze control is an important question in cognitive neuroscience with applications in diverse fields ranging from psychology to computer vision. The decision for choosing an upcoming saccade target can be framed as a selection process between two states: Should the observer further inspect the information near the current gaze position (local attention) or continue with exploration of other patches of the given scene (global attention)? Here we propose and investigate a mathematical model motivated by switching between these two attentional states during scene viewing. The model is derived from a minimal set of assumptions that generates realistic eye movement behavior. We implemented a Bayesian approach for model parameter inference based on the model's likelihood function. In order to simplify the inference, we applied data augmentation methods that allowed the use of conjugate priors and the construction of an efficient Gibbs sampler. This approach turned out to be numerically efficient and permitted fitting interindividual differences in saccade statistics. Thus, the main contribution of our modeling approach is two-fold; first, we propose a new model for saccade generation in scene viewing. Second, we demonstrate the use of novel methods from Bayesian inference in the field of scan path modeling.
Collapse
Affiliation(s)
| | - Manfred Opper
- Department of Artificial Intelligence, Technische Universität Berlin, Berlin, Germany
| | - Sebastian Reich
- Institute of Mathematics, University of Potsdam, Potsdam, Germany
| | - Lisa Schwetlick
- Department of Psychology, University of Potsdam, Potsdam, Germany
| | - Stefan A. Seelig
- Department of Psychology, University of Potsdam, Potsdam, Germany
| | - Ralf Engbert
- Department of Psychology, University of Potsdam, Potsdam, Germany
| |
Collapse
|
5
|
Abstract
It is proposed that the perceived present is not a moment in time, but an information structure comprising an integrated set of products of perceptual processing. All information in the perceived present carries an informational time marker identifying it as "present". This marker is exclusive to information in the perceived present. There are other kinds of time markers, such as ordinality ("this stimulus occurred before that one") and duration ("this stimulus lasted for 50 ms"). These are different from the "present" time marker and may be attached to information regardless of whether it is in the perceived present or not. It is proposed that the perceived present is a very short-term and very high-capacity holding area for perceptual information. The maximum holding time for any given piece of information is ~100 ms: This is affected by the need to balance the value of informational persistence for further processing against the problem of obsolescence of the information. The main function of the perceived present is to facilitate access by other specialized, automatic processes.
Collapse
Affiliation(s)
- Peter A White
- School of Psychology, Cardiff University, Tower Building, Park Place, Cardiff, Wales, CF10 3YG, UK.
| |
Collapse
|
6
|
Spivey MJ, Batzloff BJ. Bridgemanian space constancy as a precursor to extended cognition. Conscious Cogn 2018; 64:164-175. [PMID: 29709438 DOI: 10.1016/j.concog.2018.04.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2018] [Revised: 03/23/2018] [Accepted: 04/02/2018] [Indexed: 11/30/2022]
Abstract
A few decades ago, cognitive psychologists generally took for granted that the reason we perceive our visual environment as one contiguous stable whole (i.e., space constancy) is because we have an internal mental representation of the visual environment as one contiguous stable whole. They supposed that the non-contiguous visual images that are gathered during the brief fixations that intervene between pairs of saccadic eye movements (a few times every second) are somehow stitched together to construct this contiguous internal mental representation. Determining how exactly the brain does this proved to be a vexing puzzle for vision researchers. Bruce Bridgeman's research career is the story of how meticulous psychophysical experimentation, and a genius theoretical insight, eventually solved this puzzle. The reason that it was so difficult for researchers to figure out how the brain stitches together these visual snapshots into one accurately-rendered mental representation of the visual environment is that it doesn't do that. Bruce discovered that the brain couldn't do that if it tried. The neural information that codes for saccade amplitude and direction is simply too inaccurate to determine exact relative locations of each fixation. Rather than the perception of space constancy being the result of an internal representation, Bruce determined that it is the result of a brain that simply assumes that external space remains constant, and it rarely checks to verify this assumption. In our extension of Bridgeman's formulation, we suggest that objects in the world often serve as their own representations, and cognitive operations can be performed on those objects themselves, rather than on mental representations of them.
Collapse
Affiliation(s)
- Michael J Spivey
- Cognitive and Information Sciences, University of California, Merced, United States.
| | - Brandon J Batzloff
- Cognitive and Information Sciences, University of California, Merced, United States
| |
Collapse
|
7
|
Abstract
Many studies in reading have shown the enhancing effect of context on the
processing of a word before it is directly fixated (parafoveal processing of
words). Here, we examined whether scene context influences the parafoveal
processing of objects and enhances the extraction of object information. Using a
modified boundary paradigm called the Dot-Boundary paradigm, participants
fixated on a suddenly onsetting cue before the preview object would onset 4°
away. The preview object could be identical to the target, visually similar,
visually dissimilar or a control (black rectangle). The preview changed to the
target object once a saccade toward the object was made. Critically, the objects
were presented on either a consistent or an inconsistent scene background.
Results revealed that there was a greater processing benefit for consistent than
inconsistent scene backgrounds and that identical and visually similar previews
produced greater processing benefits than other previews. In the second
experiment, we added an additional context condition in which the target
location was inconsistent, but the scene semantics remained consistent. We found
that changing the location of the target object disrupted the processing benefit
derived from the consistent context. Most importantly, across both experiments,
the effect of preview was not enhanced by scene context. Thus, preview
information and scene context appear to independently boost the parafoveal
processing of objects without any interaction from object–scene congruency.
Collapse
Affiliation(s)
| | - Effie J Pereira
- Department of Psychology, McGill University, Kingston, ON, Canada
| |
Collapse
|
8
|
Harrison C, Binetti N, Mareschal I, Johnston A. Time-Order Errors in Duration Judgment Are Independent of Spatial Positioning. Front Psychol 2017; 8:340. [PMID: 28337162 PMCID: PMC5343025 DOI: 10.3389/fpsyg.2017.00340] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2016] [Accepted: 02/22/2017] [Indexed: 11/23/2022] Open
Abstract
Time-order errors (TOEs) occur when the discriminability between two stimuli are affected by the order in which they are presented. While TOEs have been studied since the 1860s, it is unknown whether the spatial properties of a stimulus will affect this temporal phenomenon. In this experiment, we asked whether perceived duration, or duration discrimination, might be influenced by whether two intervals in a standard two-interval method of constants paradigm were spatially overlapping in visual short-term memory. Two circular sinusoidal gratings (one standard and the other a comparison) were shown sequentially and participants judged which of the two was presented for a longer duration. The test stimuli were either spatially overlapping (in different spatial frames) or separate. Stimulus order was randomized between trials. The standard stimulus lasted 600 ms, and the test stimulus had one of seven possible values (between 300 and 900 ms). There were no overall significant differences observed between spatially overlapping and separate stimuli. However, in trials where the standard stimulus was presented second, TOEs were greater, and participants were significantly less sensitive to differences in duration. TOEs were also greater in conditions involving a saccade. This suggests there is an intrinsic memory component to two interval tasks in that the information from the first interval has to be stored; this is more demanding when the standard is presented in the second interval. Overall, this study suggests that while temporal information may be encoded in some spatial form, it is not dependent on visual short-term memory.
Collapse
Affiliation(s)
- Charlotte Harrison
- Department of Experiment Psychology, University College London London, UK
| | - Nicola Binetti
- Department of Experiment Psychology, University College London London, UK
| | - Isabelle Mareschal
- School of Biological and Chemical Sciences, Psychology, Queen Mary University of London London, UK
| | - Alan Johnston
- Department of Experiment Psychology, University College LondonLondon, UK; School of Psychology, University of NottinghamNottingham, UK
| |
Collapse
|
9
|
Öğmen H, Herzog MH. A New Conceptualization of Human Visual Sensory-Memory. Front Psychol 2016; 7:830. [PMID: 27375519 PMCID: PMC4899472 DOI: 10.3389/fpsyg.2016.00830] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2016] [Accepted: 05/18/2016] [Indexed: 11/16/2022] Open
Abstract
Memory is an essential component of cognition and disorders of memory have significant individual and societal costs. The Atkinson–Shiffrin “modal model” forms the foundation of our understanding of human memory. It consists of three stores: Sensory Memory (SM), whose visual component is called iconic memory, Short-Term Memory (STM; also called working memory, WM), and Long-Term Memory (LTM). Since its inception, shortcomings of all three components of the modal model have been identified. While the theories of STM and LTM underwent significant modifications to address these shortcomings, models of the iconic memory remained largely unchanged: A high capacity but rapidly decaying store whose contents are encoded in retinotopic coordinates, i.e., according to how the stimulus is projected on the retina. The fundamental shortcoming of iconic memory models is that, because contents are encoded in retinotopic coordinates, the iconic memory cannot hold any useful information under normal viewing conditions when objects or the subject are in motion. Hence, half-century after its formulation, it remains an unresolved problem whether and how the first stage of the modal model serves any useful function and how subsequent stages of the modal model receive inputs from the environment. Here, we propose a new conceptualization of human visual sensory memory by introducing an additional component whose reference-frame consists of motion-grouping based coordinates rather than retinotopic coordinates. We review data supporting this new model and discuss how it offers solutions to the paradoxes of the traditional model of sensory memory.
Collapse
Affiliation(s)
- Haluk Öğmen
- Department of Electrical and Computer Engineering, University of HoustonHouston, TX, USA; Center for Neuro-Engineering and Cognitive Science, University of HoustonHouston, TX, USA
| | - Michael H Herzog
- Laboratory of Psychophysics, Ecole Polytechnique Fédérale de Lausanne (EPFL) Lausanne, Switzerland
| |
Collapse
|
10
|
Henderson JM, Hollingworth A. The Role of Fixation Position in Detecting Scene Changes Across Saccades. Psychol Sci 2016. [DOI: 10.1111/1467-9280.00183] [Citation(s) in RCA: 196] [Impact Index Per Article: 24.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
Target objects presented within color images of naturalistic scenes were deleted or rotated during a saccade to or from the target object or to a control region of the scene. Despite instructions to memorize the details of the scenes and to monitor for object changes, viewers frequently failed to notice the changes. However, the failure to detect change was mediated by three other important factors: First, accuracy generally increased as the distance between the changing region and the fixation immediately before or after the change decreased. Second, changes were sometimes initially missed, but subsequently noticed when the changed region was later refixated. Third, when an object disappeared from a scene, detection of that disappearance was greatly improved when the deletion occurred during the saccade toward that object. These results suggest that fixation position and saccade direction play an important role in determining whether changes will be detected. It appears that more information can be retained across views than has been suggested by previous studies.
Collapse
Affiliation(s)
- John M. Henderson
- Department of Psychology
- Cognitive Science Program, Michigan State University
| | | |
Collapse
|
11
|
Transsaccadic processing: stability, integration, and the potential role of remapping. Atten Percept Psychophys 2015; 77:3-27. [PMID: 25380979 DOI: 10.3758/s13414-014-0751-y] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
While our frequent saccades allow us to sample the complex visual environment in a highly efficient manner, they also raise certain challenges for interpreting and acting upon visual input. In the present, selective review, we discuss key findings from the domains of cognitive psychology, visual perception, and neuroscience concerning two such challenges: (1) maintaining the phenomenal experience of visual stability despite our rapidly shifting gaze, and (2) integrating visual information across discrete fixations. In the first two sections of the article, we focus primarily on behavioral findings. Next, we examine the possibility that a neural phenomenon known as predictive remapping may provide an explanation for aspects of transsaccadic processing. In this section of the article, we delineate and critically evaluate multiple proposals about the potential role of predictive remapping in light of both theoretical principles and empirical findings.
Collapse
|
12
|
|
13
|
Evaluating the influence of motor control on selective attention through a stochastic model: the paradigm of motor control dysfunction in cerebellar patient. BIOMED RESEARCH INTERNATIONAL 2014; 2014:162423. [PMID: 24672782 PMCID: PMC3932822 DOI: 10.1155/2014/162423] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/29/2013] [Revised: 11/03/2013] [Accepted: 11/07/2013] [Indexed: 11/17/2022]
Abstract
Attention allows us to selectively process the vast amount of information with which we are confronted, prioritizing some aspects of information and ignoring others by focusing on a certain location or aspect of the visual scene. Selective attention is guided by two cognitive mechanisms: saliency of the image (bottom up) and endogenous mechanisms (top down). These two mechanisms interact to direct attention and plan eye movements; then, the movement profile is sent to the motor system, which must constantly update the command needed to produce the desired eye movement. A new approach is described here to study how the eye motor control could influence this selection mechanism in clinical behavior: two groups of patients (SCA2 and late onset cerebellar ataxia LOCA) with well-known problems of motor control were studied; patients performed a cognitively demanding task; the results were compared to a stochastic model based on Monte Carlo simulations and a group of healthy subjects. The analytical procedure evaluated some energy functions for understanding the process. The implemented model suggested that patients performed an optimal visual search, reducing intrinsic noise sources. Our findings theorize a strict correlation between the "optimal motor system" and the "optimal stimulus encoders."
Collapse
|
14
|
Abstract
In the present review, we address the relationship between attention and visual stability. Even though with each eye, head and body movement the retinal image changes dramatically, we perceive the world as stable and are able to perform visually guided actions. However, visual stability is not as complete as introspection would lead us to believe. We attend to only a few items at a time and stability is maintained only for those items. There appear to be two distinct mechanisms underlying visual stability. The first is a passive mechanism: the visual system assumes the world to be stable, unless there is a clear discrepancy between the pre- and post-saccadic image of the region surrounding the saccade target. This is related to the pre-saccadic shift of attention, which allows for an accurate preview of the saccade target. The second is an active mechanism: information about attended objects is remapped within retinotopic maps to compensate for eye movements. The locus of attention itself, which is also characterized by localized retinotopic activity, is remapped as well. We conclude that visual attention is crucial in our perception of a stable world.
Collapse
Affiliation(s)
- Sebastiaan Mathôt
- Department of Cognitive Psychology, Vrije Universiteit, Amsterdam, The Netherlands.
| | | |
Collapse
|
15
|
Lin IF, Gorea A. Location and identity memory of saccade targets. Vision Res 2010; 51:323-32. [PMID: 21115027 DOI: 10.1016/j.visres.2010.11.010] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2010] [Revised: 10/17/2010] [Accepted: 11/22/2010] [Indexed: 11/16/2022]
Abstract
While the memory of objects' identity and of their spatiotopic location may sustain transsaccadic spatial constancy, the memory of their retinotopic location may hamper it. Is it then true that saccades perturb retinotopic but not spatiotopic memory? We address this issue by assessing localization performances of the last and of the penultimate saccade target in a series of 2-6 saccades. Upon fixation, nine letter-pairs, eight black and one white, were displayed at 3° eccentricity around fixation within a 20° × 20° grey frame, and subjects were instructed to saccade to the white letter-pair; the cycle was then repeated. Identical conditions were run with the eyes maintaining fixation throughout the trial but with the grey frame moving so as to mimic its retinal displacement when the eyes moved. At the end of a trial, subjects reported the identity and/or the location of the target in either retinotopic (relative to the current fixation dot) or frame-based(1) (relative to the grey frame) coordinates. Saccades degraded target's retinotopic location memory but not its frame-based location or its identity memory. Results are compatible with the notion that spatiotopic representation takes over retinotopic representation during eye movements thereby contributing to the stability of the visual world as its retinal projection jumps on our retina from saccade to saccade.
Collapse
Affiliation(s)
- I-Fan Lin
- Laboratorie Psychologie de la Perception, Paris Descartes University and CNRS, 45 rue des Saints Pères, 75006 Paris, France
| | | |
Collapse
|
16
|
De Pisapia N, Kaunitz L, Melcher D. Backward Masking and Unmasking Across Saccadic Eye Movements. Curr Biol 2010; 20:613-7. [DOI: 10.1016/j.cub.2010.01.056] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2009] [Revised: 12/01/2009] [Accepted: 01/20/2010] [Indexed: 11/25/2022]
|
17
|
Visual stability based on remapping of attention pointers. Trends Cogn Sci 2010; 14:147-53. [PMID: 20189870 DOI: 10.1016/j.tics.2010.01.007] [Citation(s) in RCA: 234] [Impact Index Per Article: 16.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2009] [Revised: 01/14/2010] [Accepted: 01/18/2010] [Indexed: 10/19/2022]
Abstract
When we move our eyes, we easily keep track of where relevant things are in the world. Recent proposals link this stability to the shifting of receptive fields of neurons in eye movement and attention control areas. Reports of 'spatiotopic' visual aftereffects have also been claimed to support this shifting connectivity even at an early level, but these results have been challenged. Here, the process of updating visual location is described as predictive shifts of location 'pointers' to attended targets, analogous to predictive activation seen cross-modally. We argue that these location pointers, the core operators of spatial attention, are linked to identity information and that such a link is necessary to establish a workable visual architecture and to explain frequently reported positive spatiotopic biases.
Collapse
|
18
|
|
19
|
|
20
|
Is there a role for extraretinal factors in the maintenance of stability in a structured environment? Behav Brain Sci 2010. [DOI: 10.1017/s0140525x00034373] [Citation(s) in RCA: 26] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
The calibration solution to the stability of the world despite eye movements depends, according to Bridgeman et al., upon a combination of three factors which presumably all need to operate to achieve the goal of stability. Although the authors admit (sect. 4.3, para. 5) that the relative contributions of retinal and extraretinal factors will depend on the particular viewing situation, Figure 5 (sect. 4.3) makes it clear in its representation that the role of perceptual factors is relatively minor compared to extraretinal ones. It is with this representation that this commentary wishes to take issue, believing that it occurs as a result of some assumptions about terminology that may be ambiguous, as well as some misconceptions about the circumstances in which there is a need for stability.
Collapse
|
21
|
|
22
|
|
23
|
Abstract
AbstractWe identify two aspects of the problem of maintaining perceptual stability despite an observer's eye movements. The first, visual direction constancy, is the (egocentric) stability of apparent positions of objects in the visual world relative to the perceiver. The second, visual position constancy, is the (exocentric) stability of positions of objects relative to each other. We analyze the constancy of visual direction despite saccadic eye movements.Three information sources have been proposed to enable the visual system to achieve stability: the structure of the visual field, proprioceptive inflow, and a copy of neural efference or outflow to the extraocular muscles. None of these sources by itself provides adequate information to achieve visual direction constancy; present evidence indicates that all three are used.Our final question concerns how information processing operations result in a stable world. The three traditionally suggested means have been elimination, translation, or evaluation. All are rejected. From a review of the physiological and psychological evidence we conclude that no subtraction, compensation, or evaluation need take place. The problem for which these solutions were developed turns out to be a false one. We propose a “calibration” solution: correct spatiotopic positions are calculated anew for each fixation. Inflow, outflow, and retinal sources are used in this calculation: saccadic suppression of displacement bridges the errors between these sources and the actual extent of movement.
Collapse
|
24
|
|
25
|
|
26
|
|
27
|
|
28
|
Abstract
AbstractEvery time we look around we can see a rich and detailed world surrounding us. Nevertheless, the majority of visual information seems to slip out of our thoughts instantly. Can we still say that this fleeting percept of the entire world was a conscious percept in the first place, as Block proposes?
Collapse
|
29
|
Brockmole JR, Irwin DE. Eye movements and the integration of visual memory and visual perception. ACTA ACUST UNITED AC 2005; 67:495-512. [PMID: 16119397 DOI: 10.3758/bf03193327] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Because visual perception has temporal extent, temporally discontinuous input must be linked in memory. Recent research has suggested that this may be accomplished by integrating the active contents of visual short-term memory (VSTM) with subsequently perceived information. In the present experiments, we explored the relationship between VSTM consolidation and maintenance and eye movements, in order to discover how attention selects the information that is to be integrated. Specifically, we addressed whether stimuli needed to be overtly attended in order to be included in the memory representation or whether covert attention was sufficient. Results demonstrated that in static displays in which the to-be-integrated information was presented in the same spatial location, VSTM consolidation proceeded independently of the eyes, since subjects made few eye movements. In dynamic displays, however, in which the to-be-integrated information was presented in different spatial locations, eye movements were directly related to task performance. We conclude that these differences are related to different encoding strategies. In the static display case, VSTM was maintained in the same spatial location as that in which it was generated. This could apparently be accomplished with covert deployments of attention. In the dynamic case, however, VSTM was generated in a location that did not overlap with one of the to-be-integrated percepts. In order to "move" the memory trace, overt shifts of attention were required.
Collapse
Affiliation(s)
- James R Brockmole
- Department of Psychology, Michigan State University, East Lansing, Michigan 48824, USA.
| | | |
Collapse
|
30
|
Simons DJ, Levin DT. What Makes Change Blindness Interesting? PSYCHOLOGY OF LEARNING AND MOTIVATION 2003. [DOI: 10.1016/s0079-7421(03)01009-0] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
31
|
Henderson JM, Hollingworth A. Eye movements and visual memory: detecting changes to saccade targets in scenes. PERCEPTION & PSYCHOPHYSICS 2003; 65:58-71. [PMID: 12699309 DOI: 10.3758/bf03194783] [Citation(s) in RCA: 105] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Saccade-contingent change detection provides a powerful tool for investigating scene representation and scene memory. In the present study, critical objects presented within color images of naturalistic scenes were changed during a saccade toward or away from the target. During the saccade,the critical object was changed to another object type, to a visually different token of the same object type, or was deleted from the scene. There were three main results. First, the deletion of a saccade target was special: Detection performance for saccade target deletions was very good, and this level of performance did not decline with the amplitude of the saccade. In contrast, detection of type and token changes at the saccade target, and of all changes including deletions at a location that had just been fixated but was not the saccade target, decreased as the amplitude of the saccade increased. Second, detection performance for type and token changes, both when the changing object was the target of the saccade and when the object had just been fixated but was not the saccade target, was well above chance. Third, mean gaze durations were reliably elevated for those trials in which the change was not overtly detected. The results suggest that the presence of the saccade target plays a special role in trassaccadic integration, and together with other recent findings, suggest more generally that a relatively rich scene representation is retained across saccades and stored in visual memory.
Collapse
Affiliation(s)
- John M Henderson
- Michigan State University, East Lansing, Michigan 48824-1117, USA.
| | | |
Collapse
|
32
|
Brockmole JR, Carlson LA, Irwin DE. Inhibition of attended processing during saccadic eye movements. ACTA ACUST UNITED AC 2002; 64:867-81. [PMID: 12269295 DOI: 10.3758/bf03196792] [Citation(s) in RCA: 15] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
People are unable to perform some, but not all, cognitive tasks while moving their eyes. A possible common denominator among disrupted processes is the use of attention. The present research proposes and tests an attentional suppression hypothesis to evaluate this claim. This hypothesis states that because attention is obligatorily allocated to a to-be-fixated location prior to the onset of a saccade, during saccadic events attentional resources are unavailable to direct processing associated with higher order cognitive tasks. Subjects were engaged in a task that combined saccades and shifts of attention across global and local levels of hierarchical figures. When the eyes did not move, this shift took place between stimulus presentations. When saccades intervened between the stimuli, the global-local shifts of attention were interrupted, suggesting that saccades suppress cognitive processes requiring attention.
Collapse
Affiliation(s)
- James R Brockmole
- Department of Psychology, University of Illinois at Urbana-Champaign, Champaign 61820, USA.
| | | | | |
Collapse
|
33
|
Hollingworth A, Henderson JM. Accurate visual memory for previously attended objects in natural scenes. ACTA ACUST UNITED AC 2002. [DOI: 10.1037/0096-1523.28.1.113] [Citation(s) in RCA: 266] [Impact Index Per Article: 12.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
34
|
Tatler BW. Characterising the visual buffer: real-world evidence for overwriting early in each fixation. Perception 2001; 30:993-1006. [PMID: 11578084 DOI: 10.1068/p3121] [Citation(s) in RCA: 26] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Abstract
What happens to the pictorial content of fixations when we move our eyes? Previous studies demonstrate that observers are very poor at detecting changes in natural scenes that occur across saccades, blinks, and artificial interruptions ('change blindness'). They suggest that the visual 'snapshots' of what is on the retina during a fixation are not retained and fused over successive fixations. I find similar results when volunteers are performing the complex real-life task of making a cup of tea. Volunteers can access the snapshot of the current fixation but not those of previous fixations. I suggest that volunteers are reporting the content of a low-level visual store that holds a veridical snapshot of the current fixation, rather than the retina itself. The snapshots are not 'wiped' by the saccade and remain in the buffer until they are overwritten by a new snapshot. The overwrite occurs in an all-or-none manner and can be at any time within the first 400 ms of each new fixation, with 50% of overwrites being within the first 100 ms.
Collapse
Affiliation(s)
- B W Tatler
- Sussex Centre for Neuroscience, School of Biological Sciences, University of Sussex, Brighton, UK.
| |
Collapse
|
35
|
Abstract
In two experiments, participants searched for a difference between two views of a scene. In Experiment 1, the authors extended the change-blindness findings from previous work by R. A. Rensink, J. K. O'Regan, and J. J. Clark (1997), which used an experimenter-induced global transient, to a less artificial situation in which participants searched for a difference in a pair of photographic images presented simultaneously. To examine the idea that meaning-driven endogenous orienting was responsible for the previously observed advantage for changes in center-of-interest items, the authors inverted half of the image pairs. The advantage for center-of-interest items was replicated with upright displays, but it was completely eliminated by inversion, strongly supporting the role of meaning-driven endogenous orienting in this task. With flickering displays (Experiment 2), the center-of-interest effect was completely unaffected by inversion. The authors suggest that when change blindness is induced via flicker, scene modifications are typically found by stimulus-driven rather than by meaning-driven processes.
Collapse
Affiliation(s)
- D I Shore
- Department of Psychology, Dalhousie University, Nova Scotia, Canada.
| | | |
Collapse
|
36
|
Abstract
Three areas of high-level scene perception research are reviewed. The first concerns the role of eye movements in scene perception, focusing on the influence of ongoing cognitive processing on the position and duration of fixations in a scene. The second concerns the nature of the scene representation that is retained across a saccade and other brief time intervals during ongoing scene perception. Finally, we review research on the relationship between scene and object identification, focusing particularly on whether the meaning of a scene influences the identification of constituent objects.
Collapse
Affiliation(s)
- J M Henderson
- Department of Psychology, Michigan State University, East Lansing 48824, USA.
| | | |
Collapse
|
37
|
Loftus GR, Irwin DE. On the relations among different measures of visible and informational persistence. Cogn Psychol 1998; 35:135-99. [PMID: 9570898 DOI: 10.1006/cogp.1998.0678] [Citation(s) in RCA: 62] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Abstract
We report research designed to accomplish two goals. We first consider the question, raised by Coltheart (1980) and others, of whether three measures of visible and informational persistence--performance in temporally integrating two successively presented stimuli, subjective rating of the degree to which two successively presented stimuli appear to constitute a single or a dual temporal event, and partial-report performance--all measure the same underlying mental entity. We answer this question using a superset of dissociation logic called state-trace analysis (Bamber, 1979), and within the context of a systematic empirical foundation consisting of seven closely related experiments. Our second goal is to extend and apply a theory to data acquired from our seven experiments and also to data reported by other investigators. This theory, which has been confirmed in a variety of paradigms (see Busey & Loftus, 1994) assumes that (1) the initial stages of the visual system act as a low-pass linear filter which operates on a stimulus temporal waveform to produce a sensory response; (2) instantaneous rate of acquiring information from the stimulus is jointly proportional to sensory-response magnitude and proportion of as-yet-to-be-acquired stimulus information; (3) partial-report performance is determined by total amount of acquired information; (4) the probability that two events are perceived as contemporaneous is determined by the temporal correlation of their respective information-acquisition rate functions (which is similar to a suggestion by Dixon & Di Lollo, 1994); and (5) temporal integration is successful to the degree that the two temporal events are perceived as contemporaneous. This theory was highly successful in accounting for our and other investigators' temporal-integration and completeness-rating data, and was moderately successful in accounting for partial-report data. We discuss the degree to which our three persistence measures can be united within the context of our theory; we comment on the distinction between objective and subjective measures of visible persistence; and we address the decades-old question: "What is persistence good for?"
Collapse
|
38
|
|
39
|
Jüttner M. Effects of perceptual context on transsaccadic visual matching. PERCEPTION & PSYCHOPHYSICS 1997; 59:762-73. [PMID: 9259643 DOI: 10.3758/bf03206022] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
Transsaccadic visual matching refers to the phenomenon in which presaccadic signals at the location of the sacccade goal influence the visibility of postsaccadic test signals presented at the fovea (Jüttner & Röhler, 1993). The present study uses variations of the perceptual context, provided by the structure of the presaccadic stimulus display, to investigate the influence of spatial information, decision factors, and visual attention on this form of transsaccadic information processing. The experiments yielded the following results: First, analysis of the data in terms of signal detection theory revealed that transsaccadic visual matching manifests in a shift of decision criterion (beta) rather than in a change of sensory sensitivity (d'). The criterion shift leads to a suppression of postsaccadic stimulus information that is incompatible with presaccadic processed information. Second, the matching effect strongly depends on the structure of the presaccadic display, which suggests that mechanisms of visual attention provide the spatial binding of pre- and postsaccadic stimulus information. Third, transsaccadic matching is phenomenologically tied to the execution of the saccade and effective during a postsaccadic period extending up to 160 msec after termination of the eye movement. These findings indicate a form of context-sensitive evaluation process that could subsidize the maintenance of visual stability.
Collapse
Affiliation(s)
- M Jüttner
- Institute for Medical Psychology, University of Munich, Germany.
| |
Collapse
|
40
|
Abstract
The classification behaviour of human observers with respect to compound Gabor signals is tested at foveal and extrafoveal retinal positions. Classification performance is analysed in terms of a probabilistic classification model recently proposed by Rentschler, Jüttner and Caelli [(1994) Vision Research, 34, 669-687]. The analysis allows inferences about structure and dimensionality of the individual internal representations underlying the classification task and their temporal evolution during the learning process. Using this technique it is found that the internal representations of direct and eccentric viewing are intrinsically incommensurable, in the sense that extrafoveal pattern representations are characterized by a lower perceptual dimension in feature space relative to the corresponding physical input signals, whereas foveal representations are not. The observed deficits cannot be renormalized by size scaling (cortical magnification); however, they can be partially reduced by learning although the learning progress strongly depends on the observer's practice. The structural incommensurability between foveal and extrafoveal representations poses constraints on possible forms of foveal-extrafoveal interaction, which might have implications on related perceptual phenomena such as visual stability across saccadic eye movements.
Collapse
Affiliation(s)
- M Jüttner
- Institut für Medizinische Psychologie, Universität München, Germany.
| | | |
Collapse
|
41
|
Abstract
This paper examines people's ability to make judgments which require them to know the relative positions of objects that are not simultaneously visible is examined. It has previously been shown that people can accurately perform such a task. The current experiments test the capacity limits for such tasks. Two experiments were conducted that required subjects to make spatial judgments based on sequences of points presented two at a time. It was shown that, whereas subjects can perform accurately when memory for a small number of dots (about four) is required, increasing the number of dots results in a radical reduction in performance. This argues against both the idea that spatial memory is based on a linguistic description and the idea that it is based on an image-like representation. Rather it appears that one can form an accurate representation of the spatial properties of a small number of objects.
Collapse
Affiliation(s)
- J Lachter
- Cognitive Science Laboratory, Princeton University, NJ 08544, USA
| | | |
Collapse
|
42
|
Jüttner M. Transsaccadic visual matching: evidence for a foveal-extrafoveal cooperation across saccadic eye movements. THE SCIENCE OF NATURE - NATURWISSENSCHAFTEN 1995; 82:557-9. [PMID: 8569851 DOI: 10.1007/bf01140244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Affiliation(s)
- M Jüttner
- Institut für Medizinische Psychologie der Universität, München, Germany
| |
Collapse
|
43
|
Is there any essential difference between the “calibration” and “elimination” solutions? Behav Brain Sci 1994. [DOI: 10.1017/s0140525x00034464] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
44
|
The translation solution plus motion suppression account for perceived stability. Behav Brain Sci 1994. [DOI: 10.1017/s0140525x00034580] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
45
|
Visual stability: What is new? Behav Brain Sci 1994. [DOI: 10.1017/s0140525x00034610] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
46
|
Vector code in space constancy. Behav Brain Sci 1994. [DOI: 10.1017/s0140525x00034579] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
47
|
|
48
|
Neuronal death of the cancellation theory? Behav Brain Sci 1994. [DOI: 10.1017/s0140525x00034531] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
The question of how the brain can construct a stable representation of the external world despite eye movements is a very old one. If there have been some wrong statements of problems (such as the inverted retinal image), other statements are less naive and have led to analytic solutions possibly adopted by the brain to counteract the spurious effects of eye movements. Following the MacKay (1973) objections to the analytic view of perceptual stability, Bridgeman et al. claim that the idea that signals canceling the effects of saccadic eye movements are needed is also a misconception, as is the claim that stability and position encoding are two distinct problems. It must be remembered, however, that what made the theory of “cancellation” formulated by von Holst and Mittelstaedt (1950) so appealing was the clinical observation of perceptual instability following ocular paralysis. Following the concept of corollary discharge, the theory of efference copy had the advantage of simultaneously solving three problems: the stability of the visual world during the saccade, the same visual stability across saccades, and the visual constancy problem of allowing the subject to know where an object in space is.
Collapse
|
49
|
Just how different are perceptual and visuomotor localization abilities? Behav Brain Sci 1994. [DOI: 10.1017/s0140525x00034385] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
50
|
Voluntary oscillopsia: Watching the world go round. Behav Brain Sci 1994. [DOI: 10.1017/s0140525x00034403] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|