1
|
Walcher S, Korda Ž, Körner C, Benedek M. How workload and availability of spatial reference shape eye movement coupling in visuospatial working memory. Cognition 2024; 249:105815. [PMID: 38761645 DOI: 10.1016/j.cognition.2024.105815] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2023] [Revised: 03/27/2024] [Accepted: 05/13/2024] [Indexed: 05/20/2024]
Abstract
Eyes are active in memory recall and visual imagination, yet our grasp of the underlying qualities and factors of these internally coupled eye movements is limited. To explore this, we studied 50 participants, examining how workload, spatial reference availability, and imagined movement direction influence internal coupling of eye movements. We designed a visuospatial working memory task in which participants mentally moved a black patch along a path within a matrix and each trial involved one step along this path (presented via speakers: up, down, left, or right). We varied workload by adjusting matrix size (3 × 3 vs. 5 × 5), manipulated availability of a spatial frame of reference by presenting either a blank screen (requiring participants to rely solely on their mental representation of the matrix) or spatial reference in the form of an empty matrix, and contrasted active task performance to two control conditions involving only active or passive listening. Our findings show that eye movements consistently matched the imagined movement of the patch in the matrix, not driven solely by auditory or semantic cues. While workload influenced pupil diameter, perceived demand, and performance, it had no observable impact on internal coupling. The availability of spatial reference enhanced coupling of eye movements, leading more frequent, precise, and resilient saccades against noise and bias. The absence of workload effects on coupled saccades in our study, in combination with the relatively high degree of coupling observed even in the invisible matrix condition, indicates that eye movements align with shifts in attention across both visually and internally represented information. This suggests that coupled eye movements are not merely strategic efforts to reduce workload, but rather a natural response to where attention is directed.
Collapse
Affiliation(s)
- Sonja Walcher
- Creative Cognition Lab, Institute of Psychology, University of Graz, Graz, Austria.
| | - Živa Korda
- Creative Cognition Lab, Institute of Psychology, University of Graz, Graz, Austria.
| | - Christof Körner
- Cognitive Psychology & Neuroscience, Institute of Psychology, University of Graz, Graz, Austria.
| | - Mathias Benedek
- Creative Cognition Lab, Institute of Psychology, University of Graz, Graz, Austria.
| |
Collapse
|
2
|
Severe distortion in the representation of foveal visual image locations in short-term memory. Proc Natl Acad Sci U S A 2022; 119:e2121860119. [PMID: 35675430 PMCID: PMC9214507 DOI: 10.1073/pnas.2121860119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
The foveal visual image region provides the human visual system with the highest acuity. However, it is unclear whether such a high fidelity representational advantage is maintained when foveal image locations are committed to short-term memory. Here, we describe a paradoxically large distortion in foveal target location recall by humans. We briefly presented small, but high contrast, points of light at eccentricities ranging from 0.1 to 12°, while subjects maintained their line of sight on a stable target. After a brief memory period, the subjects indicated the remembered target locations via computer controlled cursors. The biggest localization errors, in terms of both directional deviations and amplitude percentage overshoots or undershoots, occurred for the most foveal targets, and such distortions were still present, albeit with qualitatively different patterns, when subjects shifted their gaze to indicate the remembered target locations. Foveal visual images are severely distorted in short-term memory.
Collapse
|
3
|
Laurin AS, Bleau M, Gedjakouchian J, Fournet R, Pisella L, Khan AZ. Post-saccadic changes disrupt attended pre-saccadic object memory. J Vis 2021; 21:8. [PMID: 34347017 PMCID: PMC8340665 DOI: 10.1167/jov.21.8.8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Trans-saccadic memory consists of keeping track of objects’ locations and features across saccades; pre-saccadic information is remembered and compared with post-saccadic information. It has been shown to have limited resources and involve attention with respect to the selection of objects and features. In support, a previous study showed that recognition of distinct post-saccadic objects in the visual scene is impaired when pre-saccadic objects are relevant and thus already encoded in memory (Poth, Herwig, Schneider, 2015). Here, we investigated the inverse (i.e. how the memory of pre-saccadic objects is affected by abrupt but irrelevant changes in the post-saccadic visual scene). We also modulated the amount of attention to the relevant pre-saccadic object by having participants either make a saccade to it or elsewhere and observed that pre-saccadic attentional facilitation affected how much post-saccadic changes disrupted trans-saccadic memory of pre-saccadic objects. Participants identified a flashed symbol (d, b, p, or q, among distracters), at one of six placeholders (figures “8”) arranged in circle around fixation while planning a saccade to one of them. They reported the identity of the symbol after the saccade. We changed the post-saccadic scene in Experiment one by removing the entire scene, only the placeholder where the pre-saccadic symbol was presented, or all other placeholders except this one. We observed reduced identification performance when only the saccade-target placeholder disappeared after the saccade. In Experiment two, we changed one placeholder location (inward/outward shift or rotation re. saccade vector) after the saccade and observed that identification performance decreased with increased shift/rotation of the saccade-target placeholder. We conclude that pre-saccadic memory is disrupted by abrupt attention-capturing post-saccadic changes of visual scene, particularly when these changes involve the object prioritized by being the goal of a saccade. These findings support the notion that limited trans-saccadic memory resources are disrupted when object correspondence at saccadic goal is broken through removal or location change.
Collapse
Affiliation(s)
- Anne-Sophie Laurin
- University of Montreal, Department of Psychology, Montreal, Quebec, Canada.,
| | - Maxime Bleau
- University of Montreal, School of Optometry, Montreal, Quebec, Canada.,
| | | | - Romain Fournet
- University of Montreal, School of Optometry, Montreal, Quebec, Canada.,
| | - Laure Pisella
- ImpAct, INSERM UM1028, CNRS UMR 5292, University Claude Bernard Lyon 1, Lyon, France.,
| | | |
Collapse
|
4
|
Abstract
On average, we redirect our gaze with a frequency at about 3 Hz. In real life, gaze shifts consist of eye and head movements. Much research has focused on how the accuracy of eye movements is monitored and calibrated. By contrast, little is known about how head movements remain accurate. I wondered whether serial dependencies between artificially induced errors in head movement targeting and the immediately following head movement might recalibrate movement accuracy. I also asked whether head movement targeting errors would influence visual localization. To this end, participants wore a head mounted display and performed head movements to targets, which were displaced as soon as the start of the head movement was detected. I found that target displacements influenced head movement amplitudes in the same trial, indicating that participants could adjust their movement online to reach the new target location. However, I also found serial dependencies between the target displacement in trial n-1 and head movements amplitudes in the following trial n. I did not find serial dependencies between target displacements and visuomotor localization. The results reveal that serial dependencies recalibrate head movement accuracy.
Collapse
Affiliation(s)
- Eckart Zimmermann
- Institute for Experimental Psychology, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| |
Collapse
|
5
|
Vasilev MR, Adedeji VI, Laursen C, Budka M, Slattery TJ. Do readers use character information when programming return-sweep saccades? Vision Res 2021; 183:30-40. [PMID: 33652273 DOI: 10.1016/j.visres.2021.01.003] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2019] [Revised: 01/05/2021] [Accepted: 01/11/2021] [Indexed: 11/18/2022]
Abstract
Reading saccades that occur within a single line of text are guided by the size of letters. However, readers occasionally need to make longer saccades (known as return-sweeps) that take their eyes from the end of one line of text to the beginning of the next. In this study, we tested whether return-sweep saccades are also guided by font size information and whether this guidance depends on visual acuity of the return-sweep target area. To do this, we manipulated the font size of letters (0.29 vs 0.39° per character) and the length of the first line of text (16 vs 26°). The larger font resulted in return-sweeps that landed further to the right of the line start and in a reduction of under-sweeps compared to the smaller font. This suggests that font size information is used when programming return-sweeps. Return-sweeps in the longer line condition landed further to the right of the line start and the proportion of under-sweeps increased compared to the short line condition. This likely reflects an increase in saccadic undershoot error with the increase in intended saccade size. Critically, there was no interaction between font size and line length. This suggests that when programming return-sweeps, the use of font size information does not depend on visual acuity at the saccade target. Instead, it appears that readers rely on global typographic properties of the text in order to maintain an optimal number of characters to the left of their first fixation on a new line.
Collapse
Affiliation(s)
- Martin R Vasilev
- Bournemouth University, Department of Psychology, United Kingdom.
| | | | - Calvin Laursen
- Bournemouth University, Department of Psychology, United Kingdom
| | - Marcin Budka
- Bournemouth University, Department of Computing and Informatics, United Kingdom
| | | |
Collapse
|
6
|
Zhou Y, Yu Y. Human visual search follows a suboptimal Bayesian strategy revealed by a spatiotemporal computational model and experiment. Commun Biol 2021; 4:34. [PMID: 33397998 PMCID: PMC7782508 DOI: 10.1038/s42003-020-01485-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2020] [Accepted: 11/14/2020] [Indexed: 11/09/2022] Open
Abstract
There is conflicting evidence regarding whether humans can make spatially optimal eye movements during visual search. Some studies have shown that humans can optimally integrate information across fixations and determine the next fixation location, however, these models have generally ignored the control of fixation duration and memory limitation, and the model results do not agree well with the details of human eye movement metrics. Here, we measured the temporal course of the human visibility map and performed a visual search experiment. We further built a continuous-time eye movement model that considers saccadic inaccuracy, saccadic bias, and memory constraints. We show that this model agrees better with the spatial and temporal properties of human eye movements and predict that humans have a memory capacity of around eight previous fixations. The model results reveal that humans employ a suboptimal eye movement strategy to find a target, which may minimize costs while still achieving sufficiently high search performance.
Collapse
Affiliation(s)
- Yunhui Zhou
- School of Life Sciences, Fudan University, 200433, Shanghai, China
| | - Yuguo Yu
- School of Life Sciences, Fudan University, 200433, Shanghai, China.
- State Key Laboratory of Medical Neurobiology and MOE Frontiers Center for Brain Science, Fudan University, 200433, Shanghai, China.
- Human Phenome Institute, Fudan University, 200433, Shanghai, China.
- Research Institute of Intelligent Complex Systems and Institutes of Brain Science, Fudan University, 200433, Shanghai, China.
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, 200433, Shanghai, China.
| |
Collapse
|
7
|
Krügel A, Rothkegel L, Engbert R. No exception from Bayes' rule: The presence and absence of the range effect for saccades explained. J Vis 2020; 20:15. [PMID: 32687553 PMCID: PMC7424097 DOI: 10.1167/jov.20.7.15] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023] Open
Abstract
In an influential theoretical model, human sensorimotor control is achieved by a Bayesian decision process, which combines noisy sensory information and learned prior knowledge. A ubiquitous signature of prior knowledge and Bayesian integration in human perception and motor behavior is the frequently observed bias toward an average stimulus magnitude (i.e., a central-tendency bias, range effect, regression-to-the-mean effect). However, in the domain of eye movements, there is a recent controversy about the fundamental existence of a range effect in the saccadic system. Here we argue that the problem of the existence of a range effect is linked to the availability of prior knowledge for saccade control. We present results from two prosaccade experiments that both employ an informative prior structure (i.e., a nonuniform Gaussian distribution of saccade target distances). Our results demonstrate the validity of Bayesian integration in saccade control, which generates a range effect in saccades. According to Bayesian integration principles, the saccadic range effect depends on the availability of prior knowledge and varies in size as a function of the reliability of the prior and the sensory likelihood.
Collapse
Affiliation(s)
- André Krügel
- Experimental and Biological Psychology, Department of Psychology, University of Potsdam, Potsdam, Germany
| | - Lars Rothkegel
- Experimental and Biological Psychology, Department of Psychology, University of Potsdam, Potsdam, Germany
| | - Ralf Engbert
- Experimental and Biological Psychology, Department of Psychology, University of Potsdam, Potsdam, Germany
| |
Collapse
|
8
|
Abstract
During sentence reading, low spatial frequency information afforded by spaces between words is the primary factor for eye guidance in spaced writing systems, whereas saccade generation for unspaced writing systems is less clear and under debate. In the present study, we investigated whether word-boundary information, provided by alternating colors (consistent or inconsistent with word-boundary information) influences saccade-target selection in Chinese. In Experiment 1, as compared to a baseline (i.e., uniform color) condition, word segmentation with alternating color shifted fixation location towards the center of words. In contrast, incorrect word segmentation shifted fixation location towards the beginning of words. In Experiment 2, we used a gaze-contingent paradigm to restrict the color manipulation only to the upcoming parafoveal words and replicated the results, including fixation location effects, as observed in Experiment 1. These results indicate that Chinese readers are capable of making use of parafoveal word-boundary knowledge for saccade generation, even if such information is unfamiliar to them. The present study provides novel support for the hypothesis that word segmentation is involved in the decision about where to fixate next during Chinese reading.
Collapse
|
9
|
Abstract
Saccades are rapid eye movements that orient the visual axis toward objects of interest to allow their processing by the central, high-acuity retina. Our ability to collect visual information efficiently relies on saccadic accuracy, which is limited by a combination of uncertainty in the location of the target and motor noise. It has been observed that saccades have a systematic tendency to fall short of their intended targets, and it has been suggested that this bias originates from a cost function that overly penalizes hypermetric errors. Here, we tested this hypothesis by systematically manipulating the positional uncertainty of saccadic targets. We found that increasing uncertainty produced not only a larger spread of the saccadic endpoints but also more hypometric errors and a systematic bias toward the average of target locations in a given block, revealing that prior knowledge was integrated into saccadic planning. Moreover, by examining how variability and bias covaried across conditions, we estimated the asymmetry of the cost function and found that it was related to individual differences in the additional time needed to program secondary saccades for correcting hypermetric errors, relative to hypometric ones. Taken together, these findings reveal that the saccadic system uses a probabilistic-Bayesian control strategy to compensate for uncertainty in a statistically principled way and to minimize the expected cost of saccadic errors.
Collapse
|
10
|
Albrengues C, Lavigne F, Aguilar C, Castet E, Vitu F. Linguistic processes do not beat visuo-motor constraints, but they modulate where the eyes move regardless of word boundaries: Evidence against top-down word-based eye-movement control during reading. PLoS One 2019; 14:e0219666. [PMID: 31329614 PMCID: PMC6645505 DOI: 10.1371/journal.pone.0219666] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2018] [Accepted: 06/29/2019] [Indexed: 11/18/2022] Open
Abstract
Where readers move their eyes, while proceeding forward along lines of text, has long been assumed to be determined in a top-down word-based manner. According to this classical view, readers of alphabetic languages would invariably program their saccades towards the center of peripheral target words, as selected based on the (expected) needs of ongoing (word-identification) processing, and the variability in within-word landing positions would exclusively result from systematic and random errors. Here we put this predominant hypothesis to a strong test by estimating the respective influences of language-related variables (word frequency and word predictability) and lower-level visuo-motor factors (word length and saccadic launch-site distance to the beginning of words) on both word-skipping likelihood and within-word landing positions. Our eye-movement data were collected while forty participants read 316 pairs of sentences, that differed only by one word, the prime; this was either semantically related or unrelated to a following test word of variable frequency and length. We found that low-level visuo-motor variables largely predominated in determining which word would be fixated next, and where in a word the eye would land. In comparison, language-related variables only had tiny influences. Yet, linguistic variables affected both the likelihood of word skipping and within-word initial landing positions, all depending on the words’ length and how far on average the eye landed from the word boundaries, but pending the word could benefit from peripheral preview. These findings provide a strong case against the predominant word-based account of eye-movement guidance during reading, by showing that saccades are primarily driven by low-level visuo-motor processes, regardless of word boundaries, while being overall subject to subtle, one-off, language-based modulations. Our results also suggest that overall distributions of saccades’ landing positions, instead of truncated within-word landing-site distributions, should be used for a better understanding of eye-movement guidance during reading.
Collapse
Affiliation(s)
- Claire Albrengues
- Université Côte d’Azur, CNRS, BCL (Bases, Corpus, Langage), Nice, France
| | - Frédéric Lavigne
- Université Côte d’Azur, CNRS, BCL (Bases, Corpus, Langage), Nice, France
| | | | - Eric Castet
- Aix-Marseille Univ, CNRS, LPC (Laboratoire de Psychologie Cognitive), Fédération de Recherche 3C, Marseille, France
| | - Françoise Vitu
- Aix-Marseille Univ, CNRS, LPC (Laboratoire de Psychologie Cognitive), Fédération de Recherche 3C, Marseille, France
- * E-mail:
| |
Collapse
|
11
|
Knox PC, Heming De-Allie E, Wolohan FDA. Probing oculomotor inhibition with the minimally delayed oculomotor response task. Exp Brain Res 2018; 236:2867-2876. [PMID: 30062441 PMCID: PMC6223844 DOI: 10.1007/s00221-018-5345-9] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2018] [Accepted: 07/24/2018] [Indexed: 11/28/2022]
Abstract
The ability to not execute (i.e. to inhibit) actions is important for behavioural flexibility and frees us from being slaves to our immediate sensory environment. The antisaccade task is one of several used to investigate behavioural inhibitory control. However, antisaccades involve a number of important processes besides inhibition such as attention and working memory. In the minimally delayed oculomotor response (MDOR) task, participants are presented with a simple target step, but instructed to saccade not to the target when it appears (a prosaccade response), but when it disappears (i.e. on target offset). Varying the target display duration prevents offset timing being predictable from the time of target onset, and saccades prior to the offset are counted as errors. Antisaccade error rate and latency are modified by alterations in fixation conditions produced by inserting a gap between fixation target offset and stimulus onset (the gap paradigm; error rate increases, latency decreases) or by leaving the fixation target on when the target appears (overlap paradigm; error rate decreases, latency increases). We investigated the effect of gaps and overlaps on performance in the MDOR task. In Experiment 1 we confirmed that, compared to a control condition in which participants responded to target onsets, in the MDOR task saccade latency was considerably increased (increases of 122-272 ms depending on target display duration and experimental condition). However, there was no difference in error rate or saccade latency between gap and synchronous (fixation target offset followed immediately by saccade target onset) conditions. In Experiment 2, in a different group of participants, we compared overlap and synchronous conditions and again found no statistically significant differences in error rate and saccade latency. The timing distribution of errors suggested that most were responses to target onsets, which we take to be evidence of inhibition failure. We conclude that the MDOR task evokes behaviour that is consistent across different groups of participants. Because it is free of the non-inhibitory processes operative in the antisaccade task, it provides a useful means of investigating behavioural inhibition.
Collapse
Affiliation(s)
- Paul C Knox
- Eye and Vision Science, Institute of Ageing and Chronic Disease, University of Liverpool, William Henry Duncan Building, 6 West Derby Street, Liverpool, L7 8TX, UK.
| | - Emma Heming De-Allie
- Eye and Vision Science, Institute of Ageing and Chronic Disease, University of Liverpool, William Henry Duncan Building, 6 West Derby Street, Liverpool, L7 8TX, UK
| | - Felicity D A Wolohan
- Eye and Vision Science, Institute of Ageing and Chronic Disease, University of Liverpool, William Henry Duncan Building, 6 West Derby Street, Liverpool, L7 8TX, UK.,Department of Psychology, Edge Hill University, Ormskirk, UK
| |
Collapse
|
12
|
Johnson RL, Starr EL. The Preferred Viewing Location in Top-to-Bottom Sentence Reading. Q J Exp Psychol (Hove) 2017; 71:1-32. [PMID: 28322110 DOI: 10.1080/17470218.2017.1307860] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
The preferred viewing location (PVL) is a robust finding in research on reading that when fixating on a word during normal sentence reading, readers tend to land slightly to the left of the center of the word. This is in contrast to the optimal viewing location (OVL) in single word recognition, which falls at the center of the word. The current study outlines the history of the PVL in eye-tracking since Rayner's 1979 original study, documenting the origins of these conflicting theoretical explanations. In addition, a new study is reported examining whether the PVL can be attributed solely to oculomotor error or a processing advantage by using an experimental manipulation that separates tracking direction (left-to-right reading) and landing position (left-to-right within a word). Sentences were presented to participants from the top to the bottom of a computer screen with one word per line while eye movements were recorded. In this presentation format, readers continued to land to the left of center, suggesting that the PVL in normal reading is not solely due to oculomotor error.
Collapse
|