1
|
Villavicencio P, de la Malla C, López-Moliner J. Prediction of time to contact under perceptual and contextual uncertainties. J Vis 2024; 24:14. [PMID: 38904641 PMCID: PMC11204063 DOI: 10.1167/jov.24.6.14] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2024] [Accepted: 05/17/2024] [Indexed: 06/22/2024] Open
Abstract
Accurately estimating time to contact (TTC) is crucial for successful interactions with moving objects, yet it is challenging under conditions of sensory and contextual uncertainty, such as occlusion. In this study, participants engaged in a prediction motion task, monitoring a target that moved rightward and an occluder. The participants' task was to press a key when they predicted the target would be aligned with the occluder's right edge. We manipulated sensory uncertainty by varying the visible and occluded periods of the target, thereby modulating the time available to integrate sensory information and the duration over which motion must be extrapolated. Additionally, contextual uncertainty was manipulated by having a predictable and unpredictable condition, meaning the occluder either reliably indicated where the moving target would disappear or provided no such indication. Results showed differences in accuracy between the predictable and unpredictable occluder conditions, with different eye movement patterns in each case. Importantly, the ratio of the time the target was visible, which allows for the integration of sensory information, to the occlusion time, which determines perceptual uncertainty, was a key factor in determining performance. This ratio is central to our proposed model, which provides a robust framework for understanding and predicting human performance in dynamic environments with varying degrees of uncertainty.
Collapse
Affiliation(s)
- Pamela Villavicencio
- Vision and Control of Action Group, Department of Cognition, Development, and Psychology of Education, Institute of Neurosciences, Universitat de Barcelona, Barcelona, Catalonia, Spain
| | - Cristina de la Malla
- Vision and Control of Action Group, Department of Cognition, Development, and Psychology of Education, Institute of Neurosciences, Universitat de Barcelona, Barcelona, Catalonia, Spain
| | - Joan López-Moliner
- Vision and Control of Action Group, Department of Cognition, Development, and Psychology of Education, Institute of Neurosciences, Universitat de Barcelona, Barcelona, Catalonia, Spain
| |
Collapse
|
2
|
Shanidze NM, Verghese P. Smooth pursuit deficits impact dynamic visual acuity in macular degeneration. Optom Vis Sci 2024; 101:435-442. [PMID: 38913934 PMCID: PMC11239305 DOI: 10.1097/opx.0000000000002144] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/26/2024] Open
Abstract
SIGNIFICANCE Prior studies with large, highly visible targets report low smooth pursuit gains in individuals with macular degeneration (MD). We show that lower gains persist even when observers are pursuing a target that requires discrimination at the acuity limit. This low gain causes retinal slip, potentially leading to motion blur and target disappearance in the scotoma, which further compromise the visibility of moving object. PURPOSE In this study, we examine whether the characteristics of smooth pursuit (pursuit gain and placement of the fixational locus relative to the target) change when the task requires dynamic visual acuity. METHODS Using the scanning laser ophthalmoscope, we recorded smooth pursuit eye movements in 10 eyes of 6 MD participants and 7 eyes of 4 age-matched controls in response to leftward- or rightward-moving annular targets (O) that briefly (300 milliseconds) changed to a Landolt C at one of several time points during the pursuit trial. Participants were asked to pursue the target and indicate the direction of the C opening. RESULTS Individuals with MD had lower pursuit gains and fewer saccades during the C presentation than during the O, compared with their age-matched peers. Further, pursuit gain, but not the distance of the retinal pursuit locus from the target, predicted task performance in the MD group. CONCLUSIONS Our findings suggest that compromised pursuit gain in MD participants likely further compromises their dynamic visual acuity and thus ability to view moving targets.
Collapse
Affiliation(s)
| | - Preeti Verghese
- The Smith-Kettlewell Eye Research Institute, San Francisco, California
| |
Collapse
|
3
|
Borot L, Ogden R, Bennett SJ. Prefrontal cortex activity and functional organisation in dual-task ocular pursuit is affected by concurrent upper limb movement. Sci Rep 2024; 14:9996. [PMID: 38693184 PMCID: PMC11063197 DOI: 10.1038/s41598-024-57012-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Accepted: 03/13/2024] [Indexed: 05/03/2024] Open
Abstract
Tracking a moving object with the eyes seems like a simple task but involves areas of prefrontal cortex (PFC) associated with attention, working memory and prediction. Increasing the demand on these processes with secondary tasks can affect eye movements and/or perceptual judgments. This is particularly evident in chronic or acute neurological conditions such as Alzheimer's disease or mild traumatic brain injury. Here, we combined near infrared spectroscopy and video-oculography to examine the effects of concurrent upper limb movement, which provides additional afference and efference that facilitates tracking of a moving object, in a novel dual-task pursuit protocol. We confirmed the expected effects on judgement accuracy in the primary and secondary tasks, as well as a reduction in eye velocity when the moving object was occluded. Although there was limited evidence of oculo-manual facilitation on behavioural measures, performing concurrent upper limb movement did result in lower activity in left medial PFC, as well as a change in PFC network organisation, which was shown by Graph analysis to be locally and globally more efficient. These findings extend upon previous work by showing how PFC is functionally organised to support eye-hand coordination when task demands more closely replicate daily activities.
Collapse
Affiliation(s)
- Lénaïc Borot
- School of Sport and Exercise Sciences, Faculty of Science, Liverpool John Moores University, Liverpool, UK
| | - Ruth Ogden
- School of Psychology, Faculty of Health, Liverpool John Moores University, Liverpool, UK
| | - Simon J Bennett
- School of Sport and Exercise Sciences, Faculty of Science, Liverpool John Moores University, Liverpool, UK.
| |
Collapse
|
4
|
de la Malla C, Goettker A. The effect of impaired velocity signals on goal-directed eye and hand movements. Sci Rep 2023; 13:13646. [PMID: 37607970 PMCID: PMC10444871 DOI: 10.1038/s41598-023-40394-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2023] [Accepted: 08/09/2023] [Indexed: 08/24/2023] Open
Abstract
Information about position and velocity is essential to predict where moving targets will be in the future, and to accurately move towards them. But how are the two signals combined over time to complete goal-directed movements? We show that when velocity information is impaired due to using second-order motion stimuli, saccades directed towards moving targets land at positions where targets were ~ 100 ms before saccade initiation, but hand movements are accurate. Importantly, the longer latencies of hand movements allow for additional time to process the sensory information available. When increasing the period of time one sees the moving target before making the saccade, saccades become accurate. In line with that, hand movements with short latencies show higher curvature, indicating corrections based on an update of incoming sensory information. These results suggest that movements are controlled by an independent and evolving combination of sensory information about the target's position and velocity.
Collapse
Affiliation(s)
- Cristina de la Malla
- Vision and Control of Action Group, Department of Cognition, Development, and Psychology of Education, Institute of Neurosciences, Universitat de Barcelona, Barcelona, Catalonia, Spain.
| | - Alexander Goettker
- Justus Liebig Universität Giessen, Giessen, Germany.
- Center for Mind, Brain and Behavior, University of Marburg and Justus Liebig University, Giessen, Germany.
| |
Collapse
|
5
|
Vrijling ACL, de Boer MJ, Renken RJ, Marsman JBC, Grillini A, Petrillo CE, Heutink J, Jansonius NM, Cornelissen FW. Stimulus contrast, pursuit mode, and age strongly influence tracking performance on a continuous visual tracking task. Vision Res 2023; 205:108188. [PMID: 36773370 DOI: 10.1016/j.visres.2023.108188] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2022] [Revised: 01/23/2023] [Accepted: 01/23/2023] [Indexed: 02/12/2023]
Abstract
Human observers tend to naturally track moving stimuli. This tendency may be exploited towards an intuitive means of screening visual function as an impairment induced reduction in stimulus visibility will decrease tracking performance. Yet, to be able to detect subtle impairments, stimulus contrast is critical. If too high, the decrease in performance may remain undetected. Therefore, for this approach to become reliable and sensitive, we need a detailed understanding of how age, stimulus contrast, and the type of stimulus movement affect continuous tracking performance. To do so, we evaluated how well twenty younger and twenty older participants tracked a semi-randomly moving stimulus (Goldmann size III, 0.43 degrees of visual angle), presented at five contrast levels (5%-10%-20%-40%-80%). The stimulus could move smoothly only (smooth pursuit mode) or in alternation with displacements (saccadic pursuit mode). Additionally, we assessed static foveal and peripheral contrast thresholds. For all participants, tracking performance improved with increasing contrast in both pursuit modes. To reach threshold performance levels, older participants required about twice as much contrast (20% vs. 10% and 40% vs. 20% in smooth and saccadic modes respectively). Saccadic pursuit detection thresholds correlated significantly with static peripheral contrast thresholds (rho = 0.64). Smooth pursuit detection thresholds were uncorrelated with static foveal contrast thresholds (rho = 0.29). We conclude that continuous visual stimulus tracking is strongly affected by stimulus contrast, pursuit mode, and age. This provides essential insights that can be applied towards new and intuitive approaches of screening visual function.
Collapse
Affiliation(s)
- A C L Vrijling
- Laboratory of Experimental Ophthalmology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands; Royal Dutch Visio, Centre of Expertise for Blind and Partially Sighted People, Huizen, the Netherlands.
| | - M J de Boer
- Laboratory of Experimental Ophthalmology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | - R J Renken
- Cognitive Neuroscience Center, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | - J B C Marsman
- Cognitive Neuroscience Center, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | | | | | - J Heutink
- Royal Dutch Visio, Centre of Expertise for Blind and Partially Sighted People, Huizen, the Netherlands; Department of Clinical and Developmental Neuropsychology, University of Groningen, Groningen, the Netherlands
| | - N M Jansonius
- Laboratory of Experimental Ophthalmology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands; Department of Ophthalmology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | - F W Cornelissen
- Laboratory of Experimental Ophthalmology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| |
Collapse
|
6
|
Effects of internally directed cognition on smooth pursuit eye movements: A systematic examination of perceptual decoupling. Atten Percept Psychophys 2023; 85:1159-1178. [PMID: 36922477 PMCID: PMC10167146 DOI: 10.3758/s13414-023-02688-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/21/2023] [Indexed: 03/17/2023]
Abstract
Eye behavior differs between internally and externally directed cognition and thus is indicative of an internal versus external attention focus. Recent work implicated perceptual decoupling (i.e., eye behavior becoming less determined by the sensory environment) as one of the key mechanisms involved in these attention-related eye movement differences. However, it is not yet understood how perceptual decoupling depends on the characteristics of the internal task. Therefore, we systematically examined effects of varying internal task demands on smooth pursuit eye movements. Specifically, we evaluated effects of the internal workload (control vs. low vs. high) and of internal task (arithmetic vs. visuospatial). The results of multilevel modelling showed that effects of perceptual decoupling were stronger for higher workload, and more pronounced for the visuospatial modality. Effects also followed a characteristic time-course relative to internal operations. The findings provide further support of the perceptual decoupling mechanism by showing that it is sensitive to the degree of interference between external and internal information.
Collapse
|
7
|
Shanidze NM, Lively Z, Lee R, Verghese P. Saccadic contributions to smooth pursuit in macular degeneration. Vision Res 2022; 200:108102. [PMID: 35870286 PMCID: PMC9831682 DOI: 10.1016/j.visres.2022.108102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Revised: 04/12/2022] [Accepted: 06/27/2022] [Indexed: 01/25/2023]
Abstract
Saccades during smooth pursuit can help bring the fovea on target, particularly in cases of low pursuit gain. Individuals with macular degeneration often suffer damage to the central retina including the fovea, which impacts oculomotor function such as fixation, saccadic and smooth pursuit eye movements. We hypothesized that these oculomotor changes in macular degeneration (MD) would make saccades less appropriately directed (even if more numerous). To investigate saccades during pursuit in MD, we conducted a quantitative analysis of smooth pursuit eye movement data from a prior study, Vision Research 141 (2017) 181-190. Here we examined saccade frequency, magnitude, and direction across viewing conditions for MD and control participants during pursuit of a target moving in a modified step-ramp paradigm. Individuals with MD had more variability in saccade directions that included directions orthogonal to the target trajectory. PRL eccentricity significantly correlated with increases in saccades in non-target directions during smooth pursuit. These results suggest that a large number of saccades during pursuit in MD participants are unlikely to be catch-up saccades that serve to keep the eye on the target.
Collapse
Affiliation(s)
| | - Zachary Lively
- Smith-Kettlewell Eye Research Institute, San Francisco, CA, USA
| | - Rachel Lee
- Smith-Kettlewell Eye Research Institute, San Francisco, CA, USA
| | - Preeti Verghese
- Smith-Kettlewell Eye Research Institute, San Francisco, CA, USA
| |
Collapse
|
8
|
Vandevoorde K, Vollenkemper L, Schwan C, Kohlhase M, Schenck W. Using Artificial Intelligence for Assistance Systems to Bring Motor Learning Principles into Real World Motor Tasks. SENSORS (BASEL, SWITZERLAND) 2022; 22:2481. [PMID: 35408094 PMCID: PMC9002555 DOI: 10.3390/s22072481] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Revised: 03/18/2022] [Accepted: 03/20/2022] [Indexed: 11/03/2022]
Abstract
Humans learn movements naturally, but it takes a lot of time and training to achieve expert performance in motor skills. In this review, we show how modern technologies can support people in learning new motor skills. First, we introduce important concepts in motor control, motor learning and motor skill learning. We also give an overview about the rapid expansion of machine learning algorithms and sensor technologies for human motion analysis. The integration between motor learning principles, machine learning algorithms and recent sensor technologies has the potential to develop AI-guided assistance systems for motor skill training. We give our perspective on this integration of different fields to transition from motor learning research in laboratory settings to real world environments and real world motor tasks and propose a stepwise approach to facilitate this transition.
Collapse
Affiliation(s)
- Koenraad Vandevoorde
- Center for Applied Data Science (CfADS), Faculty of Engineering and Mathematics, Bielefeld University of Applied Sciences, 33619 Bielefeld, Germany; (L.V.); (C.S.); (M.K.)
| | | | | | | | - Wolfram Schenck
- Center for Applied Data Science (CfADS), Faculty of Engineering and Mathematics, Bielefeld University of Applied Sciences, 33619 Bielefeld, Germany; (L.V.); (C.S.); (M.K.)
| |
Collapse
|
9
|
Novel FPGA-Based Visual Stimulation Method for Eye Movement Analysis. ELECTRONICS 2022. [DOI: 10.3390/electronics11030303] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Several studies have demonstrated that irregularities in eye movements represent an important indicator to diagnose diseases affecting the central nervous system. In fact, abnormal horizontal and vertical eye movements play an important role in measuring the progress of neurodegenerative diseases. Electro-oculography (EOG) is a widespread technique that monitors the horizontal and vertical eye movements in response to a visual stimulation pattern. These visual stimuli require stimulus-response synchronization, low latency, and a real-time response. In this work, a novel system based on a Field-Programmable Gate Array (FPGA) is designed to address hundreds of LEDs for the generation of multiple visual stimulus signals and for EOG acquisition. Our evaluation demonstrates that the proposed system enhances the accuracy of the signals generated, showing excellent results in the stimulus-response synchronism and quality of the stimuli waveform.
Collapse
|
10
|
Goettker A, Gegenfurtner KR. A change in perspective: The interaction of saccadic and pursuit eye movements in oculomotor control and perception. Vision Res 2021; 188:283-296. [PMID: 34489101 DOI: 10.1016/j.visres.2021.08.004] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2021] [Revised: 07/26/2021] [Accepted: 08/16/2021] [Indexed: 11/17/2022]
Abstract
Due to the close relationship between oculomotor behavior and visual processing, eye movements have been studied in many different areas of research over the last few decades. While these studies have brought interesting insights, specialization within each research area comes at the potential cost of a narrow and isolated view of the oculomotor system. In this review, we want to expand this perspective by looking at the interactions between the two most important types of voluntary eye movements: saccades and pursuit. Recent evidence indicates multiple interactions and shared signals at the behavioral and neurophysiological level for oculomotor control and for visual perception during pursuit and saccades. Oculomotor control seems to be based on shared position- and velocity-related information, which leads to multiple behavioral interactions and synergies. The distinction between position- and velocity-related information seems to be also present at the neurophysiological level. In addition, visual perception seems to be based on shared efferent signals about upcoming eye positions and velocities, which are to some degree independent of the actual oculomotor response. This review suggests an interactive perspective on the oculomotor system, based mainly on different types of sensory input, and less so on separate subsystems for saccadic or pursuit eye movements.
Collapse
Affiliation(s)
- Alexander Goettker
- Abteilung Allgemeine Psychologie and Center for Mind, Brain & Behavior, Justus-Liebig University Giessen, Germany.
| | - Karl R Gegenfurtner
- Abteilung Allgemeine Psychologie and Center for Mind, Brain & Behavior, Justus-Liebig University Giessen, Germany
| |
Collapse
|
11
|
Park WJ, Schauder KB, Kwon OS, Bennetto L, Tadin D. Atypical visual motion prediction abilities in autism spectrum disorder. Clin Psychol Sci 2021; 9:944-960. [PMID: 34721951 DOI: 10.1177/2167702621991803] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
A recent theory posits that prediction deficits may underlie the core symptoms in autism spectrum disorder (ASD). However, empirical evidence for this hypothesis is minimal. Using a visual extrapolation task, we tested motion prediction abilities in children and adolescents with and without ASD. We examined the factors known to be important for motion prediction: the central-tendency response bias and smooth pursuit eye movements. In ASD, response biases followed an atypical trajectory that was dominated by early responses. This differed from controls who exhibited response biases that reflected a gradual accumulation of knowledge about stimulus statistics. Moreover, while better smooth pursuit eye movements for the moving object were linked to more accurate motion prediction in controls, in ASD, better smooth pursuit was counterintuitively linked to a more pronounced early response bias. Together, these results demonstrate atypical visual prediction abilities in ASD and offer insights into possible mechanisms underlying the observed differences.
Collapse
Affiliation(s)
- Woon Ju Park
- Department of Psychology, University of Washington, Seattle, WA, 98195
| | - Kimberly B Schauder
- Center for Autism Spectrum Disorders, Children's National Hospital, Rockville, MD, 20850
| | - Oh-Sang Kwon
- Department of Human Factors Engineering, Ulsan National Institute of Science and Technology, Ulsan, South Korea
| | - Loisa Bennetto
- Department of Psychology, University of Rochester, Rochester, NY, 14627.,Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, 14627.,Department of Neuroscience, University of Rochester Medical Center, Rochester, NY, 14642
| | - Duje Tadin
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, 14627.,Department of Neuroscience, University of Rochester Medical Center, Rochester, NY, 14642.,Center for Visual Science, University of Rochester, Rochester, NY, 14627.,Department of Ophthalmology, University of Rochester Medical Center, Rochester, NY, 14642
| |
Collapse
|
12
|
Abstract
In healthy vision, the fovea provides high acuity and serves as the locus for fixation achieved through saccadic eye movements. Bilateral loss of the foveal regions in both eyes causes individuals to adopt an eccentric locus for fixation. This review deals with the eye movement consequences of the loss of the foveal oculomotor reference and the ability of individuals to use an eccentric fixation locus as the new oculomotor reference. Eye movements are an integral part of everyday activities, such as reading, searching for an item of interest, eye-hand coordination, navigation, or tracking an approaching car. We consider how these tasks are impacted by the need to use an eccentric locus for fixation and as a reference for eye movements, specifically saccadic and smooth pursuit eye movements. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
Collapse
Affiliation(s)
- Preeti Verghese
- The Smith-Kettlewell Eye Research Institute, San Francisco, California 94115, USA;
| | - Cécile Vullings
- The Smith-Kettlewell Eye Research Institute, San Francisco, California 94115, USA;
| | - Natela Shanidze
- The Smith-Kettlewell Eye Research Institute, San Francisco, California 94115, USA;
| |
Collapse
|
13
|
Goettker A. Retinal error signals and fluctuations in eye velocity influence oculomotor behavior in subsequent trials. J Vis 2021; 21:28. [PMID: 34036299 PMCID: PMC8164369 DOI: 10.1167/jov.21.5.28] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Accepted: 05/01/2021] [Indexed: 01/07/2023] Open
Abstract
The oculomotor system makes use of an integration of previous stimulus velocities (the prior) and current sensory inputs to adjust initial eye speeds. The present study extended this research by investigating the roles of different retinal or extra-retinal signals for this process. To test for this, participants viewed movement sequences that all ended with the same test trial. Earlier in the sequence, the prior was manipulated by presenting targets that either had different velocities, different starting positions, or target movements designed to elicit differential oculomotor behavior (tracked with or without additional corrective saccades). Additionally, these prior targets could vary in terms of contrast to manipulate reliability. When the velocity of prior trials differed from test trials, the reliability-weighted integration of prior information was replicated. When the prior trials differed in starting position, significant effects on subsequent oculomotor behavior were only observed for the reliable target. Although there were also differences in eye velocity across the different manipulations, they could not explain the observed reliability-weighted integration. When comparing the same physical prior trials but tracked with additional corrective saccades, the eye velocity in the test trial also differed systematically (slower for forward saccades, and faster for backward saccades). The direction of the observed effect contradicts the expectations based on perceived speed and eye velocity, but can be predicted by a combination of retinal velocity and position error signals. Together, these results suggest that general fluctuations in eye velocity as well as retinal error signals are related to oculomotor behavior in subsequent trials.
Collapse
|
14
|
Thompson-Harvey A, Dutcher CE, Monroe HA, Sinks BC, Goebel JA. Detection of VOR dysfunction during the gaze stabilization test: Does target size matter? J Vestib Res 2021; 31:495-504. [PMID: 33896858 DOI: 10.3233/ves-201602] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND The Gaze Stabilization Test (GST) identifies vestibulo-ocular reflex (VOR) dysfunction using a decline in target recognition with increasing head velocity, but there is no consensus on target (optotype) size above static visual acuity. OBJECTIVE To determine the optimal initial optotype size above static visual acuity to be used during the GST in subjects with unilateral vestibular dysfunction and healthy individuals. METHODS Eight subjects with unilateral vestibular dysfunction (UVD) and 19 age-matched, healthy control subjects were studied with the standard GST protocol using two optotype sizes, 0.2 and 0.3 logMAR above static visual acuity (ΔlogMAR). Maximal head velocity achieved while maintaining fixation on both optotypes was measured. Sensitivity, specificity and receiver-operator characteristic area under the curve (ROC AUC) analyses were performed to determine the optimal head velocity cut off point for each optotype, based on ability to identify the lesioned side of the UVD group from the control group. RESULTS There was a significant difference in maximal head velocity between the UVD group and control group using 0.2 ΔlogMAR (p = 0.032) but not 0.3 ΔlogMAR (p = 0.061). While both targets produced similar specificities (90%) for distinguishing normal from subjects with UVD, 0.2 ΔlogMAR targets yielded higher sensitivity (75%) than 0.3 logMAR (63%) and accuracy (86% vs 80%, respectively) in detecting the lesioned side in subjects with UVD versus controls with maximal head velocities≤105 deg/s (p = 0.017). Furthermore, positive likelihood ratios were nearly twice as high when using 0.2 ΔlogMAR targets (+ LR 10) compared to 0.3 ΔlogMAR (+ LR 6.3). CONCLUSION The 0.2 ΔlogMAR optotype demonstrated significantly superior identification of subjects with UVD, better sensitivity and positive likelihood ratios than 0.3 ΔlogMAR for detection of VOR dysfunction. Using a target size 0.2logMAR above static visual acuity (ΔlogMAR) during GST may yield better detection of VOR dysfunction to serve as a baseline for gaze stabilization rehabilitation therapy.
Collapse
Affiliation(s)
- Adam Thompson-Harvey
- Department of Otolaryngology and Communication Sciences, Medical College of Wisconsin, Milwaukee, Wisconsin, USA
| | | | | | - Belinda C Sinks
- Dizziness and Balance Center, Department of Otolaryngology-Head and Neck Surgery, Washington University School of Medicine, Saint Louis, MO, USA
| | - Joel A Goebel
- Dizziness and Balance Center, Department of Otolaryngology-Head and Neck Surgery, Washington University School of Medicine, Saint Louis, MO, USA
| |
Collapse
|
15
|
Fooken J, Kreyenmeier P, Spering M. The role of eye movements in manual interception: A mini-review. Vision Res 2021; 183:81-90. [PMID: 33743442 DOI: 10.1016/j.visres.2021.02.007] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2020] [Revised: 01/28/2021] [Accepted: 02/04/2021] [Indexed: 10/21/2022]
Abstract
When we catch a moving object in mid-flight, our eyes and hands are directed toward the object. Yet, the functional role of eye movements in guiding interceptive hand movements is not yet well understood. This review synthesizes emergent views on the importance of eye movements during manual interception with an emphasis on laboratory studies published since 2015. We discuss the role of eye movements in forming visual predictions about a moving object, and for enhancing the accuracy of interceptive hand movements through feedforward (extraretinal) and feedback (retinal) signals. We conclude by proposing a framework that defines the role of human eye movements for manual interception accuracy as a function of visual certainty and object motion predictability.
Collapse
Affiliation(s)
- Jolande Fooken
- Department of Psychology and Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada; Department of Ophthalmology & Visual Sciences, University of British Columbia, Vancouver, Canada.
| | - Philipp Kreyenmeier
- Department of Ophthalmology & Visual Sciences, University of British Columbia, Vancouver, Canada; Graduate Program in Neuroscience, University of British Columbia, Vancouver, Canada.
| | - Miriam Spering
- Department of Ophthalmology & Visual Sciences, University of British Columbia, Vancouver, Canada; Graduate Program in Neuroscience, University of British Columbia, Vancouver, Canada; Djavad Mowafaghian Centre for Brain Health, University of British Columbia, Vancouver, Canada; Institute for Computing, Information, and Cognitive Systems, University of British Columbia, Vancouver, Canada
| |
Collapse
|
16
|
Fooken J, Spering M. Eye movements as a readout of sensorimotor decision processes. J Neurophysiol 2020; 123:1439-1447. [PMID: 32159423 DOI: 10.1152/jn.00622.2019] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023] Open
Abstract
Real-world tasks, such as avoiding obstacles, require a sequence of interdependent choices to reach accurate motor actions. Yet, most studies on primate decision making involve simple one-step choices. Here we analyze motor actions to investigate how sensorimotor decisions develop over time. In a go/no-go interception task human observers (n = 42) judged whether a briefly presented moving target would pass (interceptive hand movement required) or miss (no hand movement required) a strike box while their eye and hand movements were recorded. Go/no-go decision formation had to occur within the first few hundred milliseconds to allow time-critical interception. We found that the earliest time point at which eye movements started to differentiate actions (go versus no-go) preceded hand movement onset. Moreover, eye movements were related to different stages of decision making. Whereas higher eye velocity during smooth pursuit initiation was related to more accurate interception decisions (whether or not to act), faster pursuit maintenance was associated with more accurate timing decisions (when to act). These results indicate that pursuit initiation and maintenance are continuously linked to ongoing sensorimotor decision formation.NEW & NOTEWORTHY Here we show that eye movements are a continuous indicator of decision processes underlying go/no-go actions. We link different stages of decision formation to distinct oculomotor events during open- and closed-loop smooth pursuit. Critically, the earliest time point at which eye movements differentiate actions preceded hand movement onset, suggesting shared sensorimotor processing for eye and hand movements. These results emphasize the potential of studying eye movements as a readout of cognitive processes.
Collapse
Affiliation(s)
- Jolande Fooken
- Department of Ophthalmology and Visual Sciences, University of British Columbia, Vancouver, Canada.,Graduate Program in Neuroscience, University of British Columbia, Vancouver, Canada
| | - Miriam Spering
- Department of Ophthalmology and Visual Sciences, University of British Columbia, Vancouver, Canada.,Graduate Program in Neuroscience, University of British Columbia, Vancouver, Canada.,Center for Brain Health, University of British Columbia, Vancouver, Canada.,Institute for Computing, Information and Cognitive Systems, University of British Columbia, Vancouver, Canada
| |
Collapse
|
17
|
Goettker A, Braun DI, Gegenfurtner KR. Dynamic combination of position and motion information when tracking moving targets. J Vis 2020; 19:2. [PMID: 31287856 DOI: 10.1167/19.7.2] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
To accurately foveate a moving target, the oculomotor system needs to estimate the position of the target at the saccade end, based on information about its position and ongoing movement, while accounting for neuronal delays and execution time of the saccade. We investigated human interceptive saccades and pursuit responses to moving targets defined by high and low luminance contrast or by chromatic contrast only (isoluminance). We used step-ramps with perpendicular directions between vertical target steps of 10 deg/s and horizontal ramps of 2.5 to 20 deg/s to separate errors with respect to the position step of the target in the vertical dimension, and errors related to target motion in the horizontal dimension. Interceptive saccades to targets of high and low luminance contrast landed close to the actual target positions, suggesting relatively accurate estimates of the amount of target displacement. Interceptive saccades to isoluminant targets were less accurate. They landed at positions the target had on average 100 ms before saccade onset. One account of this finding is that the integration of target motion is compromised for isoluminant targets moving in the periphery. In this case, the oculomotor system can use an accurate, but delayed position component, but cannot account for target movement. This deficit was also present for the postsaccadic pursuit speed. For the two luminance conditions, pursuit direction and speed were adjusted depending on the saccadic landing position. The rapid postsaccadic pursuit adjustments suggest shared position- and motion-related signals of target and eye for saccade and pursuit control.
Collapse
|
18
|
Mathew J, Flanagan JR, Danion FR. Gaze behavior during visuomotor tracking with complex hand-cursor dynamics. J Vis 2019; 19:24. [PMID: 31868897 DOI: 10.1167/19.14.24] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
The ability to track a moving target with the hand has been extensively studied, but few studies have characterized gaze behavior during this task. Here we investigate gaze behavior when participants learn a new mapping between hand and cursor motion, such that the cursor represented the position of a virtual mass attached to the grasped handle via a virtual spring. Depending on the experimental condition, haptic feedback consistent with mass-spring dynamics could also be provided. For comparison a simple one-to-one hand-cursor mapping was also tested. We hypothesized that gaze would be drawn, at times, to the cursor in the mass-spring conditions, especially in the absence of haptic feedback. As expected hand tracking performance was less accurate under the spring mapping, but gaze behavior was virtually unaffected by the spring mapping, regardless of whether haptic feedback was provided. Specifically, relative gaze position between target and cursor, rate of saccades, and gain of smooth pursuit were similar under both mappings and both haptic feedback conditions. We conclude that even when participants are exposed to a challenging hand-cursor mapping, gaze is primarily concerned about ongoing target motion suggesting that peripheral vision is sufficient to monitor cursor position and to update hand movement control.
Collapse
Affiliation(s)
- James Mathew
- Aix-Marseille Université, CNRS, Institut de Neurosciences de la Timone, Marseille, France.,Current affiliation: Institute of Neuroscience, Institute of Communication & Information Technologies, Electronics & Applied Mathematics, Université Catholique de Louvain, Louvain-la-neuve, Belgium
| | - J Randall Flanagan
- Department of Psychology and Centre for Neurosciences Studies, Queens University, Ontario, Canada
| | - Frederic R Danion
- Aix-Marseille Université, CNRS, Institut de Neurosciences de la Timone, Marseille, France
| |
Collapse
|
19
|
Jörges B, López-Moliner J. Earth-Gravity Congruent Motion Facilitates Ocular Control for Pursuit of Parabolic Trajectories. Sci Rep 2019; 9:14094. [PMID: 31575901 PMCID: PMC6773720 DOI: 10.1038/s41598-019-50512-6] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2019] [Accepted: 09/09/2019] [Indexed: 01/08/2023] Open
Abstract
There is evidence that humans rely on an earth gravity (9.81 m/s²) prior for a series of tasks involving perception and action, the reason being that gravity helps predict future positions of moving objects. Eye-movements in turn are partially guided by predictions about observed motion. Thus, the question arises whether knowledge about gravity is also used to guide eye-movements: If humans rely on a representation of earth gravity for the control of eye movements, earth-gravity-congruent motion should elicit improved visual pursuit. In a pre-registered experiment, we presented participants (n = 10) with parabolic motion governed by six different gravities (-1/0.7/0.85/1/1.15/1.3 g), two initial vertical velocities and two initial horizontal velocities in a 3D environment. Participants were instructed to follow the target with their eyes. We tracked their gaze and computed the visual gain (velocity of the eyes divided by velocity of the target) as proxy for the quality of pursuit. An LMM analysis with gravity condition as fixed effect and intercepts varying per subject showed that the gain was lower for -1 g than for 1 g (by -0.13, SE = 0.005). This model was significantly better than a null model without gravity as fixed effect (p < 0.001), supporting our hypothesis. A comparison of 1 g and the remaining gravity conditions revealed that 1.15 g (by 0.043, SE = 0.005) and 1.3 g (by 0.065, SE = 0.005) were associated with lower gains, while 0.7 g (by 0.054, SE = 0.005) and 0.85 g (by 0.029, SE = 0.005) were associated with higher gains. This model was again significantly better than a null model (p < 0.001), contradicting our hypothesis. Post-hoc analyses reveal that confounds in the 0.7/0.85/1/1.15/1.3 g condition may be responsible for these contradicting results. Despite these discrepancies, our data thus provide some support for the hypothesis that internalized knowledge about earth gravity guides eye movements.
Collapse
Affiliation(s)
- Björn Jörges
- Vision and Control of Action (VISCA) group, Department of Cognition, Development and Psychology of Education, Institut de Neurociències, Universitat de Barcelona, Ps. Vall d'Hebron 171, 08035, Barcelona, Catalonia, Spain
| | - Joan López-Moliner
- Vision and Control of Action (VISCA) group, Department of Cognition, Development and Psychology of Education, Institut de Neurociències, Universitat de Barcelona, Ps. Vall d'Hebron 171, 08035, Barcelona, Catalonia, Spain.
| |
Collapse
|
20
|
Affiliation(s)
- Katja Fiehler
- Department of Psychology, Justus Liebig University, Giessen, Germany
- Center for Mind, Brain, and Behavior (CMBB), Universities of Marburg and Giessen, Germany
| | - Eli Brenner
- Department of Human Movement Sciences, Vrije Universiteit Amsterdam, The Netherlands
| | - Miriam Spering
- Department of Ophthalmology & Visual Sciences, University of British Columbia, Vancouver, Canada
| |
Collapse
|
21
|
Delle Monache S, Lacquaniti F, Bosco G. Ocular tracking of occluded ballistic trajectories: Effects of visual context and of target law of motion. J Vis 2019; 19:13. [PMID: 30952164 DOI: 10.1167/19.4.13] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
In tracking a moving target, the visual context may provide cues for an observer to interpret the causal nature of the target motion and extract features to which the visual system is weakly sensitive, such as target acceleration. This information could be critical when vision of the target is temporarily impeded, requiring visual motion extrapolation processes. Here we investigated how visual context influences ocular tracking of motion either congruent or not with natural gravity. To this end, 28 subjects tracked computer-simulated ballistic trajectories either perturbed in the descending segment with altered gravity effects (0g/2g) or retaining natural-like motion (1g). Shortly after the perturbation (550 ms), targets disappeared for either 450 or 650 ms and became visible again until landing. Target motion occurred with either quasi-realistic pictorial cues or a uniform background, presented in counterbalanced order. We analyzed saccadic and pursuit movements after 0g and 2g target-motion perturbations and for corresponding intervals of unperturbed 1g trajectories, as well as after corresponding occlusions. Moreover, we considered the eye-to-target distance at target reappearance. Tracking parameters differed significantly between scenarios: With a neutral background, eye movements did not depend consistently on target motion, whereas with pictorial background they showed significant dependence, denoting better tracking of accelerated targets. These results suggest that oculomotor control is tuned to realistic properties of the visual scene.
Collapse
Affiliation(s)
- Sergio Delle Monache
- Department of Systems Medicine, Neuroscience Section, University of Rome Tor Vergata, Rome, Italy.,Center of Space Biomedicine, University of Rome Tor Vergata, Rome, Italy.,Laboratory of Neuromotor Physiology, Santa Lucia Foundation, Rome, Italy
| | - Francesco Lacquaniti
- Department of Systems Medicine, Neuroscience Section, University of Rome Tor Vergata, Rome, Italy.,Center of Space Biomedicine, University of Rome Tor Vergata, Rome, Italy.,Laboratory of Neuromotor Physiology, Santa Lucia Foundation, Rome, Italy
| | - Gianfranco Bosco
- Department of Systems Medicine, Neuroscience Section, University of Rome Tor Vergata, Rome, Italy.,Center of Space Biomedicine, University of Rome Tor Vergata, Rome, Italy.,Laboratory of Neuromotor Physiology, Santa Lucia Foundation, Rome, Italy
| |
Collapse
|
22
|
Goettker A, Brenner E, Gegenfurtner KR, de la Malla C. Corrective saccades influence velocity judgments and interception. Sci Rep 2019; 9:5395. [PMID: 30931972 PMCID: PMC6443687 DOI: 10.1038/s41598-019-41857-z] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2018] [Accepted: 03/19/2019] [Indexed: 11/16/2022] Open
Abstract
In daily life we often interact with moving objects in tasks that involve analyzing visual motion, like catching a ball. To do so successfully we track objects with our gaze, using a combination of smooth pursuit and saccades. Previous work has shown that the occurrence and direction of corrective saccades leads to changes in the perceived velocity of moving objects. Here we investigate whether such changes lead to equivalent biases in interception. Participants had to track moving targets with their gaze, and in separate sessions either judge the targets' velocities or intercept them by tapping on them. We separated trials in which target movements were tracked with pure pursuit from trials in which identical target movements were tracked with a combination of pursuit and corrective saccades. Our results show that interception errors are shifted in accordance with the observed influence of corrective saccades on velocity judgments. Furthermore, while the time at which corrective saccades occurred did not affect velocity judgments, it did influence their effect in the interception task. Corrective saccades around 100 ms before the tap had a stronger effect on the endpoint error than earlier saccades. This might explain why participants made earlier corrective saccades in the interception task.
Collapse
Affiliation(s)
- Alexander Goettker
- Abteilung Allgemeine Psychologie, Justus-Liebig University Giessen, 35394, Giessen, Germany.
| | - Eli Brenner
- Department of Human Movement Sciences, Institute for Brain and Behavior Amsterdam, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Karl R Gegenfurtner
- Abteilung Allgemeine Psychologie, Justus-Liebig University Giessen, 35394, Giessen, Germany
| | - Cristina de la Malla
- Department of Human Movement Sciences, Institute for Brain and Behavior Amsterdam, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
- Vision and Control of Action (VISCA) Group, Department of Cognition, Development and Psychology of Education, Institut de Neurociències, Universitat de Barcelona, Barcelona, Spain
| |
Collapse
|
23
|
Mathew J, Danion FR. Ups and downs in catch-up saccades following single-pulse TMS-methodological considerations. PLoS One 2018; 13:e0205208. [PMID: 30307976 PMCID: PMC6181330 DOI: 10.1371/journal.pone.0205208] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2018] [Accepted: 09/20/2018] [Indexed: 12/02/2022] Open
Abstract
Transcranial magnetic stimulation (TMS) can interfere with smooth pursuit or with saccades initiated from a fixed position toward a fixed target, but little is known about the effect of TMS on catch-up saccade made to assist smooth pursuit. Here we explored the effect of TMS on catch-up saccades by means of a situation in which the moving target was driven by an external agent, or moved by the participants’ hand, a condition known to decrease the occurrence of catch-up saccade. Two sites of stimulation were tested, the vertex and M1 hand area. Compared to conditions with no TMS, we found a consistent modulation of saccadic activity after TMS such that it decreased at 40-100ms, strongly resumed at 100-160ms, and then decreased at 200-300ms. Despite this modulatory effect, the accuracy of catch-up saccade was maintained, and the mean saccadic activity over the 0-300ms period remained unchanged. Those findings are discussed in the context of studies showing that single-pulse TMS can induce widespread effects on neural oscillations as well as perturbations in the latency of saccades during reaction time protocols. At a more general level, despite challenges and interpretational limitations making uncertain the origin of this modulatory effect, our study provides direct evidence that TMS over presumably non-oculomotor regions interferes with the initiation of catch-up saccades, and thus offers methodological considerations for future studies that wish to investigate the underlying neural circuitry of catch-up saccades using TMS.
Collapse
Affiliation(s)
- James Mathew
- Aix Marseille University, CNRS, Institut de Neurosciences de la Timone UMR 7289, Marseille, France
| | - Frederic R Danion
- Aix Marseille University, CNRS, Institut de Neurosciences de la Timone UMR 7289, Marseille, France
| |
Collapse
|
24
|
Deravet N, Blohm G, de Xivry JJO, Lefèvre P. Weighted integration of short-term memory and sensory signals in the oculomotor system. J Vis 2018; 18:16. [PMID: 29904791 DOI: 10.1167/18.5.16] [Citation(s) in RCA: 27] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Oculomotor behaviors integrate sensory and prior information to overcome sensory-motor delays and noise. After much debate about this process, reliability-based integration has recently been proposed and several models of smooth pursuit now include recurrent Bayesian integration or Kalman filtering. However, there is a lack of behavioral evidence in humans supporting these theoretical predictions. Here, we independently manipulated the reliability of visual and prior information in a smooth pursuit task. Our results show that both smooth pursuit eye velocity and catch-up saccade amplitude were modulated by visual and prior information reliability. We interpret these findings as the continuous reliability-based integration of a short-term memory of target motion with visual information, which support modeling work. Furthermore, we suggest that saccadic and pursuit systems share this short-term memory. We propose that this short-term memory of target motion is quickly built and continuously updated, and constitutes a general building block present in all sensorimotor systems.
Collapse
Affiliation(s)
- Nicolas Deravet
- Institute of Information and Communication Technologies, Electronics, and Applied Mathematics and Institute of Neuroscience, Université catholique de Louvain, B-1348 Louvain-La-Neuve, Belgium
| | - Gunnar Blohm
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada.,Canadian Action and Perception Network (CAPnet)
| | - Jean-Jacques Orban de Xivry
- Department of Kinesiology, Movement Control and Neuroplasticity Research Group, and Leuven Brain Institute, Katholieke Universiteit Leuven, Leuven, Belgium
| | - Philippe Lefèvre
- Institute of Information and Communication Technologies, Electronics, and Applied Mathematics and Institute of Neuroscience, Université catholique de Louvain, B-1348 Louvain-La-Neuve, Belgium
| |
Collapse
|
25
|
Danion FR, Flanagan JR. Different gaze strategies during eye versus hand tracking of a moving target. Sci Rep 2018; 8:10059. [PMID: 29968806 PMCID: PMC6030130 DOI: 10.1038/s41598-018-28434-6] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2018] [Accepted: 06/19/2018] [Indexed: 11/09/2022] Open
Abstract
The ability to visually track, using smooth pursuit eye movements, moving objects is critical in both perceptual and action tasks. Here, by asking participants to view a moving target or track it with their hand, we tested whether different task demands give rise to different gaze strategies. We hypothesized that during hand tracking, in comparison to eye tracking, the frequency of catch-up saccades would be lower, and the smooth pursuit gain would be greater, because it limits the loss of stable retinal and extra-retinal information due to saccades. In our study participants viewed a visual target that followed a smooth but unpredictable trajectory in a horizontal plane and were instructed to either track the target with their gaze or with a cursor controlled by a manipulandum. Although the mean distance between gaze and target was comparable in both tasks, we found, consistent with our hypothesis, an increase in smooth pursuit gain and a decrease in the frequency of catch-up saccades during hand tracking. We suggest that this difference in gaze behavior arises from different tasks demands. Whereas keeping gaze close to the target is important in both tasks, obtaining stable retinal and extra-retinal information is critical for guiding hand movement.
Collapse
Affiliation(s)
- Frederic R Danion
- Aix Marseille University, CNRS, Institut de Neurosciences de la Timone, Marseille, France.
| | - J Randall Flanagan
- Department of Psychology and Centre for Neurosciences Studies, Queen's University, Ontario, Canada
| |
Collapse
|
26
|
Zheng R, Maraj BKV. The effect of concurrent hand movement on estimated time to contact in a prediction motion task. Exp Brain Res 2018; 236:1953-1962. [DOI: 10.1007/s00221-018-5276-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2017] [Accepted: 04/24/2018] [Indexed: 10/17/2022]
|
27
|
|
28
|
Abstract
Investigation of natural behavior has contributed a number of insights to our understanding of visual guidance of actions by highlighting the importance of behavioral goals and focusing attention on how vision and action play out in time. In this context, humans make continuous sequences of sensory-motor decisions to satisfy current behavioral goals, and the role of vision is to provide the relevant information for making good decisions in order to achieve those goals. This conceptualization of visually guided actions as a sequence of sensory-motor decisions has been formalized within the framework of statistical decision theory, which structures the problem and provides the context for much recent progress in vision and action. Components of a good decision include the task, which defines the behavioral goals, the rewards and costs associated with those goals, uncertainty about the state of the world, and prior knowledge.
Collapse
Affiliation(s)
- Mary M Hayhoe
- Center for Perceptual Systems, University of Texas at Austin, Texas 78712;
| |
Collapse
|
29
|
Abstract
In this study, we address the question of whether a target is foveated during smooth pursuit. Specifically, we examine whether smooth pursuit eye movements land near the center-of-mass of the target, as is the case for saccades. To that end, we instructed eight untrained, healthy participants to follow moving targets, presented monocularly in a scanning laser ophthalmoscope. Stimuli moved either in a modified step-ramp (smooth pursuit), or made a single step (saccade), stepping 6° from the center. Targets were ring-shaped and either 0.6° or 1.7° in diameter. In an additional set of experiments, two participants collected more extensive data on smooth pursuit and saccades for a larger range of target sizes (0.6°, 1.7°, or 4.3°). During pursuit, eyes were rarely placed at target center, even when participants' fixational stability was taken into account. Furthermore, there was a clear tendency for distance from target center to increase with target size. This outcome was in contrast to saccades, where there was no effect of target size across participants. The difference in foveal placement between the two types of eye movements is consistent with their different purposes: closer inspection of the target for saccades versus maintenance of the target in the visual field for smooth pursuit.
Collapse
Affiliation(s)
- Natela Shanidze
- Smith-Kettlewell Eye Research Institute, San Francisco, CA, ://www.ski.org/users/natela-shanidze
| | - Saeideh Ghahghaei
- Smith-Kettlewell Eye Research Institute, San Francisco, CA, ://www.ski.org/users/saeideh-ghahghaei
| | - Preeti Verghese
- Smith-Kettlewell Eye Research Institute, San Francisco, CA, ://www.ski.org/users/preeti-verghese
| |
Collapse
|
30
|
Eye Tracking of Occluded Self-Moved Targets: Role of Haptic Feedback and Hand-Target Dynamics. eNeuro 2017; 4:eN-NWR-0101-17. [PMID: 28680964 PMCID: PMC5494895 DOI: 10.1523/eneuro.0101-17.2017] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2017] [Revised: 06/06/2017] [Accepted: 06/08/2017] [Indexed: 01/04/2023] Open
Abstract
Previous studies on smooth pursuit eye movements have shown that humans can continue to track the position of their hand, or a target controlled by the hand, after it is occluded, thereby demonstrating that arm motor commands contribute to the prediction of target motion driving pursuit eye movements. Here, we investigated this predictive mechanism by manipulating both the complexity of the hand-target mapping and the provision of haptic feedback. Two hand-target mappings were used, either a rigid (simple) one in which hand and target motion matched perfectly or a nonrigid (complex) one in which the target behaved as a mass attached to the hand by means of a spring. Target animation was obtained by asking participants to oscillate a lightweight robotic device that provided (or not) haptic feedback consistent with the target dynamics. Results showed that as long as 7 s after target occlusion, smooth pursuit continued to be the main contributor to total eye displacement (∼60%). However, the accuracy of eye-tracking varied substantially across experimental conditions. In general, eye-tracking was less accurate under the nonrigid mapping, as reflected by higher positional and velocity errors. Interestingly, haptic feedback helped to reduce the detrimental effects of target occlusion when participants used the nonrigid mapping, but not when they used the rigid one. Overall, we conclude that the ability to maintain smooth pursuit in the absence of visual information can extend to complex hand-target mappings, but the provision of haptic feedback is critical for the maintenance of accurate eye-tracking performance.
Collapse
|
31
|
Kreyenmeier P, Fooken J, Spering M. Context effects on smooth pursuit and manual interception of a disappearing target. J Neurophysiol 2017; 118:404-415. [PMID: 28515287 DOI: 10.1152/jn.00217.2017] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2017] [Revised: 04/25/2017] [Accepted: 05/12/2017] [Indexed: 11/22/2022] Open
Abstract
In our natural environment, we interact with moving objects that are surrounded by richly textured, dynamic visual contexts. Yet most laboratory studies on vision and movement show visual objects in front of uniform gray backgrounds. Context effects on eye movements have been widely studied, but it is less well known how visual contexts affect hand movements. Here we ask whether eye and hand movements integrate motion signals from target and context similarly or differently, and whether context effects on eye and hand change over time. We developed a track-intercept task requiring participants to track the initial launch of a moving object ("ball") with smooth pursuit eye movements. The ball disappeared after a brief presentation, and participants had to intercept it in a designated "hit zone." In two experiments (n = 18 human observers each), the ball was shown in front of a uniform or a textured background that either was stationary or moved along with the target. Eye and hand movement latencies and speeds were similarly affected by the visual context, but eye and hand interception (eye position at time of interception, and hand interception timing error) did not differ significantly between context conditions. Eye and hand interception timing errors were strongly correlated on a trial-by-trial basis across all context conditions, highlighting the close relation between these responses in manual interception tasks. Our results indicate that visual contexts similarly affect eye and hand movements but that these effects may be short-lasting, affecting movement trajectories more than movement end points.NEW & NOTEWORTHY In a novel track-intercept paradigm, human observers tracked a briefly shown object moving across a textured, dynamic context and intercepted it with their finger after it had disappeared. Context motion significantly affected eye and hand movement latency and speed, but not interception accuracy; eye and hand position at interception were correlated on a trial-by-trial basis. Visual context effects may be short-lasting, affecting movement trajectories more than movement end points.
Collapse
Affiliation(s)
- Philipp Kreyenmeier
- Department of Ophthalmology and Visual Sciences, University of British Columbia, Vancouver, Canada.,Graduate Program in Neuro-Cognitive Psychology, Ludwig Maximilian University, Munich, Germany
| | - Jolande Fooken
- Department of Ophthalmology and Visual Sciences, University of British Columbia, Vancouver, Canada.,Graduate Program in Neuroscience, University of British Columbia, Vancouver, Canada
| | - Miriam Spering
- Department of Ophthalmology and Visual Sciences, University of British Columbia, Vancouver, Canada; .,Graduate Program in Neuroscience, University of British Columbia, Vancouver, Canada.,Center for Brain Health, University of British Columbia, Vancouver, Canada.,Institute for Information, Computing and Cognitive Systems, University of British Columbia, Vancouver, Canada; and.,International Collaboration on Repair Discoveries, Vancouver, Canada
| |
Collapse
|
32
|
Makin AD. Choosing the speed of dynamic mental simulations. PROGRESS IN BRAIN RESEARCH 2017; 236:193-210. [DOI: 10.1016/bs.pbr.2017.05.001] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
|
33
|
Behavioral characterization of prediction and internal models in adolescents with autistic spectrum disorders. Neuropsychologia 2016; 91:335-345. [PMID: 27553268 DOI: 10.1016/j.neuropsychologia.2016.08.021] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2016] [Revised: 07/19/2016] [Accepted: 08/19/2016] [Indexed: 11/21/2022]
Abstract
Autism has been considered as a deficit in prediction of the upcoming event or of the sensory consequences of our own movements. To test this hypothesis, we recorded eye movements from high-functioning autistic adolescents and from age-matched controls during a blanking paradigm. In this paradigm, adolescents were instructed to follow a moving target with their eyes even during its transient disappearance. Given the absence of visual information during the blanking period, eye movements during this period are solely controlled on the basis of the prediction of the ongoing target motion. Typical markers of predictive eye movements such as the number and accuracy of predictive saccades and the predictive reacceleration before target reappearance were identical in the two populations. In addition, the synergy of predictive saccades and smooth pursuit observed during the blanking periods, which is a marker for the quality of internal models about target/eye motions, was comparable between these two populations. These results suggest that, in our large population of high-functioning autistic adolescent, both predictive abilities and internal models are left intact in Autism, at least for low-level sensorimotor transformations.
Collapse
|
34
|
Landelle C, Montagnini A, Madelain L, Danion F. Eye tracking a self-moved target with complex hand-target dynamics. J Neurophysiol 2016; 116:1859-1870. [PMID: 27466129 DOI: 10.1152/jn.00007.2016] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2016] [Accepted: 07/26/2016] [Indexed: 12/31/2022] Open
Abstract
Previous work has shown that the ability to track with the eye a moving target is substantially improved when the target is self-moved by the subject's hand compared with when being externally moved. Here, we explored a situation in which the mapping between hand movement and target motion was perturbed by simulating an elastic relationship between the hand and target. Our objective was to determine whether the predictive mechanisms driving eye-hand coordination could be updated to accommodate this complex hand-target dynamics. To fully appreciate the behavioral effects of this perturbation, we compared eye tracking performance when self-moving a target with a rigid mapping (simple) and a spring mapping as well as when the subject tracked target trajectories that he/she had previously generated when using the rigid or spring mapping. Concerning the rigid mapping, our results confirmed that smooth pursuit was more accurate when the target was self-moved than externally moved. In contrast, with the spring mapping, eye tracking had initially similar low spatial accuracy (though shorter temporal lag) in the self versus externally moved conditions. However, within ∼5 min of practice, smooth pursuit improved in the self-moved spring condition, up to a level similar to the self-moved rigid condition. Subsequently, when the mapping unexpectedly switched from spring to rigid, the eye initially followed the expected target trajectory and not the real one, thereby suggesting that subjects used an internal representation of the new hand-target dynamics. Overall, these results emphasize the stunning adaptability of smooth pursuit when self-maneuvering objects with complex dynamics.
Collapse
Affiliation(s)
- Caroline Landelle
- Institut de Neurosciences de la Timone UMR 7289, Aix Marseille Université, Centre National de la Recherche Scientifique (CNRS), Marseille, France; and
| | - Anna Montagnini
- Institut de Neurosciences de la Timone UMR 7289, Aix Marseille Université, Centre National de la Recherche Scientifique (CNRS), Marseille, France; and
| | | | - Frederic Danion
- Institut de Neurosciences de la Timone UMR 7289, Aix Marseille Université, Centre National de la Recherche Scientifique (CNRS), Marseille, France; and
| |
Collapse
|
35
|
Disappearance of the inversion effect during memory-guided tracking of scrambled biological motion. Psychon Bull Rev 2016; 23:1170-80. [PMID: 26926834 DOI: 10.3758/s13423-015-0994-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The human visual system is highly sensitive to biological motion. Even when a point-light walker is temporarily occluded from view by other objects, our eyes are still able to maintain tracking continuity. To investigate how the visual system establishes a correspondence between the biological-motion stimuli visible before and after the disruption, we used the occlusion paradigm with biological-motion stimuli that were intact or scrambled. The results showed that during visually guided tracking, both the observers' predicted times and predictive smooth pursuit were more accurate for upright biological motion (intact and scrambled) than for inverted biological motion. During memory-guided tracking, however, the processing advantage for upright as compared with inverted biological motion was not found in the scrambled condition, but in the intact condition only. This suggests that spatial location information alone is not sufficient to build and maintain the representational continuity of the biological motion across the occlusion, and that the object identity may act as an important information source in visual tracking. The inversion effect disappeared when the scrambled biological motion was occluded, which indicates that when biological motion is temporarily occluded and there is a complete absence of visual feedback signals, an oculomotor prediction is executed to maintain the tracking continuity, which is established not only by updating the target's spatial location, but also by the retrieval of identity information stored in long-term memory.
Collapse
|
36
|
Adams RA, Bauer M, Pinotsis D, Friston KJ. Dynamic causal modelling of eye movements during pursuit: Confirming precision-encoding in V1 using MEG. Neuroimage 2016; 132:175-189. [PMID: 26921713 PMCID: PMC4862965 DOI: 10.1016/j.neuroimage.2016.02.055] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2015] [Revised: 02/15/2016] [Accepted: 02/17/2016] [Indexed: 01/06/2023] Open
Abstract
This paper shows that it is possible to estimate the subjective precision (inverse variance) of Bayesian beliefs during oculomotor pursuit. Subjects viewed a sinusoidal target, with or without random fluctuations in its motion. Eye trajectories and magnetoencephalographic (MEG) data were recorded concurrently. The target was periodically occluded, such that its reappearance caused a visual evoked response field (ERF). Dynamic causal modelling (DCM) was used to fit models of eye trajectories and the ERFs. The DCM for pursuit was based on predictive coding and active inference, and predicts subjects' eye movements based on their (subjective) Bayesian beliefs about target (and eye) motion. The precisions of these hierarchical beliefs can be inferred from behavioural (pursuit) data. The DCM for MEG data used an established biophysical model of neuronal activity that includes parameters for the gain of superficial pyramidal cells, which is thought to encode precision at the neuronal level. Previous studies (using DCM of pursuit data) suggest that noisy target motion increases subjective precision at the sensory level: i.e., subjects attend more to the target's sensory attributes. We compared (noisy motion-induced) changes in the synaptic gain based on the modelling of MEG data to changes in subjective precision estimated using the pursuit data. We demonstrate that imprecise target motion increases the gain of superficial pyramidal cells in V1 (across subjects). Furthermore, increases in sensory precision – inferred by our behavioural DCM – correlate with the increase in gain in V1, across subjects. This is a step towards a fully integrated model of brain computations, cortical responses and behaviour that may provide a useful clinical tool in conditions like schizophrenia. The brain encodes states of the world probabilistically with means and precisions. Precision (inverse variance) may be encoded by the synaptic gain of pyramidal cells. We estimate subjects' sensory precision using a model of oculomotor pursuit and DCM. We estimate subjects' synaptic gain in V1 using DCM of MEG data during pursuit. Estimates of synaptic gain in V1 and sensory precision are significantly correlated.
Collapse
Affiliation(s)
- Rick A Adams
- The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, 12 Queen Square, London WC1N 3BG, UK.
| | - Markus Bauer
- The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, 12 Queen Square, London WC1N 3BG, UK; School of Psychology, University Park, Nottingham University, Nottingham, NG7 2RD, UK.
| | - Dimitris Pinotsis
- The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, 12 Queen Square, London WC1N 3BG, UK.
| | - Karl J Friston
- The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, 12 Queen Square, London WC1N 3BG, UK.
| |
Collapse
|
37
|
Ego C, Yüksel D, Orban de Xivry JJ, Lefèvre P. Development of internal models and predictive abilities for visual tracking during childhood. J Neurophysiol 2016; 115:301-9. [PMID: 26510757 PMCID: PMC4760460 DOI: 10.1152/jn.00534.2015] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2015] [Accepted: 10/28/2015] [Indexed: 12/28/2022] Open
Abstract
The prediction of the consequences of our own actions through internal models is an essential component of motor control. Previous studies showed improvement of anticipatory behaviors with age for grasping, drawing, and postural control. Since these actions require visual and proprioceptive feedback, these improvements might reflect both the development of internal models and the feedback control. In contrast, visual tracking of a temporarily invisible target gives specific markers of prediction and internal models for eye movements. Therefore, we recorded eye movements in 50 children (aged 5-19 yr) and in 10 adults, who were asked to pursue a visual target that is temporarily blanked. Results show that the youngest children (5-7 yr) have a general oculomotor behavior in this task, qualitatively similar to the one observed in adults. However, the overall performance of older subjects in terms of accuracy at target reappearance and variability in their behavior was much better than the youngest children. This late maturation of predictive mechanisms with age was reflected into the development of the accuracy of the internal models governing the synergy between the saccadic and pursuit systems with age. Altogether, we hypothesize that the maturation of the interaction between smooth pursuit and saccades that relies on internal models of the eye and target displacement is related to the continuous maturation of the cerebellum.
Collapse
Affiliation(s)
- Caroline Ego
- Institute of Information and Communication Technologies, Electronics and Applied Mathematics, Université Catholique de Louvain, Louvain-la-Neuve, Belgium; Institute of Neuroscience, Université Catholique de Louvain, Brussels, Belgium
| | - Demet Yüksel
- Institute of Neuroscience, Université Catholique de Louvain, Brussels, Belgium; Ophthalmology Department, Cliniques Universitaires Saint-Luc, Brussels, Belgium; and
| | - Jean-Jacques Orban de Xivry
- Department of Kinesiology, Movement Control and Neuroplasticity Research Group, Katholieke Universiteit Leuven, Leuven, Belgium
| | - Philippe Lefèvre
- Institute of Information and Communication Technologies, Electronics and Applied Mathematics, Université Catholique de Louvain, Louvain-la-Neuve, Belgium; Institute of Neuroscience, Université Catholique de Louvain, Brussels, Belgium;
| |
Collapse
|
38
|
Bosco G, Monache SD, Gravano S, Indovina I, La Scaleia B, Maffei V, Zago M, Lacquaniti F. Filling gaps in visual motion for target capture. Front Integr Neurosci 2015; 9:13. [PMID: 25755637 PMCID: PMC4337337 DOI: 10.3389/fnint.2015.00013] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2014] [Accepted: 01/30/2015] [Indexed: 11/17/2022] Open
Abstract
A remarkable challenge our brain must face constantly when interacting with the environment is represented by ambiguous and, at times, even missing sensory information. This is particularly compelling for visual information, being the main sensory system we rely upon to gather cues about the external world. It is not uncommon, for example, that objects catching our attention may disappear temporarily from view, occluded by visual obstacles in the foreground. Nevertheless, we are often able to keep our gaze on them throughout the occlusion or even catch them on the fly in the face of the transient lack of visual motion information. This implies that the brain can fill the gaps of missing sensory information by extrapolating the object motion through the occlusion. In recent years, much experimental evidence has been accumulated that both perceptual and motor processes exploit visual motion extrapolation mechanisms. Moreover, neurophysiological and neuroimaging studies have identified brain regions potentially involved in the predictive representation of the occluded target motion. Within this framework, ocular pursuit and manual interceptive behavior have proven to be useful experimental models for investigating visual extrapolation mechanisms. Studies in these fields have pointed out that visual motion extrapolation processes depend on manifold information related to short-term memory representations of the target motion before the occlusion, as well as to longer term representations derived from previous experience with the environment. We will review recent oculomotor and manual interception literature to provide up-to-date views on the neurophysiological underpinnings of visual motion extrapolation.
Collapse
Affiliation(s)
- Gianfranco Bosco
- Department of Systems Medicine, University of Rome "Tor Vergata" Rome, Italy ; Centre of Space Bio-medicine, University of Rome "Tor Vergata" Rome, Italy ; Laboratory of Neuromotor Physiology, IRCCS Santa Lucia Foundation Rome, Italy
| | - Sergio Delle Monache
- Department of Systems Medicine, University of Rome "Tor Vergata" Rome, Italy ; Centre of Space Bio-medicine, University of Rome "Tor Vergata" Rome, Italy
| | - Silvio Gravano
- Centre of Space Bio-medicine, University of Rome "Tor Vergata" Rome, Italy ; Laboratory of Neuromotor Physiology, IRCCS Santa Lucia Foundation Rome, Italy
| | - Iole Indovina
- Centre of Space Bio-medicine, University of Rome "Tor Vergata" Rome, Italy ; Laboratory of Neuromotor Physiology, IRCCS Santa Lucia Foundation Rome, Italy
| | - Barbara La Scaleia
- Laboratory of Neuromotor Physiology, IRCCS Santa Lucia Foundation Rome, Italy
| | - Vincenzo Maffei
- Laboratory of Neuromotor Physiology, IRCCS Santa Lucia Foundation Rome, Italy
| | - Myrka Zago
- Laboratory of Neuromotor Physiology, IRCCS Santa Lucia Foundation Rome, Italy
| | - Francesco Lacquaniti
- Department of Systems Medicine, University of Rome "Tor Vergata" Rome, Italy ; Centre of Space Bio-medicine, University of Rome "Tor Vergata" Rome, Italy ; Laboratory of Neuromotor Physiology, IRCCS Santa Lucia Foundation Rome, Italy
| |
Collapse
|
39
|
Adams RA, Aponte E, Marshall L, Friston KJ. Active inference and oculomotor pursuit: the dynamic causal modelling of eye movements. J Neurosci Methods 2015; 242:1-14. [PMID: 25583383 PMCID: PMC4346275 DOI: 10.1016/j.jneumeth.2015.01.003] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2014] [Revised: 12/30/2014] [Accepted: 01/03/2015] [Indexed: 01/01/2023]
Abstract
We use a normative (Bayes optimal) model of oculomotor pursuit. We average the empirical responses of subjects performing a pursuit paradigm. We invert these responses using the pursuit model and dynamic causal modelling. We thereby estimate the precision of subjects’ Bayesian beliefs from their pursuit. This could be used to quantify abnormal precision encoding in schizophrenia.
Background This paper introduces a new paradigm that allows one to quantify the Bayesian beliefs evidenced by subjects during oculomotor pursuit. Subjects’ eye tracking responses to a partially occluded sinusoidal target were recorded non-invasively and averaged. These response averages were then analysed using dynamic causal modelling (DCM). In DCM, observed responses are modelled using biologically plausible generative or forward models – usually biophysical models of neuronal activity. New method Our key innovation is to use a generative model based on a normative (Bayes-optimal) model of active inference to model oculomotor pursuit in terms of subjects’ beliefs about how visual targets move and how their oculomotor system responds. Our aim here is to establish the face validity of the approach, by manipulating the content and precision of sensory information – and examining the ensuing changes in the subjects’ implicit beliefs. These beliefs are inferred from their eye movements using the normative model. Results We show that on average, subjects respond to an increase in the ‘noise’ of target motion by increasing sensory precision in their models of the target trajectory. In other words, they attend more to the sensory attributes of a noisier stimulus. Conversely, subjects only change kinetic parameters in their model but not precision, in response to increased target speed. Conclusions Using this technique one can estimate the precisions of subjects’ hierarchical Bayesian beliefs about target motion. We hope to apply this paradigm to subjects with schizophrenia, whose pursuit abnormalities may result from the abnormal encoding of precision.
Collapse
Affiliation(s)
- Rick A Adams
- The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, 12 Queen Square, London WC1N 3BG, UK.
| | - Eduardo Aponte
- The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, 12 Queen Square, London WC1N 3BG, UK; Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich & ETH Zurich, Wilfriedstr. 6, 8032 Zurich, Switzerland
| | - Louise Marshall
- The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, 12 Queen Square, London WC1N 3BG, UK; Sobell Department of Motor Neuroscience and Movement Disorders, UCL Institute of Neurology, 33 Queen Square, London WC1N 3BG, UK
| | - Karl J Friston
- The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, 12 Queen Square, London WC1N 3BG, UK
| |
Collapse
|
40
|
Eye movements and manual interception of ballistic trajectories: effects of law of motion perturbations and occlusions. Exp Brain Res 2014; 233:359-74. [DOI: 10.1007/s00221-014-4120-9] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2013] [Accepted: 09/29/2014] [Indexed: 01/01/2023]
|
41
|
Kalman filtering naturally accounts for visually guided and predictive smooth pursuit dynamics. J Neurosci 2013; 33:17301-13. [PMID: 24174663 DOI: 10.1523/jneurosci.2321-13.2013] [Citation(s) in RCA: 66] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022] Open
Abstract
The brain makes use of noisy sensory inputs to produce eye, head, or arm motion. In most instances, the brain combines this sensory information with predictions about future events. Here, we propose that Kalman filtering can account for the dynamics of both visually guided and predictive motor behaviors within one simple unifying mechanism. Our model relies on two Kalman filters: (1) one processing visual information about retinal input; and (2) one maintaining a dynamic internal memory of target motion. The outputs of both Kalman filters are then combined in a statistically optimal manner, i.e., weighted with respect to their reliability. The model was tested on data from several smooth pursuit experiments and reproduced all major characteristics of visually guided and predictive smooth pursuit. This contrasts with the common belief that anticipatory pursuit, pursuit maintenance during target blanking, and zero-lag pursuit of sinusoidally moving targets all result from different control systems. This is the first instance of a model integrating all aspects of pursuit dynamics within one coherent and simple model and without switching between different parallel mechanisms. Our model suggests that the brain circuitry generating a pursuit command might be simpler than previously believed and only implement the functional equivalents of two Kalman filters whose outputs are optimally combined. It provides a general framework of how the brain can combine continuous sensory information with a dynamic internal memory and transform it into motor commands.
Collapse
|
42
|
Diaz G, Cooper J, Hayhoe M. Memory and prediction in natural gaze control. Philos Trans R Soc Lond B Biol Sci 2013; 368:20130064. [PMID: 24018726 DOI: 10.1098/rstb.2013.0064] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
In addition to stimulus properties and task factors, memory is an important determinant of the allocation of attention and gaze in the natural world. One way that the role of memory is revealed is by predictive eye movements. Both smooth pursuit and saccadic eye movements demonstrate predictive effects based on previous experience. We have previously shown that unskilled subjects make highly accurate predictive saccades to the anticipated location of a ball prior to a bounce in a virtual racquetball setting. In this experiment, we examined this predictive behaviour. We asked whether the period after the bounce provides subjects with visual information about the ball trajectory that is used to programme the pursuit movement initiated when the ball passes through the fixation point. We occluded a 100 ms period of the ball's trajectory immediately after the bounce, and found very little effect on the subsequent pursuit movement. Subjects did not appear to modify their strategy to prolong the fixation. Neither were we able to find an effect on interception performance. Thus, it is possible that the occluded trajectory information is not critical for subsequent pursuit, and subjects may use an estimate of the ball's trajectory to programme pursuit. These results provide further support for the role of memory in eye movements.
Collapse
Affiliation(s)
- Gabriel Diaz
- Center for Perceptual Systems, University of Texas Austin, , 1 University Station, A8000, Austin, TX 78712, USA
| | | | | |
Collapse
|
43
|
Murdison TS, Paré-Bingley CA, Blohm G. Evidence for a retinal velocity memory underlying the direction of anticipatory smooth pursuit eye movements. J Neurophysiol 2013; 110:732-47. [PMID: 23678014 DOI: 10.1152/jn.00991.2012] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
To compute spatially correct smooth pursuit eye movements, the brain uses both retinal motion and extraretinal signals about the eyes and head in space (Blohm and Lefèvre 2010). However, when smooth eye movements rely solely on memorized target velocity, such as during anticipatory pursuit, it is unknown if this velocity memory also accounts for extraretinal information, such as head roll and ocular torsion. To answer this question, we used a novel behavioral updating paradigm in which participants pursued a repetitive, spatially constant fixation-gap-ramp stimulus in series of five trials. During the first four trials, participants' heads were rolled toward one shoulder, inducing ocular counterroll (OCR). With each repetition, participants increased their anticipatory pursuit gain, indicating a robust encoding of velocity memory. On the fifth trial, they rolled their heads to the opposite shoulder before pursuit, also inducing changes in ocular torsion. Consequently, for spatially accurate anticipatory pursuit, the velocity memory had to be updated across changes in head roll and ocular torsion. We tested how the velocity memory accounted for head roll and OCR by observing the effects of changes to these signals on anticipatory trajectories of the memory decoding (fifth) trials. We found that anticipatory pursuit was updated for changes in head roll; however, we observed no evidence of compensation for OCR, representing the absence of ocular torsion signals within the velocity memory. This indicated that the directional component of the memory must be coded retinally and updated to account for changes in head roll, but not OCR.
Collapse
Affiliation(s)
- T Scott Murdison
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | | | | |
Collapse
|
44
|
Ego C, Orban de Xivry JJ, Nassogne MC, Yüksel D, Lefèvre P. The saccadic system does not compensate for the immaturity of the smooth pursuit system during visual tracking in children. J Neurophysiol 2013; 110:358-67. [PMID: 23615545 DOI: 10.1152/jn.00981.2012] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
Abstract
Motor skills improve with age from childhood into adulthood, and this improvement is reflected in the performance of smooth pursuit eye movements. In contrast, the saccadic system becomes mature earlier than the smooth pursuit system. Therefore, the present study investigates whether the early mature saccadic system compensates for the lower pursuit performance during childhood. To answer this question, horizontal eye movements were recorded in 58 children (ages 5-16 yr) and 16 adults (ages 23-36 yr) in a task that required the combination of smooth pursuit and saccadic eye movements. Smooth pursuit performance improved with age. However, children had larger average position error during target tracking compared with adults, but they did not execute more saccades to compensate for their low pursuit performance despite the early maturity of their saccadic system. This absence of error correction suggests that children have a lower sensitivity to visual errors compared with adults. This reduced sensitivity might stem from poor internal models and longer processing time in young children.
Collapse
Affiliation(s)
- Caroline Ego
- ICTEAM, Université catholique de Louvain, Louvain-la-Neuve, Belgium
| | | | | | | | | |
Collapse
|
45
|
Diaz G, Cooper J, Rothkopf C, Hayhoe M. Saccades to future ball location reveal memory-based prediction in a virtual-reality interception task. J Vis 2013; 13:13.1.20. [PMID: 23325347 DOI: 10.1167/13.1.20] [Citation(s) in RCA: 96] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Despite general agreement that prediction is a central aspect of perception, there is relatively little evidence concerning the basis on which visual predictions are made. Although both saccadic and pursuit eye-movements reveal knowledge of the future position of a moving visual target, in many of these studies targets move along simple trajectories through a fronto-parallel plane. Here, using a naturalistic and racquet-based interception task in a virtual environment, we demonstrate that subjects make accurate predictions of visual target motion, even when targets follow trajectories determined by the complex dynamics of physical interactions and the head and body are unrestrained. Furthermore, we found that, following a change in ball elasticity, subjects were able to accurately adjust their prebounce predictions of the ball's post-bounce trajectory. This suggests that prediction is guided by experience-based models of how information in the visual image will change over time.
Collapse
Affiliation(s)
- Gabriel Diaz
- Center for Perceptual Systems, University of Texas Austin, Austin, TX, USA.
| | | | | | | |
Collapse
|
46
|
Adams RA, Perrinet LU, Friston K. Smooth pursuit and visual occlusion: active inference and oculomotor control in schizophrenia. PLoS One 2012; 7:e47502. [PMID: 23110076 PMCID: PMC3482214 DOI: 10.1371/journal.pone.0047502] [Citation(s) in RCA: 65] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2012] [Accepted: 09/17/2012] [Indexed: 01/08/2023] Open
Abstract
This paper introduces a model of oculomotor control during the smooth pursuit of occluded visual targets. This model is based upon active inference, in which subjects try to minimise their (proprioceptive) prediction error based upon posterior beliefs about the hidden causes of their (exteroceptive) sensory input. Our model appeals to a single principle – the minimisation of variational free energy – to provide Bayes optimal solutions to the smooth pursuit problem. However, it tries to accommodate the cardinal features of smooth pursuit of partially occluded targets that have been observed empirically in normal subjects and schizophrenia. Specifically, we account for the ability of normal subjects to anticipate periodic target trajectories and emit pre-emptive smooth pursuit eye movements – prior to the emergence of a target from behind an occluder. Furthermore, we show that a single deficit in the postsynaptic gain of prediction error units (encoding the precision of posterior beliefs) can account for several features of smooth pursuit in schizophrenia: namely, a reduction in motor gain and anticipatory eye movements during visual occlusion, a paradoxical improvement in tracking unpredicted deviations from target trajectories and a failure to recognise and exploit regularities in the periodic motion of visual targets. This model will form the basis of subsequent (dynamic causal) models of empirical eye tracking measurements, which we hope to validate, using psychopharmacology and studies of schizophrenia.
Collapse
Affiliation(s)
- Rick A Adams
- The Wellcome Trust Centre for Neuroimaging, University College London, Queen Square, London, United Kingdom.
| | | | | |
Collapse
|
47
|
Coppe S, Orban de Xivry JJ, Yüksel D, Ivanoiu A, Lefèvre P. Dramatic impairment of prediction due to frontal lobe degeneration. J Neurophysiol 2012; 108:2957-66. [PMID: 22956792 DOI: 10.1152/jn.00582.2012] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
Prediction is essential for motor function in everyday life. For instance, predictive mechanisms improve the perception of a moving target by increasing eye speed anticipatively, thus reducing motion blur on the retina. Subregions of the frontal lobes play a key role in eye movements in general and in smooth pursuit in particular, but their precise function is not firmly established. Here, the role of frontal lobes in the timing of predictive action is demonstrated by studying predictive smooth pursuit during transient blanking of a moving target in mild frontotemporal lobar degeneration (FTLD) and Alzheimer's disease (AD) patients. While control subjects and AD patients predictively reaccelerated their eyes before the predicted time of target reappearance, FTLD patients did not. The difference was so dramatic (classification accuracy >90%) that it could even lead to the definition of a new biomarker. In contrast, anticipatory eye movements triggered by the disappearance of the fixation point were still present before target motion onset in FTLD patients and visually guided pursuit was normal in both patient groups compared with controls. Therefore, FTLD patients were only impaired when the predicted timing of an external event was required to elicit an action. These results argue in favor of a role of the frontal lobes in predictive movement timing.
Collapse
Affiliation(s)
- Sébastien Coppe
- ICTEAM, Université catholique de Louvain, Louvain-La-Neuve, Belgium
| | | | | | | | | |
Collapse
|
48
|
The influence of cues and stimulus history on the non-linear frequency characteristics of the pursuit response to randomized target motion. Exp Brain Res 2011; 212:225-40. [PMID: 21590260 DOI: 10.1007/s00221-011-2725-9] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2011] [Accepted: 04/28/2011] [Indexed: 10/18/2022]
Abstract
When humans pursue motion stimuli composed of alternating constant velocity segments of randomised duration (RD), they nevertheless initiate anticipatory eye deceleration before stimulus direction changes at a pre-programmed time based on averaging prior stimulus timing. We investigated, in both the time and frequency domains, how averaging interacts with deceleration cues by comparing responses to stimuli composed of segments that were either constant-velocity ramps or half-cycle sinusoids. RDs were randomized within 6 ranges, each comprising 8 RDs and having differing mean RD. In sine responses, deceleration cues could be used to modulate eye velocity for long-range stimuli (RD = 840-1,200 ms) but in the shortest range (RD = 240-660 ms) cues became ineffective, so that sine responses resembled ramp responses, and anticipatory timing was primarily dependent on averaging. Additionally, inclusion of short duration (240 ms) segments reduced peak eye velocity for all RDs within a range, even when longer RDs in the range (up to 1,080 ms) would normally elicit much higher velocities. These effects could be attributed to antagonistic interactions between visually driven pursuit components and pre-programmed anticipatory deceleration components. In the frequency domain, the changes in peak velocity and anticipatory timing with RD range were translated into non-linear gain and phase characteristics similar to those evoked by sum-of-sines stimuli. Notably, a reduction in pursuit gain occurred when high-frequency components associated with short duration segments were present. Results appear consistent with an adapted pursuit model, in which pre-programmed timing information derived from an internally reconstructed stimulus signal is stored in short-term memory and controls the initiation of predictive responses.
Collapse
|
49
|
Spering M, Schütz AC, Braun DI, Gegenfurtner KR. Keep your eyes on the ball: smooth pursuit eye movements enhance prediction of visual motion. J Neurophysiol 2011; 105:1756-67. [DOI: 10.1152/jn.00344.2010] [Citation(s) in RCA: 74] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Success of motor behavior often depends on the ability to predict the path of moving objects. Here we asked whether tracking a visual object with smooth pursuit eye movements helps to predict its motion direction. We developed a paradigm, “eye soccer,” in which observers had to either track or fixate a visual target (ball) and judge whether it would have hit or missed a stationary vertical line segment (goal). Ball and goal were presented briefly for 100–500 ms and disappeared from the screen together before the perceptual judgment was prompted. In pursuit conditions, the ball moved towards the goal; in fixation conditions, the goal moved towards the stationary ball, resulting in similar retinal stimulation during pursuit and fixation. We also tested the condition in which the goal was fixated and the ball moved. Motion direction prediction was significantly better in pursuit than in fixation trials, regardless of whether ball or goal served as fixation target. In both fixation and pursuit trials, prediction performance was better when eye movements were accurate. Performance also increased with shorter ball-goal distance and longer presentation duration. A longer trajectory did not affect performance. During pursuit, an efference copy signal might provide additional motion information, leading to the advantage in motion prediction.
Collapse
Affiliation(s)
- Miriam Spering
- Department of Psychology, Experimental Psychology, Justus-Liebig University, Giessen, Germany; and
- Department of Ophthalmology and Visual Sciences, University of British Columbia, Vancouver, Canada
| | - Alexander C. Schütz
- Department of Psychology, Experimental Psychology, Justus-Liebig University, Giessen, Germany; and
| | - Doris I. Braun
- Department of Psychology, Experimental Psychology, Justus-Liebig University, Giessen, Germany; and
| | - Karl R. Gegenfurtner
- Department of Psychology, Experimental Psychology, Justus-Liebig University, Giessen, Germany; and
| |
Collapse
|
50
|
Schütz AC, Souto D. Adaptation of catch-up saccades during the initiation of smooth pursuit eye movements. Exp Brain Res 2011; 209:537-49. [DOI: 10.1007/s00221-011-2581-7] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2010] [Accepted: 01/28/2011] [Indexed: 10/18/2022]
|