1
|
Lehet M, Rolfs M, Bao J, Fattal J, Thakkar KN. Pre-saccadic shifts of attention in individuals diagnosed with schizophrenia. Brain Behav 2024; 14:e3466. [PMID: 38450916 PMCID: PMC10918725 DOI: 10.1002/brb3.3466] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 02/15/2024] [Accepted: 02/18/2024] [Indexed: 03/08/2024] Open
Abstract
INTRODUCTION Pathophysiological theories of schizophrenia (SZ) symptoms posit an abnormality in using predictions to guide behavior. One such prediction is based on imminent movements, via corollary discharge signals (CD) that relay information about planned movement kinematics to sensory brain regions. Empirical evidence suggests a reduced influence of sensorimotor predictions in individuals with SZ within multiple sensory systems, including in the visual system. One function of CD in the visual system is to selectively enhance visual sensitivity at the location of planned eye movements (pre-saccadic attention), thus enabling a prediction of the to-be-foveated stimulus. We expected pre-saccadic attention shifts to be less pronounced in individuals with SZ than in healthy controls (HC), resulting in unexpected sensory consequences of eye movements, which may relate to symptoms than can be explained in the context of altered allocation of attention. METHODS We examined this question by testing 30 SZ and 30 HC on a pre-saccadic attention task. On each trial participants made a saccade to a cued location in an array of four stimuli. A discrimination target that was either congruent or incongruent with the cued location was briefly presented after the cue, during saccade preparation. Pre-saccadic attention was quantified by comparing accuracy on congruent trials to incongruent trials within the interval preceding the saccade. RESULTS Although SZs were less accurate overall, the magnitude of the pre-saccadic attention effect generally did not differ across groups nor show a convincing relationship with symptom severity. We did, however, observe that SZ had reduced pre-saccadic attention effects when the discrimination target (probe) was presented at early stages of saccade planning, when pre-saccadic attention effects first emerged in HC. CONCLUSION These findings suggest generally intact pre-saccadic shifts of attention in SZ, albeit slightly delayed. Results contribute to our understanding of altered sensory predictions in people with schizophrenia.
Collapse
Affiliation(s)
- Matthew Lehet
- Department of PsychologyMichigan State UniversityEast LansingMichiganUSA
| | - Martin Rolfs
- Department of PsychologyHumboldt UniversityBerlinGermany
| | - Jacqueline Bao
- Department of PsychologyMichigan State UniversityEast LansingMichiganUSA
| | - Jessica Fattal
- Department of PsychologyNorthwestern UniversityEvanstonIllinoisUSA
| | - Katharine N. Thakkar
- Department of PsychologyMichigan State UniversityEast LansingMichiganUSA
- Psychiatry and Behavioral MedicineMichigan State University College of Human MedicineEast LansingMichiganUSA
| |
Collapse
|
2
|
Chen C, Lee VG. Looking away to see: The acquisition of a search habit away from the saccade direction. Vision Res 2023; 211:108276. [PMID: 37356376 DOI: 10.1016/j.visres.2023.108276] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Revised: 05/20/2023] [Accepted: 06/02/2023] [Indexed: 06/27/2023]
Abstract
Growing evidence has shown that attention can be habit-like, unconsciously and persistently directed toward locations that have frequently contained search targets in the past. The attentional preference typically arises when the eye gaze aligns with the attended location. Here we tested whether this spatial alignment is necessary for the acquisition of a search habit. To divert eye movements away from an attended location, we used gaze-contingent eye tracking, restricting the visible portion of the screen to an area opposite to the current gaze. Participants searched for a T target amidst a circular array of L distractors. Unbeknownst to them, the target appeared more frequently in one screen quadrant. Despite fixating on a location diametrically opposite to the visible, attended region, participants acquired probability cuing, producing quicker responses when the target appeared in the high-probability quadrant. They also showed a speed advantage in the diagonal quadrant. The attentional preference for the high-probability quadrant persisted during a testing phase in which the target's location was unbiased, but only when participants continued to search with the restricted view. These results indicate that a search habit can be acquired even when participants are required to look away from the high-probability locations. The finding suggests that the learned search habit is not solely a result of oculomotor learning.
Collapse
Affiliation(s)
- Chen Chen
- Department of Psychology, University of Minnesota, United States.
| | - Vanessa G Lee
- Department of Psychology, University of Minnesota, United States; Center for Cognitive Sciences, University of Minnesota, United States
| |
Collapse
|
3
|
Chawoush B, Draschkow D, van Ede F. Capacity and selection in immersive visual working memory following naturalistic object disappearance. J Vis 2023; 23:9. [PMID: 37548958 PMCID: PMC10411649 DOI: 10.1167/jov.23.8.9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2023] [Accepted: 07/06/2023] [Indexed: 08/08/2023] Open
Abstract
Visual working memory-holding past visual information in mind for upcoming behavior-is commonly studied following the abrupt removal of visual objects from static two-dimensional (2D) displays. In everyday life, visual objects do not typically vanish from the environment in front of us. Rather, visual objects tend to enter working memory following self or object motion: disappearing from view gradually and changing the spatial relation between memoranda and observer. Here, we used virtual reality (VR) to investigate whether two classic findings from visual working memory research-a capacity of around three objects and the reliance on space for object selection-generalize to more naturalistic modes of object disappearance. Our static reference condition mimicked traditional laboratory tasks whereby visual objects were held static in front of the participant and removed from view abruptly. In our critical flow condition, the same visual objects flowed by participants, disappearing from view gradually and behind the observer. We considered visual working memory performance and capacity, as well as space-based mnemonic selection, indexed by directional biases in gaze. Despite vastly distinct modes of object disappearance and altered spatial relations between memoranda and observer, we found comparable capacity and comparable gaze signatures of space-based mnemonic selection. This finding reveals how classic findings from visual working memory research generalize to immersive situations with more naturalistic modes of object disappearance and with dynamic spatial relations between memoranda and observer.
Collapse
Affiliation(s)
- Babak Chawoush
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Dejan Draschkow
- Department of Experimental Psychology, University of Oxford, United Kingdom
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| | - Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
4
|
Hanning NM, Deubel H. A dynamic 1/f noise protocol to assess visual attention without biasing perceptual processing. Behav Res Methods 2023; 55:2583-2594. [PMID: 35915360 PMCID: PMC10439027 DOI: 10.3758/s13428-022-01916-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/20/2022] [Indexed: 11/08/2022]
Abstract
Psychophysical paradigms measure visual attention via localized test items to which observers must react or whose features have to be discriminated. These items, however, potentially interfere with the intended measurement, as they bias observers' spatial and temporal attention to their location and presentation time. Furthermore, visual sensitivity for conventional test items naturally decreases with retinal eccentricity, which prevents direct comparison of central and peripheral attention assessments. We developed a stimulus that overcomes these limitations. A brief oriented discrimination signal is seamlessly embedded into a continuously changing 1/f noise field, such that observers cannot anticipate potential test locations or times. Using our new protocol, we demonstrate that local orientation discrimination accuracy for 1/f filtered signals is largely independent of retinal eccentricity. Moreover, we show that items present in the visual field indeed shape the distribution of visual attention, suggesting that classical studies investigating the spatiotemporal dynamics of visual attention via localized test items may have obtained a biased measure. We recommend our protocol as an efficient method to evaluate the behavioral and neurophysiological correlates of attentional orienting across space and time.
Collapse
Affiliation(s)
- Nina M Hanning
- Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany.
- Department of Psychology and Center for Neural Science, New York University, New York, NY, USA.
- Institut für Psychologie, Humboldt-Universität zu Berlin, Berlin, Germany.
| | - Heiner Deubel
- Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| |
Collapse
|
5
|
Masson N, Pesenti M. A functional role for oculomotor preparation in mental arithmetic evidenced by the abducted eye paradigm. PSYCHOLOGICAL RESEARCH 2023; 87:919-928. [PMID: 35758995 DOI: 10.1007/s00426-022-01696-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2021] [Accepted: 06/02/2022] [Indexed: 11/25/2022]
Abstract
Solving subtraction and addition problems is accompanied by spontaneous leftward and rightward gaze shifts, respectively. These shifts have been related to attentional processes involved in mental arithmetic, but whether these processes induce overt attentional shifts mediated by the activation of the motor programs underlying lateral eye movements or covert shifts only is still unknown. Here, we used the abducted eye paradigm to selectively disrupt activation of the oculomotor system and prevent oculomotor preparation, which affects overt but not covert attentional shifts. Participants had to mentally solve addition and subtraction problems while fixating a screen positioned either in front of them or laterally to their left or right such that they were physically unable to programme and execute saccades further into their temporal field while they still could do so in their nasal field. In comparison to the frontal condition, rightward eye abduction impaired additions (with carrying), and leftward eye abduction impaired subtractions (with borrowing) showing that at least some arithmetic problems rely on processes dedicated to overt attentional shifts. We propose that when solving arithmetic problems requires procedures such as carrying and borrowing, oculomotor mechanisms operating on a mental space transiently built in working memory are recruited to represent one numerical magnitude in relation to another (e.g. the first operand and the result).
Collapse
Affiliation(s)
- Nicolas Masson
- Psychological Sciences Research Institute, Université catholique de Louvain, place Mercier 10, B-1348, Louvain-la-Neuve, Belgium.
- Department of Behavioural and Cognitive Sciences (DBCS), Institute of Cognitive Science and Assessment (COSA), Faculty of Humanities, Education and Social Sciences (FHSE), University of Luxembourg, Luxembourg, Luxembourg.
| | - Mauro Pesenti
- Psychological Sciences Research Institute, Université catholique de Louvain, place Mercier 10, B-1348, Louvain-la-Neuve, Belgium.
- Institute of Neuroscience, Université catholique de Louvain, Bruxelles, Belgium.
| |
Collapse
|
6
|
Hanning NM, Fernández A, Carrasco M. Dissociable roles of human frontal eye fields and early visual cortex in presaccadic attention - evidence from TMS. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.02.23.529691. [PMID: 36865228 PMCID: PMC9980111 DOI: 10.1101/2023.02.23.529691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/03/2023]
Abstract
Shortly before each saccadic eye movement, presaccadic attention improves visual sensitivity at the saccade target 1-5 at the expense of lowered sensitivity at non-target locations 6-11 . Some behavioral and neural correlates of presaccadic attention and covert attention -which likewise enhances sensitivity, but during fixation 12 -are similar 13 . This resemblance has led to the debatable 13-18 notion that presaccadic and covert attention are functionally equivalent and rely on the same neural circuitry 19-21 . At a broad scale, oculomotor brain structures (e.g., FEF) are also modulated during covert attention 22-24 - yet by distinct neuronal subpopulations 25-28 . Perceptual benefits of presaccadic attention rely on feedback from oculomotor structures to visual cortices 29,30 ( Fig. 1a ); micro-stimulation of FEF in non-human primates affects activity in visual cortex 31-34 and enhances visual sensitivity at the movement field of the stimulated neurons 35-37 . Similar feedback projections seem to exist in humans: FEF+ activation precedes occipital activation during saccade preparation 38,39 and FEF TMS modulates activity in visual cortex 40-42 and enhances perceived contrast in the contralateral hemifield 40 . We investigated presaccadic feedback in humans by applying TMS to frontal or visual areas during saccade preparation. By simultaneously measuring perceptual performance, we show the causal and differential roles of these brain regions in contralateral presaccadic benefits at the saccade target and costs at non-targets: Whereas rFEF+ stimulation reduced presaccadic costs throughout saccade preparation, V1/V2 stimulation reduced benefits only shortly before saccade onset. These effects provide causal evidence that presaccadic attention modulates perception through cortico-cortical feedback and further dissociate presaccadic and covert attention.
Collapse
|
7
|
Abstract
Visual perception is limited by spatial resolution, the ability to discriminate fine details. Spatial resolution not only declines with eccentricity but also differs for polar angle locations around the visual field, also known as 'performance fields'. To compensate for poor peripheral resolution, we make rapid eye movements-saccades-to bring peripheral objects into high-acuity foveal vision. Already before saccade onset, visual attention shifts to the saccade target location and prioritizes visual processing. This presaccadic shift of attention improves performance in many visual tasks, but whether it changes resolution is unknown. Here, we investigated whether presaccadic attention sharpens peripheral spatial resolution; and if so, whether such effect interacts with performance fields asymmetries. We measured acuity thresholds in an orientation discrimination task during fixation and saccade preparation around the visual field. The results revealed that presaccadic attention sharpens acuity, which can facilitate a smooth transition from peripheral to foveal representation. This acuity enhancement is similar across the four cardinal locations; thus, the typically robust effect of presaccadic attention does not change polar angle differences in resolution.
Collapse
|
8
|
Ouerfelli-Ethier J, Comtois Bona I, Fournet R, Pisella L, Khan AZ. Pre-saccadic attention relies more on suppression than does covert attention. J Vis 2023; 23:1. [PMID: 36595283 PMCID: PMC9819743 DOI: 10.1167/jov.23.1.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023] Open
Abstract
During covert and pre-saccadic attentional shifts, it is unclear how facilitation and suppression processes interact for target selection. A recent countermanding task pointed to greater suppression at unattended locations during trials with saccades compared to trials without saccades (i.e., fixation and successful stop trials), whereas target facilitation did not differ. It is unknown whether this finding is restricted to countermanding paradigms that involve inhibitory processes. To test this, we adapted Gaspelin and colleagues (2015)'s attention capture task where, within the same block, one location was primed with frequent line discrimination trials, and all locations were occasionally probed using letters report trials. Participants also performed a baseline condition without priming. We tested 15 participants and examined how performance at non-primed locations was affected by covert versus pre-saccadic attention in blocks of four or six items, as well as by position from the primed location and timing from saccade onset. For both attention conditions, letter report at non-primed locations was worse compared to baseline, demonstrating suppression, and letter report at primed location was better, demonstrating facilitation. In saccades trials, letter report was better at primed locations and worse at non-primed locations compared to fixation trials. The timing of this additional pre-saccadic suppression differed from saccadic suppression. In both attention conditions, suppression was greater when primed and non-primed locations were within the same hemifield or in diagonal opposite quadrants. These results confirmed that attention preceding saccade execution suppressed non-primed locations to a larger extent than covert attention, with the same spatial quadrant effect.
Collapse
Affiliation(s)
- Julie Ouerfelli-Ethier
- School of Optometry, University of Montreal, Montreal, Canada.,Lyon Neuroscience Research Center, Trajectoires team, University of Lyon I Claude-Bernard, Bron, France.,
| | | | - Romain Fournet
- School of Optometry, University of Montreal, Montreal, Canada.,
| | - Laure Pisella
- Lyon Neuroscience Research Center, Trajectoires team, University of Lyon I Claude-Bernard, Bron, France.,
| | | |
Collapse
|
9
|
Independence of implicitly guided attention from goal-driven oculomotor control. Atten Percept Psychophys 2022; 84:1460-1476. [PMID: 35538292 PMCID: PMC9090122 DOI: 10.3758/s13414-022-02491-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/07/2022] [Indexed: 11/08/2022]
Abstract
Location probability learning-the acquisition of an attentional bias toward locations that frequently contained a search target-shows many characteristics of a search habit. To what degree does it depend on oculomotor control, as might be expected if habit-like attention is grounded in eye movements? Here, we examined the impact of a spatially incompatible oculomotor signal on location probability learning (LPL). On each trial of a visual search task, participants first saccaded toward a unique C-shape, whose orientation determined whether participants should continue searching for a T target among L distractors. The C-shape often appeared in one, "C-rich" quadrant that differed from where the T was frequently located. Experiment 1 showed that participants acquired LPL toward the high-probability, "T-rich" quadrant, an effect that persisted in an unbiased testing phase. Participants were also faster finding the target in the vicinity of the C-shape, but this effect did not persist after the C-shape was removed. Experiment 2 found that the C-shape affected search only when it was task-relevant. Experiment 3 replicated and extended the findings of Experiment 1 using eye tracking. Thus, location probability learning is robust in the face of a spatially incompatible saccade, demonstrating partial independence between experience-guided attention and goal-driven oculomotor control. The findings are in line with the modular view of attention, which conceptualizes the search habit as a high-level process abstracted from eye movements.
Collapse
|
10
|
Bielas J, Michalczyk Ł. What does it actually mean that Premotor Theory is about embodied attention? PHILOSOPHICAL PSYCHOLOGY 2022. [DOI: 10.1080/09515089.2022.2092464] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Affiliation(s)
- Jacek Bielas
- Institute of Psychology, Jesuit University Ignatianum in Krakow, Krakow, Poland
| | - Łukasz Michalczyk
- Institute of Psychology, Jesuit University Ignatianum in Krakow, Krakow, Poland
| |
Collapse
|
11
|
Hanning NM, Deubel H. The effect of spatial structure on presaccadic attention costs and benefits assessed with dynamic 1/f noise. J Neurophysiol 2022; 127:1586-1592. [PMID: 35544761 DOI: 10.1152/jn.00084.2022] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Revised: 05/05/2022] [Accepted: 05/09/2022] [Indexed: 11/22/2022] Open
Abstract
Already before the onset of a saccadic eye movement, we preferentially process visual information at the upcoming eye fixation. This 'presaccadic shift of attention' is typically assessed via localized test items, which potentially bias the attention measurement. Here we show how presaccadic attention shapes perception from saccade origin to target when no scene-structuring items are presented. Participants made saccades into a 1/f ('pink') noise field, in which we embedded a brief orientation signal at various locations shortly before saccade onset. Local orientation discrimination performance served as a proxy for the allocation of attention. Results demonstrate that (1) the presaccadic attention shift is accompanied by considerable attentional costs at the presaccadic eye fixation; (2) saccades are preceded by shifts of attention to their goal location even if they are directed into an unstructured visual field, but the spread of attention, compared to target-directed saccades, is broad; We conclude that the absence or presence of saccade target objects markedly shapes the distribution of presaccadic attention, and likely the underlying (space-based or object-based) cortical control mechanism. Our findings demonstrate the relevance of an item-free approach for measuring attentional dynamics across the visual field.
Collapse
Affiliation(s)
- Nina M Hanning
- Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, München, Germany
- Department of Psychology and Center for Neural Science, New York University, New York, NY, United States
- Institut für Psychologie, Humboldt Universität zu Berlin, Berlin, Germany
| | - Heiner Deubel
- Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, München, Germany
| |
Collapse
|
12
|
Ramezanpour H, Fallah M. The role of temporal cortex in the control of attention. CURRENT RESEARCH IN NEUROBIOLOGY 2022; 3:100038. [PMID: 36685758 PMCID: PMC9846471 DOI: 10.1016/j.crneur.2022.100038] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2021] [Revised: 02/05/2022] [Accepted: 04/01/2022] [Indexed: 01/25/2023] Open
Abstract
Attention is an indispensable component of active vision. Contrary to the widely accepted notion that temporal cortex processing primarily focusses on passive object recognition, a series of very recent studies emphasize the role of temporal cortex structures, specifically the superior temporal sulcus (STS) and inferotemporal (IT) cortex, in guiding attention and implementing cognitive programs relevant for behavioral tasks. The goal of this theoretical paper is to advance the hypothesis that the temporal cortex attention network (TAN) entails necessary components to actively participate in attentional control in a flexible task-dependent manner. First, we will briefly discuss the general architecture of the temporal cortex with a focus on the STS and IT cortex of monkeys and their modulation with attention. Then we will review evidence from behavioral and neurophysiological studies that support their guidance of attention in the presence of cognitive control signals. Next, we propose a mechanistic framework for executive control of attention in the temporal cortex. Finally, we summarize the role of temporal cortex in implementing cognitive programs and discuss how they contribute to the dynamic nature of visual attention to ensure flexible behavior.
Collapse
Affiliation(s)
- Hamidreza Ramezanpour
- Centre for Vision Research, York University, Toronto, Ontario, Canada,School of Kinesiology and Health Science, Faculty of Health, York University, Toronto, Ontario, Canada,VISTA: Vision Science to Application, York University, Toronto, Ontario, Canada,Corresponding author. Centre for Vision Research, York University, Toronto, Ontario, Canada.
| | - Mazyar Fallah
- Centre for Vision Research, York University, Toronto, Ontario, Canada,School of Kinesiology and Health Science, Faculty of Health, York University, Toronto, Ontario, Canada,VISTA: Vision Science to Application, York University, Toronto, Ontario, Canada,Department of Psychology, Faculty of Health, York University, Toronto, Ontario, Canada,Department of Human Health and Nutritional Sciences, College of Biological Science, University of Guelph, Guelph, Ontario, Canada,Corresponding author. Department of Human Health and Nutritional Sciences, College of Biological Science, University of Guelph, Guelph, Ontario, Canada.
| |
Collapse
|
13
|
Pupil size variations reveal covert shifts of attention induced by numbers. Psychon Bull Rev 2022; 29:1844-1853. [PMID: 35384595 DOI: 10.3758/s13423-022-02094-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/21/2022] [Indexed: 11/08/2022]
Abstract
The pupil light response is more than a pure reflexive mechanism that reacts to the amount of light entering the eye. The pupil size may also react to the luminance of objects lying in the visual periphery, revealing the locus of covert attention. In the present study, we took advantage of this response to study the spatial coding of abstract concepts with no physical counterpart: numbers. The participants' gaze was maintained fixed in the middle of a screen whose left and right parts were dark or bright, and variations in pupil size were recorded during an auditory number comparison task. The results showed that small numbers accentuated pupil dilation when the darker part of the screen was on the left, while large numbers accentuated pupil dilation when the darker part of the screen was on the right. This finding provides direct evidence for covert attention shifts on a left-to-right oriented mental spatial representation of numbers. From a more general perspective, it shows that the pupillary response to light is subject to modulation from spatial attention mechanisms operating on mental contents.
Collapse
|
14
|
Hanning NM, Himmelberg MM, Carrasco M. Presaccadic attention enhances contrast sensitivity, but not at the upper vertical meridian. iScience 2022; 25:103851. [PMID: 35198902 PMCID: PMC8850791 DOI: 10.1016/j.isci.2022.103851] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2021] [Revised: 11/29/2021] [Accepted: 01/25/2022] [Indexed: 11/25/2022] Open
Abstract
Visual performance has striking polar performance asymmetries: At a fixed eccentricity, it is better along the horizontal than vertical meridian and the lower than upper vertical meridian. These asymmetries are not alleviated by covert exogenous or endogenous attention, but have been studied exclusively during eye fixation. However, a major driver of everyday attentional orienting is saccade preparation, during which attention automatically shifts to the future eye fixation. This presaccadic attention shift is considered strong and compulsory, and relies on different neural computations and substrates than covert attention. Thus, we asked: Can presaccadic attention compensate for the ubiquitous performance asymmetries observed during eye fixation? Our data replicate polar performance asymmetries during fixation and document the same asymmetries during saccade preparation. Crucially, however, presaccadic attention enhanced contrast sensitivity at the horizontal and lower vertical meridian, but not at the upper vertical meridian. Thus, instead of attenuating performance asymmetries, presaccadic attention exacerbates them. Can presaccadic attention attenuate polar angle asymmetries in visual perception Presaccadic attention enhances sensitivity at horizontal and lower vertical meridians But presaccadic attention does not enhance sensitivity at the upper vertical meridian Thus, presaccadic attention even exacerbates polar angle asymmetries in perception
Collapse
Affiliation(s)
- Nina M Hanning
- Department of Psychology, New York University, New York, NY 10003, USA.,Center for Neural Sciences, New York University, New York, NY 10003, USA
| | - Marc M Himmelberg
- Department of Psychology, New York University, New York, NY 10003, USA.,Center for Neural Sciences, New York University, New York, NY 10003, USA
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, NY 10003, USA.,Center for Neural Sciences, New York University, New York, NY 10003, USA
| |
Collapse
|
15
|
Hanning NM, Wollenberg L, Jonikaitis D, Deubel H. Eye and hand movements disrupt attentional control. PLoS One 2022; 17:e0262567. [PMID: 35045115 PMCID: PMC8769330 DOI: 10.1371/journal.pone.0262567] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2021] [Accepted: 12/29/2021] [Indexed: 11/23/2022] Open
Abstract
Voluntary attentional control is the ability to selectively focus on a subset of visual information in the presence of other competing stimuli–a marker of cognitive control enabling flexible, goal-driven behavior. To test its robustness, we contrasted attentional control with the most common source of attentional orienting in daily life: attention shifts prior to goal-directed eye and hand movements. In a multi-tasking paradigm, human participants attended at a location while planning eye or hand movements elsewhere. Voluntary attentional control suffered with every simultaneous action plan, even under reduced task difficulty and memory load–factors known to interfere with attentional control. Furthermore, the performance cost was limited to voluntary attention: We observed simultaneous attention benefits at two movement targets without attentional competition between them. This demonstrates that the visual system allows for the concurrent representation of multiple attentional foci. Since attentional control is extremely fragile and dominated by premotor attention shifts, we propose that action-driven selection plays the superordinate role for visual selection.
Collapse
Affiliation(s)
- Nina Maria Hanning
- Department Psychologie, Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, München, Germany
- Department of Psychology and Center for Neural Science, New York University, New York, NY, United States of America
- * E-mail:
| | - Luca Wollenberg
- Department Psychologie, Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, München, Germany
- Department Biologie, Graduate School of Systemic Neurosciences, Ludwig-Maximilians-Universität München, Planegg, München, Germany
| | - Donatas Jonikaitis
- Department of Neurobiology and Howard Hughes Medical Institute, Stanford University School of Medicine, Stanford, CA, United States of America
| | - Heiner Deubel
- Department Psychologie, Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, München, Germany
| |
Collapse
|
16
|
Ki JJ, Dmochowski JP, Touryan J, Parra LC. Neural responses to natural visual motion are spatially selective across the visual field, with selectivity differing across brain areas and task. Eur J Neurosci 2021; 54:7609-7625. [PMID: 34679237 PMCID: PMC9298375 DOI: 10.1111/ejn.15503] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Revised: 09/16/2021] [Accepted: 10/07/2021] [Indexed: 11/28/2022]
Abstract
It is well established that neural responses to visual stimuli are enhanced at select locations in the visual field. Although spatial selectivity and the effects of spatial attention are well understood for discrete tasks (e.g. visual cueing), little is known for naturalistic experience that involves continuous dynamic visual stimuli (e.g. driving). Here, we assess the strength of neural responses across the visual space during a kart‐race game. Given the varying relevance of visual location in this task, we hypothesized that the strength of neural responses to movement will vary across the visual field, and it would differ between active play and passive viewing. To test this, we measure the correlation strength of scalp‐evoked potentials with optical flow magnitude at individual locations on the screen. We find that neural responses are strongly correlated at task‐relevant locations in visual space, extending beyond the focus of overt attention. Although the driver's gaze is directed upon the heading direction at the centre of the screen, neural responses were robust at the peripheral areas (e.g. roads and surrounding buildings). Importantly, neural responses to visual movement are broadly distributed across the scalp, with visual spatial selectivity differing across electrode locations. Moreover, during active gameplay, neural responses are enhanced at select locations in the visual space. Conventionally, spatial selectivity of neural response has been interpreted as an attentional gain mechanism. In the present study, the data suggest that different brain areas focus attention on different portions of the visual field that are task‐relevant, beyond the focus of overt attention.
Collapse
Affiliation(s)
- Jason J Ki
- Department of Biomedical Engineering, City College of the City University of New York, New York, New York, USA
| | - Jacek P Dmochowski
- Department of Biomedical Engineering, City College of the City University of New York, New York, New York, USA
| | | | - Lucas C Parra
- Department of Biomedical Engineering, City College of the City University of New York, New York, New York, USA
| |
Collapse
|
17
|
Li HH, Hanning NM, Carrasco M. To look or not to look: dissociating presaccadic and covert spatial attention. Trends Neurosci 2021; 44:669-686. [PMID: 34099240 PMCID: PMC8552810 DOI: 10.1016/j.tins.2021.05.002] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Revised: 04/25/2021] [Accepted: 05/07/2021] [Indexed: 11/23/2022]
Abstract
Attention is a central neural process that enables selective and efficient processing of visual information. Individuals can attend to specific visual information either overtly, by making an eye movement to an object of interest, or covertly, without moving their eyes. We review behavioral, neuropsychological, neurophysiological, and computational evidence of presaccadic attentional modulations that occur while preparing saccadic eye movements, and highlight their differences from those of covert spatial endogenous (voluntary) and exogenous (involuntary) attention. We discuss recent studies and experimental procedures on how these different types of attention impact visual performance, alter appearance, differentially modulate the featural representation of basic visual dimensions (orientation and spatial frequency), engage different neural computations, and recruit partially distinct neural substrates. We conclude that presaccadic attention and covert attention are dissociable.
Collapse
Affiliation(s)
- Hsin-Hung Li
- Department of Psychology and Center for Neural Science, New York University, New York, NY, USA.
| | - Nina M Hanning
- Department of Psychology and Center for Neural Science, New York University, New York, NY, USA
| | - Marisa Carrasco
- Department of Psychology and Center for Neural Science, New York University, New York, NY, USA.
| |
Collapse
|
18
|
Wollenberg L, Hanning NM, Deubel H. Visual attention and eye movement control during oculomotor competition. J Vis 2021; 20:16. [PMID: 32976594 PMCID: PMC7521175 DOI: 10.1167/jov.20.9.16] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Saccadic eye movements are typically preceded by selective shifts of visual attention. Recent evidence, however, suggests that oculomotor selection can occur in the absence of attentional selection when saccades erroneously land in between nearby competing objects (saccade averaging). This study combined a saccade task with a visual discrimination task to investigate saccade target selection during episodes of competition between a saccade target and a nearby distractor. We manipulated the spatial predictability of target and distractor locations and asked participants to execute saccades upon variably delayed go-signals. This allowed us to systematically investigate the capacity to exert top-down eye movement control (as reflected in saccade endpoints) based on the spatiotemporal dynamics of visual attention during movement preparation (measured as visual sensitivity). Our data demonstrate that the predictability of target and distractor locations, despite not affecting the deployment of visual attention prior to movement preparation, largely improved the accuracy of short-latency saccades. Under spatial uncertainty, a short go-signal delay likewise enhanced saccade accuracy substantially, which was associated with a more selective deployment of attentional resources to the saccade target. Moreover, we observed a systematic relationship between the deployment of visual attention and saccade accuracy, with visual discrimination performance being significantly enhanced at the saccade target relative to the distractor only before the execution of saccades accurately landing at the saccade target. Our results provide novel insights linking top-down eye movement control to the operation of selective visual attention during movement preparation.
Collapse
Affiliation(s)
- Luca Wollenberg
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, München, Germany.,Graduate School of Systemic Neurosciences, Department Biologie, Ludwig-Maximilians-Universität München, Planegg, Germany
| | - Nina M Hanning
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, München, Germany.,Department of Psychology, New York University, New York, NY, USA
| | - Heiner Deubel
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, München, Germany
| |
Collapse
|
19
|
Kristjánsson Á, Draschkow D. Keeping it real: Looking beyond capacity limits in visual cognition. Atten Percept Psychophys 2021; 83:1375-1390. [PMID: 33791942 PMCID: PMC8084831 DOI: 10.3758/s13414-021-02256-7] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/23/2020] [Indexed: 11/23/2022]
Abstract
Research within visual cognition has made tremendous strides in uncovering the basic operating characteristics of the visual system by reducing the complexity of natural vision to artificial but well-controlled experimental tasks and stimuli. This reductionist approach has for example been used to assess the basic limitations of visual attention, visual working memory (VWM) capacity, and the fidelity of visual long-term memory (VLTM). The assessment of these limits is usually made in a pure sense, irrespective of goals, actions, and priors. While it is important to map out the bottlenecks our visual system faces, we focus here on selected examples of how such limitations can be overcome. Recent findings suggest that during more natural tasks, capacity may be higher than reductionist research suggests and that separable systems subserve different actions, such as reaching and looking, which might provide important insights about how pure attentional or memory limitations could be circumvented. We also review evidence suggesting that the closer we get to naturalistic behavior, the more we encounter implicit learning mechanisms that operate "for free" and "on the fly." These mechanisms provide a surprisingly rich visual experience, which can support capacity-limited systems. We speculate whether natural tasks may yield different estimates of the limitations of VWM, VLTM, and attention, and propose that capacity measurements should also pass the real-world test within naturalistic frameworks. Our review highlights various approaches for this and suggests that our understanding of visual cognition will benefit from incorporating the complexities of real-world cognition in experimental approaches.
Collapse
Affiliation(s)
- Árni Kristjánsson
- School of Health Sciences, University of Iceland, Reykjavík, Iceland.
- School of Psychology, National Research University Higher School of Economics, Moscow, Russia.
| | - Dejan Draschkow
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK.
| |
Collapse
|
20
|
Li HH, Pan J, Carrasco M. Different computations underlie overt presaccadic and covert spatial attention. Nat Hum Behav 2021; 5:1418-1431. [PMID: 33875838 DOI: 10.1038/s41562-021-01099-4] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2020] [Accepted: 03/11/2021] [Indexed: 11/09/2022]
Abstract
Perception and action are tightly coupled: visual responses at the saccade target are enhanced right before saccade onset. This phenomenon, presaccadic attention, is a form of overt attention-deployment of visual attention with concurrent eye movements. Presaccadic attention is well-documented, but its underlying computational process remains unknown. This is in stark contrast to covert attention-deployment of visual attention without concurrent eye movements-for which the computational processes are well characterized by a normalization model. Here, a series of psychophysical experiments reveal that presaccadic attention modulates visual performance only via response gain changes. A response gain change was observed even when attention field size increased, violating the predictions of a normalization model of attention. Our empirical results and model comparisons reveal that the perceptual modulations by overt presaccadic and covert spatial attention are mediated through different computations.
Collapse
Affiliation(s)
- Hsin-Hung Li
- Department of Psychology, New York University, New York, NY, USA. .,Center for Neural Science, New York University, New York, NY, USA.
| | - Jasmine Pan
- Department of Psychology, New York University, New York, NY, USA
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, NY, USA.,Center for Neural Science, New York University, New York, NY, USA
| |
Collapse
|
21
|
Shurygina O, Pooresmaeili A, Rolfs M. Pre-saccadic attention spreads to stimuli forming a perceptual group with the saccade target. Cortex 2021; 140:179-198. [PMID: 33991779 DOI: 10.1016/j.cortex.2021.03.020] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2020] [Revised: 01/05/2021] [Accepted: 03/04/2021] [Indexed: 01/10/2023]
Abstract
The pre-saccadic attention shift-a rapid increase in visual sensitivity at the target-is an inevitable precursor of saccadic eye movements. Saccade targets are often parts of the objects that are of interest to the active observer. Although the link between saccades and covert attention shifts is well established, it remains unclear if pre-saccadic attention selects the location of the eye movement target or rather the entire object that occupies this location. Indeed, several neurophysiological studies suggest that attentional modulations of neural activity in visual cortex spreads across parts of objects (e.g., elements grouped by Gestalt principles) that contain the target location of a saccade. To understand the nature of pre-saccadic attentional selection, we examined how visual sensitivity, measured in a challenging orientation discrimination task, changes during saccade preparation at locations that are perceptually grouped with the saccade target. In Experiment 1, using grouping by color in a delayed-saccade task, we found no consistent spread of attention to locations that formed a perceptual group with the saccade target. However, performance depended on the side of the stimulus arrangement relative to the saccade target location, an effect we discuss with respect to attentional momentum. In Experiment 2, employing stronger perceptual grouping cues (color and motion) and an immediate-saccade task, we obtained a reliable grouping effect: Attention spread to locations that were perceptually grouped with the saccade target while saccade preparation was underway. We also replicated the side effect observed in Experiment 1. These results provide evidence that the pre-saccadic attention spreads beyond the target location along the saccade direction, and selects scene elements that-based on Gestalt criteria-are likely to belong to the same object as the saccade target.
Collapse
Affiliation(s)
- Olga Shurygina
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Germany; Department of Psychology, Humboldt-Universität zu Berlin, Germany; Exzellenzcluster Science of Intelligence, Technische Universität Berlin, Berlin, Germany.
| | - Arezoo Pooresmaeili
- Perception and Cognition Group, European Neuroscience Institute Göttingen - A Joint Initiative of the University Medical Center Göttingen and the Max-Planck-Society, Göttingen, Germany
| | - Martin Rolfs
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Germany; Department of Psychology, Humboldt-Universität zu Berlin, Germany; Exzellenzcluster Science of Intelligence, Technische Universität Berlin, Berlin, Germany
| |
Collapse
|
22
|
Spatial attention and spatial short term memory in PSP and Parkinson's disease. Cortex 2021; 137:49-60. [PMID: 33588132 DOI: 10.1016/j.cortex.2020.12.019] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2020] [Revised: 11/27/2020] [Accepted: 12/03/2020] [Indexed: 11/20/2022]
Abstract
Progressive Supranuclear Palsy (PSP) is a neurodegenerative disorder characterised by deterioration in motor, oculomotor and cognitive function. A key clinical feature of PSP is the progressive paralysis of eye movements, most notably for vertical saccades. These oculomotor signs can be subtle, however, and PSP is often misdiagnosed as Parkinson's disease (PD), in its early stages. Although some of the clinical features of PD and PSP overlap, they are distinct disorders with differing underlying pathological processes, responses to treatment and prognoses. One key difference lies in the effects the diseases have on cognition. The oculomotor system is tightly linked to cognitive processes such as spatial attention and spatial short-term memory (sSTM), and previous studies have suggested that PSP and PD experience different deficits in these domains. We therefore hypothesised that people with PSP (N = 15) would experience problems with attention (assessed with feature and conjunction visual search tasks) and sSTM (assessed with the Corsi blocks task) compared to people with PD (N = 16) and Age Matched Controls (N = 15). As predicted, feature and conjunction search were sgnificantly slower in the PSP group compared to the other groups, and this deficit was significantly worse for feature compared to conjunction search. The PD group did not differ from AMC on feature search but were significantly impaired on the conjunction search. The PSP group also had a pronounced vertical sSTM impairment that was not present in PD or AMC groups. It is argued that PSP is associated with specific impairment of visuospatial cognition which is caused by degeneration of the oculomotor structures that support exogenous spatial attention, consistent with oculomotor theories of spatial attention and memory.
Collapse
|
23
|
|
24
|
|
25
|
On the link between attentional search and the oculomotor system: Is preattentive search restricted to the range of eye movements? Atten Percept Psychophys 2020; 82:518-532. [PMID: 31942703 PMCID: PMC7246251 DOI: 10.3758/s13414-019-01949-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
It has been proposed that covert visual search can be fast, efficient, and stimulus driven, particularly when the target is defined by a salient single feature, or slow, inefficient, and effortful when the target is defined by a nonsalient conjunction of features. This distinction between fast, stimulus-driven orienting and slow, effortful orienting can be related to the distinction between exogenous spatial attention and endogenous spatial attention. Several studies have shown that exogenous, covert orienting is limited to the range of saccadic eye movements, whereas covert endogenous orienting is independent of the range of saccadic eye movements. The current study examined whether covert visual search is affected in a similar way. Experiment 1 showed that covert visual search for feature singletons was impaired when stimuli were presented beyond the range of saccadic eye movements, whereas conjunction search was unaffected by array position. Experiment 2 replicated and extended this effect by measuring search times at 6 eccentricities. The impairment in covert feature search emerged only when stimuli crossed the effective oculomotor range and remained stable for locations further into the periphery, ruling out the possibility that the results of Experiment 1 were due to a failure to fully compensate for the effects of cortical magnification. The findings are interpreted in terms of biased competition and oculomotor theories of spatial attention. It is concluded that, as with covert exogenous orienting, biological constraints on overt orienting in the oculomotor system constrain covert, preattentive search.
Collapse
|
26
|
|
27
|
Gaze-contingent stimulus removal leads to subsequent changes in overt attentional allocation. Neuropsychologia 2020; 139:107297. [DOI: 10.1016/j.neuropsychologia.2019.107297] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2019] [Revised: 11/14/2019] [Accepted: 12/04/2019] [Indexed: 11/18/2022]
|