1
|
Wang X, Zhang C, Yang L, Jin M, Goldberg ME, Zhang M, Qian N. Perisaccadic and attentional remapping of receptive fields in lateral intraparietal area and frontal eye fields. Cell Rep 2024; 43:113820. [PMID: 38386553 PMCID: PMC11011051 DOI: 10.1016/j.celrep.2024.113820] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 12/15/2023] [Accepted: 02/01/2024] [Indexed: 02/24/2024] Open
Abstract
The nature and function of perisaccadic receptive field (RF) remapping have been controversial. We use a delayed saccade task to reduce previous confounds and examine the remapping time course in the lateral intraparietal area and frontal eye fields. In the delay period, the RF shift direction turns from the initial fixation to the saccade target. In the perisaccadic period, RFs first shift toward the target (convergent remapping), but around the time of saccade onset/offset, the shifts become predominantly toward the post-saccadic RF locations (forward remapping). Thus, unlike forward remapping that depends on the corollary discharge (CD) of the saccade command, convergent remapping appears to follow attention from the initial fixation to the target. We model the data with attention-modulated and CD-gated connections and show that both sets of connections emerge automatically in neural networks trained to update stimulus retinal locations across saccades. Our work thus unifies previous findings into a mechanism for transsaccadic visual stability.
Collapse
Affiliation(s)
- Xiao Wang
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China; Department of Neuroscience and Zuckerman Institute, Columbia University, New York, NY, USA
| | - Cong Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China; Institute of Neuroscience, Key Laboratory of Primate Neurobiology, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
| | - Lin Yang
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Min Jin
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Michael E Goldberg
- Department of Neuroscience and Zuckerman Institute, Columbia University, New York, NY, USA; Departments of Neurology, Psychiatry, and Ophthalmology, Columbia University, New York, NY, USA
| | - Mingsha Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China.
| | - Ning Qian
- Department of Neuroscience and Zuckerman Institute, Columbia University, New York, NY, USA; Department of Physiology & Cellular Biophysics, Columbia University, New York, NY, USA.
| |
Collapse
|
2
|
Katsanevaki C, Bastos AM, Cagnan H, Bosman CA, Friston KJ, Fries P. Attentional effects on local V1 microcircuits explain selective V1-V4 communication. Neuroimage 2023; 281:120375. [PMID: 37714390 DOI: 10.1016/j.neuroimage.2023.120375] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Revised: 09/10/2023] [Accepted: 09/11/2023] [Indexed: 09/17/2023] Open
Abstract
Selective attention implements preferential routing of attended stimuli, likely through increasing the influence of the respective synaptic inputs on higher-area neurons. As the inputs of competing stimuli converge onto postsynaptic neurons, presynaptic circuits might offer the best target for attentional top-down influences. If those influences enabled presynaptic circuits to selectively entrain postsynaptic neurons, this might explain selective routing. Indeed, when two visual stimuli induce two gamma rhythms in V1, only the gamma induced by the attended stimulus entrains gamma in V4. Here, we modelled induced responses with a Dynamic Causal Model for Cross-Spectral Densities and found that selective entrainment can be explained by attentional modulation of intrinsic V1 connections. Specifically, local inhibition was decreased in the granular input layer and increased in the supragranular output layer of the V1 circuit that processed the attended stimulus. Thus, presynaptic attentional influences and ensuing entrainment were sufficient to mediate selective routing.
Collapse
Affiliation(s)
- Christini Katsanevaki
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, Frankfurt 60528, Germany; International Max Planck Research School for Neural Circuits, Frankfurt 60438, Germany.
| | - André M Bastos
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, Frankfurt 60528, Germany; Department of Psychology and Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN 37240, USA
| | - Hayriye Cagnan
- The Wellcome Trust Centre for Neuroimaging, University College London, London WC1N 3AR, UK; Medical Research Council Brain Network Dynamics Unit, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX1 3TH, UK
| | - Conrado A Bosman
- Donders Institute for Brain, Cognition, and Behaviour, Radboud University, Nijmegen 6525 EN, the Netherlands; Swammerdam Institute for Life Sciences, Center for Neuroscience, University of Amsterdam, Amsterdam 1098 XH, the Netherlands
| | - Karl J Friston
- The Wellcome Trust Centre for Neuroimaging, University College London, London WC1N 3AR, UK
| | - Pascal Fries
- Ernst Strüngmann Institute (ESI) for Neuroscience in Cooperation with Max Planck Society, Frankfurt 60528, Germany; International Max Planck Research School for Neural Circuits, Frankfurt 60438, Germany; Donders Institute for Brain, Cognition, and Behaviour, Radboud University, Nijmegen 6525 EN, the Netherlands
| |
Collapse
|
3
|
Gundlach C, Wehle S, Müller MM. Early sensory gain control is dominated by obligatory and global feature-based attention in top-down shifts of combined spatial and feature-based attention. Cereb Cortex 2023; 33:10286-10302. [PMID: 37536059 DOI: 10.1093/cercor/bhad282] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Revised: 07/12/2023] [Accepted: 07/13/2023] [Indexed: 08/05/2023] Open
Abstract
What are the dynamics of global feature-based and spatial attention, when deployed together? In an attentional shifting experiment, flanked by three control experiments, we investigated neural temporal dynamics of combined attentional shifts. For this purpose, orange- and blue-frequency-tagged spatially overlapping Random Dot Kinematograms were presented in the left and right visual hemifield to elicit continuous steady-state-visual-evoked-potentials. After being initially engaged in a fixation cross task, participants were at some point in time cued to shift attention to one of the Random Dot Kinematograms, to detect and respond to brief coherent motion events, while ignoring all such events in other Random Dot Kinematograms. The analysis of steady-state visual-evoked potentials allowed us to map time courses and dynamics of early sensory-gain modulations by attention. This revealed a time-invariant amplification of the to-be attended color both at the attended and the unattended side, followed by suppression for the to-be-ignored color at attended and unattended sides. Across all experiments, global and obligatory feature-based selection dominated early sensory gain modulations, whereas spatial attention played a minor modulatory role. However, analyses of behavior and neural markers such as alpha-band activity and event-related potentials to target- and distractor-event processing, revealed clear modulations by spatial attention.
Collapse
Affiliation(s)
- Christopher Gundlach
- Experimental Psychology and Methods, Universität Leipzig, Leipzig 04107, Germany
| | - Sebastian Wehle
- Experimental Psychology and Methods, Universität Leipzig, Leipzig 04107, Germany
| | - Matthias M Müller
- Experimental Psychology and Methods, Universität Leipzig, Leipzig 04107, Germany
| |
Collapse
|
4
|
Westerberg JA, Schall JD, Woodman GF, Maier A. Feedforward attentional selection in sensory cortex. Nat Commun 2023; 14:5993. [PMID: 37752171 PMCID: PMC10522696 DOI: 10.1038/s41467-023-41745-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 09/15/2023] [Indexed: 09/28/2023] Open
Abstract
Salient objects grab attention because they stand out from their surroundings. Whether this phenomenon is accomplished by bottom-up sensory processing or requires top-down guidance is debated. We tested these alternative hypotheses by measuring how early and in which cortical layer(s) neural spiking distinguished a target from a distractor. We measured synaptic and spiking activity across cortical columns in mid-level area V4 of male macaque monkeys performing visual search for a color singleton. A neural signature of attentional capture was observed in the earliest response in the input layer 4. The magnitude of this response predicted response time and accuracy. Errant behavior followed errant selection. Because this response preceded top-down influences and arose in the cortical layer not targeted by top-down connections, these findings demonstrate that feedforward activation of sensory cortex can underlie attentional priority.
Collapse
Affiliation(s)
- Jacob A Westerberg
- Department of Psychology, Vanderbilt University, Nashville, TN, 37240, USA.
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, 37240, USA.
- Vanderbilt Vision Research Center, Vanderbilt University, Nashville, TN, 37240, USA.
- Department of Vision and Cognition, Netherlands Institute for Neuroscience, Royal Netherlands Academy of Arts and Sciences, 1105 BA, Amsterdam, The Netherlands.
| | - Jeffrey D Schall
- Centre for Vision Research, York University, Toronto, ON, M3J 1P3, Canada
- Vision: Science to Applications Program, York University, Toronto, ON, M3J 1P3, Canada
- Department of Biology, York University, Toronto, ON, M3J 1P3, Canada
- Department of Psychology, York University, Toronto, ON, M3J 1P3, Canada
| | - Geoffrey F Woodman
- Department of Psychology, Vanderbilt University, Nashville, TN, 37240, USA
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, 37240, USA
- Vanderbilt Vision Research Center, Vanderbilt University, Nashville, TN, 37240, USA
| | - Alexander Maier
- Department of Psychology, Vanderbilt University, Nashville, TN, 37240, USA
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, 37240, USA
- Vanderbilt Vision Research Center, Vanderbilt University, Nashville, TN, 37240, USA
| |
Collapse
|
5
|
Wang X, Zhang C, Yang L, Jin M, Goldberg ME, Zhang M, Qian N. Perisaccadic and Attentional Remapping of Receptive Fields in Lateral Intraparietal Area and Frontal Eye Fields. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.09.23.558993. [PMID: 37790528 PMCID: PMC10542176 DOI: 10.1101/2023.09.23.558993] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/05/2023]
Abstract
The nature and function of perisaccadic receptive-field (RF) remapping have been controversial. We used a delayed saccade task to reduce previous confounds and examined the remapping time course in areas LIP and FEF. In the delay period, the RF shift direction turned from the initial fixation to the saccade target. In the perisaccadic period, RFs first shifted toward the target (convergent remapping) but around the time of saccade onset/offset, the shifts became predominantly toward the post-saccadic RF locations (forward remapping). Thus, unlike forward remapping that depends on the corollary discharge (CD) of the saccade command, convergent remapping appeared to follow attention from the initial fixation to the target. We modelled the data with attention-modulated and CD-gated connections, and showed that both sets of connections emerged automatically in neural networks trained to update stimulus retinal locations across saccades. Our work thus unifies previous findings into a mechanism for transsaccadic visual stability.
Collapse
Affiliation(s)
- Xiao Wang
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
- Department of Neuroscience and Zuckerman Institute, Columbia University, New York, NY, USA
| | - Cong Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Lin Yang
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Min Jin
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Michael E. Goldberg
- Department of Neuroscience and Zuckerman Institute, Columbia University, New York, NY, USA
- Departments of Neurology, Psychiatry, and Ophthalmology, Columbia University, New York, NY, USA
| | - Mingsha Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Ning Qian
- Department of Neuroscience and Zuckerman Institute, Columbia University, New York, NY, USA
- Department of Physiology & Cellular Biophysics, Columbia University, New York, NY, USA
| |
Collapse
|
6
|
Ouerfelli-Ethier J, Fournet R, Khan AZ, Pisella L. Spatial bias in anti-saccade endpoints following bilateral dorsal posterior parietal lesions. Eur J Neurosci 2023; 58:3488-3502. [PMID: 37501610 DOI: 10.1111/ejn.16102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Revised: 06/21/2023] [Accepted: 07/07/2023] [Indexed: 07/29/2023]
Abstract
Anti-saccades are eye movements in which the saccade is executed in the opposite direction of a visual target and are often hypometric. Because the visual target and saccade goal are decoupled, it has been suggested that competition between the two locations occurs and needs to be resolved. It has been hypothesized that the hypometria of anti-saccades reflects this spatial competition by revealing a bias towards the visual target. To confirm that this hypometria is not simply due to reduced gain, we tested 10 healthy subjects on three different anti-saccade spatial configuration tasks: 90° away across hemifields, 90° away within the same hemifield and 180° away (classic, diagonally opposite). Specifically, we examined whether saccade endpoints showed evidence for the visual target location's interference with anti-saccade programming and execution processes. Among other neural substrates involved in anti-saccades production, the dorsal posterior parietal cortex (PPC) has been implicated in the spatial inhibition of contralateral visual target. To gain insight into the neural processes involved in spatial competition during anti-saccades, we also tested one patient with a bilateral dorsal PPC lesion. In all spatial configurations, we observed that anti-saccade endpoints demonstrated a spatial bias towards the visual target for all participants, likely due to an incomplete inhibition of the visual target location. This spatial bias was exacerbated in our patient, which suggests that the dorsal PPC contributes to the amalgamation of the two competing spatial representations.
Collapse
Affiliation(s)
- Julie Ouerfelli-Ethier
- Université Claude Bernard Lyon 1, CNRS, INSERM, Centre de Recherche en Neurosciences de Lyon CRNL, Trajectoires, France
- School of Optometry, University of Montreal, Montreal, Quebec, Canada
| | - Romain Fournet
- School of Optometry, University of Montreal, Montreal, Quebec, Canada
| | - Aarlenne Z Khan
- School of Optometry, University of Montreal, Montreal, Quebec, Canada
| | - Laure Pisella
- Université Claude Bernard Lyon 1, CNRS, INSERM, Centre de Recherche en Neurosciences de Lyon CRNL, Trajectoires, France
| |
Collapse
|
7
|
Dolci C, Boehler CN, Santandrea E, Dewulf A, Ben-Hamed S, Macaluso E, Chelazzi L, Rashal E. Integrated effects of top-down attention and statistical learning during visual search: An EEG study. Atten Percept Psychophys 2023; 85:1819-1833. [PMID: 37264294 PMCID: PMC10545573 DOI: 10.3758/s13414-023-02728-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/05/2023] [Indexed: 06/03/2023]
Abstract
The present study aims to investigate how the competition between visual elements is solved by top-down and/or statistical learning (SL) attentional control (AC) mechanisms when active together. We hypothesized that the "winner" element that will undergo further processing is selected either by one AC mechanism that prevails over the other, or by the joint activity of both mechanisms. To test these hypotheses, we conducted a visual search experiment that combined an endogenous cueing protocol (valid vs. neutral cue) and an imbalance of target frequency distribution across locations (high- vs. low-frequency location). The unique and combined effects of top-down control and SL mechanisms were measured on behaviour and amplitudes of three evoked-response potential (ERP) components (i.e., N2pc, P1, CNV) related to attentional processing. Our behavioural results showed better performance for validly cued targets and for targets in the high-frequency location. The two factors were found to interact, so that SL effects emerged only in the absence of top-down guidance. Whereas the CNV and P1 only displayed a main effect of cueing, for the N2pc we observed an interaction between cueing and SL, revealing a cueing effect for targets in the low-frequency condition, but not in the high-frequency condition. Thus, our data support the view that top-down control and SL work in a conjoint, integrated manner during target selection. In particular, SL mechanisms are reduced or even absent when a fully reliable top-down guidance of attention is at play.
Collapse
Affiliation(s)
- Carola Dolci
- Department of Neuroscience, Biomedicine, and Movement Science, University of Verona, Strada le Grazie, 8, 37134, Verona, Italy.
| | - C Nico Boehler
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
| | - Elisa Santandrea
- Department of Neuroscience, Biomedicine, and Movement Science, University of Verona, Strada le Grazie, 8, 37134, Verona, Italy
| | - Anneleen Dewulf
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
| | | | | | - Leonardo Chelazzi
- Department of Neuroscience, Biomedicine, and Movement Science, University of Verona, Strada le Grazie, 8, 37134, Verona, Italy
| | - Einat Rashal
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
| |
Collapse
|
8
|
Soyuhos O, Baldauf D. Functional connectivity fingerprints of the frontal eye field and inferior frontal junction suggest spatial versus nonspatial processing in the prefrontal cortex. Eur J Neurosci 2023; 57:1114-1140. [PMID: 36789470 DOI: 10.1111/ejn.15936] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Revised: 01/28/2023] [Accepted: 02/08/2023] [Indexed: 02/16/2023]
Abstract
Neuroimaging evidence suggests that the frontal eye field (FEF) and inferior frontal junction (IFJ) govern the encoding of spatial and nonspatial (such as feature- or object-based) representations, respectively, both during visual attention and working memory tasks. However, it is still unclear whether such contrasting functional segregation is also reflected in their underlying functional connectivity patterns. Here, we hypothesized that FEF has predominant functional coupling with spatiotopically organized regions in the dorsal ('where') visual stream whereas IFJ has predominant functional connectivity with the ventral ('what') visual stream. We applied seed-based functional connectivity analyses to temporally high-resolving resting-state magnetoencephalography (MEG) recordings. We parcellated the brain according to the multimodal Glasser atlas and tested, for various frequency bands, whether the spontaneous activity of each parcel in the ventral and dorsal visual pathway has predominant functional connectivity with FEF or IFJ. The results show that FEF has a robust power correlation with the dorsal visual pathway in beta and gamma bands. In contrast, anterior IFJ (IFJa) has a strong power coupling with the ventral visual stream in delta, beta and gamma oscillations. Moreover, while FEF is phase-coupled with the superior parietal lobe in the beta band, IFJa is phase-coupled with the middle and inferior temporal cortex in delta and gamma oscillations. We argue that these intrinsic connectivity fingerprints are congruent with each brain region's function. Therefore, we conclude that FEF and IFJ have dissociable connectivity patterns that fit their respective functional roles in spatial versus nonspatial top-down attention and working memory control.
Collapse
Affiliation(s)
- Orhan Soyuhos
- Centre for Mind/Brain Sciences (CIMeC), University of Trento, Trento, Italy.,Center for Neuroscience, University of California, Davis, California, USA
| | - Daniel Baldauf
- Centre for Mind/Brain Sciences (CIMeC), University of Trento, Trento, Italy
| |
Collapse
|
9
|
Allocation of Visuospatial Attention Indexes Evidence Accumulation for Reach Decisions. eNeuro 2022; 9:ENEURO.0313-22.2022. [PMID: 36302633 PMCID: PMC9651207 DOI: 10.1523/eneuro.0313-22.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Revised: 09/19/2022] [Accepted: 09/22/2022] [Indexed: 12/24/2022] Open
Abstract
Visuospatial attention is a prerequisite for the performance of visually guided movements: perceptual discrimination is regularly enhanced at target locations before movement initiation. It is known that this attentional prioritization evolves over the time of movement preparation; however, it is not clear whether this build-up simply reflects a time requirement of attention formation or whether, instead, attention build-up reflects the emergence of the movement decision. To address this question, we combined behavioral experiments, psychophysics, and computational decision-making models to characterize the time course of attention build-up during motor preparation. Participants (n = 46, 29 female) executed center-out reaches to one of two potential target locations and reported the identity of a visual discrimination target (DT) that occurred concurrently at one of various time-points during movement preparation and execution. Visual discrimination increased simultaneously at the two potential target locations but was modulated by the experiment-wide probability that a given location would become the final goal. Attention increased further for the location that was then designated as the final goal location, with a time course closely related to movement initiation. A sequential sampling model of decision-making faithfully predicted key temporal characteristics of attentional allocation. Together, these findings provide evidence that visuospatial attentional prioritization during motor preparation does not simply reflect that a spatial location has been selected as movement goal, but rather indexes the time-extended, cumulative decision that leads to the selection, hence constituting a link between perceptual and motor aspects of sensorimotor decisions.
Collapse
|
10
|
Neuronal Response to Reward and Luminance in Macaque LIP During Saccadic Choice. Neurosci Bull 2022; 39:14-28. [PMID: 36114983 PMCID: PMC9849667 DOI: 10.1007/s12264-022-00948-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Accepted: 06/18/2022] [Indexed: 01/22/2023] Open
Abstract
Recent work in decision neuroscience suggests that visual saliency can interact with reward-based choice, and the lateral intraparietal cortex (LIP) is implicated in this process. In this study, we recorded from LIP neurons while monkeys performed a two alternative choice task in which the reward and luminance associated with each offer were varied independently. We discovered that the animal's choice was dictated by the reward amount while the luminance had a marginal effect. In the LIP, neuronal activity corresponded well with the animal's choice pattern, in that a majority of reward-modulated neurons encoded the reward amount in the neuron's preferred hemifield with a positive slope. In contrast, compared to their responses to low luminance, an approximately equal proportion of luminance-sensitive neurons responded to high luminance with increased or decreased activity, leading to a much weaker population-level response. Meanwhile, in the non-preferred hemifield, the strength of encoding for reward amount and luminance was positively correlated, suggesting the integration of these two factors in the LIP. Moreover, neurons encoding reward and luminance were homogeneously distributed along the anterior-posterior axis of the LIP. Overall, our study provides further evidence supporting the neural instantiation of a priority map in the LIP in reward-based decisions.
Collapse
|
11
|
Hanning NM, Wollenberg L, Jonikaitis D, Deubel H. Eye and hand movements disrupt attentional control. PLoS One 2022; 17:e0262567. [PMID: 35045115 PMCID: PMC8769330 DOI: 10.1371/journal.pone.0262567] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2021] [Accepted: 12/29/2021] [Indexed: 11/23/2022] Open
Abstract
Voluntary attentional control is the ability to selectively focus on a subset of visual information in the presence of other competing stimuli–a marker of cognitive control enabling flexible, goal-driven behavior. To test its robustness, we contrasted attentional control with the most common source of attentional orienting in daily life: attention shifts prior to goal-directed eye and hand movements. In a multi-tasking paradigm, human participants attended at a location while planning eye or hand movements elsewhere. Voluntary attentional control suffered with every simultaneous action plan, even under reduced task difficulty and memory load–factors known to interfere with attentional control. Furthermore, the performance cost was limited to voluntary attention: We observed simultaneous attention benefits at two movement targets without attentional competition between them. This demonstrates that the visual system allows for the concurrent representation of multiple attentional foci. Since attentional control is extremely fragile and dominated by premotor attention shifts, we propose that action-driven selection plays the superordinate role for visual selection.
Collapse
Affiliation(s)
- Nina Maria Hanning
- Department Psychologie, Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, München, Germany
- Department of Psychology and Center for Neural Science, New York University, New York, NY, United States of America
- * E-mail:
| | - Luca Wollenberg
- Department Psychologie, Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, München, Germany
- Department Biologie, Graduate School of Systemic Neurosciences, Ludwig-Maximilians-Universität München, Planegg, München, Germany
| | - Donatas Jonikaitis
- Department of Neurobiology and Howard Hughes Medical Institute, Stanford University School of Medicine, Stanford, CA, United States of America
| | - Heiner Deubel
- Department Psychologie, Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians-Universität München, München, Germany
| |
Collapse
|
12
|
Wolf C, Lappe M. Vision as oculomotor reward: cognitive contributions to the dynamic control of saccadic eye movements. Cogn Neurodyn 2021; 15:547-568. [PMID: 34367360 PMCID: PMC8286912 DOI: 10.1007/s11571-020-09661-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Revised: 12/12/2020] [Accepted: 12/28/2020] [Indexed: 01/08/2023] Open
Abstract
Humans and other primates are equipped with a foveated visual system. As a consequence, we reorient our fovea to objects and targets in the visual field that are conspicuous or that we consider relevant or worth looking at. These reorientations are achieved by means of saccadic eye movements. Where we saccade to depends on various low-level factors such as a targets' luminance but also crucially on high-level factors like the expected reward or a targets' relevance for perception and subsequent behavior. Here, we review recent findings how the control of saccadic eye movements is influenced by higher-level cognitive processes. We first describe the pathways by which cognitive contributions can influence the neural oculomotor circuit. Second, we summarize what saccade parameters reveal about cognitive mechanisms, particularly saccade latencies, saccade kinematics and changes in saccade gain. Finally, we review findings on what renders a saccade target valuable, as reflected in oculomotor behavior. We emphasize that foveal vision of the target after the saccade can constitute an internal reward for the visual system and that this is reflected in oculomotor dynamics that serve to quickly and accurately provide detailed foveal vision of relevant targets in the visual field.
Collapse
Affiliation(s)
- Christian Wolf
- Institute for Psychology, University of Muenster, Fliednerstrasse 21, 48149 Münster, Germany
| | - Markus Lappe
- Institute for Psychology, University of Muenster, Fliednerstrasse 21, 48149 Münster, Germany
| |
Collapse
|
13
|
Abstract
Remapping is a property of some cortical and subcortical neurons that update their responses around the time of an eye movement to account for the shift of stimuli on the retina due to the saccade. Physiologically, remapping is traditionally tested by briefly presenting a single stimulus around the time of the saccade and looking at the onset of the response and the locations in space to which the neuron is responsive. Here we suggest that a better way to understand the functional role of remapping is to look at the time at which the neural signal emerges when saccades are made across a stable scene. Based on data obtained using this approach, we suggest that remapping in the lateral intraparietal area is sufficient to play a role in maintaining visual stability across saccades, whereas in the frontal eye field, remapped activity carries information that affects future saccadic choices and, in a separate subset of neurons, is used to maintain a map of locations in the scene that have been previously fixated.
Collapse
Affiliation(s)
- James W Bisley
- Department of Neurobiology, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA.,Jules Stein Eye Institute, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA.,Department of Psychology and the Brain Research Institute, UCLA, Los Angeles, CA, USA
| | - Koorosh Mirpour
- Department of Neurobiology, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| | - Yelda Alkan
- Department of Neurobiology, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| |
Collapse
|
14
|
Jiang Y, Guo Z, McClure MA, He L, Mu Q. Effect of rTMS on Parkinson's cognitive function: a systematic review and meta-analysis. BMC Neurol 2020; 20:377. [PMID: 33076870 PMCID: PMC7574251 DOI: 10.1186/s12883-020-01953-4] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2019] [Accepted: 10/05/2020] [Indexed: 12/13/2022] Open
Abstract
Background To evaluate the effects and optimal parameters of repetitive transcranial magnetic stimulation (rTMS) on cognition function of patients with Parkinson’s disease (PD) and to estimate which cognitive function may obtain more benefits from rTMS. Method The articles dealing with rTMS on cognitive function of PD patients were retrieved from the databases until April 2019. Outcomes of global cognitive function and different cognitive domains were extracted. The standardized mean differences (SMDs) with 95% confidence interval (CI) of cognitive outcome for different parameters, scales, and cognitive functions were estimated. Results Fourteen studies involving 173 subjects were included in this meta-analysis. A significant effect size was observed with the mini-mental state examination (MMSE) for the global cognitive outcome based on the evidence of four published articles. Further subtests for different cognitive domains demonstrated prominent effect for the executive function. The significant effect sizes for executive function were found with multiple sessions of high-frequency rTMS over frontal cortex; especially over dorsolateral prefrontal cortex (DLPFC). All of the other cognitive domains, which included memory, attention, and language ability, did not obtain significant effects. Conclusions Multiple sessions of high-frequency rTMS over the DLPFC may have positive effect on executive function in PD patients. Further well designed studies with large sample sizes are needed to verify our results and ascertain the long-term effects of rTMS.
Collapse
Affiliation(s)
- Yi Jiang
- Department of Radiology and Institute of Rehabilitation and Imaging of Brain Function, The Second Clinical Medical College of North Sichuan Medical College Nanchong Central Hospital, NO. 97 South Renmin Road, Shunqing District, Nanchong, 637000, Sichuan, China
| | - Zhiwei Guo
- Department of Radiology and Institute of Rehabilitation and Imaging of Brain Function, The Second Clinical Medical College of North Sichuan Medical College Nanchong Central Hospital, NO. 97 South Renmin Road, Shunqing District, Nanchong, 637000, Sichuan, China
| | - Morgan A McClure
- Department of Radiology and Institute of Rehabilitation and Imaging of Brain Function, The Second Clinical Medical College of North Sichuan Medical College Nanchong Central Hospital, NO. 97 South Renmin Road, Shunqing District, Nanchong, 637000, Sichuan, China
| | - Lin He
- Department of Radiology and Institute of Rehabilitation and Imaging of Brain Function, The Second Clinical Medical College of North Sichuan Medical College Nanchong Central Hospital, NO. 97 South Renmin Road, Shunqing District, Nanchong, 637000, Sichuan, China
| | - Qiwen Mu
- Department of Radiology and Institute of Rehabilitation and Imaging of Brain Function, The Second Clinical Medical College of North Sichuan Medical College Nanchong Central Hospital, NO. 97 South Renmin Road, Shunqing District, Nanchong, 637000, Sichuan, China. .,Department of Radiology, Peking University Third Hospital, Beijing, China.
| |
Collapse
|
15
|
Machner B, Lencer MC, Möller L, von der Gablentz J, Heide W, Helmchen C, Sprenger A. Unbalancing the Attentional Priority Map via Gaze-Contingent Displays Induces Neglect-Like Visual Exploration. Front Hum Neurosci 2020; 14:41. [PMID: 32153377 PMCID: PMC7045871 DOI: 10.3389/fnhum.2020.00041] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2019] [Accepted: 01/27/2020] [Indexed: 11/15/2022] Open
Abstract
Selective spatial attention is a crucial cognitive process that guides us to the behaviorally relevant objects in a complex visual world by using exploratory eye movements. The spatial location of objects, their (bottom-up) saliency and (top-down) relevance is assumed to be encoded in one “attentional priority map” in the brain, using different egocentric (eye-, head- and trunk-centered) spatial reference frames. In patients with hemispatial neglect, this map is supposed to be imbalanced, leading to a spatially biased exploration of the visual environment. As a proof of concept, we altered the visual saliency (and thereby attentional priority) of objects in a naturalistic scene along a left-right spatial gradient and investigated whether this can induce a bias in the exploratory eye movements of healthy humans (n = 28; all right-handed; mean age: 23 years, range 19–48). We developed a computerized mask, using high-end “gaze-contingent display (GCD)” technology, that immediately and continuously reduced the saliency of objects on the left—“left” with respect to the head (body-centered) and the current position on the retina (eye-centered). In both experimental conditions, task-free viewing and goal-driven visual search, this modification induced a mild but significant bias in visual exploration similar to hemispatial neglect. Accordingly, global eye movement parameters changed (reduced number and increased duration of fixations) and the spatial distribution of fixations indicated an attentional bias towards the right (rightward shift of first orienting, fixations favoring the scene’s outmost right over left). Our results support the concept of an attentional priority map in the brain as an interface between perception and behavior and as one pathophysiological ground of hemispatial neglect.
Collapse
Affiliation(s)
- Björn Machner
- Department of Neurology, University of Lübeck, Lübeck, Germany
| | - Marie C Lencer
- Department of Psychology II, University of Lübeck, Lübeck, Germany
| | - Lisa Möller
- Department of Neurology, University of Lübeck, Lübeck, Germany
| | | | - Wolfgang Heide
- Department of Neurology, General Hospital Celle, Celle, Germany
| | | | - Andreas Sprenger
- Department of Neurology, University of Lübeck, Lübeck, Germany.,Department of Psychology II, University of Lübeck, Lübeck, Germany
| |
Collapse
|
16
|
Functional connectivity at rest captures individual differences in visual search. Brain Struct Funct 2020; 225:537-549. [PMID: 31897605 DOI: 10.1007/s00429-019-02008-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2019] [Accepted: 12/10/2019] [Indexed: 01/03/2023]
Abstract
Brain functional connectivity is supposed to capture personal and lifetime learning experiences and contribute to generating individual differences in cognitive abilities. We tested this possibility using the visual search task as a measure of visual information processing and the functioning of the visual attention control system. Forty-two undergraduate students completed a functional MRI study with a resting-state session and a visual search task scan. The visual attention and control systems were studied by investigating the functional connectivity of the primary visual area, the posterior parietal cortex, the dorsolateral prefrontal cortex, and the dorsal anterior cingulate cortex because these areas have been closely related to the visual search task. A pairwise resting-state functional connectivity analysis was conducted between these regions, followed by a correlation analysis with the behavioral measures from the visual search task. Results showed that higher connectivity values between the posterior parietal cortex and the dorsal anterior cingulate cortex were positively correlated with faster response speed. The posterior parietal cortex has been related to the formation of priority maps and the integration of sensory and executive information. Inhibitory control, performance monitoring during top-down cognitive tasks, and target detection have been associated with the dorsal anterior cingulate cortex. In light of these results, we suggest that a priori enhanced connectivity between these regions defines individual differences in visual information processing and the ability to adapt to cognitive demands.
Collapse
|
17
|
Wolf C, Schütz AC. Choice-induced inter-trial inhibition is modulated by idiosyncratic choice-consistency. PLoS One 2019; 14:e0226982. [PMID: 31877183 PMCID: PMC6932778 DOI: 10.1371/journal.pone.0226982] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2019] [Accepted: 12/10/2019] [Indexed: 12/22/2022] Open
Abstract
Humans constantly decide among multiple action plans. Carrying out one action usually implies that other plans are suppressed. Here we make use of inter-trial effects to determine whether suppression of non-chosen action plans is due to proactively preparing for upcoming decisions or due to retroactive influences from previous decisions. Participants received rewards for timely and accurate saccades to targets appearing left or right from fixation. Each block interleaved trials with one (single-trial) or two targets (choice-trial). Whereas single-trial rewards were always identical, rewards for the two targets in choice-trials could either be identical (unbiased) or differ (biased) within one block. We analyzed single-trial latencies as a function of idiosyncratic choice-consistency or reward-bias, the previous trial type and whether the same or the other target was selected in the preceding trial. After choice-trials, single-trial responses to the previously non-chosen target were delayed. For biased choices, inter-trial effects were strongest when choices were followed by a single-trial to the non-chosen target. In the unbiased condition, inter-trial effects increased with increasing individual consistency of choice behavior. These findings suggest that the suppression of alternative action plans is not coupled to target selection and motor execution but instead depends on top-down signals like the overall preference of one target over another.
Collapse
Affiliation(s)
- Christian Wolf
- AG Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, Marburg, Germany
- Allgemeine Psychologie, Westfälische Wilhelms-Universität, Münster, Germany
| | - Alexander C. Schütz
- AG Allgemeine und Biologische Psychologie, Philipps-Universität Marburg, Marburg, Germany
| |
Collapse
|
18
|
Abstract
A fundamental dogma in the cognitive neurosciences is that attention is controlled by parietal and prefrontal areas. Here, we show that an area in the temporal lobe exhibits the properties of a priority map coding the focus of attention. We show this through whole-brain functional magnetic resonance imaging, electrophysiological single-unit recordings, and causal electrical stimulation. This discovery changes our understanding of the organization of visual pathways and the functions of attention networks. From incoming sensory information, our brains make selections according to current behavioral goals. This process, selective attention, is controlled by parietal and frontal areas. Here, we show that another brain area, posterior inferotemporal cortex (PITd), also exhibits the defining properties of attentional control. We discovered this area with functional magnetic resonance imaging (fMRI) during an attentive motion discrimination task. Single-cell recordings from PITd revealed strong attentional modulation across 3 attention tasks yet no tuning to task-relevant stimulus features, like motion direction or color. Instead, PITd neurons closely tracked the subject’s attention state and predicted upcoming errors of attentional selection. Furthermore, artificial electrical PITd stimulation controlled the location of attentional selection without altering feature discrimination. These are the defining properties of a feature-blind priority map encoding the locus of attention. Together, these results suggest area PITd, located strategically to gather information about object properties, as an attentional priority map.
Collapse
|
19
|
Freedman DJ, Ibos G. An Integrative Framework for Sensory, Motor, and Cognitive Functions of the Posterior Parietal Cortex. Neuron 2019; 97:1219-1234. [PMID: 29566792 DOI: 10.1016/j.neuron.2018.01.044] [Citation(s) in RCA: 69] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2017] [Revised: 01/12/2018] [Accepted: 01/23/2018] [Indexed: 11/28/2022]
Abstract
Throughout the history of modern neuroscience, the parietal cortex has been associated with a wide array of sensory, motor, and cognitive functions. The use of non-human primates as a model organism has been instrumental in our current understanding of how areas in the posterior parietal cortex (PPC) modulate our perception and influence our behavior. In this Perspective, we highlight a series of influential studies over the last five decades examining the role of the PPC in visual perception and motor planning. We also integrate long-standing views of PPC functions with more recent evidence to propose a more general model framework to explain integrative sensory, motor, and cognitive functions of the PPC.
Collapse
Affiliation(s)
- David J Freedman
- Department of Neurobiology, The University of Chicago, Chicago, IL 60637, USA; Grossman Institute for Neuroscience, Quantitative Biology and Human Behavior, The University of Chicago, Chicago, IL 60637, USA.
| | - Guilhem Ibos
- Department of Neurobiology, The University of Chicago, Chicago, IL 60637, USA; Institut de Neuroscience de la Timone, UMR 7289 CNRS & Aix-Marseille Université, Marseille, France.
| |
Collapse
|
20
|
Updating spatial working memory in a dynamic visual environment. Cortex 2019; 119:267-286. [PMID: 31170650 DOI: 10.1016/j.cortex.2019.04.021] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2018] [Revised: 04/17/2019] [Accepted: 04/26/2019] [Indexed: 11/22/2022]
Abstract
The present review describes recent developments regarding the role of the eye movement system in representing spatial information and keeping track of locations of relevant objects. First, we discuss the active vision perspective and why eye movements are considered crucial for perception and attention. The second part focuses on the question of how the oculomotor system is used to represent spatial attentional priority, and the role of the oculomotor system in maintenance of this spatial information. Lastly, we discuss recent findings demonstrating rapid updating of information across saccadic eye movements. We argue that the eye movement system plays a key role in maintaining and rapidly updating spatial information. Furthermore, we suggest that rapid updating emerges primarily to make sure actions are minimally affected by intervening eye movements, allowing us to efficiently interact with the world around us.
Collapse
|
21
|
Vidyasagar TR, Levichkina E. An Integrated Neuronal Model of Claustral Function in Timing the Synchrony Between Cortical Areas. Front Neural Circuits 2019; 13:3. [PMID: 30804759 PMCID: PMC6371054 DOI: 10.3389/fncir.2019.00003] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2018] [Accepted: 01/14/2019] [Indexed: 11/22/2022] Open
Abstract
It has been suggested that the function of the claustrum (CL) may be to orchestrate and integrate the activity of the different cortical areas that are involved in a particular function by boosting the synchronized oscillations that occur between these areas. We propose here a model of how this may be done, thanks to the unique synaptic morphology of the CL and its excitatory and inhibitory connections with most cortical areas. Using serial visual search as an example, we describe how the functional anatomy of the claustral connections can potentially execute the sequential activation of the representations of objects that are being processed serially. We also propose that cross-frequency coupling (CFC) between low frequency signals from CL and higher frequency oscillations in the cortical areas will be an efficient means of CL modulating neural activity across multiple brain regions in synchrony. This model is applicable to the wide range of functions one performs, from simple object recognition to reading and writing, listening to or performing music, etc.
Collapse
Affiliation(s)
- Trichur R. Vidyasagar
- Department of Optometry and Vision Science, University of Melbourne, Parkville, VIC, Australia
- Florey Institute of Neuroscience and Mental Health, Parkville, VIC, Australia
- Australian Research Council Centre of Excellence in Integrative Brain Function, University of Melbourne Node, Melbourne, VIC, Australia
| | - Ekaterina Levichkina
- Department of Optometry and Vision Science, University of Melbourne, Parkville, VIC, Australia
- Institute for Information Transmission Problems, Russian Academy of Sciences, Moscow, Russia
| |
Collapse
|
22
|
Jiang Y, Guo Z, Xing G, He L, Peng H, Du F, McClure MA, Mu Q. Effects of High-Frequency Transcranial Magnetic Stimulation for Cognitive Deficit in Schizophrenia: A Meta-Analysis. Front Psychiatry 2019; 10:135. [PMID: 30984036 PMCID: PMC6450172 DOI: 10.3389/fpsyt.2019.00135] [Citation(s) in RCA: 40] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/02/2018] [Accepted: 02/25/2019] [Indexed: 12/22/2022] Open
Abstract
Objective: Repetitive transcranial magnetic stimulation (rTMS) has been applied to dorsolateral prefrontal cortex (DLPFC) to improve cognitive function of patients with schizophrenia (SZs). The aim of this meta-analysis was to evaluate whether a high-frequency rTMS course could enhance cognitive function in SZs. Methods: Studies published in PubMed, Cochrane Library, Embase, ScienceDirect, and Web of science were searched until April 2018. The search terms included: "repetitive transcranial magnetic stimulation" or "Rtms," "SZ," or "schizophrenia," and "neuro-cognition" or "neurocognitive performance" or "cognitive effects" or "cognitive" or "cognition" or "working memory" or "executive function" or "language function" or "processing speed," After screening the literatures according to inclusion and exclusion criteria, extracting data, and evaluating the methodological quality of the included studies, a meta-analysis was performed using RevMan 5.3 software (The Cochrane Collaboration, USA). Results: A total of 9 studies on cognitive dysfunction of SZs were included and involved 351 patients. A significant efficacy of high-frequency rTMS on working memory in SZs was found compared to sham stimulation [p = 0.009, standardized mean difference (SMD) = 0.34]. Specifically, rTMS treatment positioned on the left DLPFC, with a total pluses <30,000 was more significantly more effective in improving the working memory (SMD = 0.33, p = 0.03). No improvement was found in other cognitive domains such as executive function, attention, processing speed, and language function. For the follow-up observations, high-frequency rTMS had long-lasting sustained effects on working memory (SMD = 0.45, p = 0.01) and language function (SMD = 0.77, p = 0.02) in SZs. Conclusions: High-frequency rTMS over the left DLPFC with a total pulses <30,000 stimulation could significantly improve working memory in SZs for an extended period of time.
Collapse
Affiliation(s)
- Yi Jiang
- Department of Radiology and Imaging Institute of Rehabilitation and Development of Brain Function, The Second Clinical Medical College of North Sichuan Medical College Nanchong Central Hospital, Nanchong, China
| | - Zhiwei Guo
- Department of Radiology and Imaging Institute of Rehabilitation and Development of Brain Function, The Second Clinical Medical College of North Sichuan Medical College Nanchong Central Hospital, Nanchong, China
| | - Guoqiang Xing
- Department of Radiology and Imaging Institute of Rehabilitation and Development of Brain Function, The Second Clinical Medical College of North Sichuan Medical College Nanchong Central Hospital, Nanchong, China
| | - Lin He
- Department of Radiology and Imaging Institute of Rehabilitation and Development of Brain Function, The Second Clinical Medical College of North Sichuan Medical College Nanchong Central Hospital, Nanchong, China
| | - Haitao Peng
- Department of Radiology and Imaging Institute of Rehabilitation and Development of Brain Function, The Second Clinical Medical College of North Sichuan Medical College Nanchong Central Hospital, Nanchong, China
| | - Fei Du
- Department of Psychiatry, Harvard Medical School, Belmont, CA, United States
| | - Morgan A McClure
- Department of Radiology and Imaging Institute of Rehabilitation and Development of Brain Function, The Second Clinical Medical College of North Sichuan Medical College Nanchong Central Hospital, Nanchong, China
| | - Qiwen Mu
- Department of Radiology and Imaging Institute of Rehabilitation and Development of Brain Function, The Second Clinical Medical College of North Sichuan Medical College Nanchong Central Hospital, Nanchong, China.,Department of Radiology, Peking University Third Hospital, Beijing, China
| |
Collapse
|
23
|
Garcia-Lazaro HG, Bartsch MV, Boehler CN, Krebs RM, Donohue SE, Harris JA, Schoenfeld MA, Hopf JM. Dissociating Reward- and Attention-driven Biasing of Global Feature-based Selection in Human Visual Cortex. J Cogn Neurosci 2018; 31:469-481. [PMID: 30457917 DOI: 10.1162/jocn_a_01356] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Objects that promise rewards are prioritized for visual selection. The way this prioritization shapes sensory processing in visual cortex, however, is debated. It has been suggested that rewards motivate stronger attentional focusing, resulting in a modulation of sensory selection in early visual cortex. An open question is whether those reward-driven modulations would be independent of similar modulations indexing the selection of attended features that are not associated with reward. Here, we use magnetoencephalography in human observers to investigate whether the modulations indexing global color-based selection in visual cortex are separable for target- and (monetary) reward-defining colors. To assess the underlying global color-based activity modulation, we compare the event-related magnetic field response elicited by a color probe in the unattended hemifield drawn either in the target color, the reward color, both colors, or a neutral task-irrelevant color. To test whether target and reward relevance trigger separable modulations, we manipulate attention demands on target selection while keeping reward-defining experimental parameters constant. Replicating previous observations, we find that reward and target relevance produce almost indistinguishable gain modulations in ventral extratriate cortex contralateral to the unattended color probe. Importantly, increasing attention demands on target discrimination increases the response to the target-defining color, whereas the response to the rewarded color remains largely unchanged. These observations indicate that, although task relevance and reward influence the very same feature-selective area in extrastriate visual cortex, the associated modulations are largely independent.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | - Jens-Max Hopf
- Otto-von-Guericke University Magdeburg.,Leibniz Institute for Neurobiology, Magdeburg
| |
Collapse
|
24
|
Visual search task immediate training effects on task-related functional connectivity. Brain Imaging Behav 2018; 13:1566-1579. [PMID: 30443892 DOI: 10.1007/s11682-018-9993-y] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
Brain plasticity occurs over the course of the human lifetime. Learning and training modify our neuronal synapses and adapt our brain activity, from priming effects in modal areas to higher-order changes in the association cortex. The current state of the art suggests that learning and training effects might induce large-scale brain connectivity changes. Here, we used task-fMRI data and graph-based approaches to study the immediate brain changes in functional connections associated with training on a visual search task, and the individual differences in learning were studied by means of brain-behavior correlations. In a previous work, we found that trained participants improved their response speed on a visual search task by 31%, whereas the control group hardly changed. In the present study, we showed that trained individuals changed regional connections (local links) in cortical areas devoted to the specific visual search processes and to areas that support information integration, and largely modified distributed connections (distant links) linking primary visual areas to specific attentional and cognitive control areas. In addition, we found that the individuals with the most enhanced connectivity in the dorsolateral prefrontal cortex performed the task faster after training. The observed behavioral and brain connectivity findings expand our understanding of large-scale dynamic readjustment of the human brain after learning experiences.
Collapse
|
25
|
Distinct roles of prefrontal and parietal areas in the encoding of attentional priority. Proc Natl Acad Sci U S A 2018; 115:E8755-E8764. [PMID: 30154164 DOI: 10.1073/pnas.1804643115] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
When searching for an object in a crowded scene, information about the similarity of stimuli to the target object is thought to be encoded in spatial priority maps, which are subsequently used to guide shifts of attention and gaze to likely targets. Two key cortical areas that have been described as holding priority maps are the frontal eye field (FEF) and the lateral intraparietal area (LIP). However, little is known about their distinct contributions in priority encoding. Here, we compared neuronal responses in FEF and LIP during free-viewing visual search. Although saccade selection signals emerged earlier in FEF, information about the target emerged at similar latencies in distinct populations within the two areas. Notably, however, effects in FEF were more pronounced. Moreover, LIP neurons encoded the similarity of stimuli to the target independent of saccade selection, whereas in FEF, encoding of target similarity was strongly modulated by saccade selection. Taken together, our findings suggest hierarchical processing of saccade selection signals and parallel processing of feature-based attention signals within the parietofrontal network with FEF having a more prominent role in priority encoding. Furthermore, they suggest discrete roles of FEF and LIP in the construction of priority maps.
Collapse
|
26
|
Attention Effects on Neural Population Representations for Shape and Location Are Stronger in the Ventral than Dorsal Stream. eNeuro 2018; 5:eN-NWR-0371-17. [PMID: 29876521 PMCID: PMC5988342 DOI: 10.1523/eneuro.0371-17.2018] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2017] [Revised: 03/14/2018] [Accepted: 04/19/2018] [Indexed: 11/21/2022] Open
Abstract
We examined how attention causes neural population representations of shape and location to change in ventral stream (AIT) and dorsal stream (LIP). Monkeys performed two identical delayed-match-to-sample (DMTS) tasks, attending either to shape or location. In AIT, shapes were more discriminable when directing attention to shape rather than location, measured by an increase in mean distance between population response vectors. In LIP, attending to location rather than shape did not increase the discriminability of different stimulus locations. Even when factoring out the change in mean vector response distance, multidimensional scaling (MDS) still showed a significant task difference in AIT, but not LIP, indicating that beyond increasing discriminability, attention also causes a nonlinear warping of representation space in AIT. Despite single-cell attentional modulations in both areas, our data show that attentional modulations of population representations are weaker in LIP, likely due to a need to maintain veridical representations for visuomotor control.
Collapse
|
27
|
Mooshagian E, Wang C, Holmes CD, Snyder LH. Single Units in the Posterior Parietal Cortex Encode Patterns of Bimanual Coordination. Cereb Cortex 2018; 28:1549-1567. [PMID: 28369392 PMCID: PMC5907348 DOI: 10.1093/cercor/bhx052] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2016] [Revised: 02/07/2017] [Accepted: 02/10/2017] [Indexed: 11/12/2022] Open
Abstract
Bimanual coordination is critical for a broad array of behaviors. Drummers, for example, must carefully coordinate movements of their 2 arms, sometimes beating on the same drum and sometimes on different ones. While coordinated behavior is well-studied, the early stages of planning are not well understood. In the parietal reach region (PRR) of the posterior parietal cortex (PPC), the presence of neurons that modulate when either arm moves by itself has been taken as evidence for a role in bimanual coordination. To test this notion, we recorded neurons during both unilateral and bimanual movements. We find that the activity that precedes an ipsilateral arm movement is primarily a sensory response to a target in the neuron's visual receptive field and not a plan to move the ipsilateral arm. In contrast, the activity that precedes a contralateral arm movement is the sum of a movement plan plus a sensory response. Despite not coding ipsilateral arm movements, about half of neurons discriminate between different patterns of bimanual movements. These results provide direct evidence that PRR neurons represent bimanual reach plans, and suggest that bimanual coordination originates in the sensory-to-motor processing stream prior to the motor cortex, within the PPC.
Collapse
Affiliation(s)
- Eric Mooshagian
- Department of Neuroscience, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Cunguo Wang
- Department of Neuroscience, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Charles D Holmes
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, MO 63130, USA
| | - Lawrence H Snyder
- Department of Neuroscience, Washington University School of Medicine, St. Louis, MO 63110, USA
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, MO 63130, USA
| |
Collapse
|
28
|
Suppression of frontal eye field neuronal responses with maintained fixation. Proc Natl Acad Sci U S A 2018; 115:804-809. [PMID: 29311323 DOI: 10.1073/pnas.1716315115] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
The decision of where to make an eye movement is thought to be driven primarily by responses to stimuli in neurons' receptive fields (RFs) in oculomotor areas, including the frontal eye field (FEF) of prefrontal cortex. It is also thought that a saccade may be generated when the accumulation of this activity in favor of one location or another reaches a threshold. However, in the reading and scene perception fields, it is well known that the properties of the stimulus at the fovea often affect when the eyes leave that stimulus. We propose that if FEF plays a role in generating eye movements, then the identity of the stimulus at fixation should affect the FEF responses so as to reduce the probability of making a saccade when fixating an item of interest. Using a visual foraging task in which animals could make multiple eye movements within a single trial, we found that responses were strongly modulated by the identity of the stimulus at the fovea. Specifically, responses to the stimulus in the RF were suppressed when the animal maintained fixation for longer durations on a stimulus that could be associated with a reward. We suggest that this suppression, which was predicted by models of eye movement behavior, could be a mechanism by which FEF can modulate the temporal flow of saccades based on the importance of the stimulus at the fovea.
Collapse
|
29
|
Klink PC, Jeurissen D, Theeuwes J, Denys D, Roelfsema PR. Working memory accuracy for multiple targets is driven by reward expectation and stimulus contrast with different time-courses. Sci Rep 2017; 7:9082. [PMID: 28831072 PMCID: PMC5567292 DOI: 10.1038/s41598-017-08608-4] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2016] [Accepted: 07/17/2017] [Indexed: 11/25/2022] Open
Abstract
The richness of sensory input dictates that the brain must prioritize and select information for further processing and storage in working memory. Stimulus salience and reward expectations influence this prioritization but their relative contributions and underlying mechanisms are poorly understood. Here we investigate how the quality of working memory for multiple stimuli is determined by priority during encoding and later memory phases. Selective attention could, for instance, act as the primary gating mechanism when stimuli are still visible. Alternatively, observers might still be able to shift priorities across memories during maintenance or retrieval. To distinguish between these possibilities, we investigated how and when reward cues determine working memory accuracy and found that they were only effective during memory encoding. Previously learned, but currently non-predictive, color-reward associations had a similar influence, which gradually weakened without reinforcement. Finally, we show that bottom-up salience, manipulated through varying stimulus contrast, influences memory accuracy during encoding with a fundamentally different time-course than top-down reward cues. While reward-based effects required long stimulus presentation, the influence of contrast was strongest with brief presentations. Our results demonstrate how memory resources are distributed over memory targets and implicates selective attention as a main gating mechanism between sensory and memory systems.
Collapse
Affiliation(s)
- P Christiaan Klink
- Vision & Cognition, Netherlands Institute for Neuroscience, Royal Netherlands Academy of Arts & Sciences, Amsterdam, The Netherlands.
- Neuromodulation & Behaviour, Netherlands Institute for Neuroscience, Royal Netherlands Academy of Arts & Sciences, Amsterdam, The Netherlands.
- Department of Psychiatry, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands.
- Department of Integrative Neurophysiology, Centre for Neurogenomics and Cognitive Research, VU University, Amsterdam, The Netherlands.
| | - Danique Jeurissen
- Vision & Cognition, Netherlands Institute for Neuroscience, Royal Netherlands Academy of Arts & Sciences, Amsterdam, The Netherlands
- Department of Neuroscience, Zuckerman Mind Brain Behavior Institute, Columbia University, New York, USA
| | - Jan Theeuwes
- Cognitive Psychology, VU University, Amsterdam, The Netherlands
| | - Damiaan Denys
- Neuromodulation & Behaviour, Netherlands Institute for Neuroscience, Royal Netherlands Academy of Arts & Sciences, Amsterdam, The Netherlands
- Department of Psychiatry, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
| | - Pieter R Roelfsema
- Vision & Cognition, Netherlands Institute for Neuroscience, Royal Netherlands Academy of Arts & Sciences, Amsterdam, The Netherlands
- Department of Psychiatry, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
- Department of Integrative Neurophysiology, Centre for Neurogenomics and Cognitive Research, VU University, Amsterdam, The Netherlands
| |
Collapse
|
30
|
Ong WS, Mirpour K, Bisley JW. Object comparison in the lateral intraparietal area. J Neurophysiol 2017; 118:2458-2469. [PMID: 28794195 DOI: 10.1152/jn.00400.2017] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2017] [Revised: 07/24/2017] [Accepted: 08/02/2017] [Indexed: 11/22/2022] Open
Abstract
We can search for and locate specific objects in our environment by looking for objects with similar features. Object recognition involves stimulus similarity responses in ventral visual areas and task-related responses in prefrontal cortex. We tested whether neurons in the lateral intraparietal area (LIP) of posterior parietal cortex could form an intermediary representation, collating information from object-specific similarity map representations to allow general decisions about whether a stimulus matches the object being looked for. We hypothesized that responses to stimuli would correlate with how similar they are to a sample stimulus. When animals compared two peripheral stimuli to a sample at their fovea, the response to the matching stimulus was similar, independent of the sample identity, but the response to the nonmatch depended on how similar it was to the sample: the more similar, the greater the response to the nonmatch stimulus. These results could not be explained by task difficulty or confidence. We propose that LIP uses its known mechanistic properties to integrate incoming visual information, including that from the ventral stream about object identity, to create a dynamic representation that is concise, low dimensional, and task relevant and that signifies the choice priorities in mental matching behavior.NEW & NOTEWORTHY Studies in object recognition have focused on the ventral stream, in which neurons respond as a function of how similar a stimulus is to their preferred stimulus, and on prefrontal cortex, where neurons indicate which stimulus is being looked for. We found that parietal area LIP uses its known mechanistic properties to form an intermediary representation in this process. This creates a perceptual similarity map that can be used to guide decisions in prefrontal areas.
Collapse
Affiliation(s)
- Wei Song Ong
- Department of Neurobiology, David Geffen School of Medicine at UCLA, Los Angeles, California
| | - Koorosh Mirpour
- Department of Neurobiology, David Geffen School of Medicine at UCLA, Los Angeles, California
| | - James W Bisley
- Department of Neurobiology, David Geffen School of Medicine at UCLA, Los Angeles, California; .,Jules Stein Eye Institute, David Geffen School of Medicine at UCLA, Los Angeles, California; and.,Department of Psychology and Brain Research Institute, UCLA, Los Angeles, California
| |
Collapse
|
31
|
Ibos G, Freedman DJ. Sequential sensory and decision processing in posterior parietal cortex. eLife 2017; 6. [PMID: 28418332 PMCID: PMC5422072 DOI: 10.7554/elife.23743] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2016] [Accepted: 04/16/2017] [Indexed: 11/16/2022] Open
Abstract
Decisions about the behavioral significance of sensory stimuli often require comparing sensory inference of what we are looking at to internal models of what we are looking for. Here, we test how neuronal selectivity for visual features is transformed into decision-related signals in posterior parietal cortex (area LIP). Monkeys performed a visual matching task that required them to detect target stimuli composed of conjunctions of color and motion-direction. Neuronal recordings from area LIP revealed two main findings. First, the sequential processing of visual features and the selection of target-stimuli suggest that LIP is involved in transforming sensory information into decision-related signals. Second, the patterns of color and motion selectivity and their impact on decision-related encoding suggest that LIP plays a role in detecting target stimuli by comparing bottom-up sensory inputs (what the monkeys were looking at) and top-down cognitive encoding inputs (what the monkeys were looking for). DOI:http://dx.doi.org/10.7554/eLife.23743.001
Collapse
Affiliation(s)
- Guilhem Ibos
- Department of Neurobiology, The University of Chicago, Chicago, United States
| | - David J Freedman
- Department of Neurobiology, The University of Chicago, Chicago, United States.,Grossman Institute for Neuroscience, Quantitative Biology and Human Behavior, The University of Chicago, Chicago, United States
| |
Collapse
|
32
|
Abstract
In natural behavior, animals have access to multiple sources of information, but only a few of these sources are relevant for learning and actions. Beyond choosing an appropriate action, making good decisions entails the ability to choose the relevant information, but fundamental questions remain about the brain's information sampling policies. Recent studies described the neural correlates of seeking information about a reward, but it remains unknown whether, and how, neurons encode choices of instrumental information, in contexts in which the information guides subsequent actions. Here we show that parietal cortical neurons involved in oculomotor decisions encode, before an information sampling saccade, the reduction in uncertainty that the saccade is expected to bring for a subsequent action. These responses were distinct from the neurons' visual and saccadic modulations and from signals of expected reward or reward prediction errors. Therefore, even in an instrumental context when information and reward gains are closely correlated, individual cells encode decision variables that are based on informational factors and can guide the active sampling of action-relevant cues.
Collapse
|
33
|
Spatial and non-spatial aspects of visual attention: Interactive cognitive mechanisms and neural underpinnings. Neuropsychologia 2016; 92:9-19. [DOI: 10.1016/j.neuropsychologia.2016.05.021] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2015] [Revised: 04/07/2016] [Accepted: 05/19/2016] [Indexed: 11/16/2022]
|
34
|
Abstract
Environmental stimuli and objects, including rewards, are often processed sequentially in the brain. Recent work suggests that the phasic dopamine reward prediction-error response follows a similar sequential pattern. An initial brief, unselective and highly sensitive increase in activity unspecifically detects a wide range of environmental stimuli, then quickly evolves into the main response component, which reflects subjective reward value and utility. This temporal evolution allows the dopamine reward prediction-error signal to optimally combine speed and accuracy.
Collapse
Affiliation(s)
- Wolfram Schultz
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, UK.
| |
Collapse
|
35
|
Abstract
Recordings in the lateral intraparietal area (LIP) reveal that parietal cortex encodes variables related to spatial decision-making, the selection of desirable targets in space. It has been unclear whether parietal cortex is involved in spatial decision-making in general, or whether specific parietal compartments subserve decisions made using specific actions. To test this, we engaged monkeys (Macaca mulatta) in a reward-based decision task in which they selected a target based on its desirability. The animals' choice behavior in this task followed the molar matching law, and in each trial was governed by the desirability of the choice targets. Critically, animals were instructed to make the choice using one of two actions: eye movements (saccades) and arm movements (reaches). We recorded the discharge activity of neurons in area LIP and the parietal reach region (PRR) of the parietal cortex. In line with previous studies, we found that both LIP and PRR encode a reward-based decision variable, the target desirability. Crucially, the target desirability was encoded in LIP at least twice as strongly when choices were made using saccades compared with reaches. In contrast, PRR encoded target desirability only for reaches and not for saccades. These data suggest that decisions can evolve in dedicated parietal circuits in the context of specific actions. This finding supports the hypothesis of an intentional representation of developing decisions in parietal cortex. Furthermore, the close link between the cognitive (decision-related) and bodily (action-related) processes presents a neural contribution to the theories of embodied cognition.
Collapse
|
36
|
Action and perception are temporally coupled by a common mechanism that leads to a timing misperception. J Neurosci 2015; 35:1493-504. [PMID: 25632126 DOI: 10.1523/jneurosci.2054-14.2015] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023] Open
Abstract
We move our eyes to explore the world, but visual areas determining where to look next (action) are different from those determining what we are seeing (perception). Whether, or how, action and perception are temporally coordinated is not known. The preparation time course of an action (e.g., a saccade) has been widely studied with the gap/overlap paradigm with temporal asynchronies (TA) between peripheral target onset and fixation point offset (gap, synchronous, or overlap). However, whether the subjects perceive the gap or overlap, and when they perceive it, has not been studied. We adapted the gap/overlap paradigm to study the temporal coupling of action and perception. Human subjects made saccades to targets with different TAs with respect to fixation point offset and reported whether they perceived the stimuli as separated by a gap or overlapped in time. Both saccadic and perceptual report reaction times changed in the same way as a function of TA. The TA dependencies of the time change for action and perception were very similar, suggesting a common neural substrate. Unexpectedly, in the perceptual task, subjects misperceived lights overlapping by less than ∼100 ms as separated in time (overlap seen as gap). We present an attention-perception model with a map of prominence in the superior colliculus that modulates the stimulus signal's effectiveness in the action and perception pathways. This common source of modulation determines how competition between stimuli is resolved, causes the TA dependence of action and perception to be the same, and causes the misperception.
Collapse
|
37
|
Gallivan JP, Johnsrude IS, Flanagan JR. Planning Ahead: Object-Directed Sequential Actions Decoded from Human Frontoparietal and Occipitotemporal Networks. Cereb Cortex 2015; 26:708-30. [PMID: 25576538 DOI: 10.1093/cercor/bhu302] [Citation(s) in RCA: 34] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Object-manipulation tasks (e.g., drinking from a cup) typically involve sequencing together a series of distinct motor acts (e.g., reaching toward, grasping, lifting, and transporting the cup) in order to accomplish some overarching goal (e.g., quenching thirst). Although several studies in humans have investigated the neural mechanisms supporting the planning of visually guided movements directed toward objects (such as reaching or pointing), only a handful have examined how manipulatory sequences of actions-those that occur after an object has been grasped-are planned and represented in the brain. Here, using event-related functional MRI and pattern decoding methods, we investigated the neural basis of real-object manipulation using a delayed-movement task in which participants first prepared and then executed different object-directed action sequences that varied either in their complexity or final spatial goals. Consistent with previous reports of preparatory brain activity in non-human primates, we found that activity patterns in several frontoparietal areas reliably predicted entire action sequences in advance of movement. Notably, we found that similar sequence-related information could also be decoded from pre-movement signals in object- and body-selective occipitotemporal cortex (OTC). These findings suggest that both frontoparietal and occipitotemporal circuits are engaged in transforming object-related information into complex, goal-directed movements.
Collapse
Affiliation(s)
- Jason P Gallivan
- Centre for Neuroscience Studies Department of Psychology, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Ingrid S Johnsrude
- Brain and Mind Institute School of Communication Sciences and Disorders, University of Western Ontario, London, ON, Canada N6A 5B7
| | - J Randall Flanagan
- Centre for Neuroscience Studies Department of Psychology, Queen's University, Kingston, ON, Canada K7L 3N6
| |
Collapse
|
38
|
Ibos G, Freedman DJ. Dynamic integration of task-relevant visual features in posterior parietal cortex. Neuron 2014; 83:1468-80. [PMID: 25199703 DOI: 10.1016/j.neuron.2014.08.020] [Citation(s) in RCA: 41] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/06/2014] [Indexed: 11/30/2022]
Abstract
The primate visual system consists of multiple hierarchically organized cortical areas, each specialized for processing distinct aspects of the visual scene. For example, color and form are encoded in ventral pathway areas such as V4 and inferior temporal cortex, while motion is preferentially processed in dorsal pathway areas such as the middle temporal area. Such representations often need to be integrated perceptually to solve tasks that depend on multiple features. We tested the hypothesis that the lateral intraparietal area (LIP) integrates disparate task-relevant visual features by recording from LIP neurons in monkeys trained to identify target stimuli composed of conjunctions of color and motion features. We show that LIP neurons exhibit integrative representations of both color and motion features when they are task relevant and task-dependent shifts of both direction and color tuning. This suggests that LIP plays a role in flexibly integrating task-relevant sensory signals.
Collapse
Affiliation(s)
- Guilhem Ibos
- Department of Neurobiology, The University of Chicago, Chicago, IL 60637, USA.
| | - David J Freedman
- Department of Neurobiology, The University of Chicago, Chicago, IL 60637, USA
| |
Collapse
|
39
|
Abstract
Spatial priority maps are real-time representations of the behavioral salience of locations in the visual field, resulting from the combined influence of stimulus driven activity and top-down signals related to the current goals of the individual. They arbitrate which of a number of (potential) targets in the visual scene will win the competition for attentional resources. As a result, deployment of visual attention to a specific spatial location is determined by the current peak of activation (corresponding to the highest behavioral salience) across the map. Here we report a behavioral study performed on healthy human volunteers, where we demonstrate that spatial priority maps can be shaped via reward-based learning, reflecting long-lasting alterations (biases) in the behavioral salience of specific spatial locations. These biases exert an especially strong influence on performance under conditions where multiple potential targets compete for selection, conferring competitive advantage to targets presented in spatial locations associated with greater reward during learning relative to targets presented in locations associated with lesser reward. Such acquired biases of spatial attention are persistent, are nonstrategic in nature, and generalize across stimuli and task contexts. These results suggest that reward-based attentional learning can induce plastic changes in spatial priority maps, endowing these representations with the "intelligent" capacity to learn from experience.
Collapse
|
40
|
Krishna BS, Ipata AE, Bisley JW, Gottlieb J, Goldberg ME. Extrafoveal preview benefit during free-viewing visual search in the monkey. J Vis 2014; 14:6. [PMID: 24403392 PMCID: PMC5077276 DOI: 10.1167/14.1.6] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2013] [Accepted: 11/21/2013] [Indexed: 11/24/2022] Open
Abstract
Previous studies have shown that subjects require less time to process a stimulus at the fovea after a saccade if they have viewed the same stimulus in the periphery immediately prior to the saccade. This extrafoveal preview benefit indicates that information about the visual form of an extrafoveally viewed stimulus can be transferred across a saccade. Here, we extend these findings by demonstrating and characterizing a similar extrafoveal preview benefit in monkeys during a free-viewing visual search task. We trained two monkeys to report the orientation of a target among distractors by releasing one of two bars with their hand; monkeys were free to move their eyes during the task. Both monkeys took less time to indicate the orientation of the target after foveating it, when the target lay closer to the fovea during the previous fixation. An extrafoveal preview benefit emerged even if there was more than one intervening saccade between the preview and the target fixation, indicating that information about target identity could be transferred across more than one saccade and could be obtained even if the search target was not the goal of the next saccade. An extrafoveal preview benefit was also found for distractor stimuli. These results aid future physiological investigations of the extrafoveal preview benefit.
Collapse
Affiliation(s)
- B. Suresh Krishna
- Mahoney-Keck Center for Brain and Behavior Research, New York State Psychiatric Institute, New York, NY, USA
- Cognitive Neuroscience Laboratory, German Primate Center, Goettingen, Germany
| | - Anna E. Ipata
- Mahoney-Keck Center for Brain and Behavior Research, New York State Psychiatric Institute, New York, NY, USA
- Department of Neuroscience, Kavli Neuroscience Institute, Columbia University College of Physicians and Surgeons, New York, NY, USA
| | - James W. Bisley
- Mahoney-Keck Center for Brain and Behavior Research, New York State Psychiatric Institute, New York, NY, USA
- Department of Neurobiology, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| | - Jacqueline Gottlieb
- Mahoney-Keck Center for Brain and Behavior Research, New York State Psychiatric Institute, New York, NY, USA
- Cognitive Neuroscience Laboratory, German Primate Center, Goettingen, Germany
| | - Michael E. Goldberg
- Mahoney-Keck Center for Brain and Behavior Research, New York State Psychiatric Institute, New York, NY, USA
- Department of Neuroscience, Kavli Neuroscience Institute, Columbia University College of Physicians and Surgeons, New York, NY, USA
- Departments of Neurology, Psychiatry, and Ophthalmology, Columbia University College of Physicians and Surgeons, New York, NY, USA
| |
Collapse
|
41
|
Drummond L, Shomstein S. The timecourse of space- and object-based attentional prioritization with varying degrees of certainty. Front Integr Neurosci 2013; 7:88. [PMID: 24367302 PMCID: PMC3851778 DOI: 10.3389/fnint.2013.00088] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2013] [Accepted: 11/19/2013] [Indexed: 11/23/2022] Open
Abstract
The relative contributions of objects (i.e., object-based) and underlying spatial (i.e., space-based representations) to attentional prioritization and selection remain unclear. In most experimental circumstances, the two representations overlap thus their respective contributions cannot be evaluated. Here, a dynamic version of the two-rectangle paradigm allowed for a successful de-coupling of spatial and object representations. Space-based (cued spatial location), cued end of the object, and object-based (locations within the cued object) effects were sampled at several timepoints following the cue with high or low certainty as to target location. In the high uncertainty condition spatial benefits prevailed throughout most of the timecourse, as evidenced by facilitatory and inhibitory effects. Additionally, the cued end of the object, rather than a whole object, received the attentional benefit. When target location was predictable (low uncertainty manipulation), only probabilities guided selection (i.e., evidence by a benefit for the statistically biased location). These results suggest that with high spatial uncertainty, all available information present within the stimulus display is used for the purposes of attentional selection (e.g., spatial locations, cued end of the object) albeit to varying degrees and at different time points. However, as certainty increases, only spatial certainty guides selection (i.e., object ends and whole objects are filtered out). Taken together, these results further elucidate the contributing role of space- and object-representations to attentional guidance.
Collapse
Affiliation(s)
- Leslie Drummond
- Department of Psychology, George Washington University Washington, DC, USA
| | - Sarah Shomstein
- Department of Psychology, George Washington University Washington, DC, USA
| |
Collapse
|
42
|
Production, control, and visual guidance of saccadic eye movements. ISRN NEUROLOGY 2013; 2013:752384. [PMID: 24260720 PMCID: PMC3821953 DOI: 10.1155/2013/752384] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/30/2013] [Accepted: 08/29/2013] [Indexed: 11/21/2022]
Abstract
Primate vision is served by rapid shifts of gaze called saccades. This review will survey current knowledge and particular problems concerning the neural control and guidance of gaze shifts.
Collapse
|
43
|
Jonikaitis D, Theeuwes J. Dissociating oculomotor contributions to spatial and feature-based selection. J Neurophysiol 2013; 110:1525-34. [DOI: 10.1152/jn.00275.2013] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Saccades not only deliver the high-resolution retinal image requisite for visual perception, but processing stages associated with saccade target selection affect visual perception even before the eye movement starts. These presaccadic effects are thought to arise from two visual selection mechanisms: spatial selection that enhances processing of the saccade target location and feature-based selection that enhances processing of the saccade target features. By measuring oculomotor performance and perceptual discrimination, we determined which selection mechanisms are associated with saccade preparation. We observed both feature-based and space-based selection during saccade preparation but found that feature-based selection was neither related to saccade initiation nor was it affected by simultaneously observed redistribution of spatial selection. We conclude that oculomotor selection biases visual selection only in a spatial, feature-unspecific manner.
Collapse
Affiliation(s)
- Donatas Jonikaitis
- Allgemeine und Experimentelle Psychologie, Ludwig-Maximilians Universität München, Munich, Germany; and
- Department of Cognitive Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Jan Theeuwes
- Department of Cognitive Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
44
|
Mirpour K, Bisley JW. Evidence for differential top-down and bottom-up suppression in posterior parietal cortex. Philos Trans R Soc Lond B Biol Sci 2013; 368:20130069. [PMID: 24018730 DOI: 10.1098/rstb.2013.0069] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022] Open
Abstract
When searching for an object, we usually avoid items that are visually different from the target and objects or places that have been searched already. Previous studies have shown that neural activity in the lateral intraparietal area (LIP) can be used to guide this behaviour; responses to task irrelevant stimuli or to stimuli that have been fixated previously in the trial are reduced compared with responses to potential targets. Here, we test the hypothesis that these reduced responses have a different genesis. Two animals were trained on a visual foraging task, in which they had to find a target among a number of physically identical potential targets (T) and task irrelevant distractors. We recorded neural activity and local field potentials (LFPs) in LIP while the animals performed the task. We found that LFP power was similar for potential targets and distractors but was greater in the alpha and low beta bands when a previously fixated T was in the response field. We interpret these data to suggest that the reduced single-unit response to distractors is a bottom-up feed-forward result of processing in earlier areas and the reduced response to previously fixated Ts is a result of active top-down suppression.
Collapse
Affiliation(s)
- Koorosh Mirpour
- Department of Neurobiology, David Geffen School of Medicine, University of California, Los Angeles, , Los Angeles, CA 90095, USA
| | | |
Collapse
|
45
|
Kubanek J, Wang C, Snyder LH. Neuronal responses to target onset in oculomotor and somatomotor parietal circuits differ markedly in a choice task. J Neurophysiol 2013; 110:2247-56. [PMID: 23966670 DOI: 10.1152/jn.00968.2012] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
We often look at and sometimes reach for visible targets. Looking at a target is fast and relatively easy. By comparison, reaching for an object is slower and is associated with a larger cost. We hypothesized that, as a result of these differences, abrupt visual onsets may drive the circuits involved in saccade planning more directly and with less intermediate regulation than the circuits involved in reach planning. To test this hypothesis, we recorded discharge activity of neurons in the parietal oculomotor system (area LIP) and in the parietal somatomotor system (area PRR) while monkeys performed a visually guided movement task and a choice task. We found that in the visually guided movement task LIP neurons show a prominent transient response to target onset. PRR neurons also show a transient response, although this response is reduced in amplitude, is delayed, and has a slower rise time compared with LIP. A more striking difference is observed in the choice task. The transient response of PRR neurons is almost completely abolished and replaced with a slow buildup of activity, while the LIP response is merely delayed and reduced in amplitude. Our findings suggest that the oculomotor system is more closely and obligatorily coupled to the visual system, whereas the somatomotor system operates in a more discriminating manner.
Collapse
Affiliation(s)
- J Kubanek
- Department of Anatomy and Neurobiology, Washington University School of Medicine, St. Louis, Missouri; and
| | | | | |
Collapse
|
46
|
Jerde TA, Curtis CE. Maps of space in human frontoparietal cortex. ACTA ACUST UNITED AC 2013; 107:510-6. [PMID: 23603831 DOI: 10.1016/j.jphysparis.2013.04.002] [Citation(s) in RCA: 50] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2013] [Revised: 04/09/2013] [Accepted: 04/10/2013] [Indexed: 11/15/2022]
Abstract
Prefrontal cortex (PFC) and posterior parietal cortex (PPC) are neural substrates for spatial cognition. We here review studies in which we tested the hypothesis that human frontoparietal cortex may function as a priority map. According to priority map theory, objects or locations in the visual world are represented by neural activity that is proportional to their attentional priority. Using functional magnetic resonance imaging (fMRI), we first identified topographic maps in PFC and PPC as candidate priority maps of space. We then measured fMRI activity in candidate priority maps during the delay periods of a covert attention task, a spatial working memory task, and a motor planning task to test whether the activity depended on the particular spatial cognition. Our hypothesis was that some, but not all, candidate priority maps in PFC and PPC would be agnostic with regard to what was being prioritized, in that their activity would reflect the location in space across tasks rather than a particular kind of spatial cognition (e.g., covert attention). To test whether patterns of delay period activity were interchangeable during the spatial cognitive tasks, we used multivariate classifiers. We found that decoders trained to predict the locations on one task (e.g., working memory) cross-predicted the locations on the other tasks (e.g., covert attention and motor planning) in superior precentral sulcus (sPCS) and in a region of intraparietal sulcus (IPS2), suggesting that these patterns of maintenance activity may be interchangeable across the tasks. Such properties make sPCS in frontal cortex and IPS2 in parietal cortex viable priority map candidates, and suggest that these areas may be the human homologs of the monkey frontal eye field (FEF) and lateral intraparietal area (LIP).
Collapse
Affiliation(s)
- Trenton A Jerde
- Center for Cognitive Sciences, University of Minnesota, 75 East River Road, Minneapolis, MN 55455-0366, USA.
| | | |
Collapse
|
47
|
Signal multiplexing and single-neuron computations in lateral intraparietal area during decision-making. J Neurosci 2013; 33:2254-67. [PMID: 23392657 DOI: 10.1523/jneurosci.2984-12.2013] [Citation(s) in RCA: 120] [Impact Index Per Article: 10.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Previous work has revealed a remarkably direct neural correlate of decisions in the lateral intraparietal area (LIP). Specifically, firing rate has been observed to ramp up or down in a manner resembling the accumulation of evidence for a perceptual decision reported by making a saccade into (or away from) the neuron's response field (RF). However, this link between LIP response and decision formation emerged from studies where a saccadic target was always stimulating the RF during decisions, and where the neural correlate was the averaged activity of a restricted sample of neurons. Because LIP cells are (1) highly responsive to the presence of a visual stimulus in the RF, (2) heterogeneous, and (3) not clearly anatomically segregated from large numbers of neurons that fail selection criteria, the underlying neuronal computations are potentially obscured. To address this, we recorded single neuron spiking activity in LIP during a well-studied moving-dot direction-discrimination task and manipulated whether a saccade target was present in the RF during decision-making. We also recorded from a broad sample of LIP neurons, including ones conventionally excluded in prior studies. Our results show that cells multiplex decision signals with decision-irrelevant visual signals. We also observed disparate, repeating response "motifs" across neurons that, when averaged together, resemble traditional ramping decision signals. In sum, neural responses in LIP simultaneously carry decision signals and decision-irrelevant sensory signals while exhibiting diverse dynamics that reveal a broader range of neural computations than previously entertained.
Collapse
|
48
|
Steenrod SC, Phillips MH, Goldberg ME. The lateral intraparietal area codes the location of saccade targets and not the dimension of the saccades that will be made to acquire them. J Neurophysiol 2013; 109:2596-605. [PMID: 23468388 DOI: 10.1152/jn.00349.2012] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Activity in the lateral intraparietal area (LIP) represents a priority map that can be used to direct attention and guide eye movements. However, it is not known whether this activity represents the location of saccade targets or the actual eye movement made to acquire them. We recorded single neurons from rhesus macaques (Macaca mulatta) while they performed memory-guided delayed saccades to characterize the response profiles of LIP cells. We then separated the saccade target from the saccade end point by saccadic adaptation, a method that induces a change in the gain of the oculomotor system. We plotted LIP activity for all three epochs of the memory-guided delayed-response task (visual, delay period, and presaccadic responses) as a function of target location and saccade end point. We found that under saccadic adaptation the response profile for all three epochs was unchanged as a function of target location. We conclude that neurons in LIP reliably represent the locations of saccade targets, not the amplitude of the saccade required to acquire those targets. Although LIP transmits target information to the motor system, that information represents the location of the target and not the amplitude of the saccade that the monkey will make.
Collapse
Affiliation(s)
- Sara C Steenrod
- Mahoney Center for Brain and Behavior, Department of Neuroscience, Columbia University College of Physicians and Surgeons, New York State Psychiatric Institute, New York, New York, USA.
| | | | | |
Collapse
|
49
|
Abstract
It has been suggested that one way we may create a stable percept of the visual world across multiple eye movements is to pass information from one set of neurons to another around the time of each eye movement. Previous studies have shown that some neurons in the lateral intraparietal area (LIP) exhibit anticipatory remapping: these neurons produce a visual response to a stimulus that will enter their receptive field after a saccade but before it actually does so. LIP responses during fixation are thought to represent attentional priority, behavioral relevance, or value. In this study, we test whether the remapped response represents this attentional priority by examining the activity of LIP neurons while animals perform a visual foraging task. We find that the population responds more to a target than to a distractor before the saccade even begins to bring the stimulus into the receptive field. Within 20 ms of the saccade ending, the responses in almost one-third of LIP neurons closely resemble the responses that will emerge during stable fixation. Finally, we show that, in these neurons and in the population as a whole, this remapping occurs for all stimuli in all locations across the visual field and for both long and short saccades. We conclude that this complete remapping of attentional priority across the visual field could underlie spatial stability across saccades.
Collapse
|
50
|
Huk AC, Meister MLR. Neural correlates and neural computations in posterior parietal cortex during perceptual decision-making. Front Integr Neurosci 2012; 6:86. [PMID: 23087623 PMCID: PMC3467999 DOI: 10.3389/fnint.2012.00086] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2012] [Accepted: 09/11/2012] [Indexed: 11/13/2022] Open
Abstract
A recent line of work has found remarkable success in relating perceptual decision-making and the spiking activity in the macaque lateral intraparietal area (LIP). In this review, we focus on questions about the neural computations in LIP that are not answered by demonstrations of neural correlates of psychological processes. We highlight three areas of limitations in our current understanding of the precise neural computations that might underlie neural correlates of decisions: (1) empirical questions not yet answered by existing data; (2) implementation issues related to how neural circuits could actually implement the mechanisms suggested by both extracellular neurophysiology and psychophysics; and (3) ecological constraints related to the use of well-controlled laboratory tasks and whether they provide an accurate window on sensorimotor computation. These issues motivate the adoption of a more general "encoding-decoding framework" that will be fruitful for more detailed contemplation of how neural computations in LIP relate to the formation of perceptual decisions.
Collapse
Affiliation(s)
- Alexander C. Huk
- Center for Perceptual Systems, Institute for Neuroscience, Neurobiology, and Psychology, The University of Texas at AustinAustin, TX, USA
| | | |
Collapse
|