1
|
Conroy C, Nanjappa R, McPeek RM. Inhibitory tagging in the superior colliculus during visual search. J Neurophysiol 2023; 130:824-837. [PMID: 37671440 PMCID: PMC10637734 DOI: 10.1152/jn.00095.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Revised: 08/29/2023] [Accepted: 08/30/2023] [Indexed: 09/07/2023] Open
Abstract
Inhibitory tagging is an important feature of many models of saccade target selection, in particular those that are based on the notion of a neural priority map. The superior colliculus (SC) has been suggested as a potential site of such a map, yet it is unknown whether inhibitory tagging is represented in the SC during visual search. In this study, we tested the hypothesis that SC neurons represent inhibitory tagging during search, as might be expected if they contribute to a priority map. To do so, we recorded the activity of SC neurons in a multisaccade visual-search task. On each trial, a single reward-bearing target was embedded in an array of physically identical, potentially reward-bearing targets and physically distinct, non-reward-bearing distractors. The task was to fixate the reward-bearing target. We found that, in the context of this task, the activity of many SC neurons was greater when their response field stimulus was a target than when it was a distractor and was reduced when it had been previously fixated relative to when it had not. Moreover, we found that the previous-fixation-related reduction of activity was larger for targets than for distractors and decreased with increasing time (or number of saccades) since fixation. Taken together, the results suggest that fixated stimuli are transiently inhibited in the SC during search, consistent with the notion that inhibitory tagging plays an important role in visual search and that SC neurons represent this inhibition as part of a priority map used for saccade target selection.NEW & NOTEWORTHY Searching a cluttered scene for an object of interest is a ubiquitous task in everyday life, which we often perform relatively quickly and efficiently. It has been suggested that to achieve such speed and efficiency an inhibitory-tagging mechanism inhibits saccades to objects in the scene once they have been searched and rejected. Here, we demonstrate that the superior colliculus represents this type of inhibition during search, consistent with its role in saccade target selection.
Collapse
Affiliation(s)
- Christopher Conroy
- Department of Biological and Vision Sciences, SUNY College of Optometry, New York, New York, United States
| | - Rakesh Nanjappa
- Department of Biological and Vision Sciences, SUNY College of Optometry, New York, New York, United States
- School of Medical and Allied Sciences, G D Goenka University, Gurugram, India
| | - Robert M McPeek
- Department of Biological and Vision Sciences, SUNY College of Optometry, New York, New York, United States
| |
Collapse
|
2
|
Nadezhda M, Dovbnyuk K, Merzon L, MacInnes WJ. Between the Scenes. Exp Psychol 2022; 69:185-195. [PMID: 36305454 PMCID: PMC9730397 DOI: 10.1027/1618-3169/a000556] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
We constantly move our eyes to new information while inspecting a scene, but these patterns of eye movements change based on the task and goals of the observer. Inhibition of return (IOR) may facilitate visual search by reducing the likelihood of revisiting previously attended locations. However, IOR may present in any visual task, or it may be search-specific. We investigated the presence of IOR in foraging, memorization, change detection, and two versions of visual search. One version of search used a static search array that remained stable throughout the trial, but the second used a scene flickering paradigm similar to the change detection task. IOR was observed in both versions of visual search, memorization, and foraging, but not in change detection. Visual search and change detection both had temporal nonscene components, and we observed that IOR could be maintained despite the scene removal but only for search. Although IOR is maintained in scene coordinates, short disruptions to this scene are insufficient to completely remove the inhibitory tags. Finally, we compare return saccades in trials without a probe and observe fewer return saccades in tasks for which IOR was observed, providing further evidence that IOR might serve as a novelty drive.
Collapse
Affiliation(s)
| | | | - Liya Merzon
- Department of Neuroscience and Biomedical Engineering, Aalto University, Aalto, Finland
| | - W. Joseph MacInnes
- Department of Psychology, Vision Modelling Laboratory, HSE University, Moscow, Russian Federation,Department of Computer Science, Swansea University, Swansea, UK,W. Joseph MacInnes, Department of Psychology, Vision Modelling Laboratory, HSE University, 20 Myasnitskaya, 10100 Moscow, Russian Federation,
| |
Collapse
|
3
|
Almubark I, Chang LC, Shattuck KF, Nguyen T, Turner RS, Jiang X. A 5-min Cognitive Task With Deep Learning Accurately Detects Early Alzheimer's Disease. Front Aging Neurosci 2020; 12:603179. [PMID: 33343337 PMCID: PMC7744695 DOI: 10.3389/fnagi.2020.603179] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2020] [Accepted: 11/13/2020] [Indexed: 12/15/2022] Open
Abstract
Introduction: The goal of this study was to investigate and compare the classification performance of machine learning with behavioral data from standard neuropsychological tests, a cognitive task, or both. Methods: A neuropsychological battery and a simple 5-min cognitive task were administered to eight individuals with mild cognitive impairment (MCI), eight individuals with mild Alzheimer's disease (AD), and 41 demographically match controls (CN). A fully connected multilayer perceptron (MLP) network and four supervised traditional machine learning algorithms were used. Results: Traditional machine learning algorithms achieved similar classification performances with neuropsychological or cognitive data. MLP outperformed traditional algorithms with the cognitive data (either alone or together with neuropsychological data), but not neuropsychological data. In particularly, MLP with a combination of summarized scores from neuropsychological tests and the cognitive task achieved ~90% sensitivity and ~90% specificity. Applying the models to an independent dataset, in which the participants were demographically different from the ones in the main dataset, a high specificity was maintained (100%), but the sensitivity was dropped to 66.67%. Discussion: Deep learning with data from specific cognitive task(s) holds promise for assisting in the early diagnosis of Alzheimer's disease, but future work with a large and diverse sample is necessary to validate and to improve this approach.
Collapse
Affiliation(s)
- Ibrahim Almubark
- Department of Electrical Engineering and Computer Science, Catholic University of America, Washington, DC, United States
| | - Lin-Ching Chang
- Department of Electrical Engineering and Computer Science, Catholic University of America, Washington, DC, United States
| | - Kyle F Shattuck
- Department of Neuroscience, Georgetown University Medical Center, Washington, DC, United States
| | - Thanh Nguyen
- Department of Electrical Engineering and Computer Science, Catholic University of America, Washington, DC, United States
| | - Raymond Scott Turner
- Department of Neurology, Georgetown University Medical Center, Washington, DC, United States
| | - Xiong Jiang
- Department of Neuroscience, Georgetown University Medical Center, Washington, DC, United States
| |
Collapse
|
4
|
Lowe KA, Reppert TR, Schall JD. Selective Influence and Sequential Operations: A Research Strategy for Visual Search. VISUAL COGNITION 2019; 27:387-415. [PMID: 32982561 PMCID: PMC7518653 DOI: 10.1080/13506285.2019.1659896] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2019] [Accepted: 08/17/2019] [Indexed: 10/26/2022]
Abstract
We discuss the problem of elucidating mechanisms of visual search. We begin by considering the history, logic, and methods of relating behavioral or cognitive processes with neural processes. We then survey briefly the cognitive neurophysiology of visual search and essential aspects of the neural circuitry supporting this capacity. We introduce conceptually and empirically a powerful but underutilized experimental approach to dissect the cognitive processes supporting performance of a visual search task with factorial manipulations of singleton-distractor identifiability and stimulus-response cue discriminability. We show that systems factorial technology can distinguish processing architectures from the performance of macaque monkeys. This demonstration offers new opportunities to distinguish neural mechanisms through selective manipulation of visual encoding, search selection, rule encoding, and stimulus-response mapping.
Collapse
Affiliation(s)
- Kaleb A Lowe
- Department of Psychology, Vanderbilt University, Center for Integrative and Cognitive Neuroscience, Vanderbilt Vision Research Center
| | - Thomas R Reppert
- Department of Psychology, Vanderbilt University, Center for Integrative and Cognitive Neuroscience, Vanderbilt Vision Research Center
| | - Jeffrey D Schall
- Department of Psychology, Vanderbilt University, Center for Integrative and Cognitive Neuroscience, Vanderbilt Vision Research Center
| |
Collapse
|
5
|
Phillmore LS, Klein RM. The puzzle of spontaneous alternation and inhibition of return: How they might fit together. Hippocampus 2019; 29:762-770. [PMID: 31157942 DOI: 10.1002/hipo.23102] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2019] [Revised: 05/06/2019] [Accepted: 05/11/2019] [Indexed: 11/11/2022]
Abstract
Two isolated spatial phenomena share a similar "been there; done that" effect on spatial behavior. Originally discovered in rodent learning experiments, spontaneous alternation is a tendency for the organism to visit a different arm in a T-maze on subsequent trials. Originally discovered in human studies of attention, inhibition of return is a tendency for the organism to orient away from a previously attended location. Whereas spontaneous alternation was identified by O'Keefe & Nadel as dependent on an intact hippocampus, inhibition of return is dependent on neural structures that participate in oculomotor control (the superior colliculus, parietal and frontal cortex). Despite the isolated literatures, each phenomenon has been assumed to reflect a basic novelty-seeking process, avoiding places previously visited or locations attended. In this commentary, we explore and compare the behavioral manifestations and neural underpinnings of these two phenomena, and suggest what is still needed to determine whether they operate in parallel or serial.
Collapse
Affiliation(s)
- Leslie S Phillmore
- Department of Psychology and Neuroscience, Dalhousie University, Halifax, Nova Scotia, Canada
| | - Raymond M Klein
- Department of Psychology and Neuroscience, Dalhousie University, Halifax, Nova Scotia, Canada
| |
Collapse
|
6
|
Neurons in FEF Keep Track of Items That Have Been Previously Fixated in Free Viewing Visual Search. J Neurosci 2019; 39:2114-2124. [PMID: 30647149 DOI: 10.1523/jneurosci.1767-18.2018] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2018] [Revised: 11/30/2018] [Accepted: 12/02/2018] [Indexed: 11/21/2022] Open
Abstract
When searching a visual scene for a target, we tend not to look at items or locations we have already searched. It is thought that this behavior is driven by an inhibitory tagging mechanism that inhibits responses on priority maps to the relevant items. We hypothesized that this inhibitory tagging signal should be represented as an elevated response in neurons that keep track of stimuli that have been fixated. We recorded from 231 neurons in the frontal eye field (FEF) of 2 male animals performing a visual foraging task, in which they had to find a reward linked to one of five identical targets (Ts) among five distractors. We identified 38 neurons with activity that was significantly greater when the stimulus in the receptive field had been fixated previously in the trial than when it had not been fixated. The response to a fixated object began before the saccade ended, suggesting that this information is remapped. Unlike most FEF neurons, the activity in these cells was not suppressed during active fixation, had minimal motor responses, and did not change through the trial. Yet using traditional classifications from a memory-guided saccade, they were indistinguishable from the rest of the FEF population. We propose that these neurons keep track of any items that have been fixated within the trial and this signal is propagated by remapping. These neurons could be the source of the inhibitory tagging signal to parietal cortex, where a neuronal instantiation of inhibitory tagging is seen.SIGNIFICANCE STATEMENT When we search a scene for an item, we rarely examine the same location twice. It is thought that this is due to a neural mechanism that keeps track of the items at which we have looked. Here we identified a subset of neurons in the frontal eye field that preferentially responded to items that had been fixated earlier in the trial. These responses were remapped, appearing before the saccade even ended, and were not suppressed during maintained fixation. We propose that these neurons keep track of which items have been examined in search and could be the source of feedback that creates the inhibitory tagging seen in parietal cortex.
Collapse
|
7
|
Meister MLR, Buffalo EA. Getting directions from the hippocampus: The neural connection between looking and memory. Neurobiol Learn Mem 2016; 134 Pt A:135-144. [PMID: 26743043 PMCID: PMC4927424 DOI: 10.1016/j.nlm.2015.12.004] [Citation(s) in RCA: 51] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2015] [Revised: 12/12/2015] [Accepted: 12/16/2015] [Indexed: 01/29/2023]
Abstract
Investigations into the neural basis of memory in human and non-human primates have focused on the hippocampus and associated medial temporal lobe (MTL) structures. However, how memory signals from the hippocampus affect motor actions is unknown. We propose that approaching this question through eye movement, especially by assessing the changes in looking behavior that occur with experience, is a promising method for exposing neural computations within the hippocampus. Here, we review how looking behavior is guided by memory in several ways, some of which have been shown to depend on the hippocampus, and how hippocampal neural signals are modulated by eye movements. Taken together, these findings highlight the need for future research on how MTL structures interact with the oculomotor system. Probing how the hippocampus reflects and impacts motor output during looking behavior renders a practical path to advance our understanding of the hippocampal memory system.
Collapse
Affiliation(s)
- Miriam L R Meister
- Department of Physiology and Biophysics, University of Washington, USA; Washington National Primate Research Center, USA; University of Washington School of Medicine, USA
| | - Elizabeth A Buffalo
- Department of Physiology and Biophysics, University of Washington, USA; Washington National Primate Research Center, USA; University of Washington School of Medicine, USA
| |
Collapse
|
8
|
|
9
|
Mirpour K, Bisley JW. Evidence for differential top-down and bottom-up suppression in posterior parietal cortex. Philos Trans R Soc Lond B Biol Sci 2013; 368:20130069. [PMID: 24018730 DOI: 10.1098/rstb.2013.0069] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022] Open
Abstract
When searching for an object, we usually avoid items that are visually different from the target and objects or places that have been searched already. Previous studies have shown that neural activity in the lateral intraparietal area (LIP) can be used to guide this behaviour; responses to task irrelevant stimuli or to stimuli that have been fixated previously in the trial are reduced compared with responses to potential targets. Here, we test the hypothesis that these reduced responses have a different genesis. Two animals were trained on a visual foraging task, in which they had to find a target among a number of physically identical potential targets (T) and task irrelevant distractors. We recorded neural activity and local field potentials (LFPs) in LIP while the animals performed the task. We found that LFP power was similar for potential targets and distractors but was greater in the alpha and low beta bands when a previously fixated T was in the response field. We interpret these data to suggest that the reduced single-unit response to distractors is a bottom-up feed-forward result of processing in earlier areas and the reduced response to previously fixated Ts is a result of active top-down suppression.
Collapse
Affiliation(s)
- Koorosh Mirpour
- Department of Neurobiology, David Geffen School of Medicine, University of California, Los Angeles, , Los Angeles, CA 90095, USA
| | | |
Collapse
|
10
|
Carrasco M, Eckstein M, Krauzlis R, Verghese P. Attentional modulation: target selection, active search and cognitive processing. Vision Res 2013; 85:1-4. [PMID: 23747085 DOI: 10.1016/j.visres.2013.05.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
11
|
Abstract
It has been suggested that one way we may create a stable percept of the visual world across multiple eye movements is to pass information from one set of neurons to another around the time of each eye movement. Previous studies have shown that some neurons in the lateral intraparietal area (LIP) exhibit anticipatory remapping: these neurons produce a visual response to a stimulus that will enter their receptive field after a saccade but before it actually does so. LIP responses during fixation are thought to represent attentional priority, behavioral relevance, or value. In this study, we test whether the remapped response represents this attentional priority by examining the activity of LIP neurons while animals perform a visual foraging task. We find that the population responds more to a target than to a distractor before the saccade even begins to bring the stimulus into the receptive field. Within 20 ms of the saccade ending, the responses in almost one-third of LIP neurons closely resemble the responses that will emerge during stable fixation. Finally, we show that, in these neurons and in the population as a whole, this remapping occurs for all stimuli in all locations across the visual field and for both long and short saccades. We conclude that this complete remapping of attentional priority across the visual field could underlie spatial stability across saccades.
Collapse
|