1
|
Srivastava S, Wang WY, Eckstein MP. Emergent human-like covert attention in feedforward convolutional neural networks. Curr Biol 2024; 34:579-593.e12. [PMID: 38244541 DOI: 10.1016/j.cub.2023.12.058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2023] [Revised: 10/09/2023] [Accepted: 12/19/2023] [Indexed: 01/22/2024]
Abstract
Covert attention allows the selection of locations or features of the visual scene without moving the eyes. Cues and contexts predictive of a target's location orient covert attention and improve perceptual performance. The performance benefits are widely attributed to theories of covert attention as a limited resource, zoom, spotlight, or weighting of visual information. However, such concepts are difficult to map to neuronal populations. We show that a feedforward convolutional neural network (CNN) trained on images to optimize target detection accuracy and with no explicit incorporation of an attention mechanism, a limited resource, or feedback connections learns to utilize cues and contexts in the three most prominent covert attention tasks (Posner cueing, set size effects in search, and contextual cueing) and predicts the cue/context influences on human accuracy. The CNN's cueing/context effects generalize across network training schemes, to peripheral and central pre-cues, discrimination tasks, and reaction time measures, and critically do not vary with reductions in network resources (size). The CNN shows comparable cueing/context effects to a model that optimally uses image information to make decisions (Bayesian ideal observer) but generalizes these effects to cue instances unseen during training. Together, the findings suggest that human-like behavioral signatures of covert attention in the three landmark paradigms might be an emergent property of task accuracy optimization in neuronal populations without positing limited attentional resources. The findings might explain recent behavioral results showing cueing and context effects across a variety of simple organisms with no neocortex, from archerfish to fruit flies.
Collapse
Affiliation(s)
- Sudhanshu Srivastava
- Graduate Program in Dynamical Neuroscience, University of California, Santa Barbara, Santa Barbara, CA 93106, USA; Institute for Collaborative Biotechnologies, University of California, Santa Barbara, Santa Barbara, CA 93106, USA.
| | - William Yang Wang
- Department of Computer Science, University of California, Santa Barbara, Santa Barbara, CA 93106, USA; Institute for Collaborative Biotechnologies, University of California, Santa Barbara, Santa Barbara, CA 93106, USA.
| | - Miguel P Eckstein
- Graduate Program in Dynamical Neuroscience, University of California, Santa Barbara, Santa Barbara, CA 93106, USA; Department of Psychological and Brain Sciences, University of California, Santa Barbara, Santa Barbara, CA 93106, USA; Department of Computer Science, University of California, Santa Barbara, Santa Barbara, CA 93106, USA; Department of Electrical and Computer Engineering, University of California, Santa Barbara, Santa Barbara, CA 93106, USA; Institute for Collaborative Biotechnologies, University of California, Santa Barbara, Santa Barbara, CA 93106, USA.
| |
Collapse
|
2
|
Hahner L, Nieder A. Costs and benefits of voluntary attention in crows. ROYAL SOCIETY OPEN SCIENCE 2023; 10:230517. [PMID: 37593715 PMCID: PMC10427815 DOI: 10.1098/rsos.230517] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Accepted: 07/24/2023] [Indexed: 08/19/2023]
Abstract
Behavioural signatures of voluntary, endogenous selective attention have been found in both mammals and birds, but the relationship between performance benefits at attended and costs at unattended locations remains unclear. We trained two carrion crows (Corvus corone) on a Posner-like spatial cueing task with dissociated cue and target locations, using both highly predictive and neutral central cues to compare reaction time (RT) and detection accuracy for validly, invalidly and neutrally cued targets. We found robust RT effects of predictive cueing at varying stimulus-onset asynchronies (SOA) that resulted from both advantages at cued locations and costs at un-cued locations. Both crows showed cueing effects around 15-25 ms with an early onset at 100 ms SOA, comparable to macaques. Our results provide a direct assessment of costs and benefits of voluntary attention in a bird species. They show that crows are able to guide spatial attention using associative cues, and that the processing advantage at attended locations impairs performance at unattended locations.
Collapse
Affiliation(s)
- Linus Hahner
- Animal Physiology Unit, Institute of Neurobiology, University of Tübingen, 72076 Tübingen, Germany
| | - Andreas Nieder
- Animal Physiology Unit, Institute of Neurobiology, University of Tübingen, 72076 Tübingen, Germany
| |
Collapse
|
3
|
Parise AG, Oliveira TFDC, Debono MW, Souza GM. The Electrome of a Parasitic Plant in a Putative State of Attention Increases the Energy of Low Band Frequency Waves: A Comparative Study with Neural Systems. PLANTS (BASEL, SWITZERLAND) 2023; 12:2005. [PMID: 37653922 PMCID: PMC10224360 DOI: 10.3390/plants12102005] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 05/10/2023] [Accepted: 05/11/2023] [Indexed: 09/02/2023]
Abstract
Selective attention is an important cognitive phenomenon that allows organisms to flexibly engage with certain environmental cues or activities while ignoring others, permitting optimal behaviour. It has been proposed that selective attention can be present in many different animal species and, more recently, in plants. The phenomenon of attention in plants would be reflected in its electrophysiological activity, possibly being observable through electrophytographic (EPG) techniques. Former EPG time series obtained from the parasitic plant Cuscuta racemosa in a putative state of attention towards two different potential hosts, the suitable bean (Phaseolus vulgaris) and the unsuitable wheat (Triticum aestivum), were revisited. Here, we investigated the potential existence of different band frequencies (including low, delta, theta, mu, alpha, beta, and gamma waves) using a protocol adapted from neuroscientific research. Average band power (ABP) was used to analyse the energy distribution of each band frequency in the EPG signals, and time dispersion analysis of features (TDAF) was used to explore the variations in the energy of each band. Our findings indicated that most band waves were centred in the lower frequencies. We also observed that C. racemosa invested more energy in these low-frequency waves when suitable hosts were present. However, we also noted peaks of energy investment in all the band frequencies, which may be linked to extremely low oscillatory electrical signals in the entire tissue. Overall, the presence of suitable hosts induced a higher energy power, which supports the hypothesis of attention in plants. We further discuss and compare our results with generic neural systems.
Collapse
Affiliation(s)
| | - Thiago Francisco de Carvalho Oliveira
- Laboratory of Plant Cognition and Electrophysiology (LACEV), Department of Botany, Institute of Biology, Federal University of Pelotas, Capão do Leão 96160-000, RS, Brazil; (T.F.d.C.O.)
| | | | - Gustavo Maia Souza
- Laboratory of Plant Cognition and Electrophysiology (LACEV), Department of Botany, Institute of Biology, Federal University of Pelotas, Capão do Leão 96160-000, RS, Brazil; (T.F.d.C.O.)
| |
Collapse
|
4
|
Abstract
Attention describes the ability to selectively process a particular aspect of the environment at the expense of others. Despite the significance of selective processing, the types and scopes of attentional mechanisms in nonprimate species remain underexplored. We trained four carrion crows in Posner spatial cueing tasks using two separate protocols where the attention-capturing cues are shown at different times before target onset at either the same or a different location as the impending target. To probe automatic bottom-up, or exogenous, attention, two naïve crows were tested with a cue that had no predictive value concerning the location of the subsequent target. To examine volitional top-down, or endogenous, attention, the other two crows were tested with the previously learned cues that predicted the impending target location. Comparing the performance for valid (cue and target at same location) and invalid (cue and target at opposing locations) cues in the nonpredictive cue condition showed a transient, mild reaction time advantage signifying exogenous attention. In contrast, there was a strong and long-lasting performance advantage for the valid conditions with predictive cues indicating endogenous attention. Together, these results demonstrate that crows possess two different attention mechanisms (exogenous and endogenous). These findings signify that crows possess a substantial attentional capacity and robust cognitive control over attention allocation.
Collapse
|