1
|
Block N. What does decoding from the PFC reveal about consciousness? Trends Cogn Sci 2024:S1364-6613(24)00117-7. [PMID: 38862352 DOI: 10.1016/j.tics.2024.05.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Revised: 05/12/2024] [Accepted: 05/12/2024] [Indexed: 06/13/2024]
Abstract
Disputes between rival theories of consciousness have often centered on whether perceptual contents can be decoded from the prefrontal cortex (PFC). Failures to decode from the PFC are taken to challenge 'cognitive' theories of consciousness such as the global workspace theory and higher-order monitoring theories, and decoding successes have been taken to confirm these theories. However, PFC decoding shows both too much and too little. Too much because cognitive theories of consciousness do not need PFC rerepresentation of perceptual contents since pointers to perceptual representations suffice. Too little because there is evidence that PFC decoding of perceptual content reflects postperceptual cognitive representation, such as thoughts that have those perceptual contents rather than conscious percepts.
Collapse
Affiliation(s)
- Ned Block
- New York University, 5 Washington Place, New York, NY 10003, USA.
| |
Collapse
|
2
|
Csorba BA, Krause MR, Zanos TP, Pack CC. Long-range cortical synchronization supports abrupt visual learning. Curr Biol 2022; 32:2467-2479.e4. [PMID: 35523181 DOI: 10.1016/j.cub.2022.04.029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2021] [Revised: 03/08/2022] [Accepted: 04/12/2022] [Indexed: 11/29/2022]
Abstract
Visual plasticity declines sharply after the critical period, yet we easily learn to recognize new faces and places, even as adults. Such learning is often characterized by a "moment of insight," an abrupt and dramatic improvement in recognition. The mechanisms that support abrupt learning are unknown, but one hypothesis is that they involve changes in synchronization between brain regions. To test this hypothesis, we used a behavioral task in which non-human primates rapidly learned to recognize novel images and to associate them with specific responses. Simultaneous recordings from inferotemporal and prefrontal cortices revealed a transient synchronization of neural activity between these areas that peaked around the moment of insight. Synchronization was strongest between inferotemporal sites that encoded images and reward-sensitive prefrontal sites. Moreover, its magnitude intensified gradually over image exposures, suggesting that abrupt learning is the culmination of a search for informative signals within a circuit linking sensory information to task demands.
Collapse
Affiliation(s)
- Bennett A Csorba
- Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada.
| | - Matthew R Krause
- Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada
| | | | - Christopher C Pack
- Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada
| |
Collapse
|
3
|
Schartner MM, Timmermann C. Neural network models for DMT-induced visual hallucinations. Neurosci Conscious 2020; 2020:niaa024. [PMID: 33343929 PMCID: PMC7734438 DOI: 10.1093/nc/niaa024] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2020] [Revised: 08/10/2020] [Accepted: 10/03/2020] [Indexed: 01/21/2023] Open
Abstract
The regulatory role of the serotonergic system on conscious perception can be investigated perturbatorily with psychedelic drugs such as N,N-Dimethyltryptamine. There is increasing evidence that the serotonergic system gates prior (endogenous) and sensory (exogenous) information in the construction of a conscious experience. Using two generative deep neural networks as examples, we discuss how such models have the potential to be, firstly, an important medium to illustrate phenomenological visual effects of psychedelics-besides paintings, verbal reports and psychometric testing-and, secondly, their utility to conceptualize biological mechanisms of gating the influence of exogenous and endogenous information on visual perception.
Collapse
Affiliation(s)
- Michael M Schartner
- Département des Neurosciences Fondamentales, Université de Genève Rue Michel Servet 1 CH-1211 Geneva Switzerland
| | - Christopher Timmermann
- Department of Medicine, Centre for Psychedelic Research, Division of Brain Sciences, Imperial College London, UK The Commonwealth Building, The Hammersmith Hospital, Du Cane Road, London W12 0NN
- Computational, Cognitive and Clinical Neuroscience Laboratory (C3NL), Department of Medicine, Imperial College London, UK Burlington Danes Building Hammersmith Hospital Du Cane Road London W12 0NN
| |
Collapse
|
4
|
Hesse JK, Tsao DY. The macaque face patch system: a turtle’s underbelly for the brain. Nat Rev Neurosci 2020; 21:695-716. [DOI: 10.1038/s41583-020-00393-w] [Citation(s) in RCA: 38] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/30/2020] [Indexed: 02/06/2023]
|
5
|
|
6
|
Li S, Chen S, Zhang H, Zhao Q, Zhou Z, Huang F, Sui D, Wang F, Hong J. Dynamic cognitive processes of text-picture integration revealed by event-related potentials. Brain Res 2019; 1726:146513. [PMID: 31669828 DOI: 10.1016/j.brainres.2019.146513] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2019] [Revised: 09/17/2019] [Accepted: 10/15/2019] [Indexed: 11/30/2022]
Abstract
The integration of text and picture is the core of multimedia information processing. Relevant theories suggest that text and picture are processed through different channels in the early stage, and integrated in the late stage of processing. Based on these theories, the current study adopted measures of event-related potentials to examine the cognitive and neural processes of text-picture integration. The results showed that in the early stage of text-picture integration, picture processing evoked a more negative N1 over the occipital area and a N300 over the prefrontal area, which might reflect the discrimination process of visual stimuli and the imagery representation of the picture, respectively; in the late stage, the text-picture induced a N400 in the central area and an LPC over the central, parietal and temporal areas, which might be associated with the semantic activation and integration of text and picture, respectively. These results not only provide support for existing theories, but also further elucidate the dynamic neural processing of text-picture integration in terms of its temporal and spatial characteristics.
Collapse
Affiliation(s)
- Songqing Li
- Key Laboratory of Adolescent Cyberpsychology and Behavior (CCNU), Ministry of Education, Central China Normal University, Wuhan 430079, China; Key Laboratory of Human Development and Mental Health of Hubei Province, School of Psychology, Central China Normal University, Wuhan 430079, China
| | - Shi Chen
- Key Laboratory of Adolescent Cyberpsychology and Behavior (CCNU), Ministry of Education, Central China Normal University, Wuhan 430079, China; Key Laboratory of Human Development and Mental Health of Hubei Province, School of Psychology, Central China Normal University, Wuhan 430079, China
| | - Hongpo Zhang
- Key Laboratory of Adolescent Cyberpsychology and Behavior (CCNU), Ministry of Education, Central China Normal University, Wuhan 430079, China; Key Laboratory of Human Development and Mental Health of Hubei Province, School of Psychology, Central China Normal University, Wuhan 430079, China
| | - Qingbai Zhao
- Key Laboratory of Adolescent Cyberpsychology and Behavior (CCNU), Ministry of Education, Central China Normal University, Wuhan 430079, China; Key Laboratory of Human Development and Mental Health of Hubei Province, School of Psychology, Central China Normal University, Wuhan 430079, China.
| | - Zhijin Zhou
- Key Laboratory of Adolescent Cyberpsychology and Behavior (CCNU), Ministry of Education, Central China Normal University, Wuhan 430079, China; Key Laboratory of Human Development and Mental Health of Hubei Province, School of Psychology, Central China Normal University, Wuhan 430079, China.
| | - Furong Huang
- School of Psychology, Jiangxi Normal University, Nanchang 330022, China.
| | - Danni Sui
- School of Foreign Languages, Shenyang University, Shenyang 110044, China
| | - Fuxing Wang
- Key Laboratory of Adolescent Cyberpsychology and Behavior (CCNU), Ministry of Education, Central China Normal University, Wuhan 430079, China; Key Laboratory of Human Development and Mental Health of Hubei Province, School of Psychology, Central China Normal University, Wuhan 430079, China
| | - Jianzhong Hong
- Key Laboratory of Adolescent Cyberpsychology and Behavior (CCNU), Ministry of Education, Central China Normal University, Wuhan 430079, China; Key Laboratory of Human Development and Mental Health of Hubei Province, School of Psychology, Central China Normal University, Wuhan 430079, China.
| |
Collapse
|
7
|
Representation of abstract semantic knowledge in populations of human single neurons in the medial temporal lobe. PLoS Biol 2019; 17:e3000290. [PMID: 31158216 PMCID: PMC6564037 DOI: 10.1371/journal.pbio.3000290] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2018] [Revised: 06/13/2019] [Accepted: 05/10/2019] [Indexed: 11/23/2022] Open
Abstract
Sensory experience elicits complex activity patterns throughout the neocortex. Projections from the neocortex converge onto the medial temporal lobe (MTL), in which distributed neocortical firing patterns are distilled into sparse representations. The precise nature of these neuronal representations is still unknown. Here, we show that population activity patterns in the MTL are governed by high levels of semantic abstraction. We recorded human single-unit activity in the MTL (4,917 units, 25 patients) while subjects viewed 100 images grouped into 10 semantic categories of 10 exemplars each. High levels of semantic abstraction were indicated by representational similarity analyses (RSAs) of patterns elicited by individual stimuli. Moreover, pattern classifiers trained to decode semantic categories generalised successfully to unseen exemplars, and classifiers trained to decode exemplar identity more often confused exemplars of the same versus different categories. Semantic abstraction and generalisation may thus be key to efficiently distill the essence of an experience into sparse representations in the human MTL. Although semantic abstraction is efficient and may facilitate generalisation of knowledge to novel situations, it comes at the cost of a loss of detail and may be central to the generation of false memories. Single-neuron representations of stimuli in the human medial temporal lobe at the population level are governed by highly abstract semantic principles, but the attendant efficiency and potential for generalization comes at the cost of confusion between related stimuli. What is the neuronal code for sensory experience in the human medial temporal lobe (MTL)? Single-cell electrophysiology in the awake human brain during chronic, invasive epilepsy monitoring has previously revealed the existence of so-called concept cells. These cells have been found to increase their firing rate in response to, for example, the famous tennis player ‘Roger Federer’, whether his name is spoken by a computer voice or a picture of him is presented on a computer screen. These neurons thus seem to encode the semantic content of a stimulus, regardless of the sensory modality through which it is delivered. Previous work has predominantly focused on individual neurons that were selected based on their strong response to a particular stimulus using rather conservative statistical criteria. Those studies stressed that concept cells encode a single, concrete concept in an all-or-nothing fashion. Here, we analysed the neuronal code on the level of the entire population of neurons without any preselection. We conducted representational similarity analyses (RSAs) and pattern classification analyses of firing patterns evoked by visual stimuli (for example, a picture of an apple) that could be grouped into semantic categories on multiple levels of abstraction (‘fruit’, ‘food’, ‘natural things’). We found that neuronal activation patterns contain information on higher levels of categorical abstraction rather than just the level of individual exemplars. On the one hand, the neuronal code in the human MTL thus seems well suited to generalise semantic knowledge to new situations; on the other hand, it could also be responsible for the generation of false memories.
Collapse
|
8
|
Manohar SG, Zokaei N, Fallon SJ, Vogels TP, Husain M. Neural mechanisms of attending to items in working memory. Neurosci Biobehav Rev 2019; 101:1-12. [PMID: 30922977 PMCID: PMC6525322 DOI: 10.1016/j.neubiorev.2019.03.017] [Citation(s) in RCA: 73] [Impact Index Per Article: 14.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2019] [Revised: 03/18/2019] [Accepted: 03/23/2019] [Indexed: 02/03/2023]
Abstract
Working memory, the ability to keep recently accessed information available for immediate manipulation, has been proposed to rely on two mechanisms that appear difficult to reconcile: self-sustained neural firing, or the opposite-activity-silent synaptic traces. Here we review and contrast models of these two mechanisms, and then show that both phenomena can co-exist within a unified system in which neurons hold information in both activity and synapses. Rapid plasticity in flexibly-coding neurons allows features to be bound together into objects, with an important emergent property being the focus of attention. One memory item is held by persistent activity in an attended or "focused" state, and is thus remembered better than other items. Other, previously attended items can remain in memory but in the background, encoded in activity-silent synaptic traces. This dual functional architecture provides a unified common mechanism accounting for a diversity of perplexing attention and memory effects that have been hitherto difficult to explain in a single theoretical framework.
Collapse
Affiliation(s)
- Sanjay G Manohar
- Nuffield Department of Clinical Neurosciences, University of Oxford, OX3 9DU, United Kingdom.
| | - Nahid Zokaei
- Department of Experimental Psychology, University of Oxford, United Kingdom; Oxford Centre for Human Brain Activity, University of Oxford, United Kingdom
| | - Sean J Fallon
- Department of Experimental Psychology, University of Oxford, United Kingdom
| | - Tim P Vogels
- Centre for Neural Circuits and Behaviour, University of Oxford, United Kingdom
| | - Masud Husain
- Nuffield Department of Clinical Neurosciences, University of Oxford, OX3 9DU, United Kingdom; Department of Experimental Psychology, University of Oxford, United Kingdom
| |
Collapse
|
9
|
Elgueda D, Duque D, Radtke-Schuller S, Yin P, David SV, Shamma SA, Fritz JB. State-dependent encoding of sound and behavioral meaning in a tertiary region of the ferret auditory cortex. Nat Neurosci 2019; 22:447-459. [PMID: 30692690 PMCID: PMC6387638 DOI: 10.1038/s41593-018-0317-8] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2018] [Accepted: 12/05/2018] [Indexed: 12/26/2022]
Abstract
In higher sensory cortices, there is a gradual transformation from sensation to perception and action. In the auditory system, this transformation is revealed by responses in the rostral ventral posterior auditory field (VPr), a tertiary area in the ferret auditory cortex, which shows long-term learning in trained compared to naïve animals, arising from selectively enhanced responses to behaviorally relevant target stimuli. This enhanced representation is further amplified during active performance of spectral or temporal auditory discrimination tasks. VPr also shows sustained short-term memory activity after target stimulus offset, correlated with task response timing and action. These task-related changes in auditory filter properties enable VPr neurons to quickly and nimbly switch between different responses to the same acoustic stimuli, reflecting either spectrotemporal properties, timing, or behavioral meaning of the sound. Furthermore, they demonstrate an interaction between the dynamics of short-term attention and long-term learning, as incoming sound is selectively attended, recognized, and translated into action.
Collapse
Affiliation(s)
- Diego Elgueda
- Institute for Systems Research, Department of Electrical and Computer Engineering, University of Maryland, College Park, MD, USA
- Neuroscience and Cognitive Science Program, University of Maryland, College Park, MD, USA
| | - Daniel Duque
- Institute for Systems Research, Department of Electrical and Computer Engineering, University of Maryland, College Park, MD, USA
- Institut d'Investigacions Biomèdiques August Pi i Sunyer , Barcelona, Spain
| | - Susanne Radtke-Schuller
- Institute for Systems Research, Department of Electrical and Computer Engineering, University of Maryland, College Park, MD, USA
| | - Pingbo Yin
- Institute for Systems Research, Department of Electrical and Computer Engineering, University of Maryland, College Park, MD, USA
| | - Stephen V David
- Oregon Hearing Research Center, Oregon Health and Science University, Portland, OR, USA
| | - Shihab A Shamma
- Institute for Systems Research, Department of Electrical and Computer Engineering, University of Maryland, College Park, MD, USA
- Neuroscience and Cognitive Science Program, University of Maryland, College Park, MD, USA
- Laboratoire des Systèmes Perceptifs, École Normale Supérieure, Paris, France
| | - Jonathan B Fritz
- Institute for Systems Research, Department of Electrical and Computer Engineering, University of Maryland, College Park, MD, USA.
- Neuroscience and Cognitive Science Program, University of Maryland, College Park, MD, USA.
| |
Collapse
|
10
|
Lindsay GW, Miller KD. How biological attention mechanisms improve task performance in a large-scale visual system model. eLife 2018; 7:e38105. [PMID: 30272560 PMCID: PMC6207429 DOI: 10.7554/elife.38105] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2018] [Accepted: 09/28/2018] [Indexed: 11/13/2022] Open
Abstract
How does attentional modulation of neural activity enhance performance? Here we use a deep convolutional neural network as a large-scale model of the visual system to address this question. We model the feature similarity gain model of attention, in which attentional modulation is applied according to neural stimulus tuning. Using a variety of visual tasks, we show that neural modulations of the kind and magnitude observed experimentally lead to performance changes of the kind and magnitude observed experimentally. We find that, at earlier layers, attention applied according to tuning does not successfully propagate through the network, and has a weaker impact on performance than attention applied according to values computed for optimally modulating higher areas. This raises the question of whether biological attention might be applied at least in part to optimize function rather than strictly according to tuning. We suggest a simple experiment to distinguish these alternatives.
Collapse
Affiliation(s)
- Grace W Lindsay
- Center for Theoretical Neuroscience, College of Physicians and SurgeonsColumbia UniversityNew YorkUnited States
- Mortimer B. Zuckerman Mind Brain Behaviour InstituteColumbia UniversityNew YorkUnited States
| | - Kenneth D Miller
- Center for Theoretical Neuroscience, College of Physicians and SurgeonsColumbia UniversityNew YorkUnited States
- Mortimer B. Zuckerman Mind Brain Behaviour InstituteColumbia UniversityNew YorkUnited States
- Swartz Program in Theoretical NeuroscienceKavli Institute for Brain ScienceNew YorkUnited States
- Department of NeuroscienceColumbia UniversityNew YorkUnited States
| |
Collapse
|