1
|
Vogler NW, Chen R, Virkler A, Tu VY, Gottfried JA, Geffen MN. Direct piriform-to-auditory cortical projections shape auditory-olfactory integration. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.07.11.602976. [PMID: 39071445 PMCID: PMC11275881 DOI: 10.1101/2024.07.11.602976] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/30/2024]
Abstract
In a real-world environment, the brain must integrate information from multiple sensory modalities, including the auditory and olfactory systems. However, little is known about the neuronal circuits governing how odors influence and modulate sound processing. Here, we investigated the mechanisms underlying auditory-olfactory integration using anatomical, electrophysiological, and optogenetic approaches, focusing on the auditory cortex as a key locus for cross-modal integration. First, retrograde and anterograde viral tracing strategies revealed a direct projection from the piriform cortex to the auditory cortex. Next, using in vivo electrophysiological recordings of neuronal activity in the auditory cortex of awake mice, we found that odor stimuli modulate auditory cortical responses to sound. Finally, we used in vivo optogenetic manipulations during electrophysiology to demonstrate that olfactory modulation in auditory cortex, specifically, odor-driven enhancement of sound responses, depends on direct input from the piriform cortex. Together, our results identify a novel cortical circuit shaping olfactory modulation in the auditory cortex, shedding new light on the neuronal mechanisms underlying auditory-olfactory integration.
Collapse
Affiliation(s)
- Nathan W. Vogler
- Department of Otorhinolaryngology, Perelman School of Medicine, University of Pennsylvania
| | - Ruoyi Chen
- Department of Otorhinolaryngology, Perelman School of Medicine, University of Pennsylvania
| | - Alister Virkler
- Department of Neurology, Perelman School of Medicine, University of Pennsylvania
| | - Violet Y. Tu
- Department of Otorhinolaryngology, Perelman School of Medicine, University of Pennsylvania
| | - Jay A. Gottfried
- Department of Neurology, Perelman School of Medicine, University of Pennsylvania
| | - Maria N. Geffen
- Department of Otorhinolaryngology, Perelman School of Medicine, University of Pennsylvania
| |
Collapse
|
2
|
Peng B, Huang JJ, Li Z, Zhang LI, Tao HW. Cross-modal enhancement of defensive behavior via parabigemino-collicular projections. Curr Biol 2024:S0960-9822(24)00836-4. [PMID: 39019036 DOI: 10.1016/j.cub.2024.06.052] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Revised: 05/19/2024] [Accepted: 06/20/2024] [Indexed: 07/19/2024]
Abstract
Effective detection and avoidance from environmental threats are crucial for animals' survival. Integration of sensory cues associated with threats across different modalities can significantly enhance animals' detection and behavioral responses. However, the neural circuit-level mechanisms underlying the modulation of defensive behavior or fear response under simultaneous multimodal sensory inputs remain poorly understood. Here, we report in mice that bimodal looming stimuli combining coherent visual and auditory signals elicit more robust defensive/fear reactions than unimodal stimuli. These include intensified escape and prolonged hiding, suggesting a heightened defensive/fear state. These various responses depend on the activity of the superior colliculus (SC), while its downstream nucleus, the parabigeminal nucleus (PBG), predominantly influences the duration of hiding behavior. PBG temporally integrates visual and auditory signals and enhances the salience of threat signals by amplifying SC sensory responses through its feedback projection to the visual layer of the SC. Our results suggest an evolutionarily conserved pathway in defense circuits for multisensory integration and cross-modality enhancement.
Collapse
Affiliation(s)
- Bo Peng
- Zilkha Neurogenetic Institute, Center for Neural Circuits and Sensory Processing Disorders, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA; Neuroscience Graduate Program, University of Southern California, Los Angeles, CA 90089, USA
| | - Junxiang J Huang
- Zilkha Neurogenetic Institute, Center for Neural Circuits and Sensory Processing Disorders, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA; Graduate Program in Biomedical and Biological Sciences, University of Southern California, Los Angeles, CA 90033, USA
| | - Zhong Li
- Zilkha Neurogenetic Institute, Center for Neural Circuits and Sensory Processing Disorders, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA
| | - Li I Zhang
- Zilkha Neurogenetic Institute, Center for Neural Circuits and Sensory Processing Disorders, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA; Department of Physiology and Neuroscience, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA.
| | - Huizhong Whit Tao
- Zilkha Neurogenetic Institute, Center for Neural Circuits and Sensory Processing Disorders, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA; Department of Physiology and Neuroscience, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA.
| |
Collapse
|
3
|
Zou T, Li L, Huang X, Deng C, Wang X, Gao Q, Chen H, Li R. Dynamic causal modeling analysis reveals the modulation of motor cortex and integration in superior temporal gyrus during multisensory speech perception. Cogn Neurodyn 2024; 18:931-946. [PMID: 38826672 PMCID: PMC11143173 DOI: 10.1007/s11571-023-09945-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Revised: 02/03/2023] [Accepted: 02/10/2023] [Indexed: 03/06/2023] Open
Abstract
The processing of speech information from various sensory modalities is crucial for human communication. Both left posterior superior temporal gyrus (pSTG) and motor cortex importantly involve in the multisensory speech perception. However, the dynamic integration of primary sensory regions to pSTG and the motor cortex remain unclear. Here, we implemented a behavioral experiment of classical McGurk effect paradigm and acquired the task functional magnetic resonance imaging (fMRI) data during synchronized audiovisual syllabic perception from 63 normal adults. We conducted dynamic causal modeling (DCM) analysis to explore the cross-modal interactions among the left pSTG, left precentral gyrus (PrG), left middle superior temporal gyrus (mSTG), and left fusiform gyrus (FuG). Bayesian model selection favored a winning model that included modulations of connections to PrG (mSTG → PrG, FuG → PrG), from PrG (PrG → mSTG, PrG → FuG), and to pSTG (mSTG → pSTG, FuG → pSTG). Moreover, the coupling strength of the above connections correlated with behavioral McGurk susceptibility. In addition, significant differences were found in the coupling strength of these connections between strong and weak McGurk perceivers. Strong perceivers modulated less inhibitory visual influence, allowed less excitatory auditory information flowing into PrG, but integrated more audiovisual information in pSTG. Taken together, our findings show that the PrG and pSTG interact dynamically with primary cortices during audiovisual speech, and support the motor cortex plays a specifically functional role in modulating the gain and salience between auditory and visual modalities. Supplementary Information The online version contains supplementary material available at 10.1007/s11571-023-09945-z.
Collapse
Affiliation(s)
- Ting Zou
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for Neuroinformation, High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054 People’s Republic of China
| | - Liyuan Li
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for Neuroinformation, High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054 People’s Republic of China
| | - Xinju Huang
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for Neuroinformation, High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054 People’s Republic of China
| | - Chijun Deng
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for Neuroinformation, High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054 People’s Republic of China
| | - Xuyang Wang
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for Neuroinformation, High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054 People’s Republic of China
| | - Qing Gao
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for Neuroinformation, High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054 People’s Republic of China
| | - Huafu Chen
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for Neuroinformation, High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054 People’s Republic of China
| | - Rong Li
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for Neuroinformation, High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054 People’s Republic of China
| |
Collapse
|
4
|
Lemercier CE, Krieger P, Manahan-Vaughan D. Dynamic modulation of mouse thalamocortical visual activity by salient sounds. iScience 2024; 27:109364. [PMID: 38523779 PMCID: PMC10959669 DOI: 10.1016/j.isci.2024.109364] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Revised: 12/11/2023] [Accepted: 02/26/2024] [Indexed: 03/26/2024] Open
Abstract
Visual responses of the primary visual cortex (V1) are altered by sound. Sound-driven behavioral arousal suggests that, in addition to direct inputs from the primary auditory cortex (A1), multiple other sources may shape V1 responses to sound. Here, we show in anesthetized mice that sound (white noise, ≥70dB) drives a biphasic modulation of V1 visually driven gamma-band activity, comprising fast-transient inhibitory and slow, prolonged excitatory (A1-independent) arousal-driven components. An analogous yet quicker modulation of the visual response also occurred earlier in the visual pathway, at the level of the dorsolateral geniculate nucleus (dLGN), where sound transiently inhibited the early phasic visual response and subsequently induced a prolonged increase in tonic spiking activity and gamma rhythmicity. Our results demonstrate that sound-driven modulations of visual activity are not exclusive to V1 and suggest that thalamocortical inputs from the dLGN to V1 contribute to shaping V1 visual response to sound.
Collapse
Affiliation(s)
- Clément E. Lemercier
- Department of Neurophysiology, Medical Faculty, Ruhr-University Bochum, 44801 Bochum, Germany
| | - Patrik Krieger
- Department of Neurophysiology, Medical Faculty, Ruhr-University Bochum, 44801 Bochum, Germany
| | - Denise Manahan-Vaughan
- Department of Neurophysiology, Medical Faculty, Ruhr-University Bochum, 44801 Bochum, Germany
| |
Collapse
|
5
|
Oude Lohuis MN, Marchesi P, Olcese U, Pennartz CMA. Triple dissociation of visual, auditory and motor processing in mouse primary visual cortex. Nat Neurosci 2024; 27:758-771. [PMID: 38307971 DOI: 10.1038/s41593-023-01564-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Accepted: 12/19/2023] [Indexed: 02/04/2024]
Abstract
Primary sensory cortices respond to crossmodal stimuli-for example, auditory responses are found in primary visual cortex (V1). However, it remains unclear whether these responses reflect sensory inputs or behavioral modulation through sound-evoked body movement. We address this controversy by showing that sound-evoked activity in V1 of awake mice can be dissociated into auditory and behavioral components with distinct spatiotemporal profiles. The auditory component began at approximately 27 ms, was found in superficial and deep layers and originated from auditory cortex. Sound-evoked orofacial movements correlated with V1 neural activity starting at approximately 80-100 ms and explained auditory frequency tuning. Visual, auditory and motor activity were expressed by different laminar profiles and largely segregated subsets of neuronal populations. During simultaneous audiovisual stimulation, visual representations remained dissociable from auditory-related and motor-related activity. This three-fold dissociability of auditory, motor and visual processing is central to understanding how distinct inputs to visual cortex interact to support vision.
Collapse
Affiliation(s)
- Matthijs N Oude Lohuis
- Cognitive and Systems Neuroscience Group, Swammerdam Institute for Life Sciences, Faculty of Science, University of Amsterdam, Amsterdam, Netherlands
- Research Priority Area Brain and Cognition, University of Amsterdam, Amsterdam, Netherlands
- Champalimaud Neuroscience Programme, Champalimaud Foundation, Lisbon, Portugal
| | - Pietro Marchesi
- Cognitive and Systems Neuroscience Group, Swammerdam Institute for Life Sciences, Faculty of Science, University of Amsterdam, Amsterdam, Netherlands
- Research Priority Area Brain and Cognition, University of Amsterdam, Amsterdam, Netherlands
| | - Umberto Olcese
- Cognitive and Systems Neuroscience Group, Swammerdam Institute for Life Sciences, Faculty of Science, University of Amsterdam, Amsterdam, Netherlands
- Research Priority Area Brain and Cognition, University of Amsterdam, Amsterdam, Netherlands
| | - Cyriel M A Pennartz
- Cognitive and Systems Neuroscience Group, Swammerdam Institute for Life Sciences, Faculty of Science, University of Amsterdam, Amsterdam, Netherlands.
- Research Priority Area Brain and Cognition, University of Amsterdam, Amsterdam, Netherlands.
| |
Collapse
|
6
|
Etemadpour R, Shintree S, Shereen AD. Brain Activity is Influenced by How High Dimensional Data are Represented: An EEG Study of Scatterplot Diagnostic (Scagnostics) Measures. JOURNAL OF HEALTHCARE INFORMATICS RESEARCH 2024; 8:19-49. [PMID: 38273981 PMCID: PMC10805893 DOI: 10.1007/s41666-023-00145-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2022] [Revised: 07/07/2023] [Accepted: 08/29/2023] [Indexed: 01/27/2024]
Abstract
Visualization and visual analytic tools amplify one's perception of data, facilitating deeper and faster insights that can improve decision making. For multidimensional data sets, one of the most common approaches of visualization methods is to map the data into lower dimensions. Scatterplot matrices (SPLOM) are often used to visualize bivariate relationships between combinations of variables in a multidimensional dataset. However, the number of scatterplots increases quadratically with respect to the number of variables. For high dimensional data, the corresponding enormous number of scatterplots makes data exploration overwhelmingly complex, thereby hindering the usefulness of SPLOM in human decision making processes. One approach to address this difficulty utilizes Graph-theoretic Scatterplot Diagnostic (Scagnostics) to automatically extract a subset of scatterplots with salient features and of manageable size with the hope that the data will be sufficient for improving human decisions. In this paper, we use Electroencephalogram (EEG) to observe brain activity while participants make decisions informed by scatterplots created using different visual measures. We focused on 4 categories of Scagnostics measures: Clumpy, Monotonic, Striated, and Stringy. Our findings demonstrate that by adjusting the level of difficulty in discriminating between data sets based on the Scagnostics measures, different parts of the brain are activated: easier visual discrimination choices involve brain activity mostly in visual sensory cortices located in the occipital lobe, while more difficult discrimination choices tend to recruit more parietal and frontal regions as they are known to be involved in resolving ambiguities. Our results imply that patterns of neural activity are predictive markers of which specific Scagnostics measures most assist human decision making based on visual stimuli such as ours.
Collapse
Affiliation(s)
- Ronak Etemadpour
- Verus Research, 6100 Uptown Blvd NE, Suite 260, Albuquerque, New Mexico 87110 USA
- Radiology Department, UNM Health Sciences Center (UNM), Albuquerque, New Mexico USA
- The City College of New York, 160 Convent Ave, New York, NY 10031 USA
| | - Sonali Shintree
- The City College of New York, 160 Convent Ave, New York, NY 10031 USA
| | - A Duke Shereen
- CUNY Advanced Science Research Center, Neuroscience Initiative, Graduate Center, New York, NY USA
| |
Collapse
|
7
|
Evers K, Farisco M, Pennartz CMA. Assessing the commensurability of theories of consciousness: On the usefulness of common denominators in differentiating, integrating and testing hypotheses. Conscious Cogn 2024; 119:103668. [PMID: 38417198 DOI: 10.1016/j.concog.2024.103668] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Revised: 02/07/2024] [Accepted: 02/12/2024] [Indexed: 03/01/2024]
Abstract
How deep is the current diversity in the panoply of theories to define consciousness, and to what extent do these theories share common denominators? Here we first examine to what extent different theories are commensurable (or comparable) along particular dimensions. We posit logical (and, when applicable, empirical) commensurability as a necessary condition for identifying common denominators among different theories. By consequence, dimensions for inclusion in a set of logically and empirically commensurable theories of consciousness can be proposed. Next, we compare a limited subset of neuroscience-based theories in terms of commensurability. This analysis does not yield a denominator that might serve to define a minimally unifying model of consciousness. Theories that seem to be akin by one denominator can be remote by another. We suggest a methodology of comparing different theories via multiple probing questions, allowing to discern overall (dis)similarities between theories. Despite very different background definitions of consciousness, we conclude that, if attention is paid to the search for a common methological approach to brain-consciousness relationships, it should be possible in principle to overcome the current Babylonian confusion of tongues and eventually integrate and merge different theories.
Collapse
Affiliation(s)
- K Evers
- Centre for Research Ethics and Bioethics, Uppsala University, Uppsala, Sweden.
| | - M Farisco
- Centre for Research Ethics and Bioethics, Uppsala University, Uppsala, Sweden; Bioethics Unit, Biogem, Molecular Biology and Molecular Genetics Research Institute, Ariano Irpino (AV), Italy
| | - C M A Pennartz
- Department of Cognitive and Systems Neuroscience, Swammerdam Institute for Life Sciences, University of Amsterdam, Amsterdam, Netherland; Research Priority Area, Brain and Cognition, University of Amsterdam, Amsterdam, Netherlands
| |
Collapse
|
8
|
Salazar López E, Krewer C, Bergmann J, Möhwald K, Müller F, Jahn K. Lateropulsion in Right-Sided Stroke: Brain Anatomical Correlates of Severity and Duration. J Neurol Phys Ther 2024; 48:38-45. [PMID: 37306456 DOI: 10.1097/npt.0000000000000446] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
BACKGROUND AND PURPOSE Lateropulsion (LP) is a profound disorder of postural control that has a significant impact on neurorehabilitation. Knowledge of relevant brain areas could guide decisions on appropriate intervention methods. Although LP severity and duration are highly variable in individuals with LP, imaging studies on LP have not sufficiently considered these aspects. The aim of this study was to investigate the lesion location in individuals after stroke and the correlation with LP duration and severity. METHODS A retrospective case-control study using voxel lesion symptom mapping (VLSM) in 74 individuals with right-sided brain lesion (49 with and 25 without LP) was performed to analyze the correlation between lesion location and LP severity. Duration was investigated in a subsample of 22 individuals with LP. LP was diagnosed by means of the Scale for Contraversive Pushing. RESULTS Individuals with LP showed significantly larger lesion sizes compared with the individuals with no LP. VLSM analysis of LP severity did not reveal statistically significant results. VLSM analysis showed a statistically significant association with longer LP duration for the inferior frontal gyrus, the hippocampus, the inferior parietal gyrus, the supramarginal gyrus, the angular gyrus, the temporal cortex, the sagittal stratum, and the superior longitudinal fasciculus. DISCUSSION AND CONCLUSION LP-relevant areas are located in the multisensory network. Areas of the frontoparietal network, which are related to spatial cognition, memory, and attention, were found to be relevant for duration and severity. The findings, especially those regarding duration involving the middle temporal cortex, could explain the better intervention outcomes for methods based more on implicit than on explicit knowledge of verticality.Video Abstract available for more insights from the authors (see the Video, Supplemental Digital Content 1 available at: http://links.lww.com/JNPT/A433 ).
Collapse
Affiliation(s)
- Elvira Salazar López
- German Center for Vertigo and Balance Disorders (DSGZ) (E.S.L., C.K., J.B., K.M., F.M., K.J.), Ludwig-Maximilians University of Munich, Munich, Germany; Department of Neurology (C.K., J.B., F.M., K.J.), Schoen Clinic Bad Aibling, Bad Aibling, Germany; Department of Sports and Health Sciences - Chair of Human Movement Science (C.K.), Technical University of Munich, Munich, Germany; and Department of Neurology (K.M.), Ludwig-Maximilians University of Munich, Munich, Germany
| | | | | | | | | | | |
Collapse
|
9
|
Pennartz CMA, Oude Lohuis MN, Olcese U. How 'visual' is the visual cortex? The interactions between the visual cortex and other sensory, motivational and motor systems as enabling factors for visual perception. Philos Trans R Soc Lond B Biol Sci 2023; 378:20220336. [PMID: 37545313 PMCID: PMC10404929 DOI: 10.1098/rstb.2022.0336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Accepted: 06/13/2023] [Indexed: 08/08/2023] Open
Abstract
The definition of the visual cortex is primarily based on the evidence that lesions of this area impair visual perception. However, this does not exclude that the visual cortex may process more information than of retinal origin alone, or that other brain structures contribute to vision. Indeed, research across the past decades has shown that non-visual information, such as neural activity related to reward expectation and value, locomotion, working memory and other sensory modalities, can modulate primary visual cortical responses to retinal inputs. Nevertheless, the function of this non-visual information is poorly understood. Here we review recent evidence, coming primarily from studies in rodents, arguing that non-visual and motor effects in visual cortex play a role in visual processing itself, for instance disentangling direct auditory effects on visual cortex from effects of sound-evoked orofacial movement. These findings are placed in a broader framework casting vision in terms of predictive processing under control of frontal, reward- and motor-related systems. In contrast to the prevalent notion that vision is exclusively constructed by the visual cortical system, we propose that visual percepts are generated by a larger network-the extended visual system-spanning other sensory cortices, supramodal areas and frontal systems. This article is part of the theme issue 'Decision and control processes in multisensory perception'.
Collapse
Affiliation(s)
- Cyriel M. A. Pennartz
- Cognitive and Systems Neuroscience Group, Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098XH Amsterdam, The Netherlands
- Amsterdam Brain and Cognition, University of Amsterdam, Science Park 904, 1098XH Amsterdam, The Netherlands
| | - Matthijs N. Oude Lohuis
- Cognitive and Systems Neuroscience Group, Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098XH Amsterdam, The Netherlands
- Champalimaud Research, Champalimaud Foundation, 1400-038 Lisbon, Portugal
| | - Umberto Olcese
- Cognitive and Systems Neuroscience Group, Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098XH Amsterdam, The Netherlands
- Amsterdam Brain and Cognition, University of Amsterdam, Science Park 904, 1098XH Amsterdam, The Netherlands
| |
Collapse
|
10
|
Trejo DH, Ciuparu A, da Silva PG, Velasquez CM, Rebouillat B, Gross MD, Davis MB, Muresan RC, Albeanu DF. Fast updating feedback from piriform cortex to the olfactory bulb relays multimodal reward contingency signals during rule-reversal. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.09.12.557267. [PMID: 37745564 PMCID: PMC10515864 DOI: 10.1101/2023.09.12.557267] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/26/2023]
Abstract
While animals readily adjust their behavior to adapt to relevant changes in the environment, the neural pathways enabling these changes remain largely unknown. Here, using multiphoton imaging, we investigated whether feedback from the piriform cortex to the olfactory bulb supports such behavioral flexibility. To this end, we engaged head-fixed mice in a multimodal rule-reversal task guided by olfactory and auditory cues. Both odor and, surprisingly, the sound cues triggered cortical bulbar feedback responses which preceded the behavioral report. Responses to the same sensory cue were strongly modulated upon changes in stimulus-reward contingency (rule reversals). The re-shaping of individual bouton responses occurred within seconds of the rule-reversal events and was correlated with changes in the behavior. Optogenetic perturbation of cortical feedback within the bulb disrupted the behavioral performance. Our results indicate that the piriform-to-olfactory bulb feedback carries reward contingency signals and is rapidly re-formatted according to changes in the behavioral context.
Collapse
Affiliation(s)
| | - Andrei Ciuparu
- Transylvanian Institute of Neuroscience, Cluj-Napoca, Romania
| | - Pedro Garcia da Silva
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA
- current address – Champalimaud Neuroscience Program, Lisbon, Portugal
| | - Cristina M. Velasquez
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA
- current address – University of Oxford, UK
| | - Benjamin Rebouillat
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA
- current address –École Normale Supérieure, Paris, France
| | | | | | - Raul C. Muresan
- Transylvanian Institute of Neuroscience, Cluj-Napoca, Romania
- STAR-UBB Institute, Babeş-Bolyai University, Cluj-Napoca, Romania
| | - Dinu F. Albeanu
- Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA
- School for Biological Sciences, Cold Spring Harbor Laboratory, Cold Spring Harbor, NY, USA
| |
Collapse
|
11
|
Dorman R, Bos JJ, Vinck MA, Marchesi P, Fiorilli J, Lorteije JAM, Reiten I, Bjaalie JG, Okun M, Pennartz CMA. Spike-based coupling between single neurons and populations across rat sensory cortices, perirhinal cortex, and hippocampus. Cereb Cortex 2023; 33:8247-8264. [PMID: 37118890 PMCID: PMC10425201 DOI: 10.1093/cercor/bhad111] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Revised: 03/09/2023] [Accepted: 03/10/2023] [Indexed: 04/30/2023] Open
Abstract
Cortical computations require coordination of neuronal activity within and across multiple areas. We characterized spiking relationships within and between areas by quantifying coupling of single neurons to population firing patterns. Single-neuron population coupling (SNPC) was investigated using ensemble recordings from hippocampal CA1 region and somatosensory, visual, and perirhinal cortices. Within-area coupling was heterogeneous across structures, with area CA1 showing higher levels than neocortical regions. In contrast to known anatomical connectivity, between-area coupling showed strong firing coherence of sensory neocortices with CA1, but less with perirhinal cortex. Cells in sensory neocortices and CA1 showed positive correlations between within- and between-area coupling; these were weaker for perirhinal cortex. All four areas harbored broadcasting cells, connecting to multiple external areas, which was uncorrelated to within-area coupling strength. When examining correlations between SNPC and spatial coding, we found that, if such correlations were significant, they were negative. This result was consistent with an overall preservation of SNPC across different brain states, suggesting a strong dependence on intrinsic network connectivity. Overall, SNPC offers an important window on cell-to-population synchronization in multi-area networks. Instead of pointing to specific information-coding functions, our results indicate a primary function of SNPC in dynamically organizing communication in systems composed of multiple, interconnected areas.
Collapse
Affiliation(s)
- Reinder Dorman
- Systems and Cognitive Neuroscience Group, SILS Center for Neuroscience, University of Amsterdam, 1098 XH Amsterdam, The Netherlands
| | - Jeroen J Bos
- Systems and Cognitive Neuroscience Group, SILS Center for Neuroscience, University of Amsterdam, 1098 XH Amsterdam, The Netherlands
- Donders Institute for Brain, Cognition and Behavior, Radboud University, 6500 HC Nijmegen, The Netherlands
| | - Martin A Vinck
- Systems and Cognitive Neuroscience Group, SILS Center for Neuroscience, University of Amsterdam, 1098 XH Amsterdam, The Netherlands
- Ernst Strüngmann Institute for Neuroscience in Cooperation with Max Plank Society, 60528 Frankfurt, Germany
| | - Pietro Marchesi
- Systems and Cognitive Neuroscience Group, SILS Center for Neuroscience, University of Amsterdam, 1098 XH Amsterdam, The Netherlands
| | - Julien Fiorilli
- Systems and Cognitive Neuroscience Group, SILS Center for Neuroscience, University of Amsterdam, 1098 XH Amsterdam, The Netherlands
| | - Jeanette A M Lorteije
- Systems and Cognitive Neuroscience Group, SILS Center for Neuroscience, University of Amsterdam, 1098 XH Amsterdam, The Netherlands
| | - Ingrid Reiten
- Institute of Basic Medical Sciences, University of Oslo, NO-0316 Oslo, Norway
| | - Jan G Bjaalie
- Institute of Basic Medical Sciences, University of Oslo, NO-0316 Oslo, Norway
| | - Michael Okun
- Department of Psychology and Neuroscience Institute, University of Sheffield, Sheffield S10 2TN, UK
| | - Cyriel M A Pennartz
- Systems and Cognitive Neuroscience Group, SILS Center for Neuroscience, University of Amsterdam, 1098 XH Amsterdam, The Netherlands
| |
Collapse
|
12
|
Williams AM, Angeloni CF, Geffen MN. Sound Improves Neuronal Encoding of Visual Stimuli in Mouse Primary Visual Cortex. J Neurosci 2023; 43:2885-2906. [PMID: 36944489 PMCID: PMC10124961 DOI: 10.1523/jneurosci.2444-21.2023] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2021] [Revised: 02/14/2023] [Accepted: 02/23/2023] [Indexed: 03/23/2023] Open
Abstract
In everyday life, we integrate visual and auditory information in routine tasks such as navigation and communication. While concurrent sound can improve visual perception, the neuronal correlates of audiovisual integration are not fully understood. Specifically, it remains unclear whether neuronal firing patters in the primary visual cortex (V1) of awake animals demonstrate similar sound-induced improvement in visual discriminability. Furthermore, presentation of sound is associated with movement in the subjects, but little is understood about whether and how sound-associated movement affects audiovisual integration in V1. Here, we investigated how sound and movement interact to modulate V1 visual responses in awake, head-fixed mice and whether this interaction improves neuronal encoding of the visual stimulus. We presented visual drifting gratings with and without simultaneous auditory white noise to awake mice while recording mouse movement and V1 neuronal activity. Sound modulated activity of 80% of light-responsive neurons, with 95% of neurons increasing activity when the auditory stimulus was present. A generalized linear model (GLM) revealed that sound and movement had distinct and complementary effects of the neuronal visual responses. Furthermore, decoding of the visual stimulus from the neuronal activity was improved with sound, an effect that persisted even when controlling for movement. These results demonstrate that sound and movement modulate visual responses in complementary ways, improving neuronal representation of the visual stimulus. This study clarifies the role of movement as a potential confound in neuronal audiovisual responses and expands our knowledge of how multimodal processing is mediated at a neuronal level in the awake brain.SIGNIFICANCE STATEMENT Sound and movement are both known to modulate visual responses in the primary visual cortex; however, sound-induced movement has largely remained unaccounted for as a potential confound in audiovisual studies in awake animals. Here, authors found that sound and movement both modulate visual responses in an important visual brain area, the primary visual cortex, in distinct, yet complementary ways. Furthermore, sound improved encoding of the visual stimulus even when accounting for movement. This study reconciles contrasting theories on the mechanism underlying audiovisual integration and asserts the primary visual cortex as a key brain region participating in tripartite sensory interactions.
Collapse
Affiliation(s)
- Aaron M Williams
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, Pennsylvania, 19104
- Department of Neuroscience, University of Pennsylvania, Philadelphia, Pennsylvania, 19104
- Department of Neurology, University of Pennsylvania, Philadelphia, Pennsylvania, 19104
| | - Christopher F Angeloni
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, Pennsylvania, 19104
- Department of Psychology, University of Pennsylvania, Philadelphia, Pennsylvania 19104
| | - Maria N Geffen
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, Pennsylvania, 19104
- Department of Neuroscience, University of Pennsylvania, Philadelphia, Pennsylvania, 19104
- Department of Neurology, University of Pennsylvania, Philadelphia, Pennsylvania, 19104
| |
Collapse
|
13
|
Fossataro C, Galigani M, Rossi Sebastiano A, Bruno V, Ronga I, Garbarini F. Spatial proximity to others induces plastic changes in the neural representation of the peripersonal space. iScience 2022; 26:105879. [PMID: 36654859 PMCID: PMC9840938 DOI: 10.1016/j.isci.2022.105879] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2022] [Revised: 11/21/2022] [Accepted: 12/22/2022] [Indexed: 12/28/2022] Open
Abstract
Peripersonal space (PPS) is a highly plastic "invisible bubble" surrounding the body whose boundaries are mapped through multisensory integration. Yet, it is unclear how the spatial proximity to others alters PPS boundaries. Across five experiments (N = 80), by recording behavioral and electrophysiological responses to visuo-tactile stimuli, we demonstrate that the proximity to others induces plastic changes in the neural PPS representation. The spatial proximity to someone else's hand shrinks the portion of space within which multisensory responses occur, thus reducing the PPS boundaries. This suggests that PPS representation, built from bodily and multisensory signals, plastically adapts to the presence of conspecifics to define the self-other boundaries, so that what is usually coded as "my space" is recoded as "your space". When the space is shared with conspecifics, it seems adaptive to move the other-space away from the self-space to discriminate whether external events pertain to the self-body or to other-bodies.
Collapse
Affiliation(s)
- Carlotta Fossataro
- MANIBUS Lab, Psychology Department, University of Turin, Turin 10123, Italy
| | - Mattia Galigani
- MANIBUS Lab, Psychology Department, University of Turin, Turin 10123, Italy
| | | | - Valentina Bruno
- MANIBUS Lab, Psychology Department, University of Turin, Turin 10123, Italy
| | - Irene Ronga
- MANIBUS Lab, Psychology Department, University of Turin, Turin 10123, Italy
| | - Francesca Garbarini
- MANIBUS Lab, Psychology Department, University of Turin, Turin 10123, Italy,Neuroscience Institute of Turin (NIT), Turin 10123, Italy,Corresponding author
| |
Collapse
|
14
|
Vecchio F, Nucci L, Pappalettera C, Miraglia F, Iacoviello D, Rossini PM. Time-frequency analysis of brain activity in response to directional and non-directional visual stimuli: an event related spectral perturbations (ERSP) study. J Neural Eng 2022; 19. [PMID: 36270505 DOI: 10.1088/1741-2552/ac9c96] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Accepted: 10/21/2022] [Indexed: 01/11/2023]
Abstract
Objective.A large part of the cerebral cortex is dedicated to the processing of visual stimuli and there is still much to understand about such processing modalities and hierarchies. The main aim of the present study is to investigate the differences between directional visual stimuli (DS) and non-directional visual stimuli (n-DS) processing by time-frequency analysis of brain electroencephalographic activity during a visuo-motor task. Electroencephalography (EEG) data were divided into four regions of interest (ROIs) (frontal, central, parietal, occipital).Approach.The analysis of the visual stimuli processing was based on the combination of electroencephalographic recordings and time-frequency analysis. Event related spectral perturbations (ERSPs) were computed with spectrum analysis that allow to obtain the average time course of relative changes induced by the stimulus presentation in spontaneous EEG amplitude spectrum.Main results.Visual stimuli processing enhanced the same pattern of spectral modulation in all investigated ROIs with differences in amplitudes and timing. Additionally, statistically significant differences in occipital ROI between the DS and n-DS visual stimuli processing in theta, alpha and beta bands were found.Significance.These evidences suggest that ERSPs could be a useful tool to investigate the encoding of visual information in different brain regions. Because of their simplicity and their capability in the representation of brain activity, the ERSPs might be used as biomarkers of functional recovery for example in the rehabilitation of visual dysfunction and motor impairment following a stroke, as well as diagnostic tool of anomalies in brain functions in neurological diseases tailored to personalized treatments in clinical environment.
Collapse
Affiliation(s)
- Fabrizio Vecchio
- Brain Connectivity Laboratory, Department of Neuroscience and Neurorehabilitation, IRCCS San Raffaele Roma, Rome, Italy.,Department of Theoretical and Applied Sciences, eCampus University, Novedrate, Como, Italy
| | - Lorenzo Nucci
- Brain Connectivity Laboratory, Department of Neuroscience and Neurorehabilitation, IRCCS San Raffaele Roma, Rome, Italy
| | - Chiara Pappalettera
- Brain Connectivity Laboratory, Department of Neuroscience and Neurorehabilitation, IRCCS San Raffaele Roma, Rome, Italy.,Department of Theoretical and Applied Sciences, eCampus University, Novedrate, Como, Italy
| | - Francesca Miraglia
- Brain Connectivity Laboratory, Department of Neuroscience and Neurorehabilitation, IRCCS San Raffaele Roma, Rome, Italy.,Department of Theoretical and Applied Sciences, eCampus University, Novedrate, Como, Italy
| | - Daniela Iacoviello
- Department of Computer, Control and Management Engineering Antonio Ruberti, Sapienza University of Rome, Rome, Italy
| | - Paolo Maria Rossini
- Brain Connectivity Laboratory, Department of Neuroscience and Neurorehabilitation, IRCCS San Raffaele Roma, Rome, Italy
| |
Collapse
|
15
|
Giret N, Rolland M, Del Negro C. Multisensory processes in birds: from single neurons to the influence of social interactions and sensory loss. Neurosci Biobehav Rev 2022; 143:104942. [DOI: 10.1016/j.neubiorev.2022.104942] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Revised: 10/14/2022] [Accepted: 10/31/2022] [Indexed: 11/09/2022]
|
16
|
Lohse M, Zimmer-Harwood P, Dahmen JC, King AJ. Integration of somatosensory and motor-related information in the auditory system. Front Neurosci 2022; 16:1010211. [PMID: 36330342 PMCID: PMC9622781 DOI: 10.3389/fnins.2022.1010211] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Accepted: 09/28/2022] [Indexed: 11/30/2022] Open
Abstract
An ability to integrate information provided by different sensory modalities is a fundamental feature of neurons in many brain areas. Because visual and auditory inputs often originate from the same external object, which may be located some distance away from the observer, the synthesis of these cues can improve localization accuracy and speed up behavioral responses. By contrast, multisensory interactions occurring close to the body typically involve a combination of tactile stimuli with other sensory modalities. Moreover, most activities involving active touch generate sound, indicating that stimuli in these modalities are frequently experienced together. In this review, we examine the basis for determining sound-source distance and the contribution of auditory inputs to the neural encoding of space around the body. We then consider the perceptual consequences of combining auditory and tactile inputs in humans and discuss recent evidence from animal studies demonstrating how cortical and subcortical areas work together to mediate communication between these senses. This research has shown that somatosensory inputs interface with and modulate sound processing at multiple levels of the auditory pathway, from the cochlear nucleus in the brainstem to the cortex. Circuits involving inputs from the primary somatosensory cortex to the auditory midbrain have been identified that mediate suppressive effects of whisker stimulation on auditory thalamocortical processing, providing a possible basis for prioritizing the processing of tactile cues from nearby objects. Close links also exist between audition and movement, and auditory responses are typically suppressed by locomotion and other actions. These movement-related signals are thought to cancel out self-generated sounds, but they may also affect auditory responses via the associated somatosensory stimulation or as a result of changes in brain state. Together, these studies highlight the importance of considering both multisensory context and movement-related activity in order to understand how the auditory cortex operates during natural behaviors, paving the way for future work to investigate auditory-somatosensory interactions in more ecological situations.
Collapse
|
17
|
Lenschow C, Mendes ARP, Lima SQ. Hearing, touching, and multisensory integration during mate choice. Front Neural Circuits 2022; 16:943888. [PMID: 36247731 PMCID: PMC9559228 DOI: 10.3389/fncir.2022.943888] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2022] [Accepted: 06/28/2022] [Indexed: 12/27/2022] Open
Abstract
Mate choice is a potent generator of diversity and a fundamental pillar for sexual selection and evolution. Mate choice is a multistage affair, where complex sensory information and elaborate actions are used to identify, scrutinize, and evaluate potential mating partners. While widely accepted that communication during mate assessment relies on multimodal cues, most studies investigating the mechanisms controlling this fundamental behavior have restricted their focus to the dominant sensory modality used by the species under examination, such as vision in humans and smell in rodents. However, despite their undeniable importance for the initial recognition, attraction, and approach towards a potential mate, other modalities gain relevance as the interaction progresses, amongst which are touch and audition. In this review, we will: (1) focus on recent findings of how touch and audition can contribute to the evaluation and choice of mating partners, and (2) outline our current knowledge regarding the neuronal circuits processing touch and audition (amongst others) in the context of mate choice and ask (3) how these neural circuits are connected to areas that have been studied in the light of multisensory integration.
Collapse
|
18
|
Pennartz CMA. What is neurorepresentationalism? From neural activity and predictive processing to multi-level representations and consciousness. Behav Brain Res 2022; 432:113969. [PMID: 35718232 DOI: 10.1016/j.bbr.2022.113969] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2021] [Revised: 05/18/2022] [Accepted: 05/20/2022] [Indexed: 11/02/2022]
Abstract
This review provides an update on Neurorepresentationalism, a theoretical framework that defines conscious experience as multimodal, situational survey and explains its neural basis from brain systems constructing best-guess representations of sensations originating in our environment and body [1]. It posits that conscious experience is characterized by five essential hallmarks: (i) multimodal richness, (ii) situatedness and immersion, (iii) unity and integration, (iv) dynamics and stability, and (v) intentionality. Consciousness is furthermore proposed to have a biological function, framed by the contrast between reflexes and habits (not requiring consciousness) versus goal-directed, planned behavior (requiring multimodal, situational survey). Conscious experience is therefore understood as a sensorily rich, spatially encompassing representation of body and environment, while we nevertheless have the impression of experiencing external reality directly. Contributions to understanding neural mechanisms underlying consciousness are derived from models for predictive processing, which are trained in an unsupervised manner, do not necessarily require overt action, and have been extended to deep neural networks. Even with predictive processing in place, however, the question remains why this type of neural network activity would give rise to phenomenal experience. Here, I propose to tackle the Hard Problem with the concept of multi-level representations which emergently give rise to multimodal, spatially wide superinferences corresponding to phenomenal experiences. Finally, Neurorepresentationalism is compared to other neural theories of consciousness, and its implications for defining indicators of consciousness in animals, artificial intelligence devices and immobile or unresponsive patients with disorders of consciousness are discussed.
Collapse
Affiliation(s)
- Cyriel M A Pennartz
- Swammerdam Institute for Life Sciences, Center for Neuroscience, Faculty of Science, University of Amsterdam, the Netherlands; Research Priority Program Brain and Cognition, University of Amsterdam, the Netherlands.
| |
Collapse
|
19
|
Oude Lohuis MN, Pie JL, Marchesi P, Montijn JS, de Kock CPJ, Pennartz CMA, Olcese U. Multisensory task demands temporally extend the causal requirement for visual cortex in perception. Nat Commun 2022; 13:2864. [PMID: 35606448 PMCID: PMC9126973 DOI: 10.1038/s41467-022-30600-4] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2021] [Accepted: 05/09/2022] [Indexed: 01/02/2023] Open
Abstract
Primary sensory areas constitute crucial nodes during perceptual decision making. However, it remains unclear to what extent they mainly constitute a feedforward processing step, or rather are continuously involved in a recurrent network together with higher-order areas. We found that the temporal window in which primary visual cortex is required for the detection of identical visual stimuli was extended when task demands were increased via an additional sensory modality that had to be monitored. Late-onset optogenetic inactivation preserved bottom-up, early-onset responses which faithfully encoded stimulus features, and was effective in impairing detection only if it preceded a late, report-related phase of the cortical response. Increasing task demands were marked by longer reaction times and the effect of late optogenetic inactivation scaled with reaction time. Thus, independently of visual stimulus complexity, multisensory task demands determine the temporal requirement for ongoing sensory-related activity in V1, which overlaps with report-related activity. How primary sensory cortices contribute to decision making remains poorly understood. Here the authors report that increasing task demands extend the temporal window in which the primary visual cortex is required for detecting identical stimuli.
Collapse
|
20
|
Liang J, Li Y, Zhang Z, Luo W. Sound gaps boost emotional audiovisual integration independent of attention: Evidence from an ERP study. Biol Psychol 2021; 168:108246. [PMID: 34968556 DOI: 10.1016/j.biopsycho.2021.108246] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2021] [Revised: 12/18/2021] [Accepted: 12/23/2021] [Indexed: 11/02/2022]
Abstract
The emotion discrimination paradigm was adopted to study the effect of interrupted sound on visual emotional processing under different attentional states. There were two experiments: Experiment 1: judging facial expressions (explicit task), Experiment 2: judging the position of a bar (implicit task). In Experiment 1, ERP results showed that there was a sound gap accelerating the effect of P1 present only under neutral faces. In Experiment 2, the accelerating effect (P1) existed regardless of the emotional condition. Combining two experiments, P1 findings suggest that sound gap enhances bottom-up attention. The N170 and late positive component (LPC) were found to be regulated by emotion face in both experiments, with fear over the neutral. Comparing the two experiments, the explicit task induced a larger LPC than the implicit task. Overall, sound gaps boosted the audiovisual integration by bottom-up attention in early integration, while cognitive expectations led to top-down attention in late stages.
Collapse
Affiliation(s)
- Junyu Liang
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Dalian 116029, Liaoning Province, China
| | - Yuchen Li
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Dalian 116029, Liaoning Province, China
| | - Zhao Zhang
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; Institute of Psychology, Weifang Medical University, Weifang 216053, China; Key Laboratory of Brain and Cognitive Neuroscience, Dalian 116029, Liaoning Province, China
| | - Wenbo Luo
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Dalian 116029, Liaoning Province, China.
| |
Collapse
|
21
|
Oude Lohuis MN, Canton AC, Pennartz CMA, Olcese U. Higher Order Visual Areas Enhance Stimulus Responsiveness in Mouse Primary Visual Cortex. Cereb Cortex 2021; 32:3269-3288. [PMID: 34849636 PMCID: PMC9340391 DOI: 10.1093/cercor/bhab414] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2021] [Revised: 10/19/2021] [Accepted: 10/20/2021] [Indexed: 01/14/2023] Open
Abstract
Over the past few years, the various areas that surround the primary visual cortex (V1) in the mouse have been associated with many functions, ranging from higher order visual processing to decision-making. Recently, some studies have shown that higher order visual areas influence the activity of the primary visual cortex, refining its processing capabilities. Here, we studied how in vivo optogenetic inactivation of two higher order visual areas with different functional properties affects responses evoked by moving bars in the primary visual cortex. In contrast with the prevailing view, our results demonstrate that distinct higher order visual areas similarly modulate early visual processing. In particular, these areas enhance stimulus responsiveness in the primary visual cortex, by more strongly amplifying weaker compared with stronger sensory-evoked responses (for instance specifically amplifying responses to stimuli not moving along the direction preferred by individual neurons) and by facilitating responses to stimuli entering the receptive field of single neurons. Such enhancement, however, comes at the expense of orientation and direction selectivity, which increased when the selected higher order visual areas were inactivated. Thus, feedback from higher order visual areas selectively amplifies weak sensory-evoked V1 responses, which may enable more robust processing of visual stimuli.
Collapse
Affiliation(s)
- Matthijs N Oude Lohuis
- Cognitive and Systems Neuroscience Group, Swammerdam Institute for Life Sciences, University of Amsterdam, 1098XH Amsterdam, The Netherlands.,Amsterdam Brain and Cognition, University of Amsterdam, 1098XH Amsterdam, The Netherlands
| | - Alexis Cervan Canton
- Cognitive and Systems Neuroscience Group, Swammerdam Institute for Life Sciences, University of Amsterdam, 1098XH Amsterdam, The Netherlands.,Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), 08036 Barcelona, Spain
| | - Cyriel M A Pennartz
- Cognitive and Systems Neuroscience Group, Swammerdam Institute for Life Sciences, University of Amsterdam, 1098XH Amsterdam, The Netherlands.,Amsterdam Brain and Cognition, University of Amsterdam, 1098XH Amsterdam, The Netherlands
| | - Umberto Olcese
- Cognitive and Systems Neuroscience Group, Swammerdam Institute for Life Sciences, University of Amsterdam, 1098XH Amsterdam, The Netherlands.,Amsterdam Brain and Cognition, University of Amsterdam, 1098XH Amsterdam, The Netherlands
| |
Collapse
|
22
|
Marvan T, Polák M, Bachmann T, Phillips WA. Apical amplification-a cellular mechanism of conscious perception? Neurosci Conscious 2021; 2021:niab036. [PMID: 34650815 PMCID: PMC8511476 DOI: 10.1093/nc/niab036] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Revised: 07/09/2021] [Accepted: 09/23/2021] [Indexed: 11/25/2022] Open
Abstract
We present a theoretical view of the cellular foundations for network-level processes involved in producing our conscious experience. Inputs to apical synapses in layer 1 of a large subset of neocortical cells are summed at an integration zone near the top of their apical trunk. These inputs come from diverse sources and provide a context within which the transmission of information abstracted from sensory input to their basal and perisomatic synapses can be amplified when relevant. We argue that apical amplification enables conscious perceptual experience and makes it more flexible, and thus more adaptive, by being sensitive to context. Apical amplification provides a possible mechanism for recurrent processing theory that avoids strong loops. It makes the broadcasting hypothesized by global neuronal workspace theories feasible while preserving the distinct contributions of the individual cells receiving the broadcast. It also provides mechanisms that contribute to the holistic aspects of integrated information theory. As apical amplification is highly dependent on cholinergic, aminergic, and other neuromodulators, it relates the specific contents of conscious experience to global mental states and to fluctuations in arousal when awake. We conclude that apical dendrites provide a cellular mechanism for the context-sensitive selective amplification that is a cardinal prerequisite of conscious perception.
Collapse
Affiliation(s)
- Tomáš Marvan
- Department of Analytic Philosophy, Institute of Philosophy, Czech Academy of Sciences, Jilská 1, Prague 110 00, Czech Republic
| | - Michal Polák
- Department of Philosophy, University of West Bohemia, Sedláčkova 19, Pilsen 306 14, Czech Republic
| | - Talis Bachmann
- School of Law and Cognitive Neuroscience Laboratory, University of Tartu (Tallinn branch), Kaarli pst 3, Tallinn 10119, Estonia
| | - William A Phillips
- Faculty of Natural Sciences, University of Stirling, Stirling FK9 4LA, UK
| |
Collapse
|
23
|
Meijer GT, Marchesi P, Mejias JF, Montijn JS, Lansink CS, Pennartz CMA. Neural Correlates of Multisensory Detection Behavior: Comparison of Primary and Higher-Order Visual Cortex. Cell Rep 2021; 31:107636. [PMID: 32402272 DOI: 10.1016/j.celrep.2020.107636] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2019] [Revised: 01/10/2020] [Accepted: 04/21/2020] [Indexed: 01/16/2023] Open
Abstract
We act upon stimuli in our surrounding environment by gathering the multisensory information they convey and by integrating this information to decide on a behavioral action. We hypothesized that the anterolateral secondary visual cortex (area AL) of the mouse brain may serve as a hub for sensorimotor transformation of audiovisual information. We imaged neuronal activity in primary visual cortex (V1) and AL of the mouse during a detection task using visual, auditory, and audiovisual stimuli. We found that AL neurons were more sensitive to weak uni- and multisensory stimuli compared to V1. Depending on contrast, different subsets of AL and V1 neurons showed cross-modal modulation of visual responses. During audiovisual stimulation, AL neurons showed stronger differentiation of behaviorally reported versus unreported stimuli compared to V1, whereas V1 showed this distinction during unisensory visual stimulation. Thus, neural population activity in area AL correlates more closely with multisensory detection behavior than V1.
Collapse
Affiliation(s)
- Guido T Meijer
- Swammerdam Institute for Life Sciences, Center for Neuroscience, Faculty of Science, University of Amsterdam, 1098 XH Amsterdam, the Netherlands
| | - Pietro Marchesi
- Swammerdam Institute for Life Sciences, Center for Neuroscience, Faculty of Science, University of Amsterdam, 1098 XH Amsterdam, the Netherlands
| | - Jorge F Mejias
- Swammerdam Institute for Life Sciences, Center for Neuroscience, Faculty of Science, University of Amsterdam, 1098 XH Amsterdam, the Netherlands
| | - Jorrit S Montijn
- Swammerdam Institute for Life Sciences, Center for Neuroscience, Faculty of Science, University of Amsterdam, 1098 XH Amsterdam, the Netherlands
| | - Carien S Lansink
- Swammerdam Institute for Life Sciences, Center for Neuroscience, Faculty of Science, University of Amsterdam, 1098 XH Amsterdam, the Netherlands; Research Priority Program Brain and Cognition, University of Amsterdam, 1098 XH Amsterdam, the Netherlands.
| | - Cyriel M A Pennartz
- Swammerdam Institute for Life Sciences, Center for Neuroscience, Faculty of Science, University of Amsterdam, 1098 XH Amsterdam, the Netherlands; Research Priority Program Brain and Cognition, University of Amsterdam, 1098 XH Amsterdam, the Netherlands.
| |
Collapse
|
24
|
Development of Auditory Cortex Circuits. J Assoc Res Otolaryngol 2021; 22:237-259. [PMID: 33909161 DOI: 10.1007/s10162-021-00794-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2020] [Accepted: 03/03/2021] [Indexed: 02/03/2023] Open
Abstract
The ability to process and perceive sensory stimuli is an essential function for animals. Among the sensory modalities, audition is crucial for communication, pleasure, care for the young, and perceiving threats. The auditory cortex (ACtx) is a key sound processing region that combines ascending signals from the auditory periphery and inputs from other sensory and non-sensory regions. The development of ACtx is a protracted process starting prenatally and requires the complex interplay of molecular programs, spontaneous activity, and sensory experience. Here, we review the development of thalamic and cortical auditory circuits during pre- and early post-natal periods.
Collapse
|
25
|
Coletta L, Pagani M, Whitesell JD, Harris JA, Bernhardt B, Gozzi A. Network structure of the mouse brain connectome with voxel resolution. SCIENCE ADVANCES 2020; 6:eabb7187. [PMID: 33355124 PMCID: PMC11206455 DOI: 10.1126/sciadv.abb7187] [Citation(s) in RCA: 50] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/13/2020] [Accepted: 11/04/2020] [Indexed: 06/12/2023]
Abstract
Fine-grained descriptions of brain connectivity are required to understand how neural information is processed and relayed across spatial scales. Previous investigations of the mouse brain connectome have used discrete anatomical parcellations, limiting spatial resolution and potentially concealing network attributes critical to connectome organization. Here, we provide a voxel-level description of the network and hierarchical structure of the directed mouse connectome, unconstrained by regional partitioning. We report a number of previously unappreciated organizational principles in the mammalian brain, including a directional segregation of hub regions into neural sink and sources, and a strategic wiring of neuromodulatory nuclei as connector hubs and critical orchestrators of network communication. We also find that the mouse cortical connectome is hierarchically organized along two superimposed cortical gradients reflecting unimodal-transmodal functional processing and a modality-specific sensorimotor axis, recapitulating a phylogenetically conserved feature of higher mammals. These findings advance our understanding of the foundational wiring principles of the mammalian connectome.
Collapse
Affiliation(s)
- Ludovico Coletta
- Functional Neuroimaging Laboratory, Center for Neuroscience and Cognitive Systems @ UniTn, Istituto Italiano di Tecnologia, Rovereto, Italy
- Center for Mind/Brain Sciences, University of Trento, 38068 Rovereto TN, Italy
| | - Marco Pagani
- Functional Neuroimaging Laboratory, Center for Neuroscience and Cognitive Systems @ UniTn, Istituto Italiano di Tecnologia, Rovereto, Italy
| | | | | | - Boris Bernhardt
- Multimodal Imaging and Connectome Analysis Lab, McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| | - Alessandro Gozzi
- Functional Neuroimaging Laboratory, Center for Neuroscience and Cognitive Systems @ UniTn, Istituto Italiano di Tecnologia, Rovereto, Italy.
| |
Collapse
|
26
|
Wang C, Liu H, Li K, Wu ZZ, Wu C, Yu JY, Gong Q, Fang P, Wang XX, Duan SM, Wang H, Gu Y, Hu J, Pan BX, Schmidt MV, Liu YJ, Wang XD. Tactile modulation of memory and anxiety requires dentate granule cells along the dorsoventral axis. Nat Commun 2020; 11:6045. [PMID: 33247136 PMCID: PMC7695841 DOI: 10.1038/s41467-020-19874-8] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2019] [Accepted: 11/02/2020] [Indexed: 12/21/2022] Open
Abstract
Touch can positively influence cognition and emotion, but the underlying mechanisms remain unclear. Here, we report that tactile experience enrichment improves memory and alleviates anxiety by remodeling neurons along the dorsoventral axis of the dentate gyrus (DG) in adult mice. Tactile enrichment induces differential activation and structural modification of neurons in the dorsal and ventral DG, and increases the presynaptic input from the lateral entorhinal cortex (LEC), which is reciprocally connected with the primary somatosensory cortex (S1), to tactile experience-activated DG neurons. Chemogenetic activation of tactile experience-tagged dorsal and ventral DG neurons enhances memory and reduces anxiety respectively, whereas inactivation of these neurons or S1-innervated LEC neurons abolishes the beneficial effects of tactile enrichment. Moreover, adulthood tactile enrichment attenuates early-life stress-induced memory deficits and anxiety-related behavior. Our findings demonstrate that enriched tactile experience retunes the pathway from S1 to DG and enhances DG neuronal plasticity to modulate cognition and emotion. Touch can positively modulate cognitive performance and emotional response. Here the authors demonstrate that enriched tactile experience improves memory and reduces anxiety in adult mice by remodelling the pathway from the primary somatosensory cortex to the dentate gyrus.
Collapse
Affiliation(s)
- Chi Wang
- Department of Neurobiology and Department of Psychiatry of Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, 310058, Hangzhou, China.,NHC and CAMS Key Laboratory of Medical Neurobiology, MOE Frontier Science Center for Brain Research and Brain-Machine Integration, School of Brain Science and Brain Medicine, Zhejiang University, 310058, Hangzhou, China
| | - Hui Liu
- Department of Neurobiology and Department of Psychiatry of Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, 310058, Hangzhou, China.,NHC and CAMS Key Laboratory of Medical Neurobiology, MOE Frontier Science Center for Brain Research and Brain-Machine Integration, School of Brain Science and Brain Medicine, Zhejiang University, 310058, Hangzhou, China
| | - Kun Li
- Department of Neurobiology and Department of Psychiatry of Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, 310058, Hangzhou, China
| | - Zhen-Zhen Wu
- Department of Neurobiology and Department of Psychiatry of Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, 310058, Hangzhou, China
| | - Chen Wu
- Department of Neurobiology and Department of Psychiatry of Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, 310058, Hangzhou, China.,NHC and CAMS Key Laboratory of Medical Neurobiology, MOE Frontier Science Center for Brain Research and Brain-Machine Integration, School of Brain Science and Brain Medicine, Zhejiang University, 310058, Hangzhou, China
| | - Jing-Ying Yu
- Department of Neurobiology and Department of Psychiatry of Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, 310058, Hangzhou, China
| | - Qian Gong
- Department of Neurobiology and Department of Psychiatry of Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, 310058, Hangzhou, China
| | - Ping Fang
- Department of Neurobiology and Department of Psychiatry of Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, 310058, Hangzhou, China
| | - Xing-Xing Wang
- Department of Anesthesiology, Technische Universität München/Klinikum Rechts der Isar, 81675, Munich, Germany
| | - Shu-Min Duan
- NHC and CAMS Key Laboratory of Medical Neurobiology, MOE Frontier Science Center for Brain Research and Brain-Machine Integration, School of Brain Science and Brain Medicine, Zhejiang University, 310058, Hangzhou, China
| | - Hao Wang
- NHC and CAMS Key Laboratory of Medical Neurobiology, MOE Frontier Science Center for Brain Research and Brain-Machine Integration, School of Brain Science and Brain Medicine, Zhejiang University, 310058, Hangzhou, China
| | - Yan Gu
- Center of Stem Cell and Regenerative Medicine, and Department of Neurology of the Second Affiliated Hospital, Zhejiang University School of Medicine, 310058, Hangzhou, China
| | - Ji Hu
- School of Life Science and Technology, ShanghaiTech University, 201210, Shanghai, China
| | - Bing-Xing Pan
- Laboratory of Fear and Anxiety Disorders, Institute of Life Science, Nanchang University, 330031, Nanchang, China
| | | | - Yi-Jun Liu
- Department of Neurobiology and Department of Psychiatry of Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, 310058, Hangzhou, China
| | - Xiao-Dong Wang
- Department of Neurobiology and Department of Psychiatry of Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, 310058, Hangzhou, China. .,NHC and CAMS Key Laboratory of Medical Neurobiology, MOE Frontier Science Center for Brain Research and Brain-Machine Integration, School of Brain Science and Brain Medicine, Zhejiang University, 310058, Hangzhou, China.
| |
Collapse
|
27
|
Shadi K, Dyer E, Dovrolis C. Multisensory integration in the mouse cortical connectome using a network diffusion model. Netw Neurosci 2020; 4:1030-1054. [PMID: 33195947 PMCID: PMC7655044 DOI: 10.1162/netn_a_00164] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2019] [Accepted: 08/03/2020] [Indexed: 01/05/2023] Open
Abstract
Having a structural network representation of connectivity in the brain is instrumental in analyzing communication dynamics and neural information processing. In this work, we make steps towards understanding multisensory information flow and integration using a network diffusion approach. In particular, we model the flow of evoked activity, initiated by stimuli at primary sensory regions, using the asynchronous linear threshold (ALT) diffusion model. The ALT model captures how evoked activity that originates at a given region of the cortex “ripples through” other brain regions (referred to as an activation cascade). We find that a small number of brain regions–the claustrum and the parietal temporal cortex being at the top of the list–are involved in almost all cortical sensory streams. This suggests that the cortex relies on an hourglass architecture to first integrate and compress multisensory information from multiple sensory regions, before utilizing that lower dimensionality representation in higher level association regions and more complex cognitive tasks. Having a structural network representation of connectivity in the brain is instrumental in analyzing communication dynamics and neural information processing. In this work, we make steps towards understanding multisensory information flow and integration using a network diffusion approach. In particular, we model the flow of evoked activity, initiated by stimuli at primary sensory regions, using the asynchronous linear threshold (ALT) diffusion model. The ALT model captures how evoked activity that originates at a given region of the cortex “ripples through” other brain regions (referred to as an activation cascade). We apply the ALT model to the mouse connectome provided by the Allen Institute for Brain Science. A first result, using functional datasets based on voltage-sensitive dye (VSD) imaging, is that the ALT model, despite its simplicity, predicts the temporal ordering of each sensory activation cascade quite accurately. We further apply this model to study multisensory integration and find that a small number of brain regionsthe claustrum and the parietal temporal cortex being at the top of the listare involved in almost all cortical sensory streams. This suggests that the cortex relies on an hourglass architecture to first integrate and compress multisensory information from multiple sensory regions, before utilizing that lower dimensionality representation in higher level association regions and more complex cognitive tasks.
Collapse
Affiliation(s)
- Kamal Shadi
- School of Computer Science, Georgia Institute of Technology, Atlanta, GA, USA
| | - Eva Dyer
- Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, GA, USA
| | | |
Collapse
|
28
|
Interplay between cell-adhesion molecules governs synaptic wiring of cone photoreceptors. Proc Natl Acad Sci U S A 2020; 117:23914-23924. [PMID: 32879010 DOI: 10.1073/pnas.2009940117] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022] Open
Abstract
Establishment of functional synaptic connections in a selective manner is essential for nervous system operation. In mammalian retinas, rod and cone photoreceptors form selective synaptic connections with different classes of bipolar cells (BCs) to propagate light signals. While there has been progress in elucidating rod wiring, molecular mechanisms used by cones to establish functional synapses with BCs have remained unknown. Using an unbiased proteomic strategy in cone-dominant species, we identified the cell-adhesion molecule ELFN2 to be pivotal for the functional wiring of cones with the ON type of BC. It is selectively expressed in cones and transsynaptically recruits the key neurotransmitter receptor mGluR6 in ON-BCs to enable synaptic transmission. Remarkably, ELFN2 in cone terminals functions in synergy with a related adhesion molecule, ELFN1, and their concerted interplay during development specifies selective wiring and transmission of cone signals. These findings identify a synaptic connectivity mechanism of cones and illustrate how interplay between adhesion molecules and postsynaptic transmitter receptors orchestrates functional synaptic specification in a neural circuit.
Collapse
|
29
|
Boyce WP, Lindsay A, Zgonnikov A, Rañó I, Wong-Lin K. Optimality and Limitations of Audio-Visual Integration for Cognitive Systems. Front Robot AI 2020; 7:94. [PMID: 33501261 PMCID: PMC7805627 DOI: 10.3389/frobt.2020.00094] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2019] [Accepted: 06/09/2020] [Indexed: 11/13/2022] Open
Abstract
Multimodal integration is an important process in perceptual decision-making. In humans, this process has often been shown to be statistically optimal, or near optimal: sensory information is combined in a fashion that minimizes the average error in perceptual representation of stimuli. However, sometimes there are costs that come with the optimization, manifesting as illusory percepts. We review audio-visual facilitations and illusions that are products of multisensory integration, and the computational models that account for these phenomena. In particular, the same optimal computational model can lead to illusory percepts, and we suggest that more studies should be needed to detect and mitigate these illusions, as artifacts in artificial cognitive systems. We provide cautionary considerations when designing artificial cognitive systems with the view of avoiding such artifacts. Finally, we suggest avenues of research toward solutions to potential pitfalls in system design. We conclude that detailed understanding of multisensory integration and the mechanisms behind audio-visual illusions can benefit the design of artificial cognitive systems.
Collapse
Affiliation(s)
- William Paul Boyce
- Intelligent Systems Research Centre, Ulster University, Magee Campus, Derry Londonderry, Northern Ireland, United Kingdom
| | - Anthony Lindsay
- Intelligent Systems Research Centre, Ulster University, Magee Campus, Derry Londonderry, Northern Ireland, United Kingdom
| | - Arkady Zgonnikov
- AiTech, Delft University of Technology, Delft, Netherlands
- Department of Cognitive Robotics, Faculty of Mechanical, Maritime, and Materials Engineering, Delft University of Technology, Delft, Netherlands
| | - Iñaki Rañó
- Intelligent Systems Research Centre, Ulster University, Magee Campus, Derry Londonderry, Northern Ireland, United Kingdom
| | - KongFatt Wong-Lin
- Intelligent Systems Research Centre, Ulster University, Magee Campus, Derry Londonderry, Northern Ireland, United Kingdom
| |
Collapse
|
30
|
Repeated Exposure to Multiple Concurrent Stresses Induce Circuit Specific Loss of Inputs to the Posterior Parietal Cortex. J Neurosci 2020; 40:1849-1861. [PMID: 31949108 DOI: 10.1523/jneurosci.1838-19.2020] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2019] [Revised: 01/06/2020] [Accepted: 01/09/2020] [Indexed: 11/21/2022] Open
Abstract
Severe loss of excitatory synapses in key brain regions is thought to be one of the major mechanisms underlying stress-induced cognitive impairment. To date, however, the identity of the affected circuits remains elusive. Here we examined the effect of exposure to repeated multiple concurrent stressors (RMS) on the connectivity of the posterior parietal cortex (PPC) in adolescent male mice. We found that RMS led to layer-specific elimination of excitatory synapses with the most pronounced loss observed in deeper cortical layers. Quantitative analysis of cortical projections to the PPC revealed a significant loss of sensory and retrosplenial inputs to the PPC while contralateral and frontal projections were preserved. These results were confirmed by decreased synaptic strength from sensory, but not from contralateral, projections in stress-exposed animals. Functionally, RMS disrupted visuospatial working memory performance, implicating disrupted higher-order visual processing. These effects were not observed in mice subjected to restraint-only stress for an identical period of time. The PPC is considered to be a cortical hub for multisensory integration, working memory, and perceptual decision-making. Our data suggest that sensory information streams targeting the PPC may be impacted by recurring stress, likely contributing to stress-induced cognitive impairment.SIGNIFICANCE STATEMENT Repeated exposure to stress profoundly impairs cognitive functions like memory, attention, or decision-making. There is emerging evidence that stress not only impacts high-order regions of the brain, but may affect earlier stages of cognitive processing. Our work focuses on the posterior parietal cortex, a brain region supporting short-term memory, multisensory integration, and decision-making. We show evidence that repeated stress specifically damages sensory inputs to this region. This disruption of synaptic connectivity is linked to working memory impairment and is specific to repeated exposure to multiple stressors. Altogether, our data provide a potential alternative explanation to ailments previously attributed to downstream, cognitive brain structures.
Collapse
|