1
|
Xu X, Hanganu-Opatz IL, Bieler M. Cross-Talk of Low-Level Sensory and High-Level Cognitive Processing: Development, Mechanisms, and Relevance for Cross-Modal Abilities of the Brain. Front Neurorobot 2020; 14:7. [PMID: 32116637 PMCID: PMC7034303 DOI: 10.3389/fnbot.2020.00007] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2019] [Accepted: 01/27/2020] [Indexed: 12/18/2022] Open
Abstract
The emergence of cross-modal learning capabilities requires the interaction of neural areas accounting for sensory and cognitive processing. Convergence of multiple sensory inputs is observed in low-level sensory cortices including primary somatosensory (S1), visual (V1), and auditory cortex (A1), as well as in high-level areas such as prefrontal cortex (PFC). Evidence shows that local neural activity and functional connectivity between sensory cortices participate in cross-modal processing. However, little is known about the functional interplay between neural areas underlying sensory and cognitive processing required for cross-modal learning capabilities across life. Here we review our current knowledge on the interdependence of low- and high-level cortices for the emergence of cross-modal processing in rodents. First, we summarize the mechanisms underlying the integration of multiple senses and how cross-modal processing in primary sensory cortices might be modified by top-down modulation of the PFC. Second, we examine the critical factors and developmental mechanisms that account for the interaction between neuronal networks involved in sensory and cognitive processing. Finally, we discuss the applicability and relevance of cross-modal processing for brain-inspired intelligent robotics. An in-depth understanding of the factors and mechanisms controlling cross-modal processing might inspire the refinement of robotic systems by better mimicking neural computations.
Collapse
Affiliation(s)
- Xiaxia Xu
- Developmental Neurophysiology, Center for Molecular Neurobiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Ileana L Hanganu-Opatz
- Developmental Neurophysiology, Center for Molecular Neurobiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Malte Bieler
- Laboratory for Neural Computation, Institute of Basic Medical Sciences, University of Oslo, Oslo, Norway
| |
Collapse
|
2
|
Maruyama AT, Komai S. Auditory-induced response in the primary sensory cortex of rodents. PLoS One 2018; 13:e0209266. [PMID: 30571722 PMCID: PMC6301624 DOI: 10.1371/journal.pone.0209266] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2018] [Accepted: 12/03/2018] [Indexed: 11/18/2022] Open
Abstract
The details of auditory response at the subthreshold level in the rodent primary somatosensory cortex, the barrel cortex, have not been studied extensively, although several phenomenological reports have been published. Multisensory features may act as neuronal representations of links between inputs from one sensory modality to other sensory modalities. Here, we examined the basic multisensory postsynaptic responses in the rodent barrel cortex using in vivo whole-cell recordings of neurons. We observed robust responses to acoustic stimuli in most barrel cortex neurons. Acoustically evoked responses were mediated by hearing and reached approximately 60% of the postsynaptic response amplitude elicited by strong somatosensory stimuli. Compared to tactile stimuli, auditory stimuli evoked postsynaptic potentials with a longer latency and longer duration. Specifically, auditory stimuli in barrel cortex neurons appeared to trigger "up states", episodes associated with membrane depolarization and increased synaptic activity. Taken together, our data suggest that barrel cortex neurons have multisensory properties, with distinct synaptic mechanisms underlying tactile and non-tactile responses.
Collapse
Affiliation(s)
- Atsuko T. Maruyama
- Department of Science and Technology, Nara Institute of Science Technology, Takayama, Japan
| | - Shoji Komai
- Department of Science and Technology, Nara Institute of Science Technology, Takayama, Japan
- * E-mail:
| |
Collapse
|
3
|
Henschke JU, Oelschlegel AM, Angenstein F, Ohl FW, Goldschmidt J, Kanold PO, Budinger E. Early sensory experience influences the development of multisensory thalamocortical and intracortical connections of primary sensory cortices. Brain Struct Funct 2018; 223:1165-1190. [PMID: 29094306 PMCID: PMC5871574 DOI: 10.1007/s00429-017-1549-1] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2017] [Accepted: 09/29/2017] [Indexed: 12/21/2022]
Abstract
The nervous system integrates information from multiple senses. This multisensory integration already occurs in primary sensory cortices via direct thalamocortical and corticocortical connections across modalities. In humans, sensory loss from birth results in functional recruitment of the deprived cortical territory by the spared senses but the underlying circuit changes are not well known. Using tracer injections into primary auditory, somatosensory, and visual cortex within the first postnatal month of life in a rodent model (Mongolian gerbil) we show that multisensory thalamocortical connections emerge before corticocortical connections but mostly disappear during development. Early auditory, somatosensory, or visual deprivation increases multisensory connections via axonal reorganization processes mediated by non-lemniscal thalamic nuclei and the primary areas themselves. Functional single-photon emission computed tomography of regional cerebral blood flow reveals altered stimulus-induced activity and higher functional connectivity specifically between primary areas in deprived animals. Together, we show that intracortical multisensory connections are formed as a consequence of sensory-driven multisensory thalamocortical activity and that spared senses functionally recruit deprived cortical areas by an altered development of sensory thalamocortical and corticocortical connections. The functional-anatomical changes after early sensory deprivation have translational implications for the therapy of developmental hearing loss, blindness, and sensory paralysis and might also underlie developmental synesthesia.
Collapse
Affiliation(s)
- Julia U Henschke
- Department Systems Physiology of Learning, Leibniz Institute for Neurobiology, Brenneckestr. 6, 39118, Magdeburg, Germany
- German Center for Neurodegenerative Diseases Within the Helmholtz Association, Leipziger Str. 44, 39120, Magdeburg, Germany
- Institute of Cognitive Neurology and Dementia Research (IKND), Otto-von-Guericke-University Magdeburg, Leipziger Str. 44, 39120, Magdeburg, Germany
- Center for Behavioral Brain Sciences, Universitätsplatz 2, 39120, Magdeburg, Germany
| | - Anja M Oelschlegel
- Research Group Neuropharmacology, Leibniz Institute for Neurobiology, Brenneckestr. 6, 39118, Magdeburg, Germany
- Institute of Anatomy, Otto-von-Guericke-University Magdeburg, Leipziger Str. 44, 39120, Magdeburg, Germany
| | - Frank Angenstein
- Functional Neuroimaging Group, German Center for Neurodegenerative Diseases Within the Helmholtz Association, Leipziger Str. 44, 39120, Magdeburg, Germany
- Center for Behavioral Brain Sciences, Universitätsplatz 2, 39120, Magdeburg, Germany
| | - Frank W Ohl
- Department Systems Physiology of Learning, Leibniz Institute for Neurobiology, Brenneckestr. 6, 39118, Magdeburg, Germany
- Institute of Biology, Otto-von-Guericke-University Magdeburg, Leipziger Str. 44, 39120, Magdeburg, Germany
- Center for Behavioral Brain Sciences, Universitätsplatz 2, 39120, Magdeburg, Germany
| | - Jürgen Goldschmidt
- Department Systems Physiology of Learning, Leibniz Institute for Neurobiology, Brenneckestr. 6, 39118, Magdeburg, Germany
- Center for Behavioral Brain Sciences, Universitätsplatz 2, 39120, Magdeburg, Germany
| | - Patrick O Kanold
- Department of Biology, University of Maryland, College Park, MD, 20742, USA
| | - Eike Budinger
- Department Systems Physiology of Learning, Leibniz Institute for Neurobiology, Brenneckestr. 6, 39118, Magdeburg, Germany.
- Center for Behavioral Brain Sciences, Universitätsplatz 2, 39120, Magdeburg, Germany.
| |
Collapse
|
4
|
Rate and Temporal Coding Convey Multisensory Information in Primary Sensory Cortices. eNeuro 2017; 4:eN-NWR-0037-17. [PMID: 28374008 PMCID: PMC5362936 DOI: 10.1523/eneuro.0037-17.2017] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2017] [Accepted: 02/10/2017] [Indexed: 11/21/2022] Open
Abstract
Optimal behavior and survival result from integration of information across sensory systems. Modulation of network activity at the level of primary sensory cortices has been identified as a mechanism of cross-modal integration, yet its cellular substrate is still poorly understood. Here, we uncover the mechanisms by which individual neurons in primary somatosensory (S1) and visual (V1) cortices encode visual-tactile stimuli. For this, simultaneous extracellular recordings were performed from all layers of the S1 barrel field and V1 in Brown Norway rats in vivo and units were clustered and assigned to pyramidal neurons (PYRs) and interneurons (INs). We show that visual-tactile stimulation modulates the firing rate of a relatively low fraction of neurons throughout all cortical layers. Generally, it augments the firing of INs and decreases the activity of PYRs. Moreover, bimodal stimulation shapes the timing of neuronal firing by strengthening the phase-coupling between neuronal discharge and theta–beta band network oscillations as well as by modulating spiking onset. Sparse direct axonal projections between neurons in S1 and V1 seem to time the spike trains between the two cortical areas and, thus, may act as a substrate of cross-modal modulation. These results indicate that few cortical neurons mediate multisensory effects in primary sensory areas by directly encoding cross-modal information by their rate and timing of firing.
Collapse
|
5
|
Restuccia D, Coppola G. Auditory stimulation enhances thalamic somatosensory high-frequency oscillations in healthy humans: a neurophysiological marker of cross-sensory sensitization? Eur J Neurosci 2015; 41:1079-85. [PMID: 25784489 DOI: 10.1111/ejn.12873] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2014] [Revised: 02/11/2015] [Accepted: 02/12/2015] [Indexed: 12/13/2022]
Abstract
Electrical stimulation of upper limb nerves evokes a train of high-frequency wavelets (high-frequency oscillations, HFOs) on the human scalp. These HFOs are related to the influence of arousal-promoting structures on somatosensory input processing, and are generated in the primary somatosensory cortex (post-synaptic HFOs) and the terminal tracts of thalamocortical radiations (pre-synaptic HFOs). We previously reported that HFOs do not undergo habituation to repeated stimulations; here, we verified whether HFOs could be modulated by external sensitizing stimuli. We recorded somatosensory evoked potentials (SSEPs) in 15 healthy volunteers before and after sensitization training with an auditory stimulus. Pre-synaptic HFO amplitudes, reflecting somatosensory thalamic/thalamocortical activity, significantly increased after the sensitizing acoustic stimulation, whereas both the low-frequency N20 SSEP component and post-synaptic HFOs were unaffected. Cross-talk between subcortical arousal-related structures is a probable mechanism for the pre-synaptic HFO effect observed in this study. We propose that part of the ascending somatosensory input encoded in HFOs is specifically able to convey sensitized inputs. This preferential involvement in sensitization mechanisms suggests that HFOs play a critical role in the detection of potentially relevant stimuli, and act at very early stages of somatosensory input processing.
Collapse
Affiliation(s)
- Domenico Restuccia
- Department of Neurosciences, Catholic University, Largo A. Gemelli 8, Rome, 00168, Italy
| | | |
Collapse
|
6
|
Sarko DK, Ghose D, Wallace MT. Convergent approaches toward the study of multisensory perception. Front Syst Neurosci 2013; 7:81. [PMID: 24265607 PMCID: PMC3820972 DOI: 10.3389/fnsys.2013.00081] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2013] [Accepted: 10/20/2013] [Indexed: 11/13/2022] Open
Abstract
Classical analytical approaches for examining multisensory processing in individual neurons have relied heavily on changes in mean firing rate to assess the presence and magnitude of multisensory interaction. However, neurophysiological studies within individual sensory systems have illustrated that important sensory and perceptual information is encoded in forms that go beyond these traditional spike-based measures. Here we review analytical tools as they are used within individual sensory systems (auditory, somatosensory, and visual) to advance our understanding of how sensory cues are effectively integrated across modalities (e.g., audiovisual cues facilitating speech processing). Specifically, we discuss how methods used to assess response variability (Fano factor, or FF), local field potentials (LFPs), current source density (CSD), oscillatory coherence, spike synchrony, and receiver operating characteristics (ROC) represent particularly promising tools for understanding the neural encoding of multisensory stimulus features. The utility of each approach and how it might optimally be applied toward understanding multisensory processing is placed within the context of exciting new data that is just beginning to be generated. Finally, we address how underlying encoding mechanisms might shape-and be tested alongside with-the known behavioral and perceptual benefits that accompany multisensory processing.
Collapse
Affiliation(s)
- Diana K. Sarko
- Department of Anatomy, Cell Biology and Physiology, Edward Via College of Osteopathic MedicineSpartanburg, SC, USA
| | - Dipanwita Ghose
- Department of Anesthesiology, Vanderbilt University Medical CenterNashville, TN, USA
| | - Mark T. Wallace
- Department of Hearing and Speech Sciences, Vanderbilt UniversityNashville, TN, USA
| |
Collapse
|
7
|
A satisficing and bricoleur approach to sensorimotor cognition. Biosystems 2012; 110:65-73. [PMID: 23063599 DOI: 10.1016/j.biosystems.2012.09.007] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2012] [Revised: 09/18/2012] [Accepted: 09/28/2012] [Indexed: 01/06/2023]
Abstract
In this manuscript I present a set of neural processing principles and evolutionary constraints that should be taken into account in the characterization of sensorimotor cognition. I review evidence supporting the choice of the set of principles, and then I assess how such principles apply to two cases, object perception-action and peripersonal space. The aim is to emphasize the importance of focusing cognitive models on how evolution shapes functional paths to adaptations, as well as to adopt fitness maximization analyses of cognitive functions. Such an approach contrasts with the widespread reverse-engineering assumption that the neural system comprises a set of specialized circuits designed to comply with its assumed functions. The evidence presented in the manuscript points to the fact that neural systems should not be seen as a seat of optimal processes and circuits addressing particular problems in sensorimotor cognition, but as a set of satisficing and tinkered components, mostly not addressing the problems that are supposed to solve, but solving them as secondary effects of the engaged processes. I conclude with a corollary of the challenges lying ahead of the proposed approach.
Collapse
|
8
|
Enriched and deprived sensory experience induces structural changes and rewires connectivity during the postnatal development of the brain. Neural Plast 2012; 2012:305693. [PMID: 22848849 PMCID: PMC3400395 DOI: 10.1155/2012/305693] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2011] [Revised: 03/20/2012] [Accepted: 06/13/2012] [Indexed: 11/17/2022] Open
Abstract
During postnatal development, sensory experience modulates cortical development, inducing numerous changes in all of the components of the cortex. Most of the cortical changes thus induced occur during the critical period, when the functional and structural properties of cortical neurons are particularly susceptible to alterations. Although the time course for experience-mediated sensory development is specific for each system, postnatal development acts as a whole, and if one cortical area is deprived of its normal sensory inputs during early stages, it will be reorganized by the nondeprived senses in a process of cross-modal plasticity that not only increases performance in the remaining senses when one is deprived, but also rewires the brain allowing the deprived cortex to process inputs from other senses and cortices, maintaining the modular configuration. This paper summarizes our current understanding of sensory systems development, focused specially in the visual system. It delineates sensory enhancement and sensory deprivation effects at both physiological and anatomical levels and describes the use of enriched environment as a tool to rewire loss of brain areas to enhance other active senses. Finally, strategies to apply restorative features in human-deprived senses are studied, discussing the beneficial and detrimental effects of cross-modal plasticity in prostheses and sensory substitution devices implantation.
Collapse
|
9
|
Kral A, Sharma A. Developmental neuroplasticity after cochlear implantation. Trends Neurosci 2011; 35:111-22. [PMID: 22104561 DOI: 10.1016/j.tins.2011.09.004] [Citation(s) in RCA: 332] [Impact Index Per Article: 25.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2011] [Revised: 09/27/2011] [Accepted: 09/27/2011] [Indexed: 10/15/2022]
Abstract
Cortical development is dependent on stimulus-driven learning. The absence of sensory input from birth, as occurs in congenital deafness, affects normal growth and connectivity needed to form a functional sensory system, resulting in deficits in oral language learning. Cochlear implants bypass cochlear damage by directly stimulating the auditory nerve and brain, making it possible to avoid many of the deleterious effects of sensory deprivation. Congenitally deaf animals and children who receive implants provide a platform to examine the characteristics of cortical plasticity in the auditory system. In this review, we discuss the existence of time limits for, and mechanistic constraints on, sensitive periods for cochlear implantation and describe the effects of multimodal and cognitive reorganization that result from long-term auditory deprivation.
Collapse
Affiliation(s)
- Andrej Kral
- Institute of Audioneurotechnology & Department of Experimental Otology, ENT Clinics, Medical University Hannover, Germany
| | | |
Collapse
|