1
|
Carretié L, Fernández-Folgueiras U, Kessel D, Alba G, Veiga-Zarza E, Tapia M, Álvarez F. An extremely fast neural mechanism to detect emotional visual stimuli: A two-experiment study. PLoS One 2024; 19:e0299677. [PMID: 38905211 PMCID: PMC11192326 DOI: 10.1371/journal.pone.0299677] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2024] [Accepted: 05/03/2024] [Indexed: 06/23/2024] Open
Abstract
Defining the brain mechanisms underlying initial emotional evaluation is a key but unexplored clue to understanding affective processing. Event-related potentials (ERPs), especially suited for investigating this issue, were recorded in two experiments (n = 36 and n = 35). We presented emotionally negative (spiders) and neutral (wheels) silhouettes homogenized regarding their visual parameters. In Experiment 1, stimuli appeared at fixation or in the periphery (200 trials per condition and location), the former eliciting a N40 (39 milliseconds) and a P80 (or C1: 80 milliseconds) component, and the latter only a P80. In Experiment 2, stimuli were presented only at fixation (500 trials per condition). Again, an N40 (45 milliseconds) was observed, followed by a P100 (or P1: 105 milliseconds). Analyses revealed significantly greater N40-C1P1 peak-to-peak amplitudes for spiders in both experiments, and ANCOVAs showed that these effects were not explained by C1P1 alone, but that processes underlying N40 significantly contributed. Source analyses pointed to V1 as an N40 focus (more clearly in Experiment 2). Sources for C1P1 included V1 (P80) and V2/LOC (P80 and P100). These results and their timing point to low-order structures (such as visual thalamic nuclei or superior colliculi) or the visual cortex itself, as candidates for initial evaluation structures.
Collapse
Affiliation(s)
- Luis Carretié
- Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain
| | | | - Dominique Kessel
- Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain
| | - Guzmán Alba
- Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain
| | | | - Manuel Tapia
- Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain
| | - Fátima Álvarez
- Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain
| |
Collapse
|
2
|
Veale R, Takahashi M. Pathways for Naturalistic Looking Behavior in Primate II. Superior Colliculus Integrates Parallel Top-down and Bottom-up Inputs. Neuroscience 2024; 545:86-110. [PMID: 38484836 DOI: 10.1016/j.neuroscience.2024.03.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2023] [Revised: 02/15/2024] [Accepted: 03/01/2024] [Indexed: 03/24/2024]
Abstract
Volitional signals for gaze control are provided by multiple parallel pathways converging on the midbrain superior colliculus (SC), whose deeper layers output to the brainstem gaze circuits. In the first of two papers (Takahashi and Veale, 2023), we described the properties of gaze behavior of several species under both laboratory and natural conditions, as well as the current understanding of the brainstem and spinal cord circuits implementing gaze control in primate. In this paper, we review the parallel pathways by which sensory and task information reaches SC and how these sensory and task signals interact within SC's multilayered structure. This includes both bottom-up (world statistics) signals mediated by sensory cortex, association cortex, and subcortical structures, as well as top-down (goal and task) influences which arrive via either direct excitatory pathways from cerebral cortex, or via indirect basal ganglia relays resulting in inhibition or dis-inhibition as appropriate for alternative behaviors. Models of attention such as saliency maps serve as convenient frameworks to organize our understanding of both the separate computations of each neural pathway, as well as the interaction between the multiple parallel pathways influencing gaze. While the spatial interactions between gaze's neural pathways are relatively well understood, the temporal interactions between and within pathways will be an important area of future study, requiring both improved technical methods for measurement and improvement of our understanding of how temporal dynamics results in the observed spatiotemporal allocation of gaze.
Collapse
Affiliation(s)
- Richard Veale
- Department of Neurobiology, Graduate School of Medicine, Kyoto University, Japan
| | - Mayu Takahashi
- Department of Systems Neurophysiology, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Japan.
| |
Collapse
|
3
|
Özcan F, Alkan A. Neural decoding of inferior colliculus multiunit activity for sound category identification with temporal correlation and transfer learning. NETWORK (BRISTOL, ENGLAND) 2024; 35:101-133. [PMID: 37982591 DOI: 10.1080/0954898x.2023.2282576] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Accepted: 11/07/2023] [Indexed: 11/21/2023]
Abstract
Natural sounds are easily perceived and identified by humans and animals. Despite this, the neural transformations that enable sound perception remain largely unknown. It is thought that the temporal characteristics of sounds may be reflected in auditory assembly responses at the inferior colliculus (IC) and which may play an important role in identification of natural sounds. In our study, natural sounds will be predicted from multi-unit activity (MUA) signals collected in the IC. Data is obtained from an international platform publicly accessible. The temporal correlation values of the MUA signals are converted into images. We used two different segment sizes and with a denoising method, we generated four subsets for the classification. Using pre-trained convolutional neural networks (CNNs), features of the images were extracted and the type of heard sound was classified. For this, we applied transfer learning from Alexnet, Googlenet and Squeezenet CNNs. The classifiers support vector machines (SVM), k-nearest neighbour (KNN), Naive Bayes and Ensemble were used. The accuracy, sensitivity, specificity, precision and F1 score were measured as evaluation parameters. By using all the tests and removing the noise, the accuracy improved significantly. These results will allow neuroscientists to make interesting conclusions.
Collapse
Affiliation(s)
- Fatma Özcan
- Electrical & Electronics Engineering Department, Kahramanmaras Sutcu Imam University, Kahramanmaraş, Turkey
| | - Ahmet Alkan
- Electrical & Electronics Engineering Department, Kahramanmaras Sutcu Imam University, Kahramanmaraş, Turkey
| |
Collapse
|
4
|
Esposito M, Palermo S, Nahi YC, Tamietto M, Celeghin A. Implicit Selective Attention: The Role of the Mesencephalic-basal Ganglia System. Curr Neuropharmacol 2024; 22:1497-1512. [PMID: 37653629 PMCID: PMC11097991 DOI: 10.2174/1570159x21666230831163052] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2023] [Revised: 04/13/2023] [Accepted: 04/13/2023] [Indexed: 09/02/2023] Open
Abstract
The ability of the brain to recognize and orient attention to relevant stimuli appearing in the visual field is highlighted by a tuning process, which involves modulating the early visual system by both cortical and subcortical brain areas. Selective attention is coordinated not only by the output of stimulus-based saliency maps but is also influenced by top-down cognitive factors, such as internal states, goals, or previous experiences. The basal ganglia system plays a key role in implicitly modulating the underlying mechanisms of selective attention, favouring the formation and maintenance of implicit sensory-motor memories that are capable of automatically modifying the output of priority maps in sensory-motor structures of the midbrain, such as the superior colliculus. The article presents an overview of the recent literature outlining the crucial contribution of several subcortical structures to the processing of different sources of salient stimuli. In detail, we will focus on how the mesencephalic- basal ganglia closed loops contribute to implicitly addressing and modulating selective attention to prioritized stimuli. We conclude by discussing implicit behavioural responses observed in clinical populations in which awareness is compromised at some level. Implicit (emergent) awareness in clinical conditions that can be accompanied by manifest anosognosic symptomatology (i.e., hemiplegia) or involving abnormal conscious processing of visual information (i.e., unilateral spatial neglect and blindsight) represents interesting neurocognitive "test cases" for inferences about mesencephalicbasal ganglia closed-loops involvement in the formation of implicit sensory-motor memories.
Collapse
Affiliation(s)
- Matteo Esposito
- Department of Psychology, University of Torino, Via Verdi 10, 10124, Turin
| | - Sara Palermo
- Department of Psychology, University of Torino, Via Verdi 10, 10124, Turin
- Neuroradiology Unit, Department of Diagnostic and Technology, Fondazione IRCCS Istituto Neurologico Carlo Besta, Milan, Italy
| | | | - Marco Tamietto
- Department of Psychology, University of Torino, Via Verdi 10, 10124, Turin
- Department of Medical and Clinical Psychology, and CoRPS - Center of Research on Psychology in Somatic Diseases, Tilburg University, PO Box 90153, 5000 LE Tilburg, The Netherlands
| | - Alessia Celeghin
- Department of Psychology, University of Torino, Via Verdi 10, 10124, Turin
| |
Collapse
|
5
|
Borgomaneri S, Zanon M, Di Luzio P, Cataneo A, Arcara G, Romei V, Tamietto M, Avenanti A. Increasing associative plasticity in temporo-occipital back-projections improves visual perception of emotions. Nat Commun 2023; 14:5720. [PMID: 37737239 PMCID: PMC10517146 DOI: 10.1038/s41467-023-41058-3] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Accepted: 08/17/2023] [Indexed: 09/23/2023] Open
Abstract
The posterior superior temporal sulcus (pSTS) is a critical node in a network specialized for perceiving emotional facial expressions that is reciprocally connected with early visual cortices (V1/V2). Current models of perceptual decision-making increasingly assign relevance to recursive processing for visual recognition. However, it is unknown whether inducing plasticity into reentrant connections from pSTS to V1/V2 impacts emotion perception. Using a combination of electrophysiological and neurostimulation methods, we demonstrate that strengthening the connectivity from pSTS to V1/V2 selectively increases the ability to perceive facial expressions associated with emotions. This behavior is associated with increased electrophysiological activity in both these brain regions, particularly in V1/V2, and depends on specific temporal parameters of stimulation that follow Hebbian principles. Therefore, we provide evidence that pSTS-to-V1/V2 back-projections are instrumental to perception of emotion from facial stimuli and functionally malleable via manipulation of associative plasticity.
Collapse
Affiliation(s)
- Sara Borgomaneri
- Centro studi e ricerche in Neuroscienze Cognitive, Dipartimento di Psicologia "Renzo Canestrari", Alma Mater Studiorum Università di Bologna, Cesena Campus, Cesena, Italy.
| | - Marco Zanon
- Centro studi e ricerche in Neuroscienze Cognitive, Dipartimento di Psicologia "Renzo Canestrari", Alma Mater Studiorum Università di Bologna, Cesena Campus, Cesena, Italy
- Neuroscience Area, International School for Advanced Studies (SISSA), Trieste, Italy
| | - Paolo Di Luzio
- Centro studi e ricerche in Neuroscienze Cognitive, Dipartimento di Psicologia "Renzo Canestrari", Alma Mater Studiorum Università di Bologna, Cesena Campus, Cesena, Italy
| | - Antonio Cataneo
- Centro studi e ricerche in Neuroscienze Cognitive, Dipartimento di Psicologia "Renzo Canestrari", Alma Mater Studiorum Università di Bologna, Cesena Campus, Cesena, Italy
| | | | - Vincenzo Romei
- Centro studi e ricerche in Neuroscienze Cognitive, Dipartimento di Psicologia "Renzo Canestrari", Alma Mater Studiorum Università di Bologna, Cesena Campus, Cesena, Italy
- Facultad de Lenguas y Educación, Universidad Antonio de Nebrija, Madrid, 28015, Spain
| | - Marco Tamietto
- Dipartimento di Psicologia, Università degli Studi di Torino, Torino, Italy.
- Department of Medical and Clinical Psychology, Tilburg University, Tilburg, The Netherlands.
| | - Alessio Avenanti
- Centro studi e ricerche in Neuroscienze Cognitive, Dipartimento di Psicologia "Renzo Canestrari", Alma Mater Studiorum Università di Bologna, Cesena Campus, Cesena, Italy.
- Centro de Investigación en Neuropsicología y Neurociencias Cognitivas, Universidad Católica del Maule, Talca, Chile.
| |
Collapse
|
6
|
Celeghin A, Borriero A, Orsenigo D, Diano M, Méndez Guerrero CA, Perotti A, Petri G, Tamietto M. Convolutional neural networks for vision neuroscience: significance, developments, and outstanding issues. Front Comput Neurosci 2023; 17:1153572. [PMID: 37485400 PMCID: PMC10359983 DOI: 10.3389/fncom.2023.1153572] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2023] [Accepted: 06/19/2023] [Indexed: 07/25/2023] Open
Abstract
Convolutional Neural Networks (CNN) are a class of machine learning models predominately used in computer vision tasks and can achieve human-like performance through learning from experience. Their striking similarities to the structural and functional principles of the primate visual system allow for comparisons between these artificial networks and their biological counterparts, enabling exploration of how visual functions and neural representations may emerge in the real brain from a limited set of computational principles. After considering the basic features of CNNs, we discuss the opportunities and challenges of endorsing CNNs as in silico models of the primate visual system. Specifically, we highlight several emerging notions about the anatomical and physiological properties of the visual system that still need to be systematically integrated into current CNN models. These tenets include the implementation of parallel processing pathways from the early stages of retinal input and the reconsideration of several assumptions concerning the serial progression of information flow. We suggest design choices and architectural constraints that could facilitate a closer alignment with biology provide causal evidence of the predictive link between the artificial and biological visual systems. Adopting this principled perspective could potentially lead to new research questions and applications of CNNs beyond modeling object recognition.
Collapse
Affiliation(s)
| | | | - Davide Orsenigo
- Department of Psychology, University of Torino, Turin, Italy
| | - Matteo Diano
- Department of Psychology, University of Torino, Turin, Italy
| | | | | | | | - Marco Tamietto
- Department of Psychology, University of Torino, Turin, Italy
- Department of Medical and Clinical Psychology, and CoRPS–Center of Research on Psychology in Somatic Diseases–Tilburg University, Tilburg, Netherlands
| |
Collapse
|
7
|
Lim C, Inagaki M, Shinozaki T, Fujita I. Analysis of convolutional neural networks reveals the computational properties essential for subcortical processing of facial expression. Sci Rep 2023; 13:10908. [PMID: 37407668 DOI: 10.1038/s41598-023-37995-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Accepted: 06/30/2023] [Indexed: 07/07/2023] Open
Abstract
Perception of facial expression is crucial for primate social interactions. This visual information is processed through the ventral cortical pathway and the subcortical pathway. However, the subcortical pathway exhibits inaccurate processing, and the responsible architectural and physiological properties remain unclear. To investigate this, we constructed and examined convolutional neural networks with three key properties of the subcortical pathway: a shallow layer architecture, concentric receptive fields at the initial processing stage, and a greater degree of spatial pooling. These neural networks achieved modest accuracy in classifying facial expressions. By replacing these properties, individually or in combination, with corresponding cortical features, performance gradually improved. Similar to amygdala neurons, some units in the final processing layer exhibited sensitivity to retina-based spatial frequencies (SFs), while others were sensitive to object-based SFs. Replacement of any of these properties affected the coordinates of the SF encoding. Therefore, all three properties limit the accuracy of facial expression information and are essential for determining the SF representation coordinate. These findings characterize the role of the subcortical computational processes in facial expression recognition.
Collapse
Affiliation(s)
- Chanseok Lim
- Laboratory for Cognitive Neuroscience, Graduate School of Frontier Biosciences, Osaka University, 1-4 Yamadaoka, Suita, Osaka, 565-0871, Japan
- Perceptual and Cognitive Neuroscience Laboratory, Graduate School of Frontier Biosciences, Osaka University, 1-4 Yamadaoka, Suita, Osaka, 565-0871, Japan
| | - Mikio Inagaki
- Laboratory for Cognitive Neuroscience, Graduate School of Frontier Biosciences, Osaka University, 1-4 Yamadaoka, Suita, Osaka, 565-0871, Japan
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, 1-4 Yamadaoka, Suita, Osaka, 565-0871, Japan
| | - Takashi Shinozaki
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, 1-4 Yamadaoka, Suita, Osaka, 565-0871, Japan
- Computational Neuroscience Laboratory, Faculty of Informatics, Kindai University, 3-4-1 Kowakae, Higashiosaka, Osaka, 577-8502, Japan
| | - Ichiro Fujita
- Laboratory for Cognitive Neuroscience, Graduate School of Frontier Biosciences, Osaka University, 1-4 Yamadaoka, Suita, Osaka, 565-0871, Japan.
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, 1-4 Yamadaoka, Suita, Osaka, 565-0871, Japan.
- Research Organization of Science and Technology, Ritsumeikan University, 1-1-1 Noji-Higashi, Kusatsu, Shiga, 525-8577, Japan.
| |
Collapse
|
8
|
Lavezzi AM, Mehboob R, Piscioli F, Pusiol T. Involvement of the Superior Colliculus in SIDS Pathogenesis. Biomedicines 2023; 11:1689. [PMID: 37371784 DOI: 10.3390/biomedicines11061689] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Revised: 05/25/2023] [Accepted: 06/07/2023] [Indexed: 06/29/2023] Open
Abstract
The aim of this study was to investigate the involvement of the mesencephalic superior colliculus (SC) in the pathogenetic mechanism of SIDS, a syndrome frequently ascribed to arousal failure from sleep. We analyzed the brains of 44 infants who died suddenly within the first 7 months of life, among which were 26 infants with SIDS and 18 controls. In-depth neuropathological investigations of serial sections of the midbrain showed the SC layered cytoarchitectural organization already well known in animals, as made up of seven distinct layers, but so far never highlighted in humans, albeit with some differences. In 69% of SIDS cases but never in the controls, we observed alterations of the laminar arrangement of the SC deep layers (precisely, an increased number of polygonal cells invading the superficial layers and an increased presence of intensely stained myelinated fibers). Since it has been demonstrated in experimental studies that the deep layers of the SC exert motor control including that of the head, their developmental disorder could lead to the failure of newborns who are in a prone position to resume regular breathing by moving their heads in the sleep-arousal phase. The SC anomalies highlighted here represent a new step in understanding the pathogenetic process that leads to SIDS.
Collapse
Affiliation(s)
- Anna M Lavezzi
- "Lino Rossi" Research Center for the Study and Prevention of Unexpected Perinatal Death and SIDS, Department of Biomedical, Surgical and Dental Sciences, University of Milan, 20122 Milan, Italy
| | - Riffat Mehboob
- Lahore Medical Research Center and LMRC Laboratories, LLP, Lahore 54000, Pakistan
| | - Francesco Piscioli
- Provincial Health Care Services, Institute of Pathology, Santa Maria del Carmine Hospital, 38068 Rovereto, Italy
| | - Teresa Pusiol
- Provincial Health Care Services, Institute of Pathology, Santa Maria del Carmine Hospital, 38068 Rovereto, Italy
| |
Collapse
|
9
|
Sun J, Dong T, Liu P. Holistic processing and visual characteristics of regulated and spontaneous expressions. J Vis 2023; 23:6. [PMID: 36912592 PMCID: PMC10019490 DOI: 10.1167/jov.23.3.6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/14/2023] Open
Abstract
The rapid and efficient recognition of facial expressions is crucial for adaptive behaviors, and holistic processing is one of the critical processing methods to achieve this adaptation. Therefore, this study integrated the effects and attentional characteristics of the authenticity of facial expressions on holistic processing. The results show that both regulated and spontaneous expressions were processed holistically. However, the spontaneous expression details did not indicate typical holistic processing, with the congruency effect observed equally for aligned and misaligned conditions. No significant difference between the two expressions was observed in terms of reaction times and eye movement characteristics (i.e., total fixation duration, fixation counts, and first fixation duration). These findings suggest that holistic processing strategies differ between the two expressions. Nevertheless, the difference was not reflected in attentional engagement.
Collapse
Affiliation(s)
- Juncai Sun
- School of Psychology, Qufu Normal University, Qufu, China.,
| | - Tiantian Dong
- Department of Psychology, Shanghai Normal University, Shanghai, China.,
| | - Ping Liu
- Department of Psychology, Shaoxing University, Shaoxing, China.,
| |
Collapse
|
10
|
Caruana F, Palagi E, de Waal FBM. Cracking the laugh code: laughter through the lens of biology, psychology and neuroscience. Philos Trans R Soc Lond B Biol Sci 2022; 377:20220159. [PMID: 36126666 PMCID: PMC9489298 DOI: 10.1098/rstb.2022.0159] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 06/20/2022] [Indexed: 11/25/2022] Open
Affiliation(s)
- Fausto Caruana
- Institute of Neuroscience, National Research Council of Italy (CNR), Via Volturno 39/E, 43125 Parma, Italy
| | - Elisabetta Palagi
- Unit of Ethology, Department of Biology, University of Pisa, via A. Volta 6, 56126, Pisa, Italy
| | | |
Collapse
|