1
|
Zhang X, Lian J, Yu Z, Tang H, Liang D, Liu J, Liu JK. Revealing the mechanisms of semantic satiation with deep learning models. Commun Biol 2024; 7:487. [PMID: 38649503 PMCID: PMC11035687 DOI: 10.1038/s42003-024-06162-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Accepted: 04/08/2024] [Indexed: 04/25/2024] Open
Abstract
The phenomenon of semantic satiation, which refers to the loss of meaning of a word or phrase after being repeated many times, is a well-known psychological phenomenon. However, the microscopic neural computational principles responsible for these mechanisms remain unknown. In this study, we use a deep learning model of continuous coupled neural networks to investigate the mechanism underlying semantic satiation and precisely describe this process with neuronal components. Our results suggest that, from a mesoscopic perspective, semantic satiation may be a bottom-up process. Unlike existing macroscopic psychological studies that suggest that semantic satiation is a top-down process, our simulations use a similar experimental paradigm as classical psychology experiments and observe similar results. Satiation of semantic objectives, similar to the learning process of our network model used for object recognition, relies on continuous learning and switching between objects. The underlying neural coupling strengthens or weakens satiation. Taken together, both neural and network mechanisms play a role in controlling semantic satiation.
Collapse
Affiliation(s)
- Xinyu Zhang
- School of Information Science and Engineering, Lanzhou University, Lanzhou, 730000, Gansu, China
| | - Jing Lian
- School of Electronics and Information Engineering, Lanzhou Jiaotong University, Lanzhou, 730070, Gansu, China
| | - Zhaofei Yu
- School of Computer Science, Peking University, Beijing, 100871, Beijing, China
- Institute for Artificial Intelligence, Peking University, Beijing, 100871, Beijing, China
| | - Huajin Tang
- The State Key Lab of Brain-Machine Intelligence, Zhejiang University, Hangzhou, 310027, Zhejiang, China
- The MOE Frontier Science Center for Brain Science and Brain-Machine Integration, Zhejiang University, Hangzhou, 310027, Zhejiang, China
| | - Dong Liang
- Department of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, 211106, Jiangsu, China
| | - Jizhao Liu
- School of Information Science and Engineering, Lanzhou University, Lanzhou, 730000, Gansu, China.
| | - Jian K Liu
- School of Computer Science, Centre for Human Brain Health, University of Birmingham, Birmingham, B15 2TT, UK.
| |
Collapse
|
2
|
White PA. The perceptual timescape: Perceptual history on the sub-second scale. Cogn Psychol 2024; 149:101643. [PMID: 38452720 DOI: 10.1016/j.cogpsych.2024.101643] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Revised: 02/27/2024] [Accepted: 02/28/2024] [Indexed: 03/09/2024]
Abstract
There is a high-capacity store of brief time span (∼1000 ms) which information enters from perceptual processing, often called iconic memory or sensory memory. It is proposed that a main function of this store is to hold recent perceptual information in a temporally segregated representation, named the perceptual timescape. The perceptual timescape is a continually active representation of change and continuity over time that endows the perceived present with a perceived history. This is accomplished primarily by two kinds of time marking information: time distance information, which marks all items of information in the perceptual timescape according to how far in the past they occurred, and ordinal temporal information, which organises items of information in terms of their temporal order. Added to that is information about connectivity of perceptual objects over time. These kinds of information connect individual items over a brief span of time so as to represent change, persistence, and continuity over time. It is argued that there is a one-way street of information flow from perceptual processing either to the perceived present or directly into the perceptual timescape, and thence to working memory. Consistent with that, the information structure of the perceptual timescape supports postdictive reinterpretations of recent perceptual information. Temporal integration on a time scale of hundreds of milliseconds takes place in perceptual processing and does not draw on information in the perceptual timescape, which is concerned with temporal segregation, not integration.
Collapse
Affiliation(s)
- Peter A White
- School of Psychology, Cardiff University, Tower Building, Park Place, Cardiff, Wales CF10 3YG, United Kingdom.
| |
Collapse
|
3
|
Zhao D, Shen X, Li S, He W. The Impact of Spatial Frequency on the Perception of Crowd Emotion: An fMRI Study. Brain Sci 2023; 13:1699. [PMID: 38137147 PMCID: PMC10742193 DOI: 10.3390/brainsci13121699] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Revised: 12/06/2023] [Accepted: 12/07/2023] [Indexed: 12/24/2023] Open
Abstract
Recognizing the emotions of faces in a crowd is crucial for understanding overall behavior and intention as well as for smooth and friendly social interactions. However, it is unclear whether the spatial frequency of faces affects the discrimination of crowd emotion. Although high- and low-spatial-frequency information for individual faces is processed by distinct neural channels, there is a lack of evidence on how this applies to crowd faces. Here, we used functional magnetic resonance imaging (fMRI) to investigate neural representations of crowd faces at different spatial frequencies. Thirty-three participants were asked to compare whether a test face was happy or more fearful than a crowd face that varied in high, low, and broad spatial frequencies. Our findings revealed that fearful faces with low spatial frequencies were easier to recognize in terms of accuracy (78.9%) and response time (927 ms). Brain regions, such as the fusiform gyrus, located in the ventral visual stream, were preferentially activated in high spatial frequency crowds, which, however, were the most difficult to recognize behaviorally (68.9%). Finally, the right inferior frontal gyrus was found to be better activated in the broad spatial frequency crowds. Our study suggests that people are more sensitive to fearful crowd faces with low spatial frequency and that high spatial frequency does not promote crowd face recognition.
Collapse
Affiliation(s)
- Dongfang Zhao
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; (D.Z.); (X.S.); (S.L.)
- Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian 116029, China
| | - Xiangnan Shen
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; (D.Z.); (X.S.); (S.L.)
- Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian 116029, China
| | - Shuaixia Li
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; (D.Z.); (X.S.); (S.L.)
- Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian 116029, China
| | - Weiqi He
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, China; (D.Z.); (X.S.); (S.L.)
- Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian 116029, China
| |
Collapse
|
4
|
Du Y, Hua L, Tian S, Dai Z, Xia Y, Zhao S, Zou H, Wang X, Sun H, Zhou H, Huang Y, Yao Z, Lu Q. Altered beta band spatial-temporal interactions during negative emotional processing in major depressive disorder: An MEG study. J Affect Disord 2023; 338:254-261. [PMID: 37271293 DOI: 10.1016/j.jad.2023.06.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Revised: 05/31/2023] [Accepted: 06/01/2023] [Indexed: 06/06/2023]
Abstract
BACKGROUND The mood-concordance bias is a key feature of major depressive disorder (MDD), but the spatiotemporal neural activity associated with emotional processing in MDD remains unclear. Understanding the dysregulated connectivity patterns during emotional processing and their relationship with clinical symptoms could provide insights into MDD neuropathology. METHODS We enrolled 108 MDD patients and 64 healthy controls (HCs) who performed an emotion recognition task during magnetoencephalography recording. Network-based statistics (NBS) was used to analyze whole-brain functional connectivity (FC) across different frequency ranges during distinct temporal periods. The relationship between the aberrant FC and affective symptoms was explored. RESULTS MDD patients exhibited decreased FC strength in the beta band (13-30 Hz) compared to HCs. During the early stage of emotional processing (0-100 ms), reduced FC was observed between the left parahippocampal gyrus and the left cuneus. In the late stage (250-400 ms), aberrant FC was primarily found in the cortex-limbic-striatum systems. Moreover, the FC strength between the right fusiform gyrus and left thalamus, and between the left calcarine fissure and left inferior temporal gyrus were negatively associated with Hamilton Depression Rating Scale (HAMD) scores. LIMITATIONS Medication information was not involved. CONCLUSION MDD patients exhibited abnormal temporal-spatial neural interactions in the beta band, ranging from early sensory to later cognitive processing stages. These aberrant interactions involve the cortex-limbic-striatum circuit. Notably, aberrant FC in may serve as a potential biomarker for assessing depression severity.
Collapse
Affiliation(s)
- Yishan Du
- Department of Psychiatry, the Affiliated Brain Hospital of Nanjing Medical University, Nanjing 210029, China
| | - Lingling Hua
- Department of Psychiatry, the Affiliated Brain Hospital of Nanjing Medical University, Nanjing 210029, China
| | - Shui Tian
- Department of Radiology, the First Affiliated Hospital of Nanjing Medical University, Nanjing 210029, China
| | - ZhongPeng Dai
- School of Biological Sciences & Medical Engineering, Southeast University, Nanjing 210096, China; Child Development and Learning Science, Key Laboratory of Ministry of Education, Southeast University, Nanjing 210096, China
| | - Yi Xia
- Department of Psychiatry, the Affiliated Brain Hospital of Nanjing Medical University, Nanjing 210029, China
| | - Shuai Zhao
- Department of Psychiatry, the Affiliated Brain Hospital of Nanjing Medical University, Nanjing 210029, China
| | - HaoWen Zou
- Nanjing Brain Hospital, Medical School of Nanjing University, Nanjing 210093, China
| | - Xiaoqin Wang
- Department of Psychiatry, the Affiliated Brain Hospital of Nanjing Medical University, Nanjing 210029, China
| | - Hao Sun
- Nanjing Brain Hospital, Medical School of Nanjing University, Nanjing 210093, China
| | - Hongliang Zhou
- Department of Psychiatry, the Affiliated Brain Hospital of Nanjing Medical University, Nanjing 210029, China
| | - YingHong Huang
- Nanjing Brain Hospital, Medical School of Nanjing University, Nanjing 210093, China
| | - ZhiJian Yao
- Department of Psychiatry, the Affiliated Brain Hospital of Nanjing Medical University, Nanjing 210029, China; School of Biological Sciences & Medical Engineering, Southeast University, Nanjing 210096, China; Nanjing Brain Hospital, Medical School of Nanjing University, Nanjing 210093, China.
| | - Qing Lu
- School of Biological Sciences & Medical Engineering, Southeast University, Nanjing 210096, China; Child Development and Learning Science, Key Laboratory of Ministry of Education, Southeast University, Nanjing 210096, China.
| |
Collapse
|
5
|
Cho J, Im HY, Yoon YJ, Joo SJ, Chong SC. The effect of masks on the emotion perception of a facial crowd. Sci Rep 2023; 13:14274. [PMID: 37653061 PMCID: PMC10471755 DOI: 10.1038/s41598-023-41366-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Accepted: 08/25/2023] [Indexed: 09/02/2023] Open
Abstract
The present study investigated the effect of facial masks on people's ability to perceive emotions in crowds. We presented faces with the bottom halves occluded by masks or full faces without occlusion. In two sequentially presented crowds, we varied the number of faces, emotional valence, and intensity of facial expressions, examining the impact of masks on the perception of crowd emotion. Participants reported which of the two crowds they would avoid based on the crowds' average emotions. The participants' ability to judge the average emotion of a crowd, especially a crowd expressing happiness, was impaired when the crowd wore masks. For faces covered by masks, crowd emotion judgments were more negatively biased than those without masks. However, participants could still distinguish the emotional intensities of a crowd wearing masks above chance. Additionally, participants responded more quickly to a crowd with more people without compromising accuracy, despite the perceptual challenges imposed by facial masks. Our results suggest that under ambiguous social situations in which individuals' emotions are partially hidden by masks, a large group may provide stronger social cues than a small group, thereby promoting communication and regulating social behaviors.
Collapse
Affiliation(s)
- Jieun Cho
- Graduate Program in Cognitive Science, Yonsei University, Seoul, South Korea
| | - Hee Yeon Im
- Department of Psychology, University of British Columbia, Vancouver, Canada
| | - Young Jun Yoon
- Department of Psychology, Pusan National University, Busan, South Korea
| | - Sung Jun Joo
- Department of Psychology, Pusan National University, Busan, South Korea
| | - Sang Chul Chong
- Graduate Program in Cognitive Science, Yonsei University, Seoul, South Korea.
- Department of Psychology, Yonsei University, Seoul, South Korea.
| |
Collapse
|
6
|
Liu R, Ye Q, Hao S, Li Y, Shen L, He W. The relationship between ensemble coding and individual representation of crowd facial emotion. Biol Psychol 2023:108593. [PMID: 37257814 DOI: 10.1016/j.biopsycho.2023.108593] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Revised: 05/12/2023] [Accepted: 05/26/2023] [Indexed: 06/02/2023]
Abstract
In recent years, the processing mechanism of group expression has gradually gained the attention of researchers owing to its high ecological validity. However, research on the relationship between ensemble coding and individual representation is still in the early stage of the investigation, with many studies remaining at the behavioral level and findings varying widely. Based on our behavioral research (Experiment 1), we used EEG measures (Experiments 2A and 2B) to investigate the relationship between summary and object representations by manipulating the exposure time of crowd emotions. The behavioral results indicated that participants performed better in judging emotions of multiple faces compared to a single face during the shorter exposure time, whereas the reverse occurred during the long exposure time. Furthermore, ERP results revealed that the N2pc effect was not affected by the number of faces in the short exposure time; however, as the exposure time increased, the N2pc increased as a function of the number of faces. The findings of the current investigation align with time-dependent assumption, indicating that during short time of visual processing, although individual representations may not be fully developed, ensemble representations are initially established. With longer processing times, detailed individual representations become complete and take precedence.
Collapse
Affiliation(s)
- Renhao Liu
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Dalian116029, China
| | - Qianjun Ye
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Dalian116029, China
| | - Shuang Hao
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Dalian116029, China
| | - Yuchen Li
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Dalian116029, China
| | - Lin Shen
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Dalian116029, China
| | - Weiqi He
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian116029, China; Key Laboratory of Brain and Cognitive Neuroscience, Dalian116029, China.
| |
Collapse
|
7
|
Levy J, Jääskeläinen IP, Taylor MJ. Editorial: Magnetoencephalography for social science. Front Syst Neurosci 2023; 16:1105923. [PMID: 36685288 PMCID: PMC9846595 DOI: 10.3389/fnsys.2022.1105923] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2022] [Accepted: 12/06/2022] [Indexed: 01/06/2023] Open
Affiliation(s)
- Jonathan Levy
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland,Ivcher School of Psychology, Reichman University, Herzliya, Israel,*Correspondence: Jonathan Levy ✉
| | - Iiro P. Jääskeläinen
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | - Margot J. Taylor
- Departments of Medical Imaging and Psychology, University of Toronto, Toronto, ON, Canada,Diagnostic Imaging, Hospital for Sick Children, Toronto, ON, Canada
| |
Collapse
|
8
|
Cushing CA, Dawes AJ, Hofmann SG, Lau H, LeDoux JE, Taschereau-Dumouchel V. A generative adversarial model of intrusive imagery in the human brain. PNAS NEXUS 2023; 2:pgac265. [PMID: 36733294 PMCID: PMC9887942 DOI: 10.1093/pnasnexus/pgac265] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Accepted: 01/20/2023] [Indexed: 01/24/2023]
Abstract
The mechanisms underlying the subjective experiences of mental disorders remain poorly understood. This is partly due to long-standing over-emphasis on behavioral and physiological symptoms and a de-emphasis of the patient's subjective experiences when searching for treatments. Here, we provide a new perspective on the subjective experience of mental disorders based on findings in neuroscience and artificial intelligence (AI). Specifically, we propose the subjective experience that occurs in visual imagination depends on mechanisms similar to generative adversarial networks that have recently been developed in AI. The basic idea is that a generator network fabricates a prediction of the world, and a discriminator network determines whether it is likely real or not. Given that similar adversarial interactions occur in the two major visual pathways of perception in people, we explored whether we could leverage this AI-inspired approach to better understand the intrusive imagery experiences of patients suffering from mental illnesses such as post-traumatic stress disorder (PTSD) and acute stress disorder. In our model, a nonconscious visual pathway generates predictions of the environment that influence the parallel but interacting conscious pathway. We propose that in some patients, an imbalance in these adversarial interactions leads to an overrepresentation of disturbing content relative to current reality, and results in debilitating flashbacks. By situating the subjective experience of intrusive visual imagery in the adversarial interaction of these visual pathways, we propose testable hypotheses on novel mechanisms and clinical applications for controlling and possibly preventing symptoms resulting from intrusive imagery.
Collapse
Affiliation(s)
- Cody A Cushing
- Department of Psychology, UCLA, Los Angeles, CA, 90095, USA
| | - Alexei J Dawes
- RIKEN Center for Brain Science, Wako, Saitama 351-0106, Japan
| | - Stefan G Hofmann
- Department of Clinical Psychology, Philipps-University Marburg, 35037 Marburg, Germany
- Department of Psychological and Brain Sciences, Boston University, Boston, MA, 02215, USA
| | - Hakwan Lau
- RIKEN Center for Brain Science, Wako, Saitama 351-0106, Japan
| | - Joseph E LeDoux
- Center for Neural Science and Department of Psychology, New York University, New York, NY, 10012, USA
- Department of Psychiatry, and Department of Child and Adolescent Psychiatry, New York University Langone Medical School, New York, NY, 10016, USA
| | - Vincent Taschereau-Dumouchel
- Department of Psychiatry and Addictology, Université de Montréal, Montreal, Quebec H3T 1J4, Canada
- Centre de Recherche de l'Institut Universitaire en Santé Mentale de Montréal, Montreal, Quebec H1N 3M5, Canada
| |
Collapse
|