1
|
Ju P, Zhou Z, Xie Y, Hui J, Yang X. Music training is associated with better audio-visual integration in Chinese language. Int J Psychophysiol 2024; 203:112414. [PMID: 39134177 DOI: 10.1016/j.ijpsycho.2024.112414] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2024] [Revised: 06/20/2024] [Accepted: 08/09/2024] [Indexed: 08/15/2024]
Abstract
In the present study, we aimed to investigate whether long-term music training could improve audio-visual speech integration in Chinese, using event-related brain potential (ERP) measurements. Specifically, we recruited musicians and non-musicians to participate in our experiment where visual Chinese characters were presented simultaneously with congruent or incongruent speech sounds. In order to maintain participants' focus on both auditory and visual modalities, they were instructed to perform a probe detection task. Our study revealed that for the musicians, audiovisual incongruent stimuli elicited larger N1 and N400 amplitudes compared to audiovisual congruent stimuli. Conversely, for the non-musicians, only a larger N400 amplitude was observed for incongruent stimuli relative to congruent stimuli, without a significant difference in N1 amplitude. Furthermore, correlation analyses indicated that more years of music training was associated with a larger N1 effect for the musicians. These results suggest that musicians were capable of detecting character-speech sound incongruence at an earlier time window compared to non-musicians. Overall, our findings provide compelling evidence that music training is associated with better integration of visual characters and auditory speech sounds in language processing.
Collapse
Affiliation(s)
- Ping Ju
- Department of Psychology, Renmin University of China, Beijing, China
| | - Zihang Zhou
- Department of Psychology, Renmin University of China, Beijing, China; School of foreign languages, Renmin University of China, Beijing, China
| | - Yuhan Xie
- Department of Psychology, Renmin University of China, Beijing, China
| | - Jiaying Hui
- Department of Psychology, Renmin University of China, Beijing, China
| | - Xiaohong Yang
- Department of Psychology, Renmin University of China, Beijing, China.
| |
Collapse
|
2
|
Lyu S, Põldver N, Kask L, Wang L, Kreegipuu K. Effect of musical expertise on the perception of duration and pitch in language: A cross-linguistic study. Acta Psychol (Amst) 2024; 244:104195. [PMID: 38412710 DOI: 10.1016/j.actpsy.2024.104195] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2023] [Revised: 02/20/2024] [Accepted: 02/21/2024] [Indexed: 02/29/2024] Open
Abstract
This study adopts a cross-linguistic perspective and investigates how musical expertise affects the perception of duration and pitch in language. Native speakers of Chinese (N = 44) and Estonian (N = 46), each group subdivided into musicians and non-musicians, participated in a mismatch negativity (MMN) experiment where they passively listened to both Chinese and Estonian stimuli, followed by a behavioral experiment where they attentively discriminated the stimuli in the non-native language (i.e., Chinese to Estonian participants and Estonian to Chinese participants). In both experiments, stimuli of duration change, pitch change, and duration plus pitch change were discriminated. We found higher behavioral sensitivity among Chinese musicians than non-musicians in perceiving the duration change in Estonian and higher behavioral sensitivity among Estonian musicians than non-musicians in perceiving all types of changes in Chinese, but no corresponding effect was found in the MMN results, which suggests a more salient effect of musical expertise on foreign language processing when attention is required. Secondly, Chinese musicians did not outperform non-musicians in attentively discriminating the pitch-related stimuli in Estonian, suggesting that musical expertise can be overridden by tonal language experience when perceiving foreign linguistic pitch, especially when an attentive discrimination task is administered. Thirdly, we found larger MMN among Chinese and Estonian musicians than their non-musician counterparts in perceiving the largest deviant (i.e., duration plus pitch) in their native language. Taken together, our results demonstrate a positive effect of musical expertise on language processing.
Collapse
Affiliation(s)
- Siqi Lyu
- Institute of Psychology, University of Tartu, Tartu, Estonia
| | - Nele Põldver
- Institute of Psychology, University of Tartu, Tartu, Estonia
| | - Liis Kask
- Institute of Psychology, University of Tartu, Tartu, Estonia
| | - Luming Wang
- College of Foreign Languages, Zhejiang University of Technology, Hangzhou, China
| | - Kairi Kreegipuu
- Institute of Psychology, University of Tartu, Tartu, Estonia.
| |
Collapse
|
3
|
Du 杜彬 B, Yang 杨振 Z, Wang 王翠翠 C, Li 李媛媛 Y, Tao 陶沙 S. Short-term training helps second-language learners read like native readers: An ERP study. BRAIN AND LANGUAGE 2023; 239:105251. [PMID: 36931112 DOI: 10.1016/j.bandl.2023.105251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/18/2022] [Revised: 03/04/2023] [Accepted: 03/07/2023] [Indexed: 05/10/2023]
Abstract
This randomized controlled trial study aimed to examine what experience other than immersion may help adult learners read with native-like neural responses. We compared a group of 13 native Chinese English learners completing English letter-sound association training with another group of 12 completing visual symbol-sound association training and included one group of native English readers as the reference. The results showed that after three hours of training, all learners no longer showed attenuated cross-modal mismatch negativity (MMN) to English letter-sound integration as in the pretest. After six hours of training, the learners receiving English letter-sound association training showed enhanced cross-modal MMN and theta oscillations, as native English readers did. The enhanced neural responses were significantly correlated with better phonological awareness. Thus, with training specific to critical second language reading skills of appropriate dosages, adult learners can overcome the constraints of their native language background and learn to read with native-like neural responses.
Collapse
Affiliation(s)
- Bin Du 杜彬
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Zhen Yang 杨振
- Department of Psychology, Zhejiang Sci-Tech University, Jianggan District, Hangzhou, Zhejiang, China
| | - Cuicui Wang 王翠翠
- Zhejiang Philosophy and Social Science Laboratory for Research in Early Development and Childcare, Hangzhou Normal University, China; Centre for Cognition and Brain Disorders, The Affiliated Hospital of Hangzhou Normal University, Hangzhou, China; Deqing Hospital of Hangzhou Normal University, China
| | - Yuanyuan Li 李媛媛
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Sha Tao 陶沙
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China.
| |
Collapse
|
4
|
Tervaniemi M, Putkinen V, Nie P, Wang C, Du B, Lu J, Li S, Cowley BU, Tammi T, Tao S. Improved Auditory Function Caused by Music Versus Foreign Language Training at School Age: Is There a Difference? Cereb Cortex 2021; 32:63-75. [PMID: 34265850 PMCID: PMC8634570 DOI: 10.1093/cercor/bhab194] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Revised: 05/28/2021] [Accepted: 05/28/2021] [Indexed: 12/03/2022] Open
Abstract
In adults, music and speech share many neurocognitive functions, but how do they interact in a developing brain? We compared the effects of music and foreign language training on auditory neurocognition in Chinese children aged 8–11 years. We delivered group-based training programs in music and foreign language using a randomized controlled trial. A passive control group was also included. Before and after these year-long extracurricular programs, auditory event-related potentials were recorded (n = 123 and 85 before and after the program, respectively). Through these recordings, we probed early auditory predictive brain processes. To our surprise, the language program facilitated the children’s early auditory predictive brain processes significantly more than did the music program. This facilitation was most evident in pitch encoding when the experimental paradigm was musically relevant. When these processes were probed by a paradigm more focused on basic sound features, we found early predictive pitch encoding to be facilitated by music training. Thus, a foreign language program is able to foster auditory and music neurocognition, at least in tonal language speakers, in a manner comparable to that by a music program. Our results support the tight coupling of musical and linguistic brain functions also in the developing brain.
Collapse
Affiliation(s)
- Mari Tervaniemi
- Cicero Learning, Faculty of Educational Sciences, University of Helsinki, Helsinki, Finland.,Cognitive Brain Research Unit, Faculty of Medicine, University of Helsinki, Helsinki, Finland.,Advanced Innovation Center for Future Education, Beijing Normal University, Beijing, China
| | - Vesa Putkinen
- Cognitive Brain Research Unit, Faculty of Medicine, University of Helsinki, Helsinki, Finland.,Turku PET Centre, University of Turku, Turku, Finland
| | - Peixin Nie
- Cicero Learning, Faculty of Educational Sciences, University of Helsinki, Helsinki, Finland.,Cognitive Brain Research Unit, Faculty of Medicine, University of Helsinki, Helsinki, Finland
| | - Cuicui Wang
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Bin Du
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Jing Lu
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Shuting Li
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Benjamin Ultan Cowley
- Faculty of Educational Sciences, University of Helsinki, Finland.,Cognitive Science, Department of Digital Humanities, Faculty of Arts, University of Helsinki, Finland
| | - Tuisku Tammi
- Cognitive Science, Department of Digital Humanities, Faculty of Arts, University of Helsinki, Finland
| | - Sha Tao
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| |
Collapse
|