1
|
Dorsi J, Lacey S, Sathian K. Multisensory and lexical information in speech perception. Front Hum Neurosci 2024; 17:1331129. [PMID: 38259332 PMCID: PMC10800662 DOI: 10.3389/fnhum.2023.1331129] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 12/11/2023] [Indexed: 01/24/2024] Open
Abstract
Both multisensory and lexical information are known to influence the perception of speech. However, an open question remains: is either source more fundamental to perceiving speech? In this perspective, we review the literature and argue that multisensory information plays a more fundamental role in speech perception than lexical information. Three sets of findings support this conclusion: first, reaction times and electroencephalographic signal latencies indicate that the effects of multisensory information on speech processing seem to occur earlier than the effects of lexical information. Second, non-auditory sensory input influences the perception of features that differentiate phonetic categories; thus, multisensory information determines what lexical information is ultimately processed. Finally, there is evidence that multisensory information helps form some lexical information as part of a phenomenon known as sound symbolism. These findings support a framework of speech perception that, while acknowledging the influential roles of both multisensory and lexical information, holds that multisensory information is more fundamental to the process.
Collapse
Affiliation(s)
- Josh Dorsi
- Department of Neurology, Penn State College of Medicine, Hershey, PA, United States
| | - Simon Lacey
- Department of Neurology, Penn State College of Medicine, Hershey, PA, United States
- Department of Neural and Behavioral Sciences, Penn State College of Medicine, Hershey, PA, United States
- Department of Psychology, Penn State Colleges of Medicine and Liberal Arts, Hershey, PA, United States
| | - K. Sathian
- Department of Neurology, Penn State College of Medicine, Hershey, PA, United States
- Department of Neural and Behavioral Sciences, Penn State College of Medicine, Hershey, PA, United States
- Department of Psychology, Penn State Colleges of Medicine and Liberal Arts, Hershey, PA, United States
| |
Collapse
|
2
|
Chapelle ADL, Savard MA, Restani R, Ghaemmaghami P, Thillou N, Zardoui K, Chandrasekaran B, Coffey EBJ. Sleep affects higher-level categorization of speech sounds, but not frequency encoding. Cortex 2022; 154:27-45. [PMID: 35732089 DOI: 10.1016/j.cortex.2022.04.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2021] [Revised: 03/26/2022] [Accepted: 04/19/2022] [Indexed: 11/03/2022]
Abstract
Sleep can increase consolidation of new knowledge and skills. It is less clear whether sleep plays a role in other aspects of experience-dependent neuroplasticity, which underlie important human capabilities such as spoken language processing. Theories of sensory learning differ in their predictions; some imply rapid learning at early sensory levels, while other propose a slow, progressive timecourse such that higher-level categorical representations guide immediate, novice learning, while lower-level sensory changes do not emerge until later stages. In this study, we investigated the role of sleep across both behavioural and physiological indices of auditory neuroplasticity. Forty healthy young human adults (23 female) who did not speak a tonal language participated in the study. They learned to categorize non-native Mandarin lexical tones using a sound-to-category training paradigm, and were then randomly assigned to a Nap or Wake condition. Polysomnographic data were recorded to quantify sleep during a 3 h afternoon nap opportunity, or equivalent period of quiet wakeful activity. Measures of behavioural performance accuracy revealed a significant improvement in learning the sound-to-category training paradigm between Nap and Wake groups. Conversely, a neural index of fine sound encoding fidelity of speech sounds known as the frequency-following response (FFR) suggested no change due to sleep, and a null model was supported, using Bayesian statistics. Together, these results support theories that propose a slow, progressive and hierarchical timecourse for sensory learning. Sleep's effect may play the biggest role in the higher-level learning, although contributions to more protracted processes of plasticity that exceed the study duration cannot be ruled out.
Collapse
Affiliation(s)
- Aurélien de la Chapelle
- Lyon Neuroscience Research Centre, Lyon, France; Department of Psychology, Concordia University, Montreal, QC, Canada
| | | | - Reyan Restani
- Department of Psychology, Concordia University, Montreal, QC, Canada; Université Paris Nanterre, Paris, France
| | | | - Noam Thillou
- Department of Psychology, Concordia University, Montreal, QC, Canada
| | - Khashayar Zardoui
- Department of Psychology, Concordia University, Montreal, QC, Canada
| | - Bharath Chandrasekaran
- Department of Communication Science and Disorders, University of Pittsburgh, Pittsburgh, USA
| | - Emily B J Coffey
- Department of Psychology, Concordia University, Montreal, QC, Canada.
| |
Collapse
|
3
|
Lemos FA, da Silva Nunes AD, de Souza Evangelista CK, Escera C, Taveira KVM, Balen SA. Frequency-Following Response in Newborns and Infants: A Systematic Review of Acquisition Parameters. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2021; 64:2085-2102. [PMID: 34057846 DOI: 10.1044/2021_jslhr-20-00639] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Purpose The purpose of this study is to characterize parameters used for frequency-following response (FFR) acquisition in children up to 24 months of age through a systematic review. Method The study was registered in PROSPERO and followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses' recommendations. Search was performed in six databases (LILACS, LIVIVO, PsycINFO, PubMed, Scopus, and Web of Science) and gray literature (Google Scholar, OpenGrey, ProQuest)as well as via manual searches in bibliographic references. Observational studies using speech stimuli to elicit the FFR in infants with normal hearing on the age range from 0 until 24 months were included. No restrictions regarding language and year of publication were applied. Risk of bias was assessed with the Joanna Briggs Institute Critical Appraisal Checklist. Data on stimulus, presentation rate, time window for analysis, number of sweeps, artifact rejection, online filters, stimulated ear, and examination condition were extracted. Results Four hundred fifty-nine studies were identified. After removing duplicates and reading titles and abstracts, 15 articles were included. Seven studies were classified as low risk of bias, seven as moderate risk, and one as high risk. Conclusions There is a consensus in the use of some acquisition parameters of the FFR with speech stimulus, such as the vertical mounting, the use of alternating polarity, a sampling rate of 20000 Hz, and the /da/ synthesized syllable of 40 ms in duration as the preferred stimulus. Although these parameters show some consensus, the results disclosed lack of a single established protocol for FFR acquisition with speech stimulus in infants in the investigated age range.
Collapse
Affiliation(s)
- Fabiana Aparecida Lemos
- Speech, Language and Hearing Sciences Graduate Program, Health Sciences Center, Federal University of Rio Grande do Norte (UFRN), Natal, Brazil
- Laboratory of Technological Innovation in Health of the Federal University of Rio Grande do Norte (LAIS/UFRN), Natal, Brazil
| | - Aryelly Dayane da Silva Nunes
- Speech, Language and Hearing Sciences Graduate Program, Health Sciences Center, Federal University of Rio Grande do Norte (UFRN), Natal, Brazil
- Laboratory of Technological Innovation in Health of the Federal University of Rio Grande do Norte (LAIS/UFRN), Natal, Brazil
| | - Carolina Karla de Souza Evangelista
- Speech, Language and Hearing Sciences Graduate Program, Health Sciences Center, Federal University of Rio Grande do Norte (UFRN), Natal, Brazil
- Laboratory of Technological Innovation in Health of the Federal University of Rio Grande do Norte (LAIS/UFRN), Natal, Brazil
| | - Carles Escera
- Brainlab - Cognitive Neuroscience Research Group, Department of Clinical Psychology and Psychobiology, University of Barcelona, Spain
- Institute of Neurosciences, University of Barcelona, Spain
- Sant Joan de Déu Research Institute, Esplugues de Llobregat Barcelona, Spain
| | | | - Sheila Andreoli Balen
- Speech, Language and Hearing Sciences Graduate Program, Health Sciences Center, Federal University of Rio Grande do Norte (UFRN), Natal, Brazil
- Laboratory of Technological Innovation in Health of the Federal University of Rio Grande do Norte (LAIS/UFRN), Natal, Brazil
| |
Collapse
|
4
|
Cecilia Dos Santos Marques M, Griz S, Lira de Andrade KC, de Lemos Menezes P, Menezes DC. Frequency Following Responses in childhood apraxia of speech. Int J Pediatr Otorhinolaryngol 2021; 145:110742. [PMID: 33933988 DOI: 10.1016/j.ijporl.2021.110742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/09/2020] [Revised: 04/17/2021] [Accepted: 04/24/2021] [Indexed: 10/21/2022]
Abstract
OBJECTIVE to compare the Frequency Following Responses of children with childhood apraxia of speech with typical development children. METHOD this is an observational cross-sectional analytical study approved by Human Research Ethics Committee. Thirty normal hearing children have participated in the study. THEY WERE DIVIDED INTO TWO GROUPS 1) study group - composed by 15 children diagnosed with childhood apraxia of speech (between the chronological ages of 3 and 11 years, mean age of 5,7 years); and 2) control group: composed by 15 children with typical development, paired by age and gender with study group. Frequency Following Response were recorded using the/da/syllable presentation rate at 10.9 ms. RESULTS there was a significant delay in latencies of waves V, A and C of children with apraxia of speech, suggesting difficulties in the ability to process sounds. CONCLUSION The delay on Frequency Following Response's latencies (waves V, A and C) in children with apraxia of speech maybe related to atypical neural coding of speech sounds, suggesting that apraxia of speech must not be purely considered as a motor speech disorder.
Collapse
Affiliation(s)
| | | | - Kelly Cristina Lira de Andrade
- Department of Audiology, State University of Health Sciences of Alagoas, Brazil; Department of Medicine, Cesmac University Center, Brazil.
| | - Pedro de Lemos Menezes
- Federal University of Pernambuco, Brazil; Department of Medicine, Cesmac University Center, Brazil.
| | - Denise Costa Menezes
- Department of Audiology, State University of Health Sciences of Alagoas, Brazil.
| |
Collapse
|
5
|
Parker AN, Wallis GM, Obergrussberger R, Siebeck UE. Categorical face perception in fish: How a fish brain warps reality to dissociate "same" from "different". J Comp Neurol 2020; 528:2919-2928. [PMID: 32406088 DOI: 10.1002/cne.24947] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2019] [Revised: 04/14/2020] [Accepted: 04/28/2020] [Indexed: 11/07/2022]
Abstract
Categorical perception (CP) is the phenomenon by which a smoothly varying stimulus property undergoes a nonlinear transformation during processing in the brain. Consequently, the stimuli are perceived as belonging to distinct categories separated by a sharp boundary. Originally thought to be largely innate, the discovery of CP in tasks such as novel image discrimination has piqued the interest of cognitive scientists because it provides compelling evidence that learning can shape a category's perceptual boundaries. CP has been particularly closely studied in human face perception. In nonprimates, there is evidence for CP for sound and color discrimination, but not for image or face discrimination. Here, we investigate the potential for learned CP in a lower vertebrate, the damselfish Pomacentrus amboinensis. Specifically, we tested whether the ability of these fish to discriminate complex facial patterns tracked categorical rather than metric differences in the stimuli. We first trained the fish to discriminate sets of two facial patterns. Next, we morphed between these patterns and determined the just noticeable difference (JND) between a morph and original image. Finally, we tested for CP by analyzing the discrimination ability of the fish for pairs of JND stimuli along the spectrum of morphs between two original images. Discrimination performance was significant for the image pair straddling the boundary between categories, and chance for equivalent stimulus pairs on either side, thus producing the classic "category boundary" effect. Our results reveal how perception can be influenced in a top-down manner even in the absence of a visual cortex.
Collapse
Affiliation(s)
- Amira N Parker
- School of Biomedical Sciences, The University of Queensland, Brisbane, Queensland, Australia
| | - Guy M Wallis
- School of Human Movement and Nutrition Sciences, The University of Queensland, Brisbane, Queensland, Australia
| | - Rainer Obergrussberger
- School of Biomedical Sciences, The University of Queensland, Brisbane, Queensland, Australia
| | - Ulrike E Siebeck
- School of Biomedical Sciences, The University of Queensland, Brisbane, Queensland, Australia
| |
Collapse
|