1
|
Gastaldon S, Bonfiglio N, Vespignani F, Peressotti F. Predictive language processing: integrating comprehension and production, and what atypical populations can tell us. Front Psychol 2024; 15:1369177. [PMID: 38836235 PMCID: PMC11148270 DOI: 10.3389/fpsyg.2024.1369177] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Accepted: 05/06/2024] [Indexed: 06/06/2024] Open
Abstract
Predictive processing, a crucial aspect of human cognition, is also relevant for language comprehension. In everyday situations, we exploit various sources of information to anticipate and therefore facilitate processing of upcoming linguistic input. In the literature, there are a variety of models that aim at accounting for such ability. One group of models propose a strict relationship between prediction and language production mechanisms. In this review, we first introduce very briefly the concept of predictive processing during language comprehension. Secondly, we focus on models that attribute a prominent role to language production and sensorimotor processing in language prediction ("prediction-by-production" models). Contextually, we provide a summary of studies that investigated the role of speech production and auditory perception on language comprehension/prediction tasks in healthy, typical participants. Then, we provide an overview of the limited existing literature on specific atypical/clinical populations that may represent suitable testing ground for such models-i.e., populations with impaired speech production and auditory perception mechanisms. Ultimately, we suggest a more widely and in-depth testing of prediction-by-production accounts, and the involvement of atypical populations both for model testing and as targets for possible novel speech/language treatment approaches.
Collapse
Affiliation(s)
- Simone Gastaldon
- Dipartimento di Psicologia dello Sviluppo e della Socializzazione, University of Padua, Padua, Italy
- Padova Neuroscience Center, University of Padua, Padua, Italy
| | - Noemi Bonfiglio
- Dipartimento di Psicologia dello Sviluppo e della Socializzazione, University of Padua, Padua, Italy
- BCBL-Basque Center on Cognition, Brain and Language, Donostia-San Sebastián, Spain
| | - Francesco Vespignani
- Dipartimento di Psicologia dello Sviluppo e della Socializzazione, University of Padua, Padua, Italy
- Centro Interdipartimentale di Ricerca "I-APPROVE-International Auditory Processing Project in Venice", University of Padua, Padua, Italy
| | - Francesca Peressotti
- Dipartimento di Psicologia dello Sviluppo e della Socializzazione, University of Padua, Padua, Italy
- Padova Neuroscience Center, University of Padua, Padua, Italy
- Centro Interdipartimentale di Ricerca "I-APPROVE-International Auditory Processing Project in Venice", University of Padua, Padua, Italy
| |
Collapse
|
2
|
Jia Y, Kudo K, Jariwala N, Tarapore P, Nagarajan S, Subramaniam K. Causal role of medial superior frontal cortex on enhancing neural information flow and self-agency judgments in the self-agency network. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.02.13.24302764. [PMID: 38405834 PMCID: PMC10888992 DOI: 10.1101/2024.02.13.24302764] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/27/2024]
Abstract
Self-agency is being aware of oneself as the agent of one's thoughts and actions. Self-agency is necessary for successful interactions with the outside world (reality-monitoring). Prior research has shown that the medial superior prefrontal gyri (mPFC/SFG) may represent one neural correlate underlying self-agency judgments. However, the causal relationship remains unknown. Here, we applied high-frequency 10Hz repetitive transcranial magnetic stimulation (rTMS) to modulate the excitability of the mPFC/SFG site that we have previously shown to mediate self-agency. For the first time, we delineate causal neural mechanisms, revealing precisely how rTMS modulates SFG excitability and impacts directional neural information flow in the self-agency network by implementing innovative magnetoencephalography (MEG) phase-transfer entropy (PTE) metrics, measured from pre-to-post rTMS. We found that, compared to control rTMS, enhancing SFG excitability by rTMS induced significant increases in information flow between SFG and specific cingulate and paracentral regions in the self-agency network in delta-theta, alpha, and gamma bands, which predicted improved self-agency judgments. This is the first multimodal imaging study in which we implement MEG PTE metrics of 5D imaging of space, frequency and time, to provide cutting-edge analyses of the causal neural mechanisms of how rTMS enhances SFG excitability and improves neural information flow between distinct regions in the self-agency network to potentiate improved self-agency judgments. Our findings provide a novel perspective for investigating causal neural mechanisms underlying self-agency and create a path towards developing novel neuromodulation interventions to improve self-agency that will be particularly useful for patients with psychosis who exhibit severe impairments in self-agency.
Collapse
|
3
|
Demopoulos C, Jesson X, Gerdes MR, Jurigova BG, Hinkley LB, Ranasinghe KG, Desai S, Honma S, Mizuiri D, Findlay A, Nagarajan SS, Marco EJ. Global MEG Resting State Functional Connectivity in Children with Autism and Sensory Processing Dysfunction. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.01.26.577499. [PMID: 38352614 PMCID: PMC10862722 DOI: 10.1101/2024.01.26.577499] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
Sensory processing dysfunction not only affects most individuals with autism spectrum disorder (ASD), but at least 5% of children without ASD also experience dysfunctional sensory processing. Our understanding of the relationship between sensory dysfunction and resting state brain activity is still emerging. This study compared long-range resting state functional connectivity of neural oscillatory behavior in children aged 8-12 years with autism spectrum disorder (ASD; N=18), those with sensory processing dysfunction (SPD; N=18) who do not meet ASD criteria, and typically developing control participants (TDC; N=24) using magnetoencephalography (MEG). Functional connectivity analyses were performed in the alpha and beta frequency bands, which are known to be implicated in sensory information processing. Group differences in functional connectivity and associations between sensory abilities and functional connectivity were examined. Distinct patterns of functional connectivity differences between ASD and SPD groups were found only in the beta band, but not in the alpha band. In both alpha and beta bands, ASD and SPD cohorts differed from the TDC cohort. Somatosensory cortical beta-band functional connectivity was associated with tactile processing abilities, while higher-order auditory cortical alpha-band functional connectivity was associated with auditory processing abilities. These findings demonstrate distinct long-range neural synchrony alterations in SPD and ASD that are associated with sensory processing abilities. Neural synchrony measures could serve as potential sensitive biomarkers for ASD and SPD.
Collapse
Affiliation(s)
- Carly Demopoulos
- Department of Psychiatry, University of California San Francisco, 675 18 Street, San Francisco, CA 94107
- Department of Radiology & Biomedical Imaging, University of California-San Francisco, 513 Parnassus Avenue, S362, San Francisco, CA 94143
| | - Xuan Jesson
- Department of Psychology, Palo Alto University, 1791 Arastradero Road, Palo Alto, CA 94304
| | - Molly Rae Gerdes
- Cortica Healthcare, Department of Neurodevelopmental Medicine, 4000 Civic Center Drive, San Rafael, CA 94903
| | - Barbora G. Jurigova
- Cortica Healthcare, Department of Neurodevelopmental Medicine, 4000 Civic Center Drive, San Rafael, CA 94903
| | - Leighton B. Hinkley
- Department of Radiology & Biomedical Imaging, University of California-San Francisco, 513 Parnassus Avenue, S362, San Francisco, CA 94143
| | - Kamalini G. Ranasinghe
- University of California-San Francisco, Department of Neurology, 675 Nelson Rising Lane, San Francisco, CA 94143
| | - Shivani Desai
- University of California-San Francisco, Department of Neurology, 675 Nelson Rising Lane, San Francisco, CA 94143
| | - Susanne Honma
- Department of Radiology & Biomedical Imaging, University of California-San Francisco, 513 Parnassus Avenue, S362, San Francisco, CA 94143
| | - Danielle Mizuiri
- Department of Radiology & Biomedical Imaging, University of California-San Francisco, 513 Parnassus Avenue, S362, San Francisco, CA 94143
| | - Anne Findlay
- Department of Radiology & Biomedical Imaging, University of California-San Francisco, 513 Parnassus Avenue, S362, San Francisco, CA 94143
| | - Srikantan S. Nagarajan
- Department of Radiology & Biomedical Imaging, University of California-San Francisco, 513 Parnassus Avenue, S362, San Francisco, CA 94143
| | - Elysa J. Marco
- Cortica Healthcare, Department of Neurodevelopmental Medicine, 4000 Civic Center Drive, San Rafael, CA 94903
| |
Collapse
|
4
|
Palaparthi A, Alluri RK, Titze IR. Deep Learning for Neuromuscular Control of Vocal Source for Voice Production. APPLIED SCIENCES (BASEL, SWITZERLAND) 2024; 14:769. [PMID: 39071945 PMCID: PMC11281313 DOI: 10.3390/app14020769] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 07/30/2024]
Abstract
A computational neuromuscular control system that generates lung pressure and three intrinsic laryngeal muscle activations (cricothyroid, thyroarytenoid, and lateral cricoarytenoid) to control the vocal source was developed. In the current study, LeTalker, a biophysical computational model of the vocal system was used as the physical plant. In the LeTalker, a three-mass vocal fold model was used to simulate self-sustained vocal fold oscillation. A constant/ǝ/vowel was used for the vocal tract shape. The trachea was modeled after MRI measurements. The neuromuscular control system generates control parameters to achieve four acoustic targets (fundamental frequency, sound pressure level, normalized spectral centroid, and signal-to-noise ratio) and four somatosensory targets (vocal fold length, and longitudinal fiber stress in the three vocal fold layers). The deep-learning-based control system comprises one acoustic feedforward controller and two feedback (acoustic and somatosensory) controllers. Fifty thousand steady speech signals were generated using the LeTalker for training the control system. The results demonstrated that the control system was able to generate the lung pressure and the three muscle activations such that the four acoustic and four somatosensory targets were reached with high accuracy. After training, the motor command corrections from the feedback controllers were minimal compared to the feedforward controller except for thyroarytenoid muscle activation.
Collapse
Affiliation(s)
- Anil Palaparthi
- Utah Center for Vocology, University of Utah, Salt Lake City, UT 84112, USA
| | - Rishi K. Alluri
- School of Biological Sciences, University of Utah, Salt Lake City, UT 84112, USA
| | - Ingo R. Titze
- Utah Center for Vocology, University of Utah, Salt Lake City, UT 84112, USA
| |
Collapse
|
5
|
Kim KX, Dale CL, Ranasinghe KG, Kothare H, Beagle AJ, Lerner H, Mizuiri D, Gorno-Tempini ML, Vossel K, Nagarajan SS, Houde JF. Impaired Speaking-Induced Suppression in Alzheimer's Disease. eNeuro 2023; 10:ENEURO.0056-23.2023. [PMID: 37221089 PMCID: PMC10249944 DOI: 10.1523/eneuro.0056-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Accepted: 04/04/2023] [Indexed: 05/25/2023] Open
Abstract
Alzheimer's disease (AD) is a neurodegenerative disease involving cognitive impairment and abnormalities in speech and language. Here, we examine how AD affects the fidelity of auditory feedback predictions during speaking. We focus on the phenomenon of speaking-induced suppression (SIS), the auditory cortical responses' suppression during auditory feedback processing. SIS is determined by subtracting the magnitude of auditory cortical responses during speaking from listening to playback of the same speech. Our state feedback control (SFC) model of speech motor control explains SIS as arising from the onset of auditory feedback matching a prediction of that feedback onset during speaking, a prediction that is absent during passive listening to playback of the auditory feedback. Our model hypothesizes that the auditory cortical response to auditory feedback reflects the mismatch with the prediction: small during speaking, large during listening, with the difference being SIS. Normally, during speaking, auditory feedback matches its predictions, then SIS will be large. Any reductions in SIS will indicate inaccuracy in auditory feedback prediction not matching the actual feedback. We investigated SIS in AD patients [n = 20; mean (SD) age, 60.77 (10.04); female (%), 55.00] and healthy controls [n = 12; mean (SD) age, 63.68 (6.07); female (%), 83.33] through magnetoencephalography (MEG)-based functional imaging. We found a significant reduction in SIS at ∼100 ms in AD patients compared with healthy controls (linear mixed effects model, F (1,57.5) = 6.849, p = 0.011). The results suggest that AD patients generate inaccurate auditory feedback predictions, contributing to abnormalities in AD speech.
Collapse
Affiliation(s)
- Kyunghee X Kim
- Department of Otolaryngology-Head and Neck Surgery, University of California San Francisco, San Francisco, CA 94117
| | - Corby L Dale
- Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA 94117
| | - Kamalini G Ranasinghe
- Department of Neurology, University of California San Francisco, San Francisco, CA 94158
| | - Hardik Kothare
- Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA 94117
| | - Alexander J Beagle
- Department of Neurology, University of California San Francisco, San Francisco, CA 94158
| | - Hannah Lerner
- Department of Neurology, University of California San Francisco, San Francisco, CA 94158
| | - Danielle Mizuiri
- Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA 94117
| | | | - Keith Vossel
- Department of Neurology, University of California San Francisco, San Francisco, CA 94158
| | - Srikantan S Nagarajan
- Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA 94117
| | - John F Houde
- Department of Otolaryngology-Head and Neck Surgery, University of California San Francisco, San Francisco, CA 94117
| |
Collapse
|
6
|
Wiesman AI, Donhauser PW, Degroot C, Diab S, Kousaie S, Fon EA, Klein D, Baillet S. Aberrant neurophysiological signaling associated with speech impairments in Parkinson's disease. NPJ Parkinsons Dis 2023; 9:61. [PMID: 37059749 PMCID: PMC10104849 DOI: 10.1038/s41531-023-00495-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Accepted: 03/16/2023] [Indexed: 04/16/2023] Open
Abstract
Difficulty producing intelligible speech is a debilitating symptom of Parkinson's disease (PD). Yet, both the robust evaluation of speech impairments and the identification of the affected brain systems are challenging. Using task-free magnetoencephalography, we examine the spectral and spatial definitions of the functional neuropathology underlying reduced speech quality in patients with PD using a new approach to characterize speech impairments and a novel brain-imaging marker. We found that the interactive scoring of speech impairments in PD (N = 59) is reliable across non-expert raters, and better related to the hallmark motor and cognitive impairments of PD than automatically-extracted acoustical features. By relating these speech impairment ratings to neurophysiological deviations from healthy adults (N = 65), we show that articulation impairments in patients with PD are associated with aberrant activity in the left inferior frontal cortex, and that functional connectivity of this region with somatomotor cortices mediates the influence of cognitive decline on speech deficits.
Collapse
Affiliation(s)
- Alex I Wiesman
- Montreal Neurological Institute, McGill University, 3801 Rue University, Montreal, QC, Canada
| | - Peter W Donhauser
- Montreal Neurological Institute, McGill University, 3801 Rue University, Montreal, QC, Canada
- Ernst Strüngmann Institute for Neuroscience, Frankfurt, Germany
| | - Clotilde Degroot
- Montreal Neurological Institute, McGill University, 3801 Rue University, Montreal, QC, Canada
| | - Sabrina Diab
- Department of Psychology, Université du Québec à Montréal, Montréal, QC, Canada
| | - Shanna Kousaie
- School of Psychology, University of Ottawa, Ottawa, ON, Canada
| | - Edward A Fon
- Montreal Neurological Institute, McGill University, 3801 Rue University, Montreal, QC, Canada
| | - Denise Klein
- Montreal Neurological Institute, McGill University, 3801 Rue University, Montreal, QC, Canada.
- Center for Research on Brain, Language and Music, McGill University, Montreal, QC, Canada.
| | - Sylvain Baillet
- Montreal Neurological Institute, McGill University, 3801 Rue University, Montreal, QC, Canada.
| |
Collapse
|
7
|
Echolocation-related reversal of information flow in a cortical vocalization network. Nat Commun 2022; 13:3642. [PMID: 35752629 PMCID: PMC9233670 DOI: 10.1038/s41467-022-31230-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2021] [Accepted: 05/30/2022] [Indexed: 11/09/2022] Open
Abstract
The mammalian frontal and auditory cortices are important for vocal behavior. Here, using local-field potential recordings, we demonstrate that the timing and spatial patterns of oscillations in the fronto-auditory network of vocalizing bats (Carollia perspicillata) predict the purpose of vocalization: echolocation or communication. Transfer entropy analyses revealed predominant top-down (frontal-to-auditory cortex) information flow during spontaneous activity and pre-vocal periods. The dynamics of information flow depend on the behavioral role of the vocalization and on the timing relative to vocal onset. We observed the emergence of predominant bottom-up (auditory-to-frontal) information transfer during the post-vocal period specific to echolocation pulse emission, leading to self-directed acoustic feedback. Electrical stimulation of frontal areas selectively enhanced responses to sounds in auditory cortex. These results reveal unique changes in information flow across sensory and frontal cortices, potentially driven by the purpose of the vocalization in a highly vocal mammalian model.
Collapse
|
8
|
Franken MK, Hartsuiker RJ, Johansson P, Hall L, Lind A. EXPRESS: Don't blame yourself: Conscious source monitoring modulates feedback control during speech production. Q J Exp Psychol (Hove) 2022; 76:15-27. [PMID: 35014590 DOI: 10.1177/17470218221075632] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Sensory feedback plays an important role in speech motor control. One of the main sources of evidence for this are studies where online auditory feedback is perturbed during ongoing speech. In motor control, it is therefore crucial to distinguish between sensory feedback and externally generated sensory events. This is called source monitoring. Previous altered feedback studies have taken non-conscious source monitoring for granted, as automatic responses to altered sensory feedback imply that the feedback changes are processed as self-caused. However, the role of conscious source monitoring is unclear. The current study investigated whether conscious source monitoring modulates responses to unexpected pitch changes in auditory feedback. During a first block, some participants spontaneously attributed the pitch shifts to themselves (self-blamers) while others attributed them to an external source (other-blamers). Before block 2, all participants were informed that the pitch shifts were experimentally induced. The self-blamers then showed a reduction in response magnitude in block 2 compared with block 1, while the other-blamers did not. This suggests that conscious source monitoring modulates responses to altered auditory feedback, such that consciously ascribing feedback to oneself leads to larger compensation responses. These results can be accounted for within the dominant comparator framework, where conscious source monitoring could modulate the gain on sensory feedback. Alternatively, the results can be naturally explained from an inferential framework, where conscious knowledge may bias the priors in a Bayesian process to determine the most likely source of a sensory event.
Collapse
Affiliation(s)
- Matthias K Franken
- Experimental Psychology, Ghent University, Henri Dunantlaan 2, 9000 Ghent, Belgium 26656.,Currently at Department of Psychology, McGill University, Montreal, Quebec, Canada
| | - Robert J Hartsuiker
- Experimental Psychology, Ghent University, Henri Dunantlaan 2, 9000 Ghent, Belgium 26656
| | - Petter Johansson
- Department of Philosophy, Lund University Cognitive Science, Lund University, Box 192, 221 00 Lund, Sweden 5193
| | - Lars Hall
- Department of Philosophy, Lund University Cognitive Science, Lund University, Box 192, 221 00 Lund, Sweden 5193
| | - Andreas Lind
- Department of Philosophy, Lund University Cognitive Science, Lund University, Box 192, 221 00 Lund, Sweden 5193
| |
Collapse
|
9
|
The Role of the Medial Prefontal Cortex in Self-Agency in Schizophrenia. JOURNAL OF PSYCHIATRY AND BRAIN SCIENCE 2021; 6. [PMID: 34761121 PMCID: PMC8577427 DOI: 10.20900/jpbs.20210017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
Schizophrenia is a disorder of the self. In particular, patients show cardinal deficits in self-agency (i.e., the experience and awareness of being the agent of one’s own thoughts and actions) that directly contribute to positive psychotic symptoms of hallucinations and delusions and distort reality monitoring (defined as distinguishing self-generated information from externally-derived information). Predictive coding models suggest that the experience of self-agency results from a minimal prediction error between the predicted sensory consequence of a self-generated action and the actual outcome. In other words, the experience of self-agency is thought to be driven by making reliable predictions about the expected outcomes of one’s own actions. Most of the agency literature has focused on the motor system; here we present a novel viewpoint that examines agency from a different lens using distinct tasks of reality monitoring and speech monitoring. The self-prediction mechanism that leads to self-agency is necessary for reality monitoring in that self-predictions represent a critical precursor for the successful encoding and memory retrieval of one’s own thoughts and actions during reality monitoring to enable accurate self-agency judgments (i.e., accurate identification of self-generated information). This self-prediction mechanism is also critical for speech monitoring where we continually compare auditory feedback (i.e., what we hear ourselves say) with what we expect to hear. Prior research has shown that the medial prefrontal cortex (mPFC) may represent one potential neural substrate of this self-prediction mechanism. Unfortunately, patients with schizophrenia (SZ) show mPFC hypoactivity associated with self-agency impairments on reality and speech monitoring tasks, as well as aberrant mPFC functional connectivity during intrinsic measures of agency during resting states that predicted worsening psychotic symptoms. Causal neurostimulation and neurofeedback techniques can move the frontiers of schizophrenia research into a new era where we implement techniques to manipulate excitability in key neural regions, such as the mPFC, to modulate patients’ reliance on self-prediction mechanisms on distinct tasks of reality and speech monitoring. We hypothesize these findings will show that mPFC provides a unitary basis for self-agency, driven by reliance on self-prediction mechanisms, which will facilitate the development of new targeted treatments in patients with schizophrenia.
Collapse
|
10
|
Sangtian S, Wang Y, Fridriksson J, Behroozmand R. Impairment of speech auditory feedback error detection and motor correction in post-stroke aphasia. JOURNAL OF COMMUNICATION DISORDERS 2021; 94:106163. [PMID: 34768093 PMCID: PMC8627481 DOI: 10.1016/j.jcomdis.2021.106163] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/14/2020] [Revised: 10/27/2021] [Accepted: 10/30/2021] [Indexed: 06/13/2023]
Abstract
INTRODUCTION The present study investigated how damage to left-hemisphere brain networks affects the ability for speech auditory feedback error detection and motor correction in post-stroke aphasia. METHODS 34 individuals with left-hemisphere stroke and 25 neurologically intact age-matched control participants performed two randomized experimental tasks in which their online speech auditory feedback was altered using externally induced pitch-shift stimuli: 1) vocalization of a steady speech vowel sound /a/, and 2) listening to the playback of the same self-produced vowel vocalizations. Randomized control condition trials were interleaved in between vocalization and listening tasks where no pitch-shift stimuli were delivered. Following each trial, participants pressed a button to indicate whether they detected a pitch-shift error in their speech auditory feedback during vocalization and listening tasks. RESULTS Our data analysis revealed that speech auditory feedback error detection accuracy rate was significantly lower in the stroke compared with control participants, irrespective of the experimental task (i.e. vocalization vs. listening) and trial condition (i.e. pitch-shifted vs. no-pitch-shift). We found that this effect was associated with the reduced magnitude of speech compensation in the early phase of responses at 150-200 ms following the onset of pitch-shift stimuli in stroke participants. In addition, motor speech compensation deficit in the stroke group was correlated with lower scores on speech repetition tasks as an index of language impairment resulting from aphasia. CONCLUSIONS These findings provide evidence that left-hemisphere stroke is associated with impaired speech auditory feedback error processing, and such deficits account for specific aspects of language impairment in aphasia.
Collapse
Affiliation(s)
- Stacey Sangtian
- Speech Neuroscience Lab, Department of Communication Sciences and Disorders, Arnold School of Public Health, University of South Carolina, 915 Greene Street, Columbia, SC 29208, United States of America
| | - Yuan Wang
- Department of Epidemiology and Biostatistics, Arnold School of Public Health, University of South Carolina, 915 Greene Street, Columbia, SC 29208, United States of America
| | - Julius Fridriksson
- Aphasia Lab, Department of Communication Sciences and Disorders, Arnold School of Public Health, University of South Carolina, 915 Greene St., Columbia, SC 29208, United States of America; Center for the Study of Aphasia Recovery (C-STAR), Department of Communication Sciences and Disorders, Arnold School of Public Health, University of South Carolina, 915 Greene St., Columbia, SC 29208, United States of America
| | - Roozbeh Behroozmand
- Speech Neuroscience Lab, Department of Communication Sciences and Disorders, Arnold School of Public Health, University of South Carolina, 915 Greene Street, Columbia, SC 29208, United States of America.
| |
Collapse
|
11
|
Dietziker J, Staib M, Frühholz S. Neural competition between concurrent speech production and other speech perception. Neuroimage 2020; 228:117710. [PMID: 33385557 DOI: 10.1016/j.neuroimage.2020.117710] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2020] [Revised: 11/28/2020] [Accepted: 12/19/2020] [Indexed: 10/22/2022] Open
Abstract
Understanding others' speech while individuals simultaneously produce speech utterances implies neural competition and requires specific mechanisms for a neural resolution given that previous studies proposed opposing signal dynamics for both processes in the auditory cortex (AC). We here used neuroimaging in humans to investigate this neural competition by lateralized stimulations with other speech samples and ipsilateral or contralateral lateralized feedback of actively produced self speech utterances in the form of various speech vowels. In experiment 1, we show, first, that others' speech classifications during active self speech lead to activity in the planum temporale (PTe) when both self and other speech samples were presented together to only the left or right ear. The contralateral PTe also seemed to indifferently respond to single self and other speech samples. Second, specific activity in the left anterior superior temporal cortex (STC) was found during dichotic stimulations (i.e. self and other speech presented to separate ears). Unlike previous studies, this left anterior STC activity supported self speech rather than other speech processing. Furthermore, right mid and anterior STC was more involved in other speech processing. These results signify specific mechanisms for self and other speech processing in the left and right STC beyond a more general speech processing in PTe. Third, other speech recognition in the context of listening to recorded self speech in experiment 2 led to largely symmetric activity in STC and additionally in inferior frontal subregions. The latter was previously reported to be generally relevant for other speech perception and classification, but we found frontal activity only when other speech classification was challenged by recorded but not by active self speech samples. Altogether, unlike formerly established brain networks for uncompetitive other speech perception, active self speech during other speech perception seemingly leads to a neural reordering, functional reassignment, and unusual lateralization of AC and frontal brain activations.
Collapse
Affiliation(s)
- Joris Dietziker
- Cognitive and Affective Neuroscience Unit, University of Zurich, Zurich, Switzerland.
| | - Matthias Staib
- Cognitive and Affective Neuroscience Unit, University of Zurich, Zurich, Switzerland; Neuroscience Center Zurich, University of Zurich and ETH Zurich, Zurich, Switzerland
| | - Sascha Frühholz
- Cognitive and Affective Neuroscience Unit, University of Zurich, Zurich, Switzerland; Neuroscience Center Zurich, University of Zurich and ETH Zurich, Zurich, Switzerland; Center for the Interdisciplinary Study of Language Evolution (ISLE), University of Zurich, Switzerland; Department of Psychology, University of Oslo, Norway.
| |
Collapse
|
12
|
Kim KS, Wang H, Max L. It's About Time: Minimizing Hardware and Software Latencies in Speech Research With Real-Time Auditory Feedback. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2020; 63:2522-2534. [PMID: 32640180 PMCID: PMC7872729 DOI: 10.1044/2020_jslhr-19-00419] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
Purpose Various aspects of speech production related to auditory-motor integration and learning have been examined through auditory feedback perturbation paradigms in which participants' acoustic speech output is experimentally altered and played back via earphones/headphones "in real time." Scientific rigor requires high precision in determining and reporting the involved hardware and software latencies. Many reports in the literature, however, are not consistent with the minimum achievable latency for a given experimental setup. Here, we focus specifically on this methodological issue associated with implementing real-time auditory feedback perturbations, and we offer concrete suggestions for increased reproducibility in this particular line of work. Method Hardware and software latencies as well as total feedback loop latency were measured for formant perturbation studies with the Audapter software. Measurements were conducted for various audio interfaces, desktop and laptop computers, and audio drivers. An approach for lowering Audapter's software latency through nondefault parameter specification was also tested. Results Oft-overlooked hardware-specific latencies were not negligible for some of the tested audio interfaces (adding up to 15 ms). Total feedback loop latencies (including both hardware and software latency) were also generally larger than claimed in the literature. Nondefault parameter values can improve Audapter's own processing latency without negative impact on formant tracking. Conclusions Audio interface selection and software parameter optimization substantially affect total feedback loop latency. Thus, the actual total latency (hardware plus software) needs to be correctly measured and described in all published reports. Future speech research with "real-time" auditory feedback perturbations should increase scientific rigor by minimizing this latency.
Collapse
Affiliation(s)
- Kwang S. Kim
- Department of Speech and Hearing Sciences, University of Washington, Seattle
| | - Hantao Wang
- Department of Speech and Hearing Sciences, University of Washington, Seattle
| | - Ludo Max
- Department of Speech and Hearing Sciences, University of Washington, Seattle
- Haskins Laboratories, New Haven, CT
| |
Collapse
|
13
|
Franken MK, Hartsuiker RJ, Johansson P, Hall L, Wartenberg T, Lind A. Does passive sound attenuation affect responses to pitch-shifted auditory feedback? THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2019; 146:4108. [PMID: 31893741 DOI: 10.1121/1.5134449] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/05/2019] [Accepted: 10/30/2019] [Indexed: 06/10/2023]
Abstract
The role of auditory feedback in vocal production has mainly been investigated by altered auditory feedback (AAF) in real time. In response, speakers compensate by shifting their speech output in the opposite direction. Current theory suggests this is caused by a mismatch between expected and observed feedback. A methodological issue is the difficulty to fully isolate the speaker's hearing so that only AAF is presented to their ears. As a result, participants may be presented with two simultaneous signals. If this is true, an alternative explanation is that responses to AAF depend on the contrast between the manipulated and the non-manipulated feedback. This hypothesis was tested by varying the passive sound attenuation (PSA). Participants vocalized while auditory feedback was unexpectedly pitch shifted. The feedback was played through three pairs of headphones with varying amounts of PSA. The participants' responses were not affected by the different levels of PSA. This suggests that across all three headphones, PSA is either good enough to make the manipulated feedback dominant, or differences in PSA are too small to affect the contribution of non-manipulated feedback. Overall, the results suggest that it is important to realize that non-manipulated auditory feedback could affect responses to AAF.
Collapse
Affiliation(s)
- Matthias K Franken
- Experimental Psychology, Ghent University, Henri Dunantlaan 2, 9000 Ghent, Belgium
| | - Robert J Hartsuiker
- Experimental Psychology, Ghent University, Henri Dunantlaan 2, 9000 Ghent, Belgium
| | - Petter Johansson
- Department of Philosophy, Lund University Cognitive Science, Lund University, Box 192, 221 00 Lund, Sweden
| | - Lars Hall
- Department of Philosophy, Lund University Cognitive Science, Lund University, Box 192, 221 00 Lund, Sweden
| | - Tijmen Wartenberg
- Hearing Technology at Wireless, acoustics, environment & expert systems (WAVES), Information Technology, Ghent University, Technologiepark-Zwijnaarde 126, 9052 Ghent, Belgium
| | - Andreas Lind
- Department of Philosophy, Lund University Cognitive Science, Lund University, Box 192, 221 00 Lund, Sweden
| |
Collapse
|
14
|
Liu Y, Gui Y, Hu J, Liang S, Mo S, Zhou Y, Li Y, Zhou F, Xu J. Attention/memory complaint is correlated with motor speech disorder in Parkinson's disease. BMC Neurol 2019; 19:309. [PMID: 31787082 PMCID: PMC6886194 DOI: 10.1186/s12883-019-1535-8] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2019] [Accepted: 11/19/2019] [Indexed: 02/02/2023] Open
Abstract
BACKGROUND The mechanisms underlying the online modulation of motor speech in Parkinson's disease (PD) have not been determined. Moreover, medical and rehabilitation interventions for PD-associated motor speech disorder (MSD) have a poor long-term prognosis. METHODS To compare risk factors in PD patients with MSD to those without MSD (non-MSD) and determine predictive independent risk factors correlated with the MSD phenotype, we enrolled 314 PD patients, including 250 with and 64 without MSD. We compared demographic, characteristic data, as well as PD-associated evaluations between the MSD group and non-MSD group. RESULTS Univariate analysis showed that demographic characteristics, including occupation, educational level, monthly income and speaking background; clinical characteristics, including lesions in the frontal and temporal lobes, and concurrent dysphagia; and PD-associated evaluations, including the activity of daily living (ADL) score, non-motor symptoms scale (NMSS) domain 4 score (perceptual problem), and NMSS domain 5 score (attention/memory) were all significantly different between the MSD and non-MSD group (all P < 0.05). Multivariate logistic regression analysis showed that educational level, frontal lesions, and NMSS domain 5 score (attention/memory) were independent risk factors for PD-associated MSD (all P < 0.005). CONCLUSIONS We determined an association between MSD phenotype and cognitive impairment, reflected by low-level education and related clinical profiles. Moreover, attention and memory dysfunction may play key roles in the progression of MSD in PD patients. Further studies are required to detail the mechanism underlying abnormal speech motor modulation in PD patients. Early cognitive intervention may enhance rehabilitation management and motor speech function in patients with PD-associated MSD.
Collapse
Affiliation(s)
- Ying Liu
- Department of Rehabilitation Medicine, the First Affiliated Hospital of Guangxi Medical University, Nanning, 530021, Guangxi, China
| | - Yuchang Gui
- Department of Rehabilitation Medicine, the First Affiliated Hospital of Guangxi Medical University, Nanning, 530021, Guangxi, China
| | - Jincui Hu
- Department of Rehabilitation Medicine, the First Affiliated Hospital of Guangxi Medical University, Nanning, 530021, Guangxi, China
| | - Shanshan Liang
- Department of Rehabilitation Medicine, the First Affiliated Hospital of Guangxi Medical University, Nanning, 530021, Guangxi, China
| | - Sixia Mo
- Department of Rehabilitation Medicine, the First Affiliated Hospital of Guangxi Medical University, Nanning, 530021, Guangxi, China
| | - Yuanfang Zhou
- Department of Neurology, the First Affiliated Hospital of Guangxi Medical University, Nanning, 530021, Guangxi, China
| | - Yujian Li
- Department of Neurology, the First Affiliated Hospital of Guangxi Medical University, Nanning, 530021, Guangxi, China
| | - Fengkun Zhou
- Department of Neurology, the First Affiliated Hospital of Guangxi Medical University, Nanning, 530021, Guangxi, China
| | - Jianwen Xu
- Department of Rehabilitation Medicine, the First Affiliated Hospital of Guangxi Medical University, Nanning, 530021, Guangxi, China.
| |
Collapse
|
15
|
Chang A, Bosnyak DJ, Trainor LJ. Rhythmicity facilitates pitch discrimination: Differential roles of low and high frequency neural oscillations. Neuroimage 2019; 198:31-43. [DOI: 10.1016/j.neuroimage.2019.05.007] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2018] [Revised: 04/30/2019] [Accepted: 05/03/2019] [Indexed: 02/04/2023] Open
|
16
|
Max L, Daliri A. Limited Pre-Speech Auditory Modulation in Individuals Who Stutter: Data and Hypotheses. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2019; 62:3071-3084. [PMID: 31465711 PMCID: PMC6813031 DOI: 10.1044/2019_jslhr-s-csmc7-18-0358] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Purpose We review and interpret our recent series of studies investigating motor-to-auditory influences during speech movement planning in fluent speakers and speakers who stutter. In those studies, we recorded auditory evoked potentials in response to probe tones presented immediately prior to speaking or at the equivalent time in no-speaking control conditions. As a measure of pre-speech auditory modulation (PSAM), we calculated changes in auditory evoked potential amplitude in the speaking conditions relative to the no-speaking conditions. Whereas adults who do not stutter consistently showed PSAM, this phenomenon was greatly reduced or absent in adults who stutter. The same between-group difference was observed in conditions where participants expected to hear their prerecorded speech played back without actively producing it, suggesting that the speakers who stutter use inefficient forward modeling processes rather than inefficient motor command generation processes. Compared with fluent participants, adults who stutter showed both less PSAM and less auditory-motor adaptation when producing speech while exposed to formant-shifted auditory feedback. Across individual participants, however, PSAM and auditory-motor adaptation did not correlate in the typically fluent group, and they were negatively correlated in the stuttering group. Interestingly, speaking with a consistent 100-ms delay added to the auditory feedback signal-normalized PSAM in speakers who stutter, and there no longer was a between-group difference in this condition. Conclusions Combining our own data with human and animal neurophysiological evidence from other laboratories, we interpret the overall findings as suggesting that (a) speech movement planning modulates auditory processing in a manner that may optimize its tuning characteristics for monitoring feedback during speech production and, (b) in conditions with typical auditory feedback, adults who stutter do not appropriately modulate the auditory system prior to speech onset. Lack of modulation of speakers who stutter may lead to maladaptive feedback-driven movement corrections that manifest themselves as repetitive movements or postural fixations.
Collapse
Affiliation(s)
- Ludo Max
- Department of Speech and Hearing Sciences, University of Washington, Seattle
- Haskins Laboratories, New Haven, CT
| | - Ayoub Daliri
- College of Health Solutions, Arizona State University, Tempe, AZ
| |
Collapse
|
17
|
Power and phase coherence in sensorimotor mu and temporal lobe alpha components during covert and overt syllable production. Exp Brain Res 2018; 237:705-721. [DOI: 10.1007/s00221-018-5447-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2018] [Accepted: 11/30/2018] [Indexed: 10/27/2022]
|