1
|
Green GD, Jacewicz E, Santosa H, Arzbecker LJ, Fox RA. Evaluating Speaker-Listener Cognitive Effort in Speech Communication Through Brain-to-Brain Synchrony: A Pilot Functional Near-Infrared Spectroscopy Investigation. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2024; 67:1339-1359. [PMID: 38535722 DOI: 10.1044/2024_jslhr-23-00476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/09/2024]
Abstract
PURPOSE We explore a new approach to the study of cognitive effort involved in listening to speech by measuring the brain activity in a listener in relation to the brain activity in a speaker. We hypothesize that the strength of this brain-to-brain synchrony (coupling) reflects the magnitude of cognitive effort involved in verbal communication and includes both listening effort and speaking effort. We investigate whether interbrain synchrony is greater in native-to-native versus native-to-nonnative communication using functional near-infrared spectroscopy (fNIRS). METHOD Two speakers participated, a native speaker of American English and a native speaker of Korean who spoke English as a second language. Each speaker was fitted with the fNIRS cap and told short stories. The native English speaker provided the English narratives, and the Korean speaker provided both the nonnative (accented) English and Korean narratives. In separate sessions, fNIRS data were obtained from seven English monolingual participants ages 20-24 years who listened to each speaker's stories. After listening to each story in native and nonnative English, they retold the content, and their transcripts and audio recordings were analyzed for comprehension and discourse fluency, measured in the number of hesitations and articulation rate. No story retellings were obtained for narratives in Korean (an incomprehensible language for English listeners). Utilizing fNIRS technique termed sequential scanning, we quantified the brain-to-brain synchronization in each speaker-listener dyad. RESULTS For native-to-native dyads, multiple brain regions associated with various linguistic and executive functions were activated. There was a weaker coupling for native-to-nonnative dyads, and only the brain regions associated with higher order cognitive processes and functions were synchronized. All listeners understood the content of all stories, but they hesitated significantly more when retelling stories told in accented English. The nonnative speaker hesitated significantly more often than the native speaker and had a significantly slower articulation rate. There was no brain-to-brain coupling during listening to Korean, indicating a break in communication when listeners failed to comprehend the speaker. CONCLUSIONS We found that effortful speech processing decreased interbrain synchrony and delayed comprehension processes. The obtained brain-based and behavioral patterns are consistent with our proposal that cognitive effort in verbal communication pertains to both the listener and the speaker and that brain-to-brain synchrony can be an indicator of differences in their cumulative communicative effort. SUPPLEMENTAL MATERIAL https://doi.org/10.23641/asha.25452142.
Collapse
Affiliation(s)
- Geoff D Green
- Department of Speech and Hearing Science, The Ohio State University, Columbus
| | - Ewa Jacewicz
- Department of Speech and Hearing Science, The Ohio State University, Columbus
| | | | - Lian J Arzbecker
- Department of Speech and Hearing Science, The Ohio State University, Columbus
| | - Robert A Fox
- Department of Speech and Hearing Science, The Ohio State University, Columbus
| |
Collapse
|
2
|
Moon J, Chau T. Online Ternary Classification of Covert Speech by Leveraging the Passive Perception of Speech. Int J Neural Syst 2023; 33:2350048. [PMID: 37522623 DOI: 10.1142/s012906572350048x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/01/2023]
Abstract
Brain-computer interfaces (BCIs) provide communicative alternatives to those without functional speech. Covert speech (CS)-based BCIs enable communication simply by thinking of words and thus have intuitive appeal. However, an elusive barrier to their clinical translation is the collection of voluminous examples of high-quality CS signals, as iteratively rehearsing words for long durations is mentally fatiguing. Research on CS and speech perception (SP) identifies common spatiotemporal patterns in their respective electroencephalographic (EEG) signals, pointing towards shared encoding mechanisms. The goal of this study was to investigate whether a model that leverages the signal similarities between SP and CS can differentiate speech-related EEG signals online. Ten participants completed a dyadic protocol where in each trial, they listened to a randomly selected word and then subsequently mentally rehearsed the word. In the offline sessions, eight words were presented to participants. For the subsequent online sessions, the two most distinct words (most separable in terms of their EEG signals) were chosen to form a ternary classification problem (two words and rest). The model comprised a functional mapping derived from SP and CS signals of the same speech token (features are extracted via a Riemannian approach). An average ternary online accuracy of 75.3% (60% chance level) was achieved across participants, with individual accuracies as high as 93%. Moreover, we observed that the signal-to-noise ratio (SNR) of CS signals was enhanced by perception-covert modeling according to the level of high-frequency ([Formula: see text]-band) correspondence between CS and SP. These findings may lead to less burdensome data collection for training speech BCIs, which could eventually enhance the rate at which the vocabulary can grow.
Collapse
Affiliation(s)
- Jae Moon
- Institute of Biomedical Engineering, University of Toronto, Holland Bloorview Kid's Rehabilitation Hospital, Toronto, Ontario, Canada
| | - Tom Chau
- Institute of Biomedical Engineering, University of Toronto, Holland Bloorview Kid's Rehabilitation Hospital, Toronto, Ontario, Canada
| |
Collapse
|
3
|
Hancock AS, Warren CM, Barrett TS, Bolton DAE, Gillam RB. Functional near-infrared spectroscopy measures of neural activity in children with and without developmental language disorder during a working memory task. Brain Behav 2023; 13:e2895. [PMID: 36706040 PMCID: PMC9927862 DOI: 10.1002/brb3.2895] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/16/2022] [Revised: 12/14/2022] [Accepted: 12/18/2022] [Indexed: 01/28/2023] Open
Abstract
INTRODUCTION Children with developmental language disorder (DLD) exhibit cognitive deficits that interfere with their ability to learn language. Little is known about the functional neuroanatomical differences between children developing typically (TD) and children with DLD. METHODS Using functional near-infrared spectroscopy, we recorded oxygenated hemoglobin (O2 hb) concentration values associated with neural activity in children with and without DLD during an auditory N-back task that included 0-back, 1-back, and 2-back conditions. Analyses focused on the left dorsolateral prefrontal cortex (DLPFC) and left inferior parietal lobule (IPL). Multilevel models were constructed with accuracy, response time, and O2 hb as outcome measures, with 0-back outcomes as fixed effects to control for sustained attention. RESULTS Children with DLD were significantly less accurate than their TD peers at both the 1-back and 2-back tasks, and they demonstrated slower response times during 2-back. In addition, children in the TD group demonstrated significantly greater sensitivity to increased task difficulty, showing increased O2 hb to the IPL during 1-back and to the DLPFC during the 2-back, whereas the DLD group did not. A secondary analysis revealed that higher O2 hb in the DLPFC predicted better task accuracy across groups. CONCLUSION When task difficulty increased, children with DLD failed to recruit the DLPFC for monitoring information and the IPL for processing information. Reduced memory capacity and reduced engagement likely contribute to the language learning difficulties of children with DLD.
Collapse
Affiliation(s)
| | | | - Tyson S Barrett
- Department of Psychology, Utah State University, Logan, Utah, USA
| | - David A E Bolton
- Department of Kinesiology and Health Sciences, Utah State University, Logan, Utah, USA
| | - Ronald B Gillam
- Department of Communicative Disorders and Deaf Education, Utah State University, Logan, Utah, USA
| |
Collapse
|
4
|
Georgiou E(EZ, Prapiadou S, Thomopoulos V, Skondra M, Charalampopoulou M, Pachi A, Anagnostopoulou Α, Vorvolakos T, Perneczky R, Politis A, Alexopoulos P. Naming ability assessment in neurocognitive disorders: a clinician's perspective. BMC Psychiatry 2022; 22:837. [PMID: 36585667 PMCID: PMC9801565 DOI: 10.1186/s12888-022-04486-x] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/21/2022] [Accepted: 12/15/2022] [Indexed: 12/31/2022] Open
Abstract
BACKGROUND Detecting impaired naming capacity is valuable in diagnosing neurocognitive disorders (ND). A. clinical practice- oriented overview of naming tests validated in ND is not available yet. Here, features of naming tests with validated utility in ND which are open access or available for purchase are succinctly presented and compared. METHODS Searches were carried out across Pubmed, Medline and Google Scholar. Additional studies were identified by searching reference lists. Only peer-reviewed journal articles were eligible. A narrative- and tabullar synthesis was used to summarize different aspects of the naming assessment instruments used in patients with ND such as stimuli type, administration time, assessment parameters and accessibility. Based on computational word frequency calculations, the tests were compared in terms of the average frequency of their linguistic content. RESULTS Twelve naming tests, relying either on visual or auditory stimuli have been validated in ND. Their content and administration time vary between three and 60 items and one and 20 minutes, respectively. The average frequency of the words of each considered test was two or lower, pointing to low frequency of most items. In all but one test, scoring systems are exclusively based on correctly named items. Seven instruments are open access and four are available in more than one language. CONCLUSIONS Gaining insights into naming tests' characteristics may catalyze the wide incorporation of those with short administration time but high diagnostic accuracy into the diagnostic workup of ND at primary healthcare and of extensive, visual or auditory ones into the diagnostic endeavors of memory clinics, as well as of secondary and tertiary brain healthcare settings.
Collapse
Affiliation(s)
- Eliza ( Eleni-Zacharoula) Georgiou
- grid.11047.330000 0004 0576 5395Department of Psychiatry, Patras University General Hospital, Faculty of Medicine, School of Health Sciences, University of Patras, Patras, Greece
| | - Savvina Prapiadou
- grid.11047.330000 0004 0576 5395Department of Psychiatry, Patras University General Hospital, Faculty of Medicine, School of Health Sciences, University of Patras, Patras, Greece
| | - Vasileios Thomopoulos
- grid.11047.330000 0004 0576 5395Large-Scale Machine Learning & Cloud Data Engineering Laboratory (ML@Cloud-Lab), Faculty of Computer Engineering & Informatics, School of Engineering, University of Patras, Patras, Greece
| | - Maria Skondra
- grid.11047.330000 0004 0576 5395Department of Psychiatry, Patras University General Hospital, Faculty of Medicine, School of Health Sciences, University of Patras, Patras, Greece
| | - Marina Charalampopoulou
- grid.11047.330000 0004 0576 5395Department of Psychiatry, Patras University General Hospital, Faculty of Medicine, School of Health Sciences, University of Patras, Patras, Greece
| | - Asimina Pachi
- grid.11047.330000 0004 0576 5395Department of Psychiatry, Patras University General Hospital, Faculty of Medicine, School of Health Sciences, University of Patras, Patras, Greece
| | - Αlexandra Anagnostopoulou
- grid.11047.330000 0004 0576 5395Department of Psychiatry, Patras University General Hospital, Faculty of Medicine, School of Health Sciences, University of Patras, Patras, Greece ,General Hospital of Zakynthos “Saint Dionysios”, Zakynthos, Greece
| | - Theofanis Vorvolakos
- grid.12284.3d0000 0001 2170 8022Department of Psychiatry, Faculty of Medicine, School of Health Sciences, University Hospital of Alexandroupolis, Democritus University of Thrace, Alexandroupolis, Greece
| | - Robert Perneczky
- grid.5252.00000 0004 1936 973XDivision of Mental Health in Older Adults and Alzheimer Therapy and Research Center, Department of Psychiatry and Psychotherapy, University Hospital, Ludwig-Maximilians-Universität Munich, Munich, Germany ,grid.7445.20000 0001 2113 8111Ageing Epidemiology (AGE) Research Unit, School of Public Health, Faculty of Medicine, The Imperial College of Science, Technology and Medicine, London, UK ,grid.424247.30000 0004 0438 0426German Center for Neurodegenerative Diseases (DZNE) Munich, Munich, Germany ,grid.452617.3Munich Cluster for Systems Neurology (SyNergy), Munich, Germany ,grid.11835.3e0000 0004 1936 9262Sheffield Institute for Translational Neurosciences (SITraN), University of Sheffield, Sheffield, UK
| | - Antonios Politis
- grid.5216.00000 0001 2155 0800First Department of Psychiatry, Eginition Hospital, School of Medicine, National and Kapodistrian University of Athens, Athens, Greece ,grid.21107.350000 0001 2171 9311Department of Psychiatry, Division of Geriatric Psychiatry and Neuropsychiatry, Johns Hopkins Medical School, Baltimore, USA
| | - Panagiotis Alexopoulos
- Department of Psychiatry, Patras University General Hospital, Faculty of Medicine, School of Health Sciences, University of Patras, Patras, Greece. .,Global Brain Health Institute, Medical School, Trinity College Dublin, The University of Dublin, Dublin, Republic of Ireland. .,Department of Psychiatry and Psychotherapy, Klinikum rechts der Isar, Faculty of Medicine, Technical University of Munich, Munich, Germany. .,Patras Dementia Day Care Center, Corporation for Succor and Care of Elderly and Disabled - FRODIZO, Patras, Greece.
| |
Collapse
|
5
|
Yuen C, Rezania K, Kelly T, Bishop MR. Clinical predictors of chimeric antigen receptor T-cell therapy neurotoxicity: a single-center study. Immunotherapy 2021; 13:1261-1269. [PMID: 34558978 DOI: 10.2217/imt-2021-0084] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022] Open
Abstract
Aims: Neurotoxicity (NT) is a common complication of chimeric antigen receptor (CAR) T-cell therapy. Data on early clinical identifiers for impending severe NT are lacking. Methods: The authors performed a retrospective study on 26 adult relapsed/refractory diffuse large B cell lymphoma patients treated with commercial CAR T-cell therapy (December 2017 - September 2018). Results: NT of any grade and severe NT occurred in 88 and 31% of patients, respectively. Dysgraphia (p < 0.01), disorientation (p = 0.01) and inattention (p = 0.018) were associated with severe NT, with positive predictive values of 100, 87.5 and 87.5%, respectively. Dysnomia was not associated with severe NT. Conclusion: In the authors' limited cohort, the dysgraphia, disorientation and inattention components of the CAR T-cell therapy-associated toxicity 10 scoring system were significantly associated with and predictive of impending severe NT.
Collapse
Affiliation(s)
- Carlen Yuen
- Department of Neuro-Oncology, Columbia University, New York, NY 10033 USA.,Department of Neurology, The University of Chicago Medical Center, Chicago, IL 60637, USA
| | - Kourosh Rezania
- Department of Neurology, The University of Chicago Medical Center, Chicago, IL 60637, USA
| | - Thomas Kelly
- Department of Neurology, The University of Chicago Medical Center, Chicago, IL 60637, USA
| | - Michael R Bishop
- Department of Medicine, The University of Chicago Medical Center, Chicago, IL 60637, USA
| |
Collapse
|
6
|
Rovetti J, Goy H, Nurgitz R, Russo FA. Comparing verbal working memory load in auditory and visual modalities using functional near-infrared spectroscopy. Behav Brain Res 2021; 402:113102. [PMID: 33422594 DOI: 10.1016/j.bbr.2020.113102] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2020] [Revised: 11/29/2020] [Accepted: 12/27/2020] [Indexed: 10/22/2022]
Abstract
The verbal identity n-back task is commonly used to assess verbal working memory (VWM) capacity. Only three studies have compared brain activation during the n-back when using auditory and visual stimuli. The earliest study, a positron emission tomography study of the 3-back, found no differences in VWM-related brain activation between n-back modalities. In contrast, two subsequent functional magnetic resonance imaging (fMRI) studies of the 2-back found that auditory VWM was associated with greater left dorsolateral prefrontal cortex (DL-PFC) activation than visual VWM, perhaps suggesting that auditory VWM requires more cognitive effort than its visual counterpart. The current study aimed to assess whether DL-PFC activation (i.e., cognitive effort) differs by VWM modality. To do this, 16 younger adults completed an auditory and visual n-back, both at four levels of VWM load. Concurrently, activation of the PFC was measured using functional near-infrared spectroscopy (fNIRS), a silent neuroimaging method. We found that DL-PFC activation increased with VWM load, but it was not affected by VWM modality or the interaction between load and modality. This supports the view that both VWM modalities require similar cognitive effort, and perhaps that previous fMRI results were an artefact of scanner noise. We also found that, across conditions, DL-PFC activation was positively correlated with reaction time. This may further support DL-PFC activation as an index of cognitive effort, and fNIRS as a method to measure it.
Collapse
Affiliation(s)
- Joseph Rovetti
- Department of Psychology, Ryerson University, 350 Victoria St, Toronto, ON M5B 2K3, Canada.
| | - Huiwen Goy
- Department of Psychology, Ryerson University, 350 Victoria St, Toronto, ON M5B 2K3, Canada.
| | - Rebecca Nurgitz
- Department of Psychology, Ryerson University, 350 Victoria St, Toronto, ON M5B 2K3, Canada.
| | - Frank A Russo
- Department of Psychology, Ryerson University, 350 Victoria St, Toronto, ON M5B 2K3, Canada.
| |
Collapse
|
7
|
Berglund-Barraza A, Tian F, Basak C, Hart J, Evans JL. Tracking Changes in Frontal Lobe Hemodynamic Response in Individual Adults With Developmental Language Disorder Following HD tDCS Enhanced Phonological Working Memory Training: An fNIRS Feasibility Study. Front Hum Neurosci 2020; 14:362. [PMID: 33132869 PMCID: PMC7511756 DOI: 10.3389/fnhum.2020.00362] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2020] [Accepted: 08/10/2020] [Indexed: 11/22/2022] Open
Abstract
Background: Current research suggests a neurobiological marker of developmental language disorder (DLD) in adolescents and young adults may be an atypical neural profile coupled with behavioral performance that overlaps with that of normal controls. Although many imaging techniques are not suitable for the study of speech and language processing in DLD populations, fNIRS may be a viable option. In this study we asked if fNIRS can be used to identify atypical cortical activation patterns in individual adults with DLD and track potential changes in cortical activation patterns following a phonological working memory training protocol enhanced with anodal HD tDCS stimulation to the presupplementary motor area (preSMA). Objective/Hypothesis: The purpose of this study was two-fold: (1) to determine if fNIRS can be used to identify atypical hemodynamic responses in individual young adults with DLD during active spoken word processing and, (2) to determine if fNIRS can detect changes in hemodynamic response in these same adults with DLD following anodal HD tDCS enhanced phonological working memory training. Methods: Two adult subjects with DLD (female, age 25) completed a total of two sessions of fNIRs working memory task prior to and following one session of a non-word repetition task paired with anodal HD tDCS (1.0 mA tDCS; 20 min) to the preSMA. Standardized z-scores of behavioral measures (accuracy and reaction time) and changes in hemodynamic response during an n-back working memory task for the two participants with DLD was compared to that of a normative sample of 21 age- and gender- matched normal controls (ages 18 to 25) prior to and following phonological working memory training. Results: Individual standardized z-scores for each participant with DLD indicated that prior to training, hemoglobin response in the prefrontal lobe for both participants was markedly different from each other and normal controls. Following training, standard scores showed that the hemodynamic response for both participants moved within normal limits for ROIs. Conclusion: These findings highlight the feasibility of fNIRS to establish individual differences in the link between behavior and neural patterns in single subjects with DLD, as well as track individual differences in changes in brain activity following working memory training.
Collapse
Affiliation(s)
- Amy Berglund-Barraza
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, Dallas, TX, United States
| | - Fenghua Tian
- Department of Bioengineering, The University of Texas at Arlington, Arlington, TX, United States
| | - Chandramallika Basak
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, Dallas, TX, United States
| | - John Hart
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, Dallas, TX, United States
| | - Julia L Evans
- School of Behavioral and Brain Sciences, The University of Texas at Dallas, Dallas, TX, United States
| |
Collapse
|