1
|
Choi HJ, Kyong JS, Lee JH, Han SH, Shim HJ. The Impact of Spectral and Temporal Degradation on Vocoded Speech Recognition in Early-Blind Individuals. eNeuro 2024; 11:ENEURO.0528-23.2024. [PMID: 38811162 PMCID: PMC11137809 DOI: 10.1523/eneuro.0528-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2023] [Revised: 04/11/2024] [Accepted: 05/01/2024] [Indexed: 05/31/2024] Open
Abstract
This study compared the impact of spectral and temporal degradation on vocoded speech recognition between early-blind and sighted subjects. The participants included 25 early-blind subjects (30.32 ± 4.88 years; male:female, 14:11) and 25 age- and sex-matched sighted subjects. Tests included monosyllable recognition in noise at various signal-to-noise ratios (-18 to -4 dB), matrix sentence-in-noise recognition, and vocoded speech recognition with different numbers of channels (4, 8, 16, and 32) and temporal envelope cutoff frequencies (50 vs 500 Hz). Cortical-evoked potentials (N2 and P3b) were measured in response to spectrally and temporally degraded stimuli. The early-blind subjects displayed superior monosyllable and sentence recognition than sighted subjects (all p < 0.01). In the vocoded speech recognition test, a three-way repeated-measure analysis of variance (two groups × four channels × two cutoff frequencies) revealed significant main effects of group, channel, and cutoff frequency (all p < 0.001). Early-blind subjects showed increased sensitivity to spectral degradation for speech recognition, evident in the significant interaction between group and channel (p = 0.007). N2 responses in early-blind subjects exhibited shorter latency and greater amplitude in the 8-channel (p = 0.022 and 0.034, respectively) and shorter latency in the 16-channel (p = 0.049) compared with sighted subjects. In conclusion, early-blind subjects demonstrated speech recognition advantages over sighted subjects, even in the presence of spectral and temporal degradation. Spectral degradation had a greater impact on speech recognition in early-blind subjects, while the effect of temporal degradation was similar in both groups.
Collapse
Affiliation(s)
- Hyo Jung Choi
- Department of Otorhinolaryngology-Head and Neck Surgery, Nowon Eulji Medical Center, Eulji University School of Medicine, Seoul 01830, Republic of Korea
- Eulji Tinnitus and Hearing Research Institute, Nowon Eulji Medical Center, Seoul 01830, Republic of Korea
| | - Jeong-Sug Kyong
- Sensory Organ Institute, Medical Research Institute, Seoul National University, Seoul 03080, Republic of Korea
- Department of Radiology, Konkuk University Medical Center, Seoul 05030, Republic of Korea
| | - Jae Hee Lee
- Department of Audiology and Speech-Language Pathology, Hallym University of Graduate Studies, Seoul 06197, Republic of Korea
| | - Seung Ho Han
- Department of Physiology and Biophysics, School of Medicine, Eulji University, Daejeon 34824, Republic of Korea
| | - Hyun Joon Shim
- Department of Otorhinolaryngology-Head and Neck Surgery, Nowon Eulji Medical Center, Eulji University School of Medicine, Seoul 01830, Republic of Korea
- Eulji Tinnitus and Hearing Research Institute, Nowon Eulji Medical Center, Seoul 01830, Republic of Korea
| |
Collapse
|
2
|
Arnold DH, Electricity F, Saurels BW. Enhanced electrophysiological responses to explicitly predicted and pre-imagined inputs, with confirmation from online decoding with neuro-feedback. Proc Biol Sci 2024; 291:20232908. [PMID: 38351803 PMCID: PMC10865004 DOI: 10.1098/rspb.2023.2908] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Accepted: 01/15/2024] [Indexed: 02/16/2024] Open
Abstract
Neural responses to sensory inputs can scale with the likelihood of encountering the input. This is consistent with the predictive coding framework, in that the human brain is expected to be less responsive to predicted inputs. Typically, however, prediction is not explicitly measured. It is inferred from the probability of encountering an event. When an input is explicitly predicted, responses to predicted inputs can be enhanced. Here, we ask if this effect can be ascribed to a generic priming effect, from pre-cogitating about one of two possible inputs. Consistent with this, we find that P300s (a relatively late event-related potential measured with electroencephalography) are greater for explicitly predicted audio and visual inputs, and that this effect cannot be distinguished from a priming effect from pre-imagining audio or visual presentations. Evidence indicates that participants engaged in pre-imagining presentations, as we were able to decode online what type of presentation (audio or visual) they were imagining with a high success rate (approx. 73%), and we encouraged compliance with neuro-feedback regarding this success rate. Our data confirm that human cortex can be more responsive to inputs that have been subject to pre-cogitation-including explicit predictions. This highlights that while anticipatory processes can reduce responding to likely inputs, they can also enhance responding to explicitly predicted inputs.
Collapse
Affiliation(s)
- Derek H. Arnold
- Perception Lab, School of Psychology, University of Queensland, Brisbane, Queensland, Australia
| | - Felicity Electricity
- Perception Lab, School of Psychology, University of Queensland, Brisbane, Queensland, Australia
| | - Blake W. Saurels
- Perception Lab, School of Psychology, University of Queensland, Brisbane, Queensland, Australia
| |
Collapse
|
3
|
Saurels BW, Johnston A, Yarrow K, Arnold DH. Event Probabilities Have a Different Impact on Early and Late Electroencephalographic Measures Regarded as Metrics of Prediction. J Cogn Neurosci 2024; 36:187-199. [PMID: 37902587 DOI: 10.1162/jocn_a_02076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2023]
Abstract
The oddball protocol has been used to study the neural and perceptual consequences of implicit predictions in the human brain. The protocol involves presenting a sequence of identical repeated events that are eventually broken by a novel "oddball" presentation. Oddball presentations have been linked to increased neural responding and to an exaggeration of perceived duration relative to repeated events. Because the number of repeated events in such protocols is circumscribed, as more repeats are encountered, the conditional probability of a further repeat decreases-whereas the conditional probability of an oddball increases. These facts have not been appreciated in many analyses of oddballs; repeats and oddballs have rather been treated as binary event categories. Here, we show that the human brain is sensitive to conditional event probabilities in an active, visual oddball paradigm. P300 responses (a relatively late component of visually evoked potentials measured with EEG) tended to be greater for less likely oddballs and repeats. By contrast, P1 responses (an earlier component) increased for repeats as a goal-relevant target presentation neared, but this effect occurred even when repeat probabilities were held constant, and oddball P1 responses were invariant. We also found that later, more likely oddballs seemed to last longer, and this effect was largely independent of the number of preceding repeats. These findings speak against a repetition suppression account of the temporal oddball effect. Overall, our data highlight an impact of event probability on later, rather than earlier, electroencephalographic measures previously related to predictive processes-and the importance of considering conditional probabilities in sequential presentation paradigms.
Collapse
|
4
|
Eyamu J, Kim WS, Kim K, Lee KH, Kim JU. Prefrontal event-related potential markers in association with mild cognitive impairment. Front Aging Neurosci 2023; 15:1273008. [PMID: 37927335 PMCID: PMC10620700 DOI: 10.3389/fnagi.2023.1273008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2023] [Accepted: 09/28/2023] [Indexed: 11/07/2023] Open
Abstract
Background Alzheimer's disease (AD) is among the leading contributors of dementia globally with approximately 60-70% of its cases. Current research is focused on the mild cognitive impairment (MCI), which is associated with cognitive decline but does not disrupt routine activities. Event-related potential (ERP) research is essential in screening patients with MCI. Low-density channel electroencephalography (EEG) is frequently used due to its convenience, portability, and affordability, making it suitable for resource-constrained environments. Despite extensive research on neural biomarkers for cognitive impairment, there is a considerable gap in understanding the effects on early stages of cognitive processes, particularly when combining physiological and cognitive markers using portable devices. The present study aimed to examine cognitive shortfalls and behavioral changes in patients with MCI using prefrontal selective attention ERP recorded from a prefrontal two-channel EEG device. Methods We assessed cognitive decline using the Mini-Mental State Examination (MMSE) and the Seoul Neuropsychological Screening Battery (SNSB). We administered auditory selective attention tasks to 598 elderly participants, including those with MCI (160) and cognitively normal (CN) individuals (407). We conducted statistical analyses such as independent t-tests, Pearson's correlations, and univariate and multiple logistic regression analyses to assess group differences and associations between neuropsychological tests, ERP measures, behavioral measures, and MCI prevalence. Results Our findings revealed that patients with MCI demonstrated slower information-processing abilities, and exhibited poorer task execution, characterized by reduced accuracy, increased errors, and higher variability in response time, compared to CN adults. Multiple logistic regression analyses confirmed the association between some ERP and behavioral measures with MCI prevalence, independent of demographic and neuropsychological factors. A relationship was observed between neuropsychological scores, ERP, and behavioral measures. Discussion The slower information processing abilities, and poor task execution in the MCI group compared to the CN individuals suggests flawed neurological changes and reduced attentional maintenance during cognitive processing, respectively. Hence, the utilization of portable EEG devices to capture prefrontal selective attention ERPs, in combination with behavioral assessments, holds promise for the identification of mild cognitive deficits and neural alterations in individuals with MCI. This approach could potentially augment the traditional neuropsychological tests during clinical screening for MCI.
Collapse
Affiliation(s)
- Joel Eyamu
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon, Republic of Korea
- KM Convergence Science, University of Science and Technology, Daejeon, Republic of Korea
| | - Wuon-Shik Kim
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon, Republic of Korea
| | - Kahye Kim
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon, Republic of Korea
| | - Kun Ho Lee
- Gwangju Alzheimer’s Disease and Related Dementias (GARD) Cohort Research Center, Chosun University, Gwangju, Republic of Korea
- Department of Biomedical Science, Chosun University, Gwangju, Republic of Korea
- Dementia Research Group, Korea Brain Research Institute, Daegu, Republic of Korea
| | - Jaeuk U. Kim
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon, Republic of Korea
- KM Convergence Science, University of Science and Technology, Daejeon, Republic of Korea
| |
Collapse
|
5
|
Imbir KK, Duda-Goławska J, Pastwa M, Sobieszek A, Wielgopolan A, Jankowska M, Modzelewska A, Żygierewicz J. Inhibitory control effectiveness can be improved: The role of arousal, subjective significance and origin of words in modified Emotional Stroop Test. PLoS One 2022; 17:e0270558. [PMID: 35763510 PMCID: PMC9239449 DOI: 10.1371/journal.pone.0270558] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2021] [Accepted: 06/13/2022] [Indexed: 11/22/2022] Open
Abstract
The interference control measured in the Emotional Stroop Task is the phenomenon that gives us an insight into mechanisms of emotion-cognition interactions. Especially the role of dimensions of affect can be easily studied with this paradigm. In the current study, we were interested in the role of the complexity of emotional stimuli (origin). We also aimed at searching for activation-like factors that impair (arousal) or improve (subjective significance) the effectiveness of cognitive control. We have used an orthogonal manipulation of all the above dimensions in words. We expected to find the contrastive effects of arousal and subjective significance on reaction times and Event Related Potential’s amplitudes. On a behavioural level, we observed the reduction of reaction times with increasing subjective significance of stimuli and reflective origin. We also found a correlation between subjective significance and reduction of amplitude polarisation in the N450 component associated with cognitive control execution effort. This experiment shows that subjective significance has an improving role for cognitive control effectiveness, even when valence, arousal and origin levels are controlled. This guides us to conclude that external stimuli may drive not only disruption of control but also its improvement.
Collapse
Affiliation(s)
- Kamil K. Imbir
- Faculty of Psychology, University of Warsaw, Warsaw, Poland
- * E-mail:
| | - Joanna Duda-Goławska
- Biomedical Physics Division, Institute of Experimental Physics, Faculty of Physics, University of Warsaw, Warsaw, Poland
| | - Maciej Pastwa
- Faculty of Psychology, University of Warsaw, Warsaw, Poland
| | - Adam Sobieszek
- Faculty of Psychology, University of Warsaw, Warsaw, Poland
| | | | | | | | - Jarosław Żygierewicz
- Biomedical Physics Division, Institute of Experimental Physics, Faculty of Physics, University of Warsaw, Warsaw, Poland
| |
Collapse
|
6
|
Saurels BW, Frommelt T, Yarrow K, Lipp OV, Arnold DH. Neural prediction errors depend on how an expectation was formed. Cortex 2021; 147:102-111. [PMID: 35032749 DOI: 10.1016/j.cortex.2021.10.012] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2021] [Revised: 09/20/2021] [Accepted: 10/18/2021] [Indexed: 11/28/2022]
Abstract
When a visual event is unexpected, because it violates a train of repeated events, it excites a greater positive electrical potential at sensors positioned above occipital-parietal human brain regions (the P300). Such events can also seem to have an increased duration relative to repeated (implicitly expected) events. However, recent behavioural evidence suggests that when events are unexpected because they violate a declared prediction-a guess-there is an opposite impact on duration perception. The neural consequences of incorrect declared predictions have not been examined. We replicated the finding whereby repetition violating events elicit a larger P300 response. However, we found that events that violated a declared prediction entrained an opposite pattern of response-a smaller P300. These data suggest that the neural consequences of a violated prediction are not uniform but depend on how the prediction was formed.
Collapse
Affiliation(s)
| | - Tonya Frommelt
- School of Psychology, University of Queensland, Australia
| | - Kielan Yarrow
- Department of Psychology, City, University of London, United Kingdom
| | - Ottmar V Lipp
- School of Psychology, University of Queensland, Australia; School of Psychology and Counselling, Queensland University of Technology, Australia
| | - Derek H Arnold
- School of Psychology, University of Queensland, Australia
| |
Collapse
|
7
|
Dimitrova M, Wagatsuma H, Krastev A, Vrochidou E, Nunez-Gonzalez JD. A Review of Possible EEG Markers of Abstraction, Attentiveness, and Memorisation in Cyber-Physical Systems for Special Education. Front Robot AI 2021; 8:715962. [PMID: 34532347 PMCID: PMC8439420 DOI: 10.3389/frobt.2021.715962] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2021] [Accepted: 07/22/2021] [Indexed: 11/21/2022] Open
Abstract
Cyber-physical systems (CPSs) for special education rely on effective mental and brain processing during the lesson, performed with the assistance of humanoid robots. The improved diagnostic ability of the CPS is a prerogative of the system for efficient technological support of the pedagogical process. The article focuses on the available knowledge of possible EEG markers of abstraction, attentiveness, and memorisation (in some cases combined with eye tracking) related to predicting effective mental and brain processing during the lesson. The role of processing abstraction is emphasised as the learning mechanism, which is given priority over the other mechanisms by the cognitive system. The main markers in focus are P1, N170, Novelty P3, RewP, N400, and P600. The description of the effects is accompanied by the analysis of some implications for the design of novel educational scenarios in inclusive classes.
Collapse
Affiliation(s)
- Maya Dimitrova
- Department of Interactive Robotics and Control Systems, Institute of Robotics, Bulgarian Academy of Sciences, Sofia, Bulgaria
| | - Hiroaki Wagatsuma
- Department of Human Intelligence Systems, Graduate School of Life Science and Systems Engineering, Kyushu Institute of Technology (KYUTECH), Kitakyushu, Japan
| | - Aleksandar Krastev
- Department of Interactive Robotics and Control Systems, Institute of Robotics, Bulgarian Academy of Sciences, Sofia, Bulgaria
| | - Eleni Vrochidou
- Human-Machines Interaction (HUMAIN) Lab, Department of Computer Science, International Hellenic University (IHU), Kavala, Greece
| | - J. David Nunez-Gonzalez
- Engineering School of Gipuzkoa—Eibar Section, Department of Applied Mathematics, University of Basque Country (UPV/EHU), Bilbao, Spain
| |
Collapse
|
8
|
Alí Diez Í, Marco-Pallarés J. Neurophysiological correlates of purchase decision-making. Biol Psychol 2021; 161:108060. [PMID: 33652040 DOI: 10.1016/j.biopsycho.2021.108060] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2020] [Revised: 02/01/2021] [Accepted: 02/25/2021] [Indexed: 10/22/2022]
Abstract
Economic decisions are characterized by their uncertainty and the lack of explicit feedback that indicates the correctness of decisions at the time they are made. Nevertheless, very little is known about the neural mechanisms involved in this process. Our study sought to identify the neurophysiological correlates of purchase decision-making in situations where the optimal purchase time is not known. EEG was recorded in 24 healthy subjects while they were performing a new experimental paradigm that simulates real economic decisions. At the time of price presentation, we found an increase in the P3 Event-Related Potential and induced theta and alpha oscillatory activity when participants chose to buy compared to when they decided to wait for a better price. These results reflect the engagement of attention and executive function in purchase decision-making and might help in the understanding of brain mechanisms underlying economic decisions in uncertain scenarios.
Collapse
Affiliation(s)
- Ítalo Alí Diez
- Cognition and Brain Plasticity Unit, Bellvitge Biomedical Research Institute, Spain; Department of Cognition, Development and Educational Psychology, Institute of Neurosciences, University of Barcelona, Spain
| | - Josep Marco-Pallarés
- Cognition and Brain Plasticity Unit, Bellvitge Biomedical Research Institute, Spain; Department of Cognition, Development and Educational Psychology, Institute of Neurosciences, University of Barcelona, Spain.
| |
Collapse
|
9
|
Levi-Aharoni H, Tishby N. The value-complexity trade-off for reinforcement learning based brain-computer interfaces. J Neural Eng 2021; 17:066011. [PMID: 33586668 DOI: 10.1088/1741-2552/abc8d8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
OBJECTIVE One of the recent developments in the field of brain-computer interfaces (BCI) is the reinforcement learning (RL) based BCI paradigm, which uses neural error responses as the reward feedback on the agent's action. While having several advantages over motor imagery based BCI, the reliability of RL-BCI is critically dependent on the decoding accuracy of noisy neural error signals. A principled method is needed to optimally handle this inherent noise under general conditions. APPROACH By determining a trade-off between the expected value and the informational cost of policies, the info-RL (IRL) algorithm provides optimal low-complexity policies, which are robust under noisy reward conditions and achieve the maximal obtainable value. In this work we utilize the IRL algorithm to characterize the maximal obtainable value under different noise levels, which in turn is used to extract the optimal robust policy for each noise level. MAIN RESULTS Our simulation results of a setting with Gaussian noise show that the complexity level of the optimal policy is dependent on the reward magnitude but not on the reward variance, whereas the variance determines whether a lower complexity solution is favorable or not. We show how this analysis can be utilized to select optimal robust policies for an RL-BCI and demonstrate its use on EEG data. SIGNIFICANCE We propose here a principled method to determine the optimal policy complexity of an RL problem with a noisy reward, which we argue is particularly useful for RL-based BCI paradigms. This framework may be used to minimize initial training time and allow for a more dynamic and robust shared control between the agent and the operator under different conditions.
Collapse
Affiliation(s)
- Hadar Levi-Aharoni
- The Edmond and Lilly Safra Center for Brain Sciences, Hebrew University of Jerusalem, Jerusalem, Israel
| | | |
Collapse
|
10
|
Lytaev S, Vatamaniuk I. Physiological and Medico-Social Research Trends of the Wave P 300 and More Late Components of Visual Event-Related Potentials. Brain Sci 2021; 11:brainsci11010125. [PMID: 33477728 PMCID: PMC7832330 DOI: 10.3390/brainsci11010125] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2020] [Revised: 01/08/2021] [Accepted: 01/15/2021] [Indexed: 11/24/2022] Open
Abstract
To extend the application of the late waves of the event-related potentials (ERPs) to multiple modalities, devices and software the underlying physiological mechanisms and responses of the brain for a particular sensory system and mental function must be carefully examined. The objective of this study was aimed to study the sensory processes of the “human-computer interaction” model when classifying visual images with an incomplete set of signs based on the analysis of early, middle, late and slow ERPs components. 26 healthy subjects (men) aged 20–26 years were investigated. ERPs in 19 monopolar sites according to the 10/20 system were recorded. Discriminant and factor analyzes (BMDP Statistical Software) were applied. The component N450 is the most specialized indicator of the perception of unrecognizable (oddball) visual images. The amplitude of the ultra-late components N750 and N900 is also higher under conditions of presentation of the oddball image, regardless of the location of the registration points. In brain pathology along with the pronounced asymmetry of the wave distribution, reduction of the N150 wave and lengthening of its peak latency, a line of regularities were noted. These include–a pronounced reduction in peak latency P250 and N350, an increased amplitude of N350 in the frontal and central points of registration, a decrease in the amplitude of N450 in the left frontal cortex and its increase in the occipital registration points, activation of the occipital cortex at a time interval of 400–500 ms, as well as fusion later waves. We called such phenomena of the development of cognitive ERP in brain pathology “the incongruence of ERP components”. The results of the research are discussed in the light of the paradigm of the P300 wave application in brain-computer interface systems, as well as with the peculiarities in brain pathology.
Collapse
Affiliation(s)
- Sergey Lytaev
- Lab of Applied Informatics, Lab of Autonomous Robotic Systems, St. Petersburg Federal Research Center of the Russian Academy of Sciences, 199178 Saint Petersburg, Russia;
- Department of Normal Physiology, Saint Petersburg State Pediatric Medical University, 194100 Saint Petersburg, Russia
- Correspondence: or ; Tel.: +7-921-938-5120
| | - Irina Vatamaniuk
- Lab of Applied Informatics, Lab of Autonomous Robotic Systems, St. Petersburg Federal Research Center of the Russian Academy of Sciences, 199178 Saint Petersburg, Russia;
| |
Collapse
|